[2025-10-28T17:00:01.675957] [INFO ] [MAIN ] Using last completed trading day: 2025-10-28 [2025-10-28T17:00:01.909109] [DEBUG] [R-STATUS ] Registered 'tdm' as a dependent service. [2025-10-28T17:00:01.909332] [INFO ] [STATE ] Waiting for all dependent services to be clear... [2025-10-28T17:00:02.040495] [WARN ] [tdm-status] Service 'tdm' is not running. [2025-10-28T17:00:02.041173] [WARN ] [STATE ] State set to: RUNNING [2025-10-28T17:00:02.041261] [INFO ] [MAIN ] Refreshing symbols list before update... [2025-10-28T17:00:02.041331] [INFO ] [MAIN ] Starting TDM symbol refresh process. [2025-10-28T17:00:02.041448] [INFO ] [MAIN ] Fetching latest NYSE symbols list. [2025-10-28T17:00:02.041524] [DEBUG] [SYMBOL ] Starting fetch of NYSE Symbols. [2025-10-28T17:00:02.941485] [DEBUG] [SYMBOL ] Found 2418 valid NYSE symbols. [2025-10-28T17:00:02.941711] [INFO ] [SYMBOL ] Completed fetch of NYSE Symbols. [2025-10-28T17:00:02.941936] [INFO ] [MAIN ] Filtered out 54 blacklisted symbols. [2025-10-28T17:00:02.942454] [INFO ] [LOCAL ] Symbols cache updated with 2366 symbols. [2025-10-28T17:00:02.942511] [INFO ] [MAIN ] Successfully refreshed symbols list. [2025-10-28T17:00:02.942543] [INFO ] [MAIN ] Finished TDM symbol refresh process. [2025-10-28T17:00:02.942600] [INFO ] [MAIN ] Pruning stale symbols... [2025-10-28T17:00:02.942633] [INFO ] [MAIN ] Starting TDM stale symbol pruning process. [2025-10-28T17:00:02.942703] [INFO ] [LOCAL ] Reading cached symbols list. [2025-10-28T17:00:02.943102] [DEBUG] [LOCAL ] Found 2366 symbols in cached list. [2025-10-28T17:00:02.943155] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-10-28T17:00:02.943313] [INFO ] [MAIN ] Including 54 blacklisted symbols for pruning. [2025-10-28T17:00:02.943346] [INFO ] [MAIN ] Pruning data for symbols not in current list of 2366 valid symbols. [2025-10-28T17:00:02.943376] [INFO ] [LOCAL ] Starting pruning of local symbol history data for inactive/invalid symbols. [2025-10-28T17:00:02.943406] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/primary_storage' [2025-10-28T17:00:02.968556] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/derivative_storage' [2025-10-28T17:00:02.993979] [INFO ] [LOCAL ] Deleted 0 obsolete data files. [2025-10-28T17:00:02.994163] [INFO ] [LOCAL ] Completed pruning of unlisted local symbol history data. [2025-10-28T17:00:02.994204] [INFO ] [MAIN ] Successfully pruned stale symbol data. [2025-10-28T17:00:02.994234] [INFO ] [MAIN ] Finished TDM stale symbol pruning process. [2025-10-28T17:00:02.994294] [INFO ] [LOCAL ] Reading cached symbols list. [2025-10-28T17:00:02.994686] [DEBUG] [LOCAL ] Found 2366 symbols in cached list. [2025-10-28T17:00:02.994754] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-10-28T17:00:02.994799] [INFO ] [MAIN ] Starting incremental update for 2366 symbols. [2025-10-28T17:00:02.994831] [INFO ] [MAIN ] Running in parallel mode [2025-10-28T17:00:02.994920] [INFO ] [MAIN ] Starting parallel primary update with 4 worker threads for 2366 symbols [2025-10-28T17:00:03.531560] [INFO ] [MAIN ] A: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:00:03.648816] [INFO ] [MAIN ] AA: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:00:03.721534] [INFO ] [MAIN ] AAMI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:00:03.802730] [INFO ] [MAIN ] AAM: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:00:03.803232] [DEBUG] [LOCAL ] AAM: No existing data file found in primary storage. [2025-10-28T17:00:03.803309] [WARN ] [MAIN ] AAM: No existing data found, performing full refresh instead. [2025-10-28T17:00:03.803614] [INFO ] [MAIN ] AAM: Wiping existing primary data before full refresh. [2025-10-28T17:00:03.803698] [INFO ] [LOCAL ] AAM: Starting deletion of primary data. [2025-10-28T17:00:03.803758] [DEBUG] [LOCAL ] AAM: No primary data file found to delete. [2025-10-28T17:00:03.803812] [INFO ] [MAIN ] AAM: Starting full primary refresh. [2025-10-28T17:00:04.045848] [DEBUG] [LOCAL ] AAMI: Loaded 23916 existing records from primary storage. [2025-10-28T17:00:04.111799] [INFO ] [MAIN ] AAMI: Loaded 23916 existing records. [2025-10-28T17:00:04.125326] [DEBUG] [LOCAL ] A: Loaded 50510 existing records from primary storage. [2025-10-28T17:00:04.190361] [DEBUG] [LOCAL ] AA: Loaded 53622 existing records from primary storage. [2025-10-28T17:00:04.190841] [INFO ] [MAIN ] A: Loaded 50510 existing records. [2025-10-28T17:00:04.300804] [INFO ] [MAIN ] AA: Loaded 53622 existing records. [2025-10-28T17:00:04.694601] [INFO ] [REMOTE ] AAM: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:00:04.759210] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-01. [2025-10-28T17:00:04.869853] [WARN ] [MAIN ] AAMI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:00:04.887593] [WARN ] [MAIN ] A: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:00:04.914950] [INFO ] [MAIN ] AAMI: Wiping existing primary data before full refresh. [2025-10-28T17:00:04.930769] [INFO ] [MAIN ] A: Wiping existing primary data before full refresh. [2025-10-28T17:00:04.930959] [INFO ] [LOCAL ] AAMI: Starting deletion of primary data. [2025-10-28T17:00:04.961070] [DEBUG] [LOCAL ] AAMI: Deleted primary data file. [2025-10-28T17:00:04.956316] [INFO ] [LOCAL ] A: Starting deletion of primary data. [2025-10-28T17:00:04.961346] [INFO ] [MAIN ] AAMI: Starting full primary refresh. [2025-10-28T17:00:04.960931] [WARN ] [MAIN ] AA: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:00:04.974216] [DEBUG] [LOCAL ] A: Deleted primary data file. [2025-10-28T17:00:04.974121] [INFO ] [MAIN ] AA: Wiping existing primary data before full refresh. [2025-10-28T17:00:05.006564] [INFO ] [MAIN ] A: Starting full primary refresh. [2025-10-28T17:00:05.028083] [INFO ] [LOCAL ] AA: Starting deletion of primary data. [2025-10-28T17:00:05.093304] [DEBUG] [LOCAL ] AA: Deleted primary data file. [2025-10-28T17:00:05.159116] [INFO ] [MAIN ] AA: Starting full primary refresh. [2025-10-28T17:00:05.296771] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-28T17:00:05.326931] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-02. [2025-10-28T17:00:05.998343] [INFO ] [REMOTE ] AAMI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:00:06.023138] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-01. [2025-10-28T17:00:06.017301] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-28T17:00:06.069716] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-03. [2025-10-28T17:00:06.131919] [INFO ] [REMOTE ] AA: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:00:06.141314] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-01. [2025-10-28T17:00:06.172851] [INFO ] [REMOTE ] A: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:00:06.173386] [INFO ] [REMOTE ] A: Fetching primary data for 2025-01. [2025-10-28T17:00:06.753391] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-28T17:00:06.754311] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-04. [2025-10-28T17:00:06.995059] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-04 (0.24 seconds). [2025-10-28T17:00:06.998335] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-05. [2025-10-28T17:00:06.996961] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-28T17:00:07.003226] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-02. [2025-10-28T17:00:07.210369] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-05 (0.21 seconds). [2025-10-28T17:00:07.211444] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-06. [2025-10-28T17:00:07.451700] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-06 (0.24 seconds). [2025-10-28T17:00:07.452900] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-07. [2025-10-28T17:00:07.594997] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-28T17:00:07.608075] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-02. [2025-10-28T17:00:07.702128] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-28T17:00:07.713506] [INFO ] [REMOTE ] A: Fetching primary data for 2025-02. [2025-10-28T17:00:07.727475] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-28T17:00:07.732078] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-03. [2025-10-28T17:00:07.861777] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-10-28T17:00:07.862928] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-08. [2025-10-28T17:00:08.154047] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-08 (0.29 seconds). [2025-10-28T17:00:08.155704] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-09. [2025-10-28T17:00:08.381902] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-09 (0.23 seconds). [2025-10-28T17:00:08.382943] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-10. [2025-10-28T17:00:08.587747] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-28T17:00:08.593249] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-04. [2025-10-28T17:00:08.778799] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-10 (0.40 seconds). [2025-10-28T17:00:08.779633] [INFO ] [REMOTE ] AAM: Full fetch complete (915 records). [2025-10-28T17:00:08.779735] [DEBUG] [VALIDATOR ] AAM: Validating primary data. [2025-10-28T17:00:08.780144] [FATAL] [VALIDATOR ] AAM: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T17:00:08.780234] [FATAL] [MAIN ] AAM: Fetched primary data is invalid. Refusing to save it. [2025-10-28T17:00:08.780278] [WARN ] [MAIN ] AAM: Deleting existing primary and derivative data due to validation failure. [2025-10-28T17:00:08.780320] [INFO ] [LOCAL ] AAM: Starting deletion of primary data. [2025-10-28T17:00:08.780381] [DEBUG] [LOCAL ] AAM: No primary data file found to delete. [2025-10-28T17:00:08.780419] [INFO ] [LOCAL ] AAM: Starting deletion of derivative data. [2025-10-28T17:00:08.780458] [DEBUG] [LOCAL ] AAM: No derivative data file found to delete. [2025-10-28T17:00:08.780518] [INFO ] [MAIN ] Update Progress: 1/2366 symbols completed. AAM took 5.7s. Estimated remaining: 3h 48m 3s. Rate: 10.4 symbols/min [2025-10-28T17:00:08.983997] [INFO ] [MAIN ] AAP: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:00:08.984416] [DEBUG] [LOCAL ] AAP: No existing data file found in primary storage. [2025-10-28T17:00:08.984570] [WARN ] [MAIN ] AAP: No existing data found, performing full refresh instead. [2025-10-28T17:00:08.984815] [INFO ] [MAIN ] AAP: Wiping existing primary data before full refresh. [2025-10-28T17:00:08.984895] [INFO ] [LOCAL ] AAP: Starting deletion of primary data. [2025-10-28T17:00:08.985229] [DEBUG] [LOCAL ] AAP: No primary data file found to delete. [2025-10-28T17:00:08.985448] [INFO ] [MAIN ] AAP: Starting full primary refresh. [2025-10-28T17:00:09.382849] [INFO ] [REMOTE ] AAP: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:00:09.384825] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-28T17:00:09.394791] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-01. [2025-10-28T17:00:09.398796] [INFO ] [REMOTE ] A: Fetching primary data for 2025-03. [2025-10-28T17:00:09.429410] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-28T17:00:09.440886] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-03. [2025-10-28T17:00:09.507250] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-28T17:00:09.514467] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-05. [2025-10-28T17:00:10.305633] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-28T17:00:10.311425] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-06. [2025-10-28T17:00:10.828949] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-28T17:00:10.841278] [INFO ] [REMOTE ] A: Fetching primary data for 2025-04. [2025-10-28T17:00:10.940891] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-28T17:00:10.952695] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-04. [2025-10-28T17:00:11.002532] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-28T17:00:11.012758] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-02. [2025-10-28T17:00:11.356066] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-28T17:00:11.361833] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-07. [2025-10-28T17:00:12.167070] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-28T17:00:12.173058] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-08. [2025-10-28T17:00:12.325171] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-28T17:00:12.337749] [INFO ] [REMOTE ] A: Fetching primary data for 2025-05. [2025-10-28T17:00:12.637479] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-28T17:00:12.648977] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-05. [2025-10-28T17:00:13.045159] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-28T17:00:13.050741] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-09. [2025-10-28T17:00:13.575885] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-28T17:00:13.587087] [INFO ] [REMOTE ] A: Fetching primary data for 2025-06. [2025-10-28T17:00:13.796899] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-28T17:00:13.802885] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-10. [2025-10-28T17:00:14.145839] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-28T17:00:14.157607] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-06. [2025-10-28T17:00:14.417524] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-02 (3.40 seconds). [2025-10-28T17:00:14.427491] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-03. [2025-10-28T17:00:14.714368] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-28T17:00:14.718969] [INFO ] [REMOTE ] AAMI: Full fetch complete (33126 records). [2025-10-28T17:00:14.719106] [DEBUG] [VALIDATOR ] AAMI: Validating primary data. [2025-10-28T17:00:15.164963] [DEBUG] [VALIDATOR ] AAMI: All expected trading days are present. [2025-10-28T17:00:15.165200] [DEBUG] [VALIDATOR ] AAMI: Primary data validation passed. [2025-10-28T17:00:15.165778] [INFO ] [MAIN ] AAMI: Fetched primary data is valid. [2025-10-28T17:00:15.165917] [DEBUG] [LOCAL ] AAMI: Saving primary data. [2025-10-28T17:00:15.167239] [DEBUG] [LOCAL ] AAMI: Trimmed 33126 records to 23756 (keeping 200 days of data) [2025-10-28T17:00:15.293306] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-28T17:00:15.339783] [INFO ] [REMOTE ] A: Fetching primary data for 2025-07. [2025-10-28T17:00:15.363546] [DEBUG] [LOCAL ] AAMI: Primary data saved (23756 records). [2025-10-28T17:00:15.363710] [INFO ] [MAIN ] AAMI: Full history saved. [2025-10-28T17:00:15.363810] [INFO ] [MAIN ] Update Progress: 2/2366 symbols completed. AAMI took 12.3s. Estimated remaining: 4h 3m 40s. Rate: 9.7 symbols/min [2025-10-28T17:00:15.558904] [INFO ] [MAIN ] AAT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:00:15.588786] [DEBUG] [LOCAL ] AAT: Loaded 29917 existing records from primary storage. [2025-10-28T17:00:15.589071] [INFO ] [MAIN ] AAT: Loaded 29917 existing records. [2025-10-28T17:00:15.769226] [WARN ] [MAIN ] AAT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:00:15.769442] [INFO ] [MAIN ] AAT: Wiping existing primary data before full refresh. [2025-10-28T17:00:15.769677] [INFO ] [LOCAL ] AAT: Starting deletion of primary data. [2025-10-28T17:00:15.770275] [DEBUG] [LOCAL ] AAT: Deleted primary data file. [2025-10-28T17:00:15.770338] [INFO ] [MAIN ] AAT: Starting full primary refresh. [2025-10-28T17:00:16.138909] [INFO ] [REMOTE ] AAT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:00:16.139254] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-01. [2025-10-28T17:00:16.169195] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-10-28T17:00:16.180847] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-07. [2025-10-28T17:00:16.309952] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-28T17:00:16.320631] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-04. [2025-10-28T17:00:16.736899] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-28T17:00:16.747777] [INFO ] [REMOTE ] A: Fetching primary data for 2025-08. [2025-10-28T17:00:17.156891] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-28T17:00:17.162605] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-02. [2025-10-28T17:00:18.147955] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-28T17:00:18.188489] [INFO ] [REMOTE ] A: Fetching primary data for 2025-09. [2025-10-28T17:00:18.189722] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-28T17:00:18.217140] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-28T17:00:18.217568] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-05. [2025-10-28T17:00:18.224931] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-03. [2025-10-28T17:00:19.630307] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-07 (3.45 seconds). [2025-10-28T17:00:19.629151] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-28T17:00:19.648811] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-04. [2025-10-28T17:00:19.649889] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-08. [2025-10-28T17:00:19.789355] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-28T17:00:19.801454] [INFO ] [REMOTE ] A: Fetching primary data for 2025-10. [2025-10-28T17:00:20.088989] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-28T17:00:20.099984] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-06. [2025-10-28T17:00:21.153351] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-28T17:00:21.160974] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-05. [2025-10-28T17:00:21.412867] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-28T17:00:21.426955] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-09. [2025-10-28T17:00:21.653004] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-28T17:00:21.670971] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-07. [2025-10-28T17:00:21.826467] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-10 (2.02 seconds). [2025-10-28T17:00:21.840680] [INFO ] [REMOTE ] A: Full fetch complete (73553 records). [2025-10-28T17:00:21.840893] [DEBUG] [VALIDATOR ] A: Validating primary data. [2025-10-28T17:00:22.401749] [DEBUG] [VALIDATOR ] A: All expected trading days are present. [2025-10-28T17:00:22.401870] [DEBUG] [VALIDATOR ] A: Primary data validation passed. [2025-10-28T17:00:22.402716] [INFO ] [MAIN ] A: Fetched primary data is valid. [2025-10-28T17:00:22.402854] [DEBUG] [LOCAL ] A: Saving primary data. [2025-10-28T17:00:22.405019] [DEBUG] [LOCAL ] A: Trimmed 73553 records to 50460 (keeping 200 days of data) [2025-10-28T17:00:22.488636] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-28T17:00:22.532061] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-06. [2025-10-28T17:00:22.756464] [DEBUG] [LOCAL ] A: Primary data saved (50460 records). [2025-10-28T17:00:22.756601] [INFO ] [MAIN ] A: Full history saved. [2025-10-28T17:00:22.756994] [INFO ] [MAIN ] Update Progress: 3/2366 symbols completed. A took 19.8s. Estimated remaining: 4h 19m 26s. Rate: 9.1 symbols/min [2025-10-28T17:00:22.937204] [INFO ] [MAIN ] AAUC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:00:22.937559] [DEBUG] [LOCAL ] AAUC: No existing data file found in primary storage. [2025-10-28T17:00:22.937707] [WARN ] [MAIN ] AAUC: No existing data found, performing full refresh instead. [2025-10-28T17:00:22.937859] [INFO ] [MAIN ] AAUC: Wiping existing primary data before full refresh. [2025-10-28T17:00:22.937959] [INFO ] [LOCAL ] AAUC: Starting deletion of primary data. [2025-10-28T17:00:22.938031] [DEBUG] [LOCAL ] AAUC: No primary data file found to delete. [2025-10-28T17:00:22.938075] [INFO ] [MAIN ] AAUC: Starting full primary refresh. [2025-10-28T17:00:23.347514] [INFO ] [REMOTE ] AAUC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:00:23.348241] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-01. [2025-10-28T17:00:23.351042] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-10-28T17:00:23.363547] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-10. [2025-10-28T17:00:23.398506] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-28T17:00:23.410487] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-08. [2025-10-28T17:00:23.458723] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-28T17:00:23.465409] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-07. [2025-10-28T17:00:23.529850] [DEBUG] [REMOTE ] AAUC: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-28T17:00:23.530149] [WARN ] [REMOTE ] AAUC: No data returned for month 2025-01 [2025-10-28T17:00:23.530238] [FATAL] [REMOTE ] AAUC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-28T17:00:23.530313] [FATAL] [MAIN ] AAUC: Failed to fetch primary data. [2025-10-28T17:00:23.530379] [WARN ] [MAIN ] AAUC: Deleting existing primary and derivative data due to fetch failure. [2025-10-28T17:00:23.530451] [INFO ] [LOCAL ] AAUC: Starting deletion of primary data. [2025-10-28T17:00:23.530515] [DEBUG] [LOCAL ] AAUC: No primary data file found to delete. [2025-10-28T17:00:23.530554] [INFO ] [LOCAL ] AAUC: Starting deletion of derivative data. [2025-10-28T17:00:23.530605] [DEBUG] [LOCAL ] AAUC: No derivative data file found to delete. [2025-10-28T17:00:23.530723] [INFO ] [MAIN ] Update Progress: 4/2366 symbols completed. AAUC took 0.8s. Estimated remaining: 3h 22m 6s. Rate: 11.7 symbols/min [2025-10-28T17:00:23.711755] [INFO ] [MAIN ] AB: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:00:23.733388] [DEBUG] [LOCAL ] AB: Loaded 24063 existing records from primary storage. [2025-10-28T17:00:23.733671] [INFO ] [MAIN ] AB: Loaded 24063 existing records. [2025-10-28T17:00:23.913348] [WARN ] [MAIN ] AB: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:00:23.913545] [INFO ] [MAIN ] AB: Wiping existing primary data before full refresh. [2025-10-28T17:00:23.913593] [INFO ] [LOCAL ] AB: Starting deletion of primary data. [2025-10-28T17:00:23.914179] [DEBUG] [LOCAL ] AB: Deleted primary data file. [2025-10-28T17:00:23.914239] [INFO ] [MAIN ] AB: Starting full primary refresh. [2025-10-28T17:00:24.278561] [INFO ] [REMOTE ] AB: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:00:24.278882] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-01. [2025-10-28T17:00:24.473786] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-28T17:00:24.480924] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-08. [2025-10-28T17:00:24.715400] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-28T17:00:24.726249] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-09. [2025-10-28T17:00:25.329158] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-28T17:00:25.337520] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-02. [2025-10-28T17:00:25.354840] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-28T17:00:25.361837] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-09. [2025-10-28T17:00:25.490352] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-10 (2.13 seconds). [2025-10-28T17:00:25.500341] [INFO ] [REMOTE ] AA: Full fetch complete (77349 records). [2025-10-28T17:00:25.500468] [DEBUG] [VALIDATOR ] AA: Validating primary data. [2025-10-28T17:00:25.502281] [FATAL] [VALIDATOR ] AA: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T17:00:25.502391] [FATAL] [MAIN ] AA: Fetched primary data is invalid. Refusing to save it. [2025-10-28T17:00:25.502466] [WARN ] [MAIN ] AA: Deleting existing primary and derivative data due to validation failure. [2025-10-28T17:00:25.502563] [INFO ] [LOCAL ] AA: Starting deletion of primary data. [2025-10-28T17:00:25.502670] [DEBUG] [LOCAL ] AA: No primary data file found to delete. [2025-10-28T17:00:25.502728] [INFO ] [LOCAL ] AA: Starting deletion of derivative data. [2025-10-28T17:00:25.502898] [DEBUG] [LOCAL ] AA: Deleted derivative data file. [2025-10-28T17:00:25.503278] [INFO ] [MAIN ] Update Progress: 5/2366 symbols completed. AA took 22.5s. Estimated remaining: 2h 57m 8s. Rate: 13.3 symbols/min [2025-10-28T17:00:25.678336] [INFO ] [MAIN ] ABBV: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:00:25.733033] [DEBUG] [LOCAL ] ABBV: Loaded 53674 existing records from primary storage. [2025-10-28T17:00:25.733350] [INFO ] [MAIN ] ABBV: Loaded 53674 existing records. [2025-10-28T17:00:25.922249] [WARN ] [MAIN ] ABBV: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:00:25.922565] [INFO ] [MAIN ] ABBV: Wiping existing primary data before full refresh. [2025-10-28T17:00:25.922693] [INFO ] [LOCAL ] ABBV: Starting deletion of primary data. [2025-10-28T17:00:25.924030] [DEBUG] [LOCAL ] ABBV: Deleted primary data file. [2025-10-28T17:00:25.924091] [INFO ] [MAIN ] ABBV: Starting full primary refresh. [2025-10-28T17:00:26.323070] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-28T17:00:26.339685] [INFO ] [REMOTE ] ABBV: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:00:26.350963] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-01. [2025-10-28T17:00:26.353125] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-10. [2025-10-28T17:00:26.373332] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-28T17:00:26.380300] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-10. [2025-10-28T17:00:26.479024] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-28T17:00:26.488031] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-03. [2025-10-28T17:00:27.460876] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-28T17:00:27.467588] [INFO ] [REMOTE ] AAT: Full fetch complete (43078 records). [2025-10-28T17:00:27.467786] [DEBUG] [VALIDATOR ] AAT: Validating primary data. [2025-10-28T17:00:27.922411] [DEBUG] [VALIDATOR ] AAT: All expected trading days are present. [2025-10-28T17:00:27.923048] [DEBUG] [VALIDATOR ] AAT: Primary data validation passed. [2025-10-28T17:00:27.924225] [INFO ] [MAIN ] AAT: Fetched primary data is valid. [2025-10-28T17:00:27.948783] [DEBUG] [LOCAL ] AAT: Saving primary data. [2025-10-28T17:00:27.966155] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-28T17:00:27.978396] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-04. [2025-10-28T17:00:27.978792] [DEBUG] [LOCAL ] AAT: Trimmed 43078 records to 29902 (keeping 200 days of data) [2025-10-28T17:00:28.122052] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-28T17:00:28.146887] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-02. [2025-10-28T17:00:28.240120] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-28T17:00:28.258002] [INFO ] [REMOTE ] AAP: Full fetch complete (74971 records). [2025-10-28T17:00:28.262013] [DEBUG] [VALIDATOR ] AAP: Validating primary data. [2025-10-28T17:00:28.267564] [DEBUG] [LOCAL ] AAT: Primary data saved (29902 records). [2025-10-28T17:00:28.267810] [INFO ] [MAIN ] AAT: Full history saved. [2025-10-28T17:00:28.336319] [INFO ] [MAIN ] Update Progress: 6/2366 symbols completed. AAT took 13.0s. Estimated remaining: 2h 46m 8s. Rate: 14.2 symbols/min [2025-10-28T17:00:28.760178] [INFO ] [MAIN ] ABCB: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:00:28.911291] [DEBUG] [VALIDATOR ] AAP: All expected trading days are present. [2025-10-28T17:00:28.911503] [DEBUG] [VALIDATOR ] AAP: Primary data validation passed. [2025-10-28T17:00:28.912329] [INFO ] [MAIN ] AAP: Fetched primary data is valid. [2025-10-28T17:00:28.912417] [DEBUG] [LOCAL ] AAP: Saving primary data. [2025-10-28T17:00:28.914215] [DEBUG] [LOCAL ] AAP: Trimmed 74971 records to 51543 (keeping 200 days of data) [2025-10-28T17:00:29.025852] [DEBUG] [LOCAL ] ABCB: Loaded 30102 existing records from primary storage. [2025-10-28T17:00:29.041399] [INFO ] [MAIN ] ABCB: Loaded 30102 existing records. [2025-10-28T17:00:29.381748] [WARN ] [MAIN ] ABCB: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:00:29.387821] [INFO ] [MAIN ] ABCB: Wiping existing primary data before full refresh. [2025-10-28T17:00:29.391217] [INFO ] [LOCAL ] ABCB: Starting deletion of primary data. [2025-10-28T17:00:29.444341] [DEBUG] [LOCAL ] ABCB: Deleted primary data file. [2025-10-28T17:00:29.465572] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-28T17:00:29.465697] [INFO ] [MAIN ] ABCB: Starting full primary refresh. [2025-10-28T17:00:29.517531] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-05. [2025-10-28T17:00:29.613891] [DEBUG] [LOCAL ] AAP: Primary data saved (51543 records). [2025-10-28T17:00:29.625716] [INFO ] [MAIN ] AAP: Full history saved. [2025-10-28T17:00:29.641407] [INFO ] [MAIN ] Update Progress: 7/2366 symbols completed. AAP took 20.9s. Estimated remaining: 2h 29m 40s. Rate: 15.8 symbols/min [2025-10-28T17:00:30.029710] [INFO ] [MAIN ] ABEV: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:00:30.096325] [INFO ] [REMOTE ] ABCB: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:00:30.098015] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-01. [2025-10-28T17:00:30.129430] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-10-28T17:00:30.141075] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-03. [2025-10-28T17:00:30.180809] [DEBUG] [LOCAL ] ABEV: Loaded 53283 existing records from primary storage. [2025-10-28T17:00:30.181418] [INFO ] [MAIN ] ABEV: Loaded 53283 existing records. [2025-10-28T17:00:30.379144] [WARN ] [MAIN ] ABEV: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:00:30.379360] [INFO ] [MAIN ] ABEV: Wiping existing primary data before full refresh. [2025-10-28T17:00:30.379420] [INFO ] [LOCAL ] ABEV: Starting deletion of primary data. [2025-10-28T17:00:30.379722] [DEBUG] [LOCAL ] ABEV: Deleted primary data file. [2025-10-28T17:00:30.379800] [INFO ] [MAIN ] ABEV: Starting full primary refresh. [2025-10-28T17:00:30.740229] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-28T17:00:30.780331] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-06. [2025-10-28T17:00:30.804007] [INFO ] [REMOTE ] ABEV: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:00:30.804346] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-01. [2025-10-28T17:00:31.402409] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-28T17:00:31.408806] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-02. [2025-10-28T17:00:31.568274] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-28T17:00:31.573226] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-07. [2025-10-28T17:00:31.712180] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-28T17:00:31.723363] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-04. [2025-10-28T17:00:32.220958] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-28T17:00:32.231841] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-02. [2025-10-28T17:00:32.249107] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-28T17:00:32.255448] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-08. [2025-10-28T17:00:32.305559] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-28T17:00:32.311946] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-03. [2025-10-28T17:00:32.977055] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-28T17:00:32.982152] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-09. [2025-10-28T17:00:33.149310] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-28T17:00:33.160358] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-05. [2025-10-28T17:00:33.514723] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-28T17:00:33.525061] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-03. [2025-10-28T17:00:33.580311] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-28T17:00:33.587946] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-04. [2025-10-28T17:00:33.764400] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-28T17:00:33.769780] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-10. [2025-10-28T17:00:34.726848] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-28T17:00:34.735323] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-05. [2025-10-28T17:00:34.814061] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-28T17:00:34.828034] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-06. [2025-10-28T17:00:34.855046] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-28T17:00:34.860396] [INFO ] [REMOTE ] AB: Full fetch complete (43559 records). [2025-10-28T17:00:34.860506] [DEBUG] [VALIDATOR ] AB: Validating primary data. [2025-10-28T17:00:34.861235] [FATAL] [VALIDATOR ] AB: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T17:00:34.861330] [FATAL] [MAIN ] AB: Fetched primary data is invalid. Refusing to save it. [2025-10-28T17:00:34.861382] [WARN ] [MAIN ] AB: Deleting existing primary and derivative data due to validation failure. [2025-10-28T17:00:34.861451] [INFO ] [LOCAL ] AB: Starting deletion of primary data. [2025-10-28T17:00:34.861517] [DEBUG] [LOCAL ] AB: No primary data file found to delete. [2025-10-28T17:00:34.861555] [INFO ] [LOCAL ] AB: Starting deletion of derivative data. [2025-10-28T17:00:34.861753] [DEBUG] [LOCAL ] AB: Deleted derivative data file. [2025-10-28T17:00:34.861848] [INFO ] [MAIN ] Update Progress: 8/2366 symbols completed. AB took 11.3s. Estimated remaining: 2h 36m 33s. Rate: 15.1 symbols/min [2025-10-28T17:00:35.040596] [INFO ] [MAIN ] ABG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:00:35.062246] [DEBUG] [LOCAL ] ABG: Loaded 17425 existing records from primary storage. [2025-10-28T17:00:35.062668] [INFO ] [MAIN ] ABG: Loaded 17425 existing records. [2025-10-28T17:00:35.263533] [WARN ] [MAIN ] ABG: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:00:35.264079] [INFO ] [MAIN ] ABG: Wiping existing primary data before full refresh. [2025-10-28T17:00:35.264215] [INFO ] [LOCAL ] ABG: Starting deletion of primary data. [2025-10-28T17:00:35.264561] [DEBUG] [LOCAL ] ABG: Deleted primary data file. [2025-10-28T17:00:35.264776] [INFO ] [MAIN ] ABG: Starting full primary refresh. [2025-10-28T17:00:35.470444] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-28T17:00:35.581092] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-04. [2025-10-28T17:00:35.747477] [INFO ] [REMOTE ] ABG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:00:35.764342] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-01. [2025-10-28T17:00:35.767081] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-28T17:00:35.773871] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-06. [2025-10-28T17:00:36.558037] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-28T17:00:36.563957] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-07. [2025-10-28T17:00:36.673060] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-28T17:00:36.710693] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-02. [2025-10-28T17:00:36.714634] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-10-28T17:00:36.726252] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-07. [2025-10-28T17:00:37.029383] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-28T17:00:37.040430] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-05. [2025-10-28T17:00:37.485181] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-28T17:00:37.492266] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-08. [2025-10-28T17:00:37.597859] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-28T17:00:37.601577] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-03. [2025-10-28T17:00:38.434405] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-28T17:00:38.446055] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-06. [2025-10-28T17:00:38.768375] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-28T17:00:38.780736] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-08. [2025-10-28T17:00:38.820096] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-28T17:00:38.826717] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-09. [2025-10-28T17:00:38.902995] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-28T17:00:38.907697] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-04. [2025-10-28T17:00:39.713244] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-28T17:00:39.736786] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-28T17:00:39.744169] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-10. [2025-10-28T17:00:39.744438] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-05. [2025-10-28T17:00:40.102328] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-28T17:00:40.112785] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-07. [2025-10-28T17:00:40.480883] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-28T17:00:40.484262] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-06. [2025-10-28T17:00:40.710552] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-28T17:00:40.716780] [INFO ] [REMOTE ] ABCB: Full fetch complete (44612 records). [2025-10-28T17:00:40.716882] [DEBUG] [VALIDATOR ] ABCB: Validating primary data. [2025-10-28T17:00:40.717482] [FATAL] [VALIDATOR ] ABCB: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T17:00:40.717563] [FATAL] [MAIN ] ABCB: Fetched primary data is invalid. Refusing to save it. [2025-10-28T17:00:40.717606] [WARN ] [MAIN ] ABCB: Deleting existing primary and derivative data due to validation failure. [2025-10-28T17:00:40.717679] [INFO ] [LOCAL ] ABCB: Starting deletion of primary data. [2025-10-28T17:00:40.717770] [DEBUG] [LOCAL ] ABCB: No primary data file found to delete. [2025-10-28T17:00:40.717818] [INFO ] [LOCAL ] ABCB: Starting deletion of derivative data. [2025-10-28T17:00:40.718258] [DEBUG] [LOCAL ] ABCB: Deleted derivative data file. [2025-10-28T17:00:40.718371] [INFO ] [MAIN ] Update Progress: 9/2366 symbols completed. ABCB took 12.4s. Estimated remaining: 2h 44m 39s. Rate: 14.3 symbols/min [2025-10-28T17:00:40.917248] [INFO ] [MAIN ] ABM: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:00:40.921731] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-10-28T17:00:40.933633] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-09. [2025-10-28T17:00:40.962870] [DEBUG] [LOCAL ] ABM: Loaded 31780 existing records from primary storage. [2025-10-28T17:00:40.963118] [INFO ] [MAIN ] ABM: Loaded 31780 existing records. [2025-10-28T17:00:41.141138] [WARN ] [MAIN ] ABM: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:00:41.141423] [INFO ] [MAIN ] ABM: Wiping existing primary data before full refresh. [2025-10-28T17:00:41.141529] [INFO ] [LOCAL ] ABM: Starting deletion of primary data. [2025-10-28T17:00:41.150586] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-28T17:00:41.153769] [DEBUG] [LOCAL ] ABM: Deleted primary data file. [2025-10-28T17:00:41.154201] [INFO ] [MAIN ] ABM: Starting full primary refresh. [2025-10-28T17:00:41.154458] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-07. [2025-10-28T17:00:41.543024] [INFO ] [REMOTE ] ABM: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:00:41.543469] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-01. [2025-10-28T17:00:41.574840] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-28T17:00:41.587008] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-08. [2025-10-28T17:00:42.048186] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-28T17:00:42.052944] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-08. [2025-10-28T17:00:42.259935] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-28T17:00:42.273796] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-10. [2025-10-28T17:00:42.447125] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-28T17:00:42.453138] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-02. [2025-10-28T17:00:42.631287] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-28T17:00:42.635985] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-09. [2025-10-28T17:00:42.859138] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-28T17:00:42.869611] [INFO ] [REMOTE ] ABBV: Full fetch complete (77839 records). [2025-10-28T17:00:42.869763] [DEBUG] [VALIDATOR ] ABBV: Validating primary data. [2025-10-28T17:00:43.308915] [DEBUG] [VALIDATOR ] ABBV: All expected trading days are present. [2025-10-28T17:00:43.309702] [DEBUG] [VALIDATOR ] ABBV: Primary data validation passed. [2025-10-28T17:00:43.310856] [INFO ] [MAIN ] ABBV: Fetched primary data is valid. [2025-10-28T17:00:43.312295] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-28T17:00:43.312541] [DEBUG] [LOCAL ] ABBV: Saving primary data. [2025-10-28T17:00:43.324886] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-09. [2025-10-28T17:00:43.326457] [DEBUG] [LOCAL ] ABBV: Trimmed 77839 records to 53674 (keeping 200 days of data) [2025-10-28T17:00:43.434411] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-28T17:00:43.439759] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-10. [2025-10-28T17:00:43.455553] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-28T17:00:43.462050] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-03. [2025-10-28T17:00:43.693824] [DEBUG] [LOCAL ] ABBV: Primary data saved (53674 records). [2025-10-28T17:00:43.693952] [INFO ] [MAIN ] ABBV: Full history saved. [2025-10-28T17:00:43.696349] [INFO ] [MAIN ] Update Progress: 10/2366 symbols completed. ABBV took 18.2s. Estimated remaining: 2h 39m 49s. Rate: 14.7 symbols/min [2025-10-28T17:00:43.862734] [INFO ] [MAIN ] ABR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:00:43.862869] [DEBUG] [LOCAL ] ABR: No existing data file found in primary storage. [2025-10-28T17:00:43.862905] [WARN ] [MAIN ] ABR: No existing data found, performing full refresh instead. [2025-10-28T17:00:43.863039] [INFO ] [MAIN ] ABR: Wiping existing primary data before full refresh. [2025-10-28T17:00:43.863118] [INFO ] [LOCAL ] ABR: Starting deletion of primary data. [2025-10-28T17:00:43.863166] [DEBUG] [LOCAL ] ABR: No primary data file found to delete. [2025-10-28T17:00:43.863200] [INFO ] [MAIN ] ABR: Starting full primary refresh. [2025-10-28T17:00:44.214771] [INFO ] [REMOTE ] ABR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:00:44.215043] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-01. [2025-10-28T17:00:44.249910] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-28T17:00:44.253452] [INFO ] [REMOTE ] ABG: Full fetch complete (26610 records). [2025-10-28T17:00:44.253532] [DEBUG] [VALIDATOR ] ABG: Validating primary data. [2025-10-28T17:00:44.254033] [FATAL] [VALIDATOR ] ABG: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T17:00:44.254108] [FATAL] [MAIN ] ABG: Fetched primary data is invalid. Refusing to save it. [2025-10-28T17:00:44.254173] [WARN ] [MAIN ] ABG: Deleting existing primary and derivative data due to validation failure. [2025-10-28T17:00:44.254243] [INFO ] [LOCAL ] ABG: Starting deletion of primary data. [2025-10-28T17:00:44.254303] [DEBUG] [LOCAL ] ABG: No primary data file found to delete. [2025-10-28T17:00:44.254338] [INFO ] [LOCAL ] ABG: Starting deletion of derivative data. [2025-10-28T17:00:44.254509] [DEBUG] [LOCAL ] ABG: Deleted derivative data file. [2025-10-28T17:00:44.254598] [INFO ] [MAIN ] Update Progress: 11/2366 symbols completed. ABG took 9.4s. Estimated remaining: 2h 27m 13s. Rate: 16.0 symbols/min [2025-10-28T17:00:44.432448] [INFO ] [MAIN ] ABT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:00:44.432703] [DEBUG] [LOCAL ] ABT: No existing data file found in primary storage. [2025-10-28T17:00:44.432771] [WARN ] [MAIN ] ABT: No existing data found, performing full refresh instead. [2025-10-28T17:00:44.433093] [INFO ] [MAIN ] ABT: Wiping existing primary data before full refresh. [2025-10-28T17:00:44.433167] [INFO ] [LOCAL ] ABT: Starting deletion of primary data. [2025-10-28T17:00:44.433314] [DEBUG] [LOCAL ] ABT: No primary data file found to delete. [2025-10-28T17:00:44.433383] [INFO ] [MAIN ] ABT: Starting full primary refresh. [2025-10-28T17:00:44.610460] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-28T17:00:44.699713] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-04. [2025-10-28T17:00:44.826386] [INFO ] [REMOTE ] ABT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:00:44.826956] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-01. [2025-10-28T17:00:44.857457] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-28T17:00:44.869402] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-10. [2025-10-28T17:00:46.093350] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-28T17:00:46.103178] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-02. [2025-10-28T17:00:46.204904] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-28T17:00:46.212502] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-05. [2025-10-28T17:00:46.484061] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-28T17:00:46.495042] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-02. [2025-10-28T17:00:46.526879] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-28T17:00:46.538293] [INFO ] [REMOTE ] ABEV: Full fetch complete (77327 records). [2025-10-28T17:00:46.538453] [DEBUG] [VALIDATOR ] ABEV: Validating primary data. [2025-10-28T17:00:46.953397] [DEBUG] [VALIDATOR ] ABEV: All expected trading days are present. [2025-10-28T17:00:46.953580] [DEBUG] [VALIDATOR ] ABEV: Primary data validation passed. [2025-10-28T17:00:46.954975] [INFO ] [MAIN ] ABEV: Fetched primary data is valid. [2025-10-28T17:00:46.955159] [DEBUG] [LOCAL ] ABEV: Saving primary data. [2025-10-28T17:00:46.957471] [DEBUG] [LOCAL ] ABEV: Trimmed 77327 records to 53276 (keeping 200 days of data) [2025-10-28T17:00:47.212076] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-28T17:00:47.232038] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-06. [2025-10-28T17:00:47.311023] [DEBUG] [LOCAL ] ABEV: Primary data saved (53276 records). [2025-10-28T17:00:47.311244] [INFO ] [MAIN ] ABEV: Full history saved. [2025-10-28T17:00:47.311370] [INFO ] [MAIN ] Update Progress: 12/2366 symbols completed. ABEV took 17.6s. Estimated remaining: 2h 24m 53s. Rate: 16.2 symbols/min [2025-10-28T17:00:47.509342] [INFO ] [MAIN ] ACA: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:00:47.535282] [DEBUG] [LOCAL ] ACA: Loaded 22078 existing records from primary storage. [2025-10-28T17:00:47.535679] [INFO ] [MAIN ] ACA: Loaded 22078 existing records. [2025-10-28T17:00:47.748436] [WARN ] [MAIN ] ACA: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:00:47.749363] [INFO ] [MAIN ] ACA: Wiping existing primary data before full refresh. [2025-10-28T17:00:47.749522] [INFO ] [LOCAL ] ACA: Starting deletion of primary data. [2025-10-28T17:00:47.750231] [DEBUG] [LOCAL ] ACA: Deleted primary data file. [2025-10-28T17:00:47.750374] [INFO ] [MAIN ] ACA: Starting full primary refresh. [2025-10-28T17:00:47.922125] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-28T17:00:48.030615] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-03. [2025-10-28T17:00:48.171231] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-28T17:00:48.200964] [INFO ] [REMOTE ] ACA: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:00:48.201268] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-01. [2025-10-28T17:00:48.202577] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-03. [2025-10-28T17:00:48.552327] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-28T17:00:48.559470] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-07. [2025-10-28T17:00:49.161149] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-28T17:00:49.166307] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-02. [2025-10-28T17:00:49.500412] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-28T17:00:49.511480] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-04. [2025-10-28T17:00:49.600093] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-28T17:00:49.612735] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-04. [2025-10-28T17:00:49.799220] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-28T17:00:49.808601] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-08. [2025-10-28T17:00:49.985882] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-28T17:00:49.990986] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-03. [2025-10-28T17:00:50.722928] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-28T17:00:50.729807] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-09. [2025-10-28T17:00:50.980707] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-28T17:00:50.987204] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-04. [2025-10-28T17:00:51.289951] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-28T17:00:51.304101] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-05. [2025-10-28T17:00:51.656555] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-28T17:00:51.838932] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-28T17:00:51.890572] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-28T17:00:51.959315] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-10. [2025-10-28T17:00:52.759315] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-05. [2025-10-28T17:00:52.901504] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-28T17:00:53.044887] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-28T17:00:53.051149] [INFO ] [REMOTE ] ABM: Full fetch complete (44884 records). [2025-10-28T17:00:53.051247] [DEBUG] [VALIDATOR ] ABM: Validating primary data. [2025-10-28T17:00:53.051917] [FATAL] [VALIDATOR ] ABM: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T17:00:53.052004] [FATAL] [MAIN ] ABM: Fetched primary data is invalid. Refusing to save it. [2025-10-28T17:00:53.052071] [WARN ] [MAIN ] ABM: Deleting existing primary and derivative data due to validation failure. [2025-10-28T17:00:53.052143] [INFO ] [LOCAL ] ABM: Starting deletion of primary data. [2025-10-28T17:00:53.052207] [DEBUG] [LOCAL ] ABM: No primary data file found to delete. [2025-10-28T17:00:53.052243] [INFO ] [LOCAL ] ABM: Starting deletion of derivative data. [2025-10-28T17:00:53.052410] [DEBUG] [LOCAL ] ABM: Deleted derivative data file. [2025-10-28T17:00:53.053491] [INFO ] [MAIN ] Update Progress: 13/2366 symbols completed. ABM took 12.3s. Estimated remaining: 2h 31m 1s. Rate: 15.6 symbols/min [2025-10-28T17:00:53.223493] [INFO ] [MAIN ] ACCO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:00:53.261150] [DEBUG] [LOCAL ] ACCO: Loaded 36287 existing records from primary storage. [2025-10-28T17:00:53.261428] [INFO ] [MAIN ] ACCO: Loaded 36287 existing records. [2025-10-28T17:00:53.444009] [WARN ] [MAIN ] ACCO: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:00:53.444198] [INFO ] [MAIN ] ACCO: Wiping existing primary data before full refresh. [2025-10-28T17:00:53.444245] [INFO ] [LOCAL ] ACCO: Starting deletion of primary data. [2025-10-28T17:00:53.444718] [DEBUG] [LOCAL ] ACCO: Deleted primary data file. [2025-10-28T17:00:53.444780] [INFO ] [MAIN ] ACCO: Starting full primary refresh. [2025-10-28T17:00:53.560478] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-05. [2025-10-28T17:00:53.856393] [INFO ] [REMOTE ] ACCO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:00:54.180980] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-28T17:00:54.286274] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-28T17:00:54.359352] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-01. [2025-10-28T17:00:55.159359] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-06. [2025-10-28T17:00:55.400436] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-28T17:00:55.959325] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-06. [2025-10-28T17:00:56.059876] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-28T17:00:56.759360] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-02. [2025-10-28T17:00:57.457578] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-28T17:00:57.559331] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-07. [2025-10-28T17:00:57.746222] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-28T17:00:58.359412] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-07. [2025-10-28T17:00:58.841731] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-28T17:00:59.159330] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-03. [2025-10-28T17:00:59.277962] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-28T17:00:59.959343] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-08. [2025-10-28T17:01:00.311272] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-28T17:01:00.759379] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-06. [2025-10-28T17:01:01.012065] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-28T17:01:01.559415] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-04. [2025-10-28T17:01:02.201462] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-28T17:01:02.359328] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-07. [2025-10-28T17:01:02.864912] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-28T17:01:03.159423] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-05. [2025-10-28T17:01:03.959417] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-08. [2025-10-28T17:01:04.184076] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-28T17:01:04.218062] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-28T17:01:04.759329] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-08. [2025-10-28T17:01:05.387210] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-28T17:01:05.559327] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-09. [2025-10-28T17:01:06.229952] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-28T17:01:06.359382] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-09. [2025-10-28T17:01:07.159322] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-09. [2025-10-28T17:01:07.244321] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-28T17:01:07.959354] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-10. [2025-10-28T17:01:08.219418] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-28T17:01:08.373179] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-28T17:01:08.759354] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-10. [2025-10-28T17:01:09.553009] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-28T17:01:09.562570] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-10. [2025-10-28T17:01:09.564372] [INFO ] [REMOTE ] ABR: Full fetch complete (75324 records). [2025-10-28T17:01:09.564466] [DEBUG] [VALIDATOR ] ABR: Validating primary data. [2025-10-28T17:01:09.945580] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-28T17:01:09.992107] [DEBUG] [VALIDATOR ] ABR: All expected trading days are present. [2025-10-28T17:01:09.992027] [INFO ] [REMOTE ] ACA: Full fetch complete (33961 records). [2025-10-28T17:01:09.992210] [DEBUG] [VALIDATOR ] ABR: Primary data validation passed. [2025-10-28T17:01:09.992309] [DEBUG] [VALIDATOR ] ACA: Validating primary data. [2025-10-28T17:01:09.993062] [INFO ] [MAIN ] ABR: Fetched primary data is valid. [2025-10-28T17:01:09.993310] [DEBUG] [LOCAL ] ABR: Saving primary data. [2025-10-28T17:01:09.994020] [FATAL] [VALIDATOR ] ACA: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T17:01:09.994278] [FATAL] [MAIN ] ACA: Fetched primary data is invalid. Refusing to save it. [2025-10-28T17:01:09.994459] [WARN ] [MAIN ] ACA: Deleting existing primary and derivative data due to validation failure. [2025-10-28T17:01:09.994601] [INFO ] [LOCAL ] ACA: Starting deletion of primary data. [2025-10-28T17:01:09.994800] [DEBUG] [LOCAL ] ACA: No primary data file found to delete. [2025-10-28T17:01:09.994953] [INFO ] [LOCAL ] ACA: Starting deletion of derivative data. [2025-10-28T17:01:09.995272] [DEBUG] [LOCAL ] ACA: Deleted derivative data file. [2025-10-28T17:01:09.995369] [INFO ] [MAIN ] Update Progress: 14/2366 symbols completed. ACA took 22.7s. Estimated remaining: 3h 7m 36s. Rate: 12.5 symbols/min [2025-10-28T17:01:10.028194] [DEBUG] [LOCAL ] ABR: Trimmed 75324 records to 51778 (keeping 200 days of data) [2025-10-28T17:01:10.277612] [INFO ] [MAIN ] ACEL: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:01:10.360525] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-06. [2025-10-28T17:01:10.423860] [DEBUG] [LOCAL ] ACEL: Loaded 25768 existing records from primary storage. [2025-10-28T17:01:10.429947] [INFO ] [MAIN ] ACEL: Loaded 25768 existing records. [2025-10-28T17:01:10.585590] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-28T17:01:10.680717] [DEBUG] [LOCAL ] ABR: Primary data saved (51778 records). [2025-10-28T17:01:10.681442] [INFO ] [MAIN ] ABR: Full history saved. [2025-10-28T17:01:10.680900] [INFO ] [REMOTE ] ABT: Full fetch complete (77774 records). [2025-10-28T17:01:10.692137] [DEBUG] [VALIDATOR ] ABT: Validating primary data. [2025-10-28T17:01:10.691989] [INFO ] [MAIN ] Update Progress: 15/2366 symbols completed. ABR took 27.0s. Estimated remaining: 2h 56m 50s. Rate: 13.3 symbols/min [2025-10-28T17:01:11.030757] [WARN ] [MAIN ] ACEL: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:01:11.054882] [INFO ] [MAIN ] ACEL: Wiping existing primary data before full refresh. [2025-10-28T17:01:11.076415] [INFO ] [LOCAL ] ACEL: Starting deletion of primary data. [2025-10-28T17:01:11.148212] [DEBUG] [LOCAL ] ACEL: Deleted primary data file. [2025-10-28T17:01:11.182384] [INFO ] [MAIN ] ACHR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:01:11.200273] [INFO ] [MAIN ] ACEL: Starting full primary refresh. [2025-10-28T17:01:11.635864] [DEBUG] [VALIDATOR ] ABT: All expected trading days are present. [2025-10-28T17:01:11.667829] [DEBUG] [VALIDATOR ] ABT: Primary data validation passed. [2025-10-28T17:01:11.688818] [INFO ] [MAIN ] ABT: Fetched primary data is valid. [2025-10-28T17:01:11.726876] [DEBUG] [LOCAL ] ABT: Saving primary data. [2025-10-28T17:01:11.756316] [DEBUG] [LOCAL ] ACHR: Loaded 53818 existing records from primary storage. [2025-10-28T17:01:11.756932] [INFO ] [MAIN ] ACHR: Loaded 53818 existing records. [2025-10-28T17:01:11.908945] [DEBUG] [LOCAL ] ABT: Trimmed 77774 records to 53625 (keeping 200 days of data) [2025-10-28T17:01:11.945379] [INFO ] [REMOTE ] ACEL: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:01:11.967798] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-28T17:01:11.962490] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-01. [2025-10-28T17:01:12.133187] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-07. [2025-10-28T17:01:12.162670] [WARN ] [MAIN ] ACHR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:01:12.165756] [INFO ] [MAIN ] ACHR: Wiping existing primary data before full refresh. [2025-10-28T17:01:12.169100] [INFO ] [LOCAL ] ACHR: Starting deletion of primary data. [2025-10-28T17:01:12.170804] [DEBUG] [LOCAL ] ACHR: Deleted primary data file. [2025-10-28T17:01:12.171351] [INFO ] [MAIN ] ACHR: Starting full primary refresh. [2025-10-28T17:01:12.688808] [INFO ] [REMOTE ] ACHR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:01:12.761092] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-01. [2025-10-28T17:01:12.810924] [DEBUG] [LOCAL ] ABT: Primary data saved (53625 records). [2025-10-28T17:01:12.811212] [INFO ] [MAIN ] ABT: Full history saved. [2025-10-28T17:01:12.811328] [INFO ] [MAIN ] Update Progress: 16/2366 symbols completed. ABT took 28.6s. Estimated remaining: 2h 50m 54s. Rate: 13.8 symbols/min [2025-10-28T17:01:12.997772] [INFO ] [MAIN ] ACI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:01:13.014869] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-28T17:01:13.077865] [DEBUG] [LOCAL ] ACI: Loaded 53285 existing records from primary storage. [2025-10-28T17:01:13.078338] [INFO ] [MAIN ] ACI: Loaded 53285 existing records. [2025-10-28T17:01:13.285341] [WARN ] [MAIN ] ACI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:01:13.285737] [INFO ] [MAIN ] ACI: Wiping existing primary data before full refresh. [2025-10-28T17:01:13.285920] [INFO ] [LOCAL ] ACI: Starting deletion of primary data. [2025-10-28T17:01:13.294112] [DEBUG] [LOCAL ] ACI: Deleted primary data file. [2025-10-28T17:01:13.307627] [INFO ] [MAIN ] ACI: Starting full primary refresh. [2025-10-28T17:01:13.308526] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-28T17:01:13.564496] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-08. [2025-10-28T17:01:13.723232] [INFO ] [REMOTE ] ACI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:01:14.359437] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-01. [2025-10-28T17:01:14.727481] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-28T17:01:14.847828] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-10-28T17:01:15.159379] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-02. [2025-10-28T17:01:15.949332] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-28T17:01:15.959322] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-02. [2025-10-28T17:01:16.759335] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-02. [2025-10-28T17:01:16.796859] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-28T17:01:16.984760] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-28T17:01:17.559383] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-09. [2025-10-28T17:01:18.359328] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-03. [2025-10-28T17:01:18.535577] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-28T17:01:18.990748] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-28T17:01:19.159363] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-10. [2025-10-28T17:01:19.959360] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-03. [2025-10-28T17:01:20.367418] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-28T17:01:20.374747] [INFO ] [REMOTE ] ACCO: Full fetch complete (53821 records). [2025-10-28T17:01:20.374876] [DEBUG] [VALIDATOR ] ACCO: Validating primary data. [2025-10-28T17:01:20.763320] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-03. [2025-10-28T17:01:20.763808] [DEBUG] [VALIDATOR ] ACCO: All expected trading days are present. [2025-10-28T17:01:20.763886] [DEBUG] [VALIDATOR ] ACCO: Primary data validation passed. [2025-10-28T17:01:20.765432] [INFO ] [MAIN ] ACCO: Fetched primary data is valid. [2025-10-28T17:01:20.765512] [DEBUG] [LOCAL ] ACCO: Saving primary data. [2025-10-28T17:01:20.766954] [DEBUG] [LOCAL ] ACCO: Trimmed 53821 records to 36225 (keeping 200 days of data) [2025-10-28T17:01:20.974743] [DEBUG] [LOCAL ] ACCO: Primary data saved (36225 records). [2025-10-28T17:01:20.975120] [INFO ] [MAIN ] ACCO: Full history saved. [2025-10-28T17:01:20.976435] [INFO ] [MAIN ] Update Progress: 17/2366 symbols completed. ACCO took 27.9s. Estimated remaining: 2h 59m 35s. Rate: 13.1 symbols/min [2025-10-28T17:01:21.107307] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-28T17:01:21.191197] [INFO ] [MAIN ] ACM: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:01:21.191468] [DEBUG] [LOCAL ] ACM: No existing data file found in primary storage. [2025-10-28T17:01:21.191634] [WARN ] [MAIN ] ACM: No existing data found, performing full refresh instead. [2025-10-28T17:01:21.191959] [INFO ] [MAIN ] ACM: Wiping existing primary data before full refresh. [2025-10-28T17:01:21.192112] [INFO ] [LOCAL ] ACM: Starting deletion of primary data. [2025-10-28T17:01:21.192209] [DEBUG] [LOCAL ] ACM: No primary data file found to delete. [2025-10-28T17:01:21.192370] [INFO ] [MAIN ] ACM: Starting full primary refresh. [2025-10-28T17:01:21.612395] [INFO ] [REMOTE ] ACM: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:01:21.573154] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-04. [2025-10-28T17:01:21.616011] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-03 (3.26 seconds). [2025-10-28T17:01:22.044839] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-28T17:01:22.359340] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-04. [2025-10-28T17:01:22.482332] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-28T17:01:23.159393] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-01. [2025-10-28T17:01:23.959341] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-05. [2025-10-28T17:01:24.264794] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-28T17:01:24.621859] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-04 (2.26 seconds). [2025-10-28T17:01:24.759330] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-05. [2025-10-28T17:01:24.957855] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-28T17:01:25.559330] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-02. [2025-10-28T17:01:26.359348] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-04. [2025-10-28T17:01:26.795039] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-28T17:01:26.864226] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-10-28T17:01:27.159359] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-06. [2025-10-28T17:01:27.959338] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-06. [2025-10-28T17:01:28.054631] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-28T17:01:28.762860] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-05. [2025-10-28T17:01:28.765805] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-28T17:01:29.439429] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-06 (2.28 seconds). [2025-10-28T17:01:29.559321] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-07. [2025-10-28T17:01:30.359318] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-07. [2025-10-28T17:01:30.469593] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-28T17:01:31.109739] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-28T17:01:31.159344] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-06. [2025-10-28T17:01:31.959336] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-08. [2025-10-28T17:01:32.165674] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-07 (2.61 seconds). [2025-10-28T17:01:32.719622] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-28T17:01:32.753060] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-28T17:01:32.759284] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-09. [2025-10-28T17:01:33.559344] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-03. [2025-10-28T17:01:33.636347] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-28T17:01:34.359335] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-10. [2025-10-28T17:01:34.883469] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-28T17:01:35.159354] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-08. [2025-10-28T17:01:35.394571] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-28T17:01:35.399453] [INFO ] [REMOTE ] ACEL: Full fetch complete (38658 records). [2025-10-28T17:01:35.399549] [DEBUG] [VALIDATOR ] ACEL: Validating primary data. [2025-10-28T17:01:35.774858] [DEBUG] [VALIDATOR ] ACEL: All expected trading days are present. [2025-10-28T17:01:35.774943] [DEBUG] [VALIDATOR ] ACEL: Primary data validation passed. [2025-10-28T17:01:35.775376] [INFO ] [MAIN ] ACEL: Fetched primary data is valid. [2025-10-28T17:01:35.775441] [DEBUG] [LOCAL ] ACEL: Saving primary data. [2025-10-28T17:01:35.776519] [DEBUG] [LOCAL ] ACEL: Trimmed 38658 records to 25609 (keeping 200 days of data) [2025-10-28T17:01:35.918940] [DEBUG] [LOCAL ] ACEL: Primary data saved (25609 records). [2025-10-28T17:01:35.919072] [INFO ] [MAIN ] ACEL: Full history saved. [2025-10-28T17:01:35.919153] [INFO ] [MAIN ] Update Progress: 18/2366 symbols completed. ACEL took 25.9s. Estimated remaining: 3h 22m 1s. Rate: 11.6 symbols/min [2025-10-28T17:01:35.964512] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-04. [2025-10-28T17:01:36.090262] [INFO ] [MAIN ] ACN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:01:36.137311] [DEBUG] [LOCAL ] ACN: Loaded 53433 existing records from primary storage. [2025-10-28T17:01:36.137613] [INFO ] [MAIN ] ACN: Loaded 53433 existing records. [2025-10-28T17:01:36.312352] [WARN ] [MAIN ] ACN: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:01:36.312579] [INFO ] [MAIN ] ACN: Wiping existing primary data before full refresh. [2025-10-28T17:01:36.312627] [INFO ] [LOCAL ] ACN: Starting deletion of primary data. [2025-10-28T17:01:36.313518] [DEBUG] [LOCAL ] ACN: Deleted primary data file. [2025-10-28T17:01:36.313576] [INFO ] [MAIN ] ACN: Starting full primary refresh. [2025-10-28T17:01:36.665840] [INFO ] [REMOTE ] ACN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:01:36.759293] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-01. [2025-10-28T17:01:37.254122] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-10-28T17:01:37.498485] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-28T17:01:37.559335] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-07. [2025-10-28T17:01:38.359346] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-05. [2025-10-28T17:01:38.463895] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-28T17:01:38.785899] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-28T17:01:39.159364] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-08. [2025-10-28T17:01:39.511512] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-28T17:01:39.959403] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-09. [2025-10-28T17:01:40.510344] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-28T17:01:40.759401] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-02. [2025-10-28T17:01:41.559349] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-09. [2025-10-28T17:01:42.245085] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-09 (2.29 seconds). [2025-10-28T17:01:42.359305] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-10. [2025-10-28T17:01:42.443833] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-28T17:01:43.083320] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-28T17:01:43.159422] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-03. [2025-10-28T17:01:43.959386] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-10. [2025-10-28T17:01:44.624519] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-10 (2.27 seconds). [2025-10-28T17:01:44.635365] [INFO ] [REMOTE ] ACHR: Full fetch complete (77998 records). [2025-10-28T17:01:44.635500] [DEBUG] [VALIDATOR ] ACHR: Validating primary data. [2025-10-28T17:01:44.764352] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-06. [2025-10-28T17:01:45.044795] [DEBUG] [VALIDATOR ] ACHR: All expected trading days are present. [2025-10-28T17:01:45.044878] [DEBUG] [VALIDATOR ] ACHR: Primary data validation passed. [2025-10-28T17:01:45.045639] [INFO ] [MAIN ] ACHR: Fetched primary data is valid. [2025-10-28T17:01:45.045726] [DEBUG] [LOCAL ] ACHR: Saving primary data. [2025-10-28T17:01:45.047202] [DEBUG] [LOCAL ] ACHR: Trimmed 77998 records to 53818 (keeping 200 days of data) [2025-10-28T17:01:45.290213] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-10-28T17:01:45.430948] [DEBUG] [LOCAL ] ACHR: Primary data saved (53818 records). [2025-10-28T17:01:45.431153] [INFO ] [MAIN ] ACHR: Full history saved. [2025-10-28T17:01:45.431275] [INFO ] [MAIN ] Update Progress: 19/2366 symbols completed. ACHR took 34.7s. Estimated remaining: 3h 30m 54s. Rate: 11.1 symbols/min [2025-10-28T17:01:45.562842] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-04. [2025-10-28T17:01:45.569942] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-28T17:01:45.602764] [INFO ] [REMOTE ] ACI: Full fetch complete (76842 records). [2025-10-28T17:01:45.627768] [DEBUG] [VALIDATOR ] ACI: Validating primary data. [2025-10-28T17:01:45.654100] [FATAL] [VALIDATOR ] ACI: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T17:01:45.655754] [INFO ] [MAIN ] ACP: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:01:45.655920] [FATAL] [MAIN ] ACI: Fetched primary data is invalid. Refusing to save it. [2025-10-28T17:01:45.656151] [DEBUG] [LOCAL ] ACP: No existing data file found in primary storage. [2025-10-28T17:01:45.656230] [WARN ] [MAIN ] ACI: Deleting existing primary and derivative data due to validation failure. [2025-10-28T17:01:45.656289] [WARN ] [MAIN ] ACP: No existing data found, performing full refresh instead. [2025-10-28T17:01:45.656400] [INFO ] [LOCAL ] ACI: Starting deletion of primary data. [2025-10-28T17:01:45.656601] [INFO ] [MAIN ] ACP: Wiping existing primary data before full refresh. [2025-10-28T17:01:45.656778] [DEBUG] [LOCAL ] ACI: No primary data file found to delete. [2025-10-28T17:01:45.656870] [INFO ] [LOCAL ] ACI: Starting deletion of derivative data. [2025-10-28T17:01:45.656979] [INFO ] [LOCAL ] ACP: Starting deletion of primary data. [2025-10-28T17:01:45.657115] [DEBUG] [LOCAL ] ACP: No primary data file found to delete. [2025-10-28T17:01:45.657157] [DEBUG] [LOCAL ] ACI: Deleted derivative data file. [2025-10-28T17:01:45.657227] [INFO ] [MAIN ] ACP: Starting full primary refresh. [2025-10-28T17:01:45.702562] [INFO ] [MAIN ] Update Progress: 20/2366 symbols completed. ACI took 32.9s. Estimated remaining: 3h 20m 48s. Rate: 11.7 symbols/min [2025-10-28T17:01:46.113086] [INFO ] [MAIN ] ACR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:01:46.118417] [DEBUG] [LOCAL ] ACR: No existing data file found in primary storage. [2025-10-28T17:01:46.141292] [WARN ] [MAIN ] ACR: No existing data found, performing full refresh instead. [2025-10-28T17:01:46.162476] [INFO ] [MAIN ] ACR: Wiping existing primary data before full refresh. [2025-10-28T17:01:46.186668] [INFO ] [LOCAL ] ACR: Starting deletion of primary data. [2025-10-28T17:01:46.200557] [DEBUG] [LOCAL ] ACR: No primary data file found to delete. [2025-10-28T17:01:46.218409] [INFO ] [MAIN ] ACR: Starting full primary refresh. [2025-10-28T17:01:46.236885] [INFO ] [REMOTE ] ACP: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:01:46.363073] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-01. [2025-10-28T17:01:46.561710] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-28T17:01:46.648363] [INFO ] [REMOTE ] ACR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:01:46.964454] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-28T17:01:47.159376] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-07. [2025-10-28T17:01:47.568179] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-28T17:01:47.959351] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-02. [2025-10-28T17:01:48.311807] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-28T17:01:48.759552] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-01. [2025-10-28T17:01:48.826201] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-28T17:01:49.147546] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-10-28T17:01:49.559360] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-08. [2025-10-28T17:01:50.359366] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-02. [2025-10-28T17:01:50.695380] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-28T17:01:50.784314] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-28T17:01:51.159365] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-03. [2025-10-28T17:01:51.959307] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-05. [2025-10-28T17:01:52.109507] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-28T17:01:52.759330] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-09. [2025-10-28T17:01:53.564494] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-03. [2025-10-28T17:01:53.589363] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-28T17:01:54.193578] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-28T17:01:54.246083] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-28T17:01:54.359344] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-04. [2025-10-28T17:01:54.841397] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-28T17:01:55.159365] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-10. [2025-10-28T17:01:55.959423] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-06. [2025-10-28T17:01:56.759332] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-04. [2025-10-28T17:01:56.902406] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-28T17:01:56.910454] [INFO ] [REMOTE ] ACM: Full fetch complete (62858 records). [2025-10-28T17:01:56.910607] [DEBUG] [VALIDATOR ] ACM: Validating primary data. [2025-10-28T17:01:56.911322] [FATAL] [VALIDATOR ] ACM: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T17:01:56.911407] [FATAL] [MAIN ] ACM: Fetched primary data is invalid. Refusing to save it. [2025-10-28T17:01:56.911456] [WARN ] [MAIN ] ACM: Deleting existing primary and derivative data due to validation failure. [2025-10-28T17:01:56.911544] [INFO ] [LOCAL ] ACM: Starting deletion of primary data. [2025-10-28T17:01:56.911623] [DEBUG] [LOCAL ] ACM: No primary data file found to delete. [2025-10-28T17:01:56.911712] [INFO ] [LOCAL ] ACM: Starting deletion of derivative data. [2025-10-28T17:01:56.911781] [DEBUG] [LOCAL ] ACM: No derivative data file found to delete. [2025-10-28T17:01:56.911857] [INFO ] [MAIN ] Update Progress: 21/2366 symbols completed. ACM took 35.9s. Estimated remaining: 3h 32m 1s. Rate: 11.1 symbols/min [2025-10-28T17:01:57.083525] [INFO ] [MAIN ] ACRE: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:01:57.114772] [DEBUG] [LOCAL ] ACRE: Loaded 32703 existing records from primary storage. [2025-10-28T17:01:57.115115] [INFO ] [MAIN ] ACRE: Loaded 32703 existing records. [2025-10-28T17:01:57.298740] [WARN ] [MAIN ] ACRE: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:01:57.298959] [INFO ] [MAIN ] ACRE: Wiping existing primary data before full refresh. [2025-10-28T17:01:57.299025] [INFO ] [LOCAL ] ACRE: Starting deletion of primary data. [2025-10-28T17:01:57.299442] [DEBUG] [LOCAL ] ACRE: Deleted primary data file. [2025-10-28T17:01:57.299500] [INFO ] [MAIN ] ACRE: Starting full primary refresh. [2025-10-28T17:01:57.566056] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-05. [2025-10-28T17:01:57.657148] [INFO ] [REMOTE ] ACRE: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:01:57.863098] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-28T17:01:57.899603] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-28T17:01:58.265461] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-28T17:01:58.359336] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-06. [2025-10-28T17:01:58.997737] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-28T17:01:59.159339] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-01. [2025-10-28T17:01:59.959361] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-07. [2025-10-28T17:02:00.317359] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-28T17:02:00.759344] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-05. [2025-10-28T17:02:01.559359] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-07. [2025-10-28T17:02:01.727769] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-28T17:02:01.821640] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-28T17:02:01.990938] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-28T17:02:02.359358] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-08. [2025-10-28T17:02:03.159343] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-06. [2025-10-28T17:02:03.959321] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-08. [2025-10-28T17:02:04.118149] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-28T17:02:04.345117] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-10-28T17:02:04.521224] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-28T17:02:04.759357] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-09. [2025-10-28T17:02:05.559335] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-09. [2025-10-28T17:02:05.942180] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-10-28T17:02:06.359369] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-07. [2025-10-28T17:02:06.406043] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-28T17:02:07.159337] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-10. [2025-10-28T17:02:07.296326] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-28T17:02:07.817850] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-28T17:02:07.819267] [INFO ] [REMOTE ] ACR: Full fetch complete (8537 records). [2025-10-28T17:02:07.819356] [DEBUG] [VALIDATOR ] ACR: Validating primary data. [2025-10-28T17:02:07.970680] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-08. [2025-10-28T17:02:08.245572] [DEBUG] [VALIDATOR ] ACR: All expected trading days are present. [2025-10-28T17:02:08.245679] [DEBUG] [VALIDATOR ] ACR: Primary data validation passed. [2025-10-28T17:02:08.245930] [INFO ] [MAIN ] ACR: Fetched primary data is valid. [2025-10-28T17:02:08.245972] [DEBUG] [LOCAL ] ACR: Saving primary data. [2025-10-28T17:02:08.246446] [DEBUG] [LOCAL ] ACR: Trimmed 8537 records to 5179 (keeping 200 days of data) [2025-10-28T17:02:08.278376] [DEBUG] [LOCAL ] ACR: Primary data saved (5179 records). [2025-10-28T17:02:08.278521] [INFO ] [MAIN ] ACR: Full history saved. [2025-10-28T17:02:08.278602] [INFO ] [MAIN ] Update Progress: 22/2366 symbols completed. ACR took 22.6s. Estimated remaining: 3h 42m 28s. Rate: 10.5 symbols/min [2025-10-28T17:02:08.458686] [INFO ] [MAIN ] ACV: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:02:08.468226] [DEBUG] [LOCAL ] ACV: Loaded 7257 existing records from primary storage. [2025-10-28T17:02:08.468445] [INFO ] [MAIN ] ACV: Loaded 7257 existing records. [2025-10-28T17:02:08.665587] [WARN ] [MAIN ] ACV: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:02:08.665885] [INFO ] [MAIN ] ACV: Wiping existing primary data before full refresh. [2025-10-28T17:02:08.665950] [INFO ] [LOCAL ] ACV: Starting deletion of primary data. [2025-10-28T17:02:08.666268] [DEBUG] [LOCAL ] ACV: Deleted primary data file. [2025-10-28T17:02:08.666337] [INFO ] [MAIN ] ACV: Starting full primary refresh. [2025-10-28T17:02:08.764613] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-02. [2025-10-28T17:02:09.055775] [INFO ] [REMOTE ] ACV: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:02:09.523489] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-28T17:02:09.559319] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-01. [2025-10-28T17:02:09.959633] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-28T17:02:10.273634] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-28T17:02:10.359352] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-03. [2025-10-28T17:02:11.159353] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-10. [2025-10-28T17:02:11.724312] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-28T17:02:11.959371] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-04. [2025-10-28T17:02:12.759359] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-02. [2025-10-28T17:02:12.952037] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-28T17:02:12.963024] [INFO ] [REMOTE ] ACN: Full fetch complete (77034 records). [2025-10-28T17:02:12.963185] [DEBUG] [VALIDATOR ] ACN: Validating primary data. [2025-10-28T17:02:12.964042] [FATAL] [VALIDATOR ] ACN: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T17:02:12.964137] [FATAL] [MAIN ] ACN: Fetched primary data is invalid. Refusing to save it. [2025-10-28T17:02:12.964184] [WARN ] [MAIN ] ACN: Deleting existing primary and derivative data due to validation failure. [2025-10-28T17:02:12.964263] [INFO ] [LOCAL ] ACN: Starting deletion of primary data. [2025-10-28T17:02:12.964342] [DEBUG] [LOCAL ] ACN: No primary data file found to delete. [2025-10-28T17:02:12.964392] [INFO ] [LOCAL ] ACN: Starting deletion of derivative data. [2025-10-28T17:02:12.964588] [DEBUG] [LOCAL ] ACN: Deleted derivative data file. [2025-10-28T17:02:12.965599] [INFO ] [MAIN ] Update Progress: 23/2366 symbols completed. ACN took 37.0s. Estimated remaining: 3h 40m 40s. Rate: 10.6 symbols/min [2025-10-28T17:02:13.155100] [INFO ] [MAIN ] ACVA: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:02:13.210716] [DEBUG] [LOCAL ] ACVA: Loaded 49125 existing records from primary storage. [2025-10-28T17:02:13.211380] [INFO ] [MAIN ] ACVA: Loaded 49125 existing records. [2025-10-28T17:02:13.418591] [WARN ] [MAIN ] ACVA: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:02:13.419289] [INFO ] [MAIN ] ACVA: Wiping existing primary data before full refresh. [2025-10-28T17:02:13.419479] [INFO ] [LOCAL ] ACVA: Starting deletion of primary data. [2025-10-28T17:02:13.420576] [DEBUG] [LOCAL ] ACVA: Deleted primary data file. [2025-10-28T17:02:13.420691] [INFO ] [MAIN ] ACVA: Starting full primary refresh. [2025-10-28T17:02:13.531095] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-28T17:02:13.561705] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-03. [2025-10-28T17:02:13.806951] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-28T17:02:13.899891] [INFO ] [REMOTE ] ACVA: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:02:14.067898] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-28T17:02:14.359365] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-09. [2025-10-28T17:02:15.112950] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-28T17:02:15.159355] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-10. [2025-10-28T17:02:15.959364] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-04. [2025-10-28T17:02:16.458496] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-28T17:02:16.535054] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-28T17:02:16.541897] [INFO ] [REMOTE ] ACP: Full fetch complete (46465 records). [2025-10-28T17:02:16.542052] [DEBUG] [VALIDATOR ] ACP: Validating primary data. [2025-10-28T17:02:16.768608] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-05. [2025-10-28T17:02:16.938790] [DEBUG] [VALIDATOR ] ACP: All expected trading days are present. [2025-10-28T17:02:16.938869] [DEBUG] [VALIDATOR ] ACP: Primary data validation passed. [2025-10-28T17:02:16.939348] [INFO ] [MAIN ] ACP: Fetched primary data is valid. [2025-10-28T17:02:16.939389] [DEBUG] [LOCAL ] ACP: Saving primary data. [2025-10-28T17:02:16.940338] [DEBUG] [LOCAL ] ACP: Trimmed 46465 records to 30672 (keeping 200 days of data) [2025-10-28T17:02:17.118066] [DEBUG] [LOCAL ] ACP: Primary data saved (30672 records). [2025-10-28T17:02:17.118205] [INFO ] [MAIN ] ACP: Full history saved. [2025-10-28T17:02:17.118277] [INFO ] [MAIN ] Update Progress: 24/2366 symbols completed. ACP took 31.7s. Estimated remaining: 3h 38m 8s. Rate: 10.7 symbols/min [2025-10-28T17:02:17.289626] [INFO ] [MAIN ] AD: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:02:17.289832] [DEBUG] [LOCAL ] AD: No existing data file found in primary storage. [2025-10-28T17:02:17.289983] [WARN ] [MAIN ] AD: No existing data found, performing full refresh instead. [2025-10-28T17:02:17.290135] [INFO ] [MAIN ] AD: Wiping existing primary data before full refresh. [2025-10-28T17:02:17.296299] [INFO ] [LOCAL ] AD: Starting deletion of primary data. [2025-10-28T17:02:17.296358] [DEBUG] [LOCAL ] AD: No primary data file found to delete. [2025-10-28T17:02:17.296395] [INFO ] [MAIN ] AD: Starting full primary refresh. [2025-10-28T17:02:17.297441] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-28T17:02:17.564505] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-05. [2025-10-28T17:02:17.669310] [INFO ] [REMOTE ] AD: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:02:18.359378] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-06. [2025-10-28T17:02:18.871260] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-28T17:02:19.159378] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-01. [2025-10-28T17:02:19.389913] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-28T17:02:19.390434] [WARN ] [REMOTE ] AD: No data returned for month 2025-01 [2025-10-28T17:02:19.390556] [FATAL] [REMOTE ] AD: API call failed - aborting fetch to avoid wasting further API calls [2025-10-28T17:02:19.390622] [FATAL] [MAIN ] AD: Failed to fetch primary data. [2025-10-28T17:02:19.390719] [WARN ] [MAIN ] AD: Deleting existing primary and derivative data due to fetch failure. [2025-10-28T17:02:19.390817] [INFO ] [LOCAL ] AD: Starting deletion of primary data. [2025-10-28T17:02:19.390927] [DEBUG] [LOCAL ] AD: No primary data file found to delete. [2025-10-28T17:02:19.390982] [INFO ] [LOCAL ] AD: Starting deletion of derivative data. [2025-10-28T17:02:19.391035] [DEBUG] [LOCAL ] AD: No derivative data file found to delete. [2025-10-28T17:02:19.391100] [INFO ] [MAIN ] Update Progress: 25/2366 symbols completed. AD took 2.3s. Estimated remaining: 3h 32m 52s. Rate: 11.0 symbols/min [2025-10-28T17:02:19.588238] [INFO ] [MAIN ] ADC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:02:19.645551] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-10-28T17:02:19.675697] [DEBUG] [LOCAL ] ADC: Loaded 46272 existing records from primary storage. [2025-10-28T17:02:19.676946] [INFO ] [MAIN ] ADC: Loaded 46272 existing records. [2025-10-28T17:02:19.906350] [WARN ] [MAIN ] ADC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:02:19.906663] [INFO ] [MAIN ] ADC: Wiping existing primary data before full refresh. [2025-10-28T17:02:19.906731] [INFO ] [LOCAL ] ADC: Starting deletion of primary data. [2025-10-28T17:02:19.908347] [DEBUG] [LOCAL ] ADC: Deleted primary data file. [2025-10-28T17:02:19.908411] [INFO ] [MAIN ] ADC: Starting full primary refresh. [2025-10-28T17:02:19.965563] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-06. [2025-10-28T17:02:20.322092] [INFO ] [REMOTE ] ADC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:02:20.759385] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-01. [2025-10-28T17:02:21.497494] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-28T17:02:21.559361] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-01. [2025-10-28T17:02:22.359358] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-07. [2025-10-28T17:02:23.096733] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-01 (2.34 seconds). [2025-10-28T17:02:23.159361] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-07. [2025-10-28T17:02:23.345397] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-28T17:02:23.959369] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-02. [2025-10-28T17:02:23.985608] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-28T17:02:24.079146] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-28T17:02:24.759366] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-02. [2025-10-28T17:02:25.017730] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-28T17:02:25.559363] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-03. [2025-10-28T17:02:25.800782] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-28T17:02:26.359352] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-03. [2025-10-28T17:02:26.797361] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-28T17:02:27.159419] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-08. [2025-10-28T17:02:27.690218] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-28T17:02:27.959390] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-08. [2025-10-28T17:02:28.105035] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-28T17:02:28.437782] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-28T17:02:28.759342] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-09. [2025-10-28T17:02:29.235932] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-28T17:02:29.559360] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-10. [2025-10-28T17:02:30.359378] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-04. [2025-10-28T17:02:30.606873] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-28T17:02:30.609636] [INFO ] [REMOTE ] ACV: Full fetch complete (10653 records). [2025-10-28T17:02:30.609736] [DEBUG] [VALIDATOR ] ACV: Validating primary data. [2025-10-28T17:02:30.968873] [DEBUG] [VALIDATOR ] ACV: All expected trading days are present. [2025-10-28T17:02:30.968965] [DEBUG] [VALIDATOR ] ACV: Primary data validation passed. [2025-10-28T17:02:30.969181] [INFO ] [MAIN ] ACV: Fetched primary data is valid. [2025-10-28T17:02:30.969222] [DEBUG] [LOCAL ] ACV: Saving primary data. [2025-10-28T17:02:30.969761] [DEBUG] [LOCAL ] ACV: Trimmed 10653 records to 7282 (keeping 200 days of data) [2025-10-28T17:02:31.015479] [DEBUG] [LOCAL ] ACV: Primary data saved (7282 records). [2025-10-28T17:02:31.015613] [INFO ] [MAIN ] ACV: Full history saved. [2025-10-28T17:02:31.015721] [INFO ] [MAIN ] Update Progress: 26/2366 symbols completed. ACV took 22.7s. Estimated remaining: 3h 42m 2s. Rate: 10.5 symbols/min [2025-10-28T17:02:31.164979] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-09. [2025-10-28T17:02:31.198963] [INFO ] [MAIN ] ADCT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:02:31.234765] [DEBUG] [LOCAL ] ADCT: Loaded 35566 existing records from primary storage. [2025-10-28T17:02:31.235073] [INFO ] [MAIN ] ADCT: Loaded 35566 existing records. [2025-10-28T17:02:31.441851] [WARN ] [MAIN ] ADCT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:02:31.442066] [INFO ] [MAIN ] ADCT: Wiping existing primary data before full refresh. [2025-10-28T17:02:31.442138] [INFO ] [LOCAL ] ADCT: Starting deletion of primary data. [2025-10-28T17:02:31.442762] [DEBUG] [LOCAL ] ADCT: Deleted primary data file. [2025-10-28T17:02:31.442823] [INFO ] [MAIN ] ADCT: Starting full primary refresh. [2025-10-28T17:02:31.807427] [INFO ] [REMOTE ] ADCT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:02:31.946636] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-28T17:02:31.959291] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-05. [2025-10-28T17:02:32.109892] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-28T17:02:32.759386] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-01. [2025-10-28T17:02:33.559321] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-10. [2025-10-28T17:02:33.769431] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-28T17:02:34.155540] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-28T17:02:34.359435] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-04. [2025-10-28T17:02:35.159582] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-06. [2025-10-28T17:02:35.343278] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-28T17:02:35.349705] [INFO ] [REMOTE ] ACRE: Full fetch complete (49046 records). [2025-10-28T17:02:35.349799] [DEBUG] [VALIDATOR ] ACRE: Validating primary data. [2025-10-28T17:02:35.730206] [DEBUG] [VALIDATOR ] ACRE: All expected trading days are present. [2025-10-28T17:02:35.730297] [DEBUG] [VALIDATOR ] ACRE: Primary data validation passed. [2025-10-28T17:02:35.730850] [INFO ] [MAIN ] ACRE: Fetched primary data is valid. [2025-10-28T17:02:35.730913] [DEBUG] [LOCAL ] ACRE: Saving primary data. [2025-10-28T17:02:35.732177] [DEBUG] [LOCAL ] ACRE: Trimmed 49046 records to 32581 (keeping 200 days of data) [2025-10-28T17:02:35.919377] [DEBUG] [LOCAL ] ACRE: Primary data saved (32581 records). [2025-10-28T17:02:35.919522] [INFO ] [MAIN ] ACRE: Full history saved. [2025-10-28T17:02:35.920217] [INFO ] [MAIN ] Update Progress: 27/2366 symbols completed. ACRE took 39.0s. Estimated remaining: 3h 40m 48s. Rate: 10.6 symbols/min [2025-10-28T17:02:35.984557] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-02. [2025-10-28T17:02:36.094231] [INFO ] [MAIN ] ADM: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:02:36.146221] [DEBUG] [LOCAL ] ADM: Loaded 53387 existing records from primary storage. [2025-10-28T17:02:36.146627] [INFO ] [MAIN ] ADM: Loaded 53387 existing records. [2025-10-28T17:02:36.340227] [WARN ] [MAIN ] ADM: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:02:36.340730] [INFO ] [MAIN ] ADM: Wiping existing primary data before full refresh. [2025-10-28T17:02:36.340882] [INFO ] [LOCAL ] ADM: Starting deletion of primary data. [2025-10-28T17:02:36.356593] [DEBUG] [LOCAL ] ADM: Deleted primary data file. [2025-10-28T17:02:36.367328] [INFO ] [MAIN ] ADM: Starting full primary refresh. [2025-10-28T17:02:36.491350] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-28T17:02:36.767230] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-05. [2025-10-28T17:02:36.771939] [INFO ] [REMOTE ] ADM: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:02:36.968354] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-28T17:02:37.002771] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-28T17:02:37.559407] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-01. [2025-10-28T17:02:37.894943] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-28T17:02:38.359553] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-06. [2025-10-28T17:02:38.872343] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-28T17:02:39.159318] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-07. [2025-10-28T17:02:39.453868] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-28T17:02:39.959388] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-02. [2025-10-28T17:02:40.613858] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-28T17:02:40.759354] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-08. [2025-10-28T17:02:41.559326] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-07. [2025-10-28T17:02:41.747704] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-28T17:02:42.011819] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-28T17:02:42.359340] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-03. [2025-10-28T17:02:42.698206] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-28T17:02:43.159405] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-08. [2025-10-28T17:02:43.964461] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-09. [2025-10-28T17:02:43.987596] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-28T17:02:44.301115] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-28T17:02:44.759349] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-03. [2025-10-28T17:02:45.448991] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-28T17:02:45.559365] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-09. [2025-10-28T17:02:45.776309] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-28T17:02:46.359362] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-10. [2025-10-28T17:02:47.155087] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-28T17:02:47.164794] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-04. [2025-10-28T17:02:47.959320] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-10. [2025-10-28T17:02:48.177987] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-28T17:02:48.187971] [INFO ] [REMOTE ] ADC: Full fetch complete (66735 records). [2025-10-28T17:02:48.188127] [DEBUG] [VALIDATOR ] ADC: Validating primary data. [2025-10-28T17:02:48.582695] [DEBUG] [VALIDATOR ] ADC: All expected trading days are present. [2025-10-28T17:02:48.582807] [DEBUG] [VALIDATOR ] ADC: Primary data validation passed. [2025-10-28T17:02:48.583517] [INFO ] [MAIN ] ADC: Fetched primary data is valid. [2025-10-28T17:02:48.583632] [DEBUG] [LOCAL ] ADC: Saving primary data. [2025-10-28T17:02:48.585246] [DEBUG] [LOCAL ] ADC: Trimmed 66735 records to 46262 (keeping 200 days of data) [2025-10-28T17:02:48.761126] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-04. [2025-10-28T17:02:48.877596] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-28T17:02:48.913932] [DEBUG] [LOCAL ] ADC: Primary data saved (46262 records). [2025-10-28T17:02:48.914058] [INFO ] [MAIN ] ADC: Full history saved. [2025-10-28T17:02:48.914150] [INFO ] [MAIN ] Update Progress: 28/2366 symbols completed. ADC took 29.5s. Estimated remaining: 3h 50m 54s. Rate: 10.1 symbols/min [2025-10-28T17:02:49.080483] [INFO ] [MAIN ] ADNT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:02:49.080680] [DEBUG] [LOCAL ] ADNT: No existing data file found in primary storage. [2025-10-28T17:02:49.080732] [WARN ] [MAIN ] ADNT: No existing data found, performing full refresh instead. [2025-10-28T17:02:49.080879] [INFO ] [MAIN ] ADNT: Wiping existing primary data before full refresh. [2025-10-28T17:02:49.080927] [INFO ] [LOCAL ] ADNT: Starting deletion of primary data. [2025-10-28T17:02:49.080972] [DEBUG] [LOCAL ] ADNT: No primary data file found to delete. [2025-10-28T17:02:49.081011] [INFO ] [MAIN ] ADNT: Starting full primary refresh. [2025-10-28T17:02:49.463847] [INFO ] [REMOTE ] ADNT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:02:49.559337] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-01. [2025-10-28T17:02:49.660134] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-28T17:02:49.670236] [INFO ] [REMOTE ] ACVA: Full fetch complete (71041 records). [2025-10-28T17:02:49.670382] [DEBUG] [VALIDATOR ] ACVA: Validating primary data. [2025-10-28T17:02:50.063322] [DEBUG] [VALIDATOR ] ACVA: All expected trading days are present. [2025-10-28T17:02:50.063396] [DEBUG] [VALIDATOR ] ACVA: Primary data validation passed. [2025-10-28T17:02:50.064055] [INFO ] [MAIN ] ACVA: Fetched primary data is valid. [2025-10-28T17:02:50.064118] [DEBUG] [LOCAL ] ACVA: Saving primary data. [2025-10-28T17:02:50.065470] [DEBUG] [LOCAL ] ACVA: Trimmed 71041 records to 49057 (keeping 200 days of data) [2025-10-28T17:02:50.189228] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-28T17:02:50.360709] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-05. [2025-10-28T17:02:50.369979] [DEBUG] [LOCAL ] ACVA: Primary data saved (49057 records). [2025-10-28T17:02:50.370057] [INFO ] [MAIN ] ACVA: Full history saved. [2025-10-28T17:02:50.370129] [INFO ] [MAIN ] Update Progress: 29/2366 symbols completed. ACVA took 37.4s. Estimated remaining: 3h 44m 48s. Rate: 10.4 symbols/min [2025-10-28T17:02:50.539729] [INFO ] [MAIN ] ADT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:02:50.585439] [DEBUG] [LOCAL ] ADT: Loaded 53432 existing records from primary storage. [2025-10-28T17:02:50.585758] [INFO ] [MAIN ] ADT: Loaded 53432 existing records. [2025-10-28T17:02:50.761880] [WARN ] [MAIN ] ADT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:02:50.762053] [INFO ] [MAIN ] ADT: Wiping existing primary data before full refresh. [2025-10-28T17:02:50.762099] [INFO ] [LOCAL ] ADT: Starting deletion of primary data. [2025-10-28T17:02:50.763000] [DEBUG] [LOCAL ] ADT: Deleted primary data file. [2025-10-28T17:02:50.763057] [INFO ] [MAIN ] ADT: Starting full primary refresh. [2025-10-28T17:02:51.127780] [INFO ] [REMOTE ] ADT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:02:51.154061] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-28T17:02:51.163122] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-05. [2025-10-28T17:02:51.959350] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-02. [2025-10-28T17:02:52.169763] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-28T17:02:52.641122] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-05 (2.28 seconds). [2025-10-28T17:02:52.759346] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-06. [2025-10-28T17:02:52.955197] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-28T17:02:53.559338] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-01. [2025-10-28T17:02:54.149716] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-28T17:02:54.359382] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-07. [2025-10-28T17:02:55.010396] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-28T17:02:55.159389] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-06. [2025-10-28T17:02:55.959307] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-03. [2025-10-28T17:02:56.003955] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-28T17:02:56.759407] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-02. [2025-10-28T17:02:56.884460] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-28T17:02:57.243324] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-28T17:02:57.559358] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-07. [2025-10-28T17:02:58.109234] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-28T17:02:58.359389] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-04. [2025-10-28T17:02:58.752678] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-28T17:02:59.159336] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-08. [2025-10-28T17:02:59.630604] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-28T17:02:59.959350] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-08. [2025-10-28T17:03:00.189230] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-28T17:03:00.759394] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-09. [2025-10-28T17:03:01.559339] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-03. [2025-10-28T17:03:01.715665] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-28T17:03:01.834681] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-28T17:03:02.359394] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-09. [2025-10-28T17:03:02.881948] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-28T17:03:03.159347] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-10. [2025-10-28T17:03:03.831521] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-28T17:03:03.959412] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-04. [2025-10-28T17:03:04.543286] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-28T17:03:04.551751] [INFO ] [REMOTE ] ADCT: Full fetch complete (51429 records). [2025-10-28T17:03:04.551855] [DEBUG] [VALIDATOR ] ADCT: Validating primary data. [2025-10-28T17:03:04.770473] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-10. [2025-10-28T17:03:04.936007] [DEBUG] [VALIDATOR ] ADCT: All expected trading days are present. [2025-10-28T17:03:04.936099] [DEBUG] [VALIDATOR ] ADCT: Primary data validation passed. [2025-10-28T17:03:04.936610] [INFO ] [MAIN ] ADCT: Fetched primary data is valid. [2025-10-28T17:03:04.936680] [DEBUG] [LOCAL ] ADCT: Saving primary data. [2025-10-28T17:03:04.940812] [DEBUG] [LOCAL ] ADCT: Trimmed 51429 records to 35678 (keeping 200 days of data) [2025-10-28T17:03:05.135294] [DEBUG] [LOCAL ] ADCT: Primary data saved (35678 records). [2025-10-28T17:03:05.135428] [INFO ] [MAIN ] ADCT: Full history saved. [2025-10-28T17:03:05.136424] [INFO ] [MAIN ] Update Progress: 30/2366 symbols completed. ADCT took 34.1s. Estimated remaining: 3h 56m 23s. Rate: 9.9 symbols/min [2025-10-28T17:03:05.326702] [INFO ] [MAIN ] ADX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:03:05.355315] [DEBUG] [LOCAL ] ADX: Loaded 27465 existing records from primary storage. [2025-10-28T17:03:05.355958] [INFO ] [MAIN ] ADX: Loaded 27465 existing records. [2025-10-28T17:03:05.507027] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-28T17:03:05.546363] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-28T17:03:05.567621] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-05. [2025-10-28T17:03:05.612988] [INFO ] [REMOTE ] ADM: Full fetch complete (77467 records). [2025-10-28T17:03:05.623884] [DEBUG] [VALIDATOR ] ADM: Validating primary data. [2025-10-28T17:03:05.646171] [WARN ] [MAIN ] ADX: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:03:05.697153] [INFO ] [MAIN ] ADX: Wiping existing primary data before full refresh. [2025-10-28T17:03:05.719724] [INFO ] [LOCAL ] ADX: Starting deletion of primary data. [2025-10-28T17:03:05.728044] [DEBUG] [LOCAL ] ADX: Deleted primary data file. [2025-10-28T17:03:05.745381] [INFO ] [MAIN ] ADX: Starting full primary refresh. [2025-10-28T17:03:06.365908] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-05. [2025-10-28T17:03:06.497857] [DEBUG] [VALIDATOR ] ADM: All expected trading days are present. [2025-10-28T17:03:06.521221] [INFO ] [REMOTE ] ADX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:03:06.521387] [DEBUG] [VALIDATOR ] ADM: Primary data validation passed. [2025-10-28T17:03:06.522525] [INFO ] [MAIN ] ADM: Fetched primary data is valid. [2025-10-28T17:03:06.522593] [DEBUG] [LOCAL ] ADM: Saving primary data. [2025-10-28T17:03:06.524212] [DEBUG] [LOCAL ] ADM: Trimmed 77467 records to 53377 (keeping 200 days of data) [2025-10-28T17:03:06.884747] [DEBUG] [LOCAL ] ADM: Primary data saved (53377 records). [2025-10-28T17:03:06.885107] [INFO ] [MAIN ] ADM: Full history saved. [2025-10-28T17:03:06.886333] [INFO ] [MAIN ] Update Progress: 31/2366 symbols completed. ADM took 31.0s. Estimated remaining: 3h 50m 51s. Rate: 10.1 symbols/min [2025-10-28T17:03:07.097219] [INFO ] [MAIN ] AEE: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:03:07.127031] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-28T17:03:07.159342] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-01. [2025-10-28T17:03:07.179127] [DEBUG] [LOCAL ] AEE: Loaded 49892 existing records from primary storage. [2025-10-28T17:03:07.179448] [INFO ] [MAIN ] AEE: Loaded 49892 existing records. [2025-10-28T17:03:07.361505] [WARN ] [MAIN ] AEE: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:03:07.361738] [INFO ] [MAIN ] AEE: Wiping existing primary data before full refresh. [2025-10-28T17:03:07.361793] [INFO ] [LOCAL ] AEE: Starting deletion of primary data. [2025-10-28T17:03:07.362372] [DEBUG] [LOCAL ] AEE: Deleted primary data file. [2025-10-28T17:03:07.362431] [INFO ] [MAIN ] AEE: Starting full primary refresh. [2025-10-28T17:03:07.746308] [INFO ] [REMOTE ] AEE: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:03:07.866513] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-28T17:03:07.959306] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-06. [2025-10-28T17:03:08.538526] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-28T17:03:08.759380] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-06. [2025-10-28T17:03:09.331424] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-28T17:03:09.559390] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-01. [2025-10-28T17:03:10.320680] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-28T17:03:10.359385] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-07. [2025-10-28T17:03:11.155849] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-28T17:03:11.165684] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-02. [2025-10-28T17:03:11.959339] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-02. [2025-10-28T17:03:12.107147] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-28T17:03:12.270322] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-28T17:03:12.759359] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-03. [2025-10-28T17:03:13.284600] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-28T17:03:13.559412] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-08. [2025-10-28T17:03:13.812044] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-28T17:03:14.359363] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-03. [2025-10-28T17:03:15.008002] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-28T17:03:15.159325] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-09. [2025-10-28T17:03:15.709715] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-28T17:03:15.959417] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-04. [2025-10-28T17:03:16.759315] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-04. [2025-10-28T17:03:16.814874] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-28T17:03:16.968875] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-28T17:03:17.559342] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-10. [2025-10-28T17:03:18.194522] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-28T17:03:18.359337] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-05. [2025-10-28T17:03:18.987053] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-28T17:03:18.999098] [INFO ] [REMOTE ] ADT: Full fetch complete (76995 records). [2025-10-28T17:03:18.999272] [DEBUG] [VALIDATOR ] ADT: Validating primary data. [2025-10-28T17:03:19.000065] [FATAL] [VALIDATOR ] ADT: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T17:03:19.000164] [FATAL] [MAIN ] ADT: Fetched primary data is invalid. Refusing to save it. [2025-10-28T17:03:19.000207] [WARN ] [MAIN ] ADT: Deleting existing primary and derivative data due to validation failure. [2025-10-28T17:03:19.000248] [INFO ] [LOCAL ] ADT: Starting deletion of primary data. [2025-10-28T17:03:19.000329] [DEBUG] [LOCAL ] ADT: No primary data file found to delete. [2025-10-28T17:03:19.000412] [INFO ] [LOCAL ] ADT: Starting deletion of derivative data. [2025-10-28T17:03:19.000632] [DEBUG] [LOCAL ] ADT: Deleted derivative data file. [2025-10-28T17:03:19.000797] [INFO ] [MAIN ] Update Progress: 32/2366 symbols completed. ADT took 28.6s. Estimated remaining: 3h 58m 16s. Rate: 9.8 symbols/min [2025-10-28T17:03:19.172823] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-07. [2025-10-28T17:03:19.176037] [INFO ] [MAIN ] AEFC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:03:19.176122] [DEBUG] [LOCAL ] AEFC: No existing data file found in primary storage. [2025-10-28T17:03:19.176158] [WARN ] [MAIN ] AEFC: No existing data found, performing full refresh instead. [2025-10-28T17:03:19.176264] [INFO ] [MAIN ] AEFC: Wiping existing primary data before full refresh. [2025-10-28T17:03:19.176305] [INFO ] [LOCAL ] AEFC: Starting deletion of primary data. [2025-10-28T17:03:19.176345] [DEBUG] [LOCAL ] AEFC: No primary data file found to delete. [2025-10-28T17:03:19.176377] [INFO ] [MAIN ] AEFC: Starting full primary refresh. [2025-10-28T17:03:19.536976] [INFO ] [REMOTE ] AEFC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:03:19.959321] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-01. [2025-10-28T17:03:20.030045] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-28T17:03:20.609743] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-28T17:03:20.759331] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-02. [2025-10-28T17:03:20.950143] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-28T17:03:21.184397] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-28T17:03:21.559336] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-06. [2025-10-28T17:03:22.359345] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-08. [2025-10-28T17:03:23.000374] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-28T17:03:23.159312] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-03. [2025-10-28T17:03:23.614210] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-28T17:03:23.745843] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-28T17:03:23.959318] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-09. [2025-10-28T17:03:24.759338] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-07. [2025-10-28T17:03:25.210075] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-28T17:03:25.559381] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-04. [2025-10-28T17:03:26.098018] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-28T17:03:26.096285] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-28T17:03:26.359326] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-05. [2025-10-28T17:03:27.159381] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-10. [2025-10-28T17:03:27.184684] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-28T17:03:27.959387] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-08. [2025-10-28T17:03:28.759344] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-06. [2025-10-28T17:03:28.829808] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-28T17:03:28.838717] [INFO ] [REMOTE ] ADNT: Full fetch complete (67625 records). [2025-10-28T17:03:28.838869] [DEBUG] [VALIDATOR ] ADNT: Validating primary data. [2025-10-28T17:03:29.261515] [DEBUG] [VALIDATOR ] ADNT: All expected trading days are present. [2025-10-28T17:03:29.261668] [DEBUG] [VALIDATOR ] ADNT: Primary data validation passed. [2025-10-28T17:03:29.262807] [INFO ] [MAIN ] ADNT: Fetched primary data is valid. [2025-10-28T17:03:29.262916] [DEBUG] [LOCAL ] ADNT: Saving primary data. [2025-10-28T17:03:29.264905] [DEBUG] [LOCAL ] ADNT: Trimmed 67625 records to 45939 (keeping 200 days of data) [2025-10-28T17:03:29.357768] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-28T17:03:29.542796] [DEBUG] [LOCAL ] ADNT: Primary data saved (45939 records). [2025-10-28T17:03:29.543007] [INFO ] [MAIN ] ADNT: Full history saved. [2025-10-28T17:03:29.543164] [INFO ] [MAIN ] Update Progress: 33/2366 symbols completed. ADNT took 40.6s. Estimated remaining: 4h 3m 22s. Rate: 9.6 symbols/min [2025-10-28T17:03:29.574788] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-05. [2025-10-28T17:03:29.757131] [INFO ] [MAIN ] AEG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:03:29.753739] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-28T17:03:29.807781] [DEBUG] [LOCAL ] AEG: Loaded 49423 existing records from primary storage. [2025-10-28T17:03:29.808083] [INFO ] [MAIN ] AEG: Loaded 49423 existing records. [2025-10-28T17:03:29.997749] [WARN ] [MAIN ] AEG: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:03:29.997938] [INFO ] [MAIN ] AEG: Wiping existing primary data before full refresh. [2025-10-28T17:03:29.998006] [INFO ] [LOCAL ] AEG: Starting deletion of primary data. [2025-10-28T17:03:29.998789] [DEBUG] [LOCAL ] AEG: Deleted primary data file. [2025-10-28T17:03:29.998848] [INFO ] [MAIN ] AEG: Starting full primary refresh. [2025-10-28T17:03:30.372260] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-07. [2025-10-28T17:03:30.378584] [INFO ] [REMOTE ] AEG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:03:30.606455] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-28T17:03:30.904583] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-28T17:03:31.159348] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-08. [2025-10-28T17:03:31.648596] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-28T17:03:31.959364] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-01. [2025-10-28T17:03:32.759354] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-09. [2025-10-28T17:03:33.372314] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-28T17:03:33.559323] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-02. [2025-10-28T17:03:34.116096] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-28T17:03:34.359381] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-06. [2025-10-28T17:03:34.917758] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-28T17:03:35.159349] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-10. [2025-10-28T17:03:35.776387] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-28T17:03:35.959359] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-07. [2025-10-28T17:03:36.701102] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-28T17:03:36.711540] [INFO ] [REMOTE ] AEE: Full fetch complete (72955 records). [2025-10-28T17:03:36.711740] [DEBUG] [VALIDATOR ] AEE: Validating primary data. [2025-10-28T17:03:36.768092] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-03. [2025-10-28T17:03:37.147771] [DEBUG] [VALIDATOR ] AEE: All expected trading days are present. [2025-10-28T17:03:37.147958] [DEBUG] [VALIDATOR ] AEE: Primary data validation passed. [2025-10-28T17:03:37.148853] [INFO ] [MAIN ] AEE: Fetched primary data is valid. [2025-10-28T17:03:37.149336] [DEBUG] [LOCAL ] AEE: Saving primary data. [2025-10-28T17:03:37.150935] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-28T17:03:37.159181] [DEBUG] [LOCAL ] AEE: Trimmed 72955 records to 49871 (keeping 200 days of data) [2025-10-28T17:03:37.471369] [DEBUG] [LOCAL ] AEE: Primary data saved (49871 records). [2025-10-28T17:03:37.471504] [INFO ] [MAIN ] AEE: Full history saved. [2025-10-28T17:03:37.472079] [INFO ] [MAIN ] Update Progress: 34/2366 symbols completed. AEE took 30.6s. Estimated remaining: 4h 5m 11s. Rate: 9.5 symbols/min [2025-10-28T17:03:37.566306] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-09. [2025-10-28T17:03:37.652488] [INFO ] [MAIN ] AEM: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:03:37.703505] [DEBUG] [LOCAL ] AEM: Loaded 53473 existing records from primary storage. [2025-10-28T17:03:37.703867] [INFO ] [MAIN ] AEM: Loaded 53473 existing records. [2025-10-28T17:03:37.884131] [WARN ] [MAIN ] AEM: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:03:37.884335] [INFO ] [MAIN ] AEM: Wiping existing primary data before full refresh. [2025-10-28T17:03:37.884382] [INFO ] [LOCAL ] AEM: Starting deletion of primary data. [2025-10-28T17:03:37.885322] [DEBUG] [LOCAL ] AEM: Deleted primary data file. [2025-10-28T17:03:37.885391] [INFO ] [MAIN ] AEM: Starting full primary refresh. [2025-10-28T17:03:38.156143] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-28T17:03:38.263414] [INFO ] [REMOTE ] AEM: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:03:38.324557] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-28T17:03:38.359303] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-04. [2025-10-28T17:03:39.159313] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-08. [2025-10-28T17:03:39.808318] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-28T17:03:39.959304] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-05. [2025-10-28T17:03:39.999834] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-28T17:03:40.759337] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-01. [2025-10-28T17:03:41.191376] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-28T17:03:41.559369] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-10. [2025-10-28T17:03:41.994599] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-28T17:03:42.177172] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-28T17:03:42.179068] [INFO ] [REMOTE ] AEFC: Full fetch complete (11572 records). [2025-10-28T17:03:42.179168] [DEBUG] [VALIDATOR ] AEFC: Validating primary data. [2025-10-28T17:03:42.364501] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-06. [2025-10-28T17:03:42.545133] [DEBUG] [VALIDATOR ] AEFC: All expected trading days are present. [2025-10-28T17:03:42.545208] [DEBUG] [VALIDATOR ] AEFC: Primary data validation passed. [2025-10-28T17:03:42.545414] [INFO ] [MAIN ] AEFC: Fetched primary data is valid. [2025-10-28T17:03:42.545454] [DEBUG] [LOCAL ] AEFC: Saving primary data. [2025-10-28T17:03:42.545934] [DEBUG] [LOCAL ] AEFC: Trimmed 11572 records to 7433 (keeping 200 days of data) [2025-10-28T17:03:42.589048] [DEBUG] [LOCAL ] AEFC: Primary data saved (7433 records). [2025-10-28T17:03:42.589172] [INFO ] [MAIN ] AEFC: Full history saved. [2025-10-28T17:03:42.589245] [INFO ] [MAIN ] Update Progress: 35/2366 symbols completed. AEFC took 23.6s. Estimated remaining: 4h 3m 45s. Rate: 9.6 symbols/min [2025-10-28T17:03:42.760790] [INFO ] [MAIN ] AEO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:03:42.809059] [DEBUG] [LOCAL ] AEO: Loaded 53563 existing records from primary storage. [2025-10-28T17:03:42.809359] [INFO ] [MAIN ] AEO: Loaded 53563 existing records. [2025-10-28T17:03:42.988397] [WARN ] [MAIN ] AEO: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:03:42.988638] [INFO ] [MAIN ] AEO: Wiping existing primary data before full refresh. [2025-10-28T17:03:42.988735] [INFO ] [LOCAL ] AEO: Starting deletion of primary data. [2025-10-28T17:03:42.990353] [DEBUG] [LOCAL ] AEO: Deleted primary data file. [2025-10-28T17:03:42.990416] [INFO ] [MAIN ] AEO: Starting full primary refresh. [2025-10-28T17:03:43.170143] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-02. [2025-10-28T17:03:43.366854] [INFO ] [REMOTE ] AEO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:03:43.965137] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-09. [2025-10-28T17:03:43.970467] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-28T17:03:44.759364] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-07. [2025-10-28T17:03:45.012845] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-10-28T17:03:45.114872] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-28T17:03:45.559389] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-10. [2025-10-28T17:03:46.062364] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-28T17:03:46.359343] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-08. [2025-10-28T17:03:46.447430] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-28T17:03:46.453793] [INFO ] [REMOTE ] ADX: Full fetch complete (41495 records). [2025-10-28T17:03:46.453939] [DEBUG] [VALIDATOR ] ADX: Validating primary data. [2025-10-28T17:03:46.454627] [FATAL] [VALIDATOR ] ADX: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T17:03:46.454736] [FATAL] [MAIN ] ADX: Fetched primary data is invalid. Refusing to save it. [2025-10-28T17:03:46.454779] [WARN ] [MAIN ] ADX: Deleting existing primary and derivative data due to validation failure. [2025-10-28T17:03:46.454820] [INFO ] [LOCAL ] ADX: Starting deletion of primary data. [2025-10-28T17:03:46.454881] [DEBUG] [LOCAL ] ADX: No primary data file found to delete. [2025-10-28T17:03:46.454917] [INFO ] [LOCAL ] ADX: Starting deletion of derivative data. [2025-10-28T17:03:46.455105] [DEBUG] [LOCAL ] ADX: Deleted derivative data file. [2025-10-28T17:03:46.455181] [INFO ] [MAIN ] Update Progress: 36/2366 symbols completed. ADX took 41.3s. Estimated remaining: 4h 1m 3s. Rate: 9.7 symbols/min [2025-10-28T17:03:46.622679] [INFO ] [MAIN ] AER: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:03:46.670099] [DEBUG] [LOCAL ] AER: Loaded 47685 existing records from primary storage. [2025-10-28T17:03:46.670390] [INFO ] [MAIN ] AER: Loaded 47685 existing records. [2025-10-28T17:03:46.850087] [WARN ] [MAIN ] AER: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:03:46.850306] [INFO ] [MAIN ] AER: Wiping existing primary data before full refresh. [2025-10-28T17:03:46.850353] [INFO ] [LOCAL ] AER: Starting deletion of primary data. [2025-10-28T17:03:46.850944] [DEBUG] [LOCAL ] AER: Deleted primary data file. [2025-10-28T17:03:46.851001] [INFO ] [MAIN ] AER: Starting full primary refresh. [2025-10-28T17:03:47.164602] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-01. [2025-10-28T17:03:47.207946] [INFO ] [REMOTE ] AER: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:03:47.704813] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-28T17:03:47.959344] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-03. [2025-10-28T17:03:48.725417] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-28T17:03:48.759309] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-02. [2025-10-28T17:03:49.476385] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-28T17:03:49.559342] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-09. [2025-10-28T17:03:49.942720] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-28T17:03:50.359365] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-03. [2025-10-28T17:03:50.696038] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-28T17:03:51.159365] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-10. [2025-10-28T17:03:51.974535] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-04. [2025-10-28T17:03:51.998491] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-28T17:03:52.458321] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-28T17:03:52.468249] [INFO ] [REMOTE ] AEG: Full fetch complete (70632 records). [2025-10-28T17:03:52.468403] [DEBUG] [VALIDATOR ] AEG: Validating primary data. [2025-10-28T17:03:52.764816] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-01. [2025-10-28T17:03:52.879522] [DEBUG] [VALIDATOR ] AEG: All expected trading days are present. [2025-10-28T17:03:52.879603] [DEBUG] [VALIDATOR ] AEG: Primary data validation passed. [2025-10-28T17:03:52.880282] [INFO ] [MAIN ] AEG: Fetched primary data is valid. [2025-10-28T17:03:52.880344] [DEBUG] [LOCAL ] AEG: Saving primary data. [2025-10-28T17:03:52.881682] [DEBUG] [LOCAL ] AEG: Trimmed 70632 records to 49393 (keeping 200 days of data) [2025-10-28T17:03:53.157620] [DEBUG] [LOCAL ] AEG: Primary data saved (49393 records). [2025-10-28T17:03:53.157780] [INFO ] [MAIN ] AEG: Full history saved. [2025-10-28T17:03:53.157864] [INFO ] [MAIN ] Update Progress: 37/2366 symbols completed. AEG took 23.6s. Estimated remaining: 4h 1m 28s. Rate: 9.6 symbols/min [2025-10-28T17:03:53.559398] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-04. [2025-10-28T17:03:54.126534] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-10-28T17:03:54.359488] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-05. [2025-10-28T17:03:54.401879] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-28T17:03:55.021098] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-28T17:03:55.159380] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-02. [2025-10-28T17:03:55.685838] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-28T17:03:55.959380] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-06. [2025-10-28T17:03:56.327693] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-28T17:03:56.759393] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-05. [2025-10-28T17:03:57.559505] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-03. [2025-10-28T17:03:58.196880] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-28T17:03:58.359350] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-06. [2025-10-28T17:03:58.722099] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-28T17:03:58.758847] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-06 (2.80 seconds). [2025-10-28T17:03:59.159320] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-04. [2025-10-28T17:03:59.740885] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-28T17:03:59.959405] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-07. [2025-10-28T17:04:00.398512] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-28T17:04:00.759360] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-05. [2025-10-28T17:04:01.559394] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-07. [2025-10-28T17:04:01.836983] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-28T17:04:02.359383] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-08. [2025-10-28T17:04:02.476486] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-28T17:04:03.150260] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-28T17:04:03.161046] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-06. [2025-10-28T17:04:03.959402] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-08. [2025-10-28T17:04:04.167494] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-28T17:04:04.383760] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-10-28T17:04:04.759361] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-09. [2025-10-28T17:04:05.555089] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-28T17:04:05.566039] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-07. [2025-10-28T17:04:06.359324] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-09. [2025-10-28T17:04:06.553971] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-28T17:04:07.159383] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-10. [2025-10-28T17:04:07.632539] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-28T17:04:07.959326] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-08. [2025-10-28T17:04:08.073281] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-28T17:04:08.759301] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-10. [2025-10-28T17:04:08.931565] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-28T17:04:08.942310] [INFO ] [REMOTE ] AEM: Full fetch complete (77491 records). [2025-10-28T17:04:08.942459] [DEBUG] [VALIDATOR ] AEM: Validating primary data. [2025-10-28T17:04:09.335158] [DEBUG] [VALIDATOR ] AEM: All expected trading days are present. [2025-10-28T17:04:09.335289] [DEBUG] [VALIDATOR ] AEM: Primary data validation passed. [2025-10-28T17:04:09.336098] [INFO ] [MAIN ] AEM: Fetched primary data is valid. [2025-10-28T17:04:09.336206] [DEBUG] [LOCAL ] AEM: Saving primary data. [2025-10-28T17:04:09.350112] [DEBUG] [LOCAL ] AEM: Trimmed 77491 records to 53472 (keeping 200 days of data) [2025-10-28T17:04:09.368150] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-28T17:04:09.560328] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-09. [2025-10-28T17:04:09.697218] [DEBUG] [LOCAL ] AEM: Primary data saved (53472 records). [2025-10-28T17:04:09.697366] [INFO ] [MAIN ] AEM: Full history saved. [2025-10-28T17:04:09.698022] [INFO ] [MAIN ] Update Progress: 38/2366 symbols completed. AEM took 32.2s. Estimated remaining: 4h 11m 54s. Rate: 9.2 symbols/min [2025-10-28T17:04:10.867130] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-28T17:04:10.877596] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-10. [2025-10-28T17:04:10.913360] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-10 (2.15 seconds). [2025-10-28T17:04:10.923894] [INFO ] [REMOTE ] AEO: Full fetch complete (77651 records). [2025-10-28T17:04:10.924023] [DEBUG] [VALIDATOR ] AEO: Validating primary data. [2025-10-28T17:04:11.317704] [DEBUG] [VALIDATOR ] AEO: All expected trading days are present. [2025-10-28T17:04:11.317807] [DEBUG] [VALIDATOR ] AEO: Primary data validation passed. [2025-10-28T17:04:11.318516] [INFO ] [MAIN ] AEO: Fetched primary data is valid. [2025-10-28T17:04:11.318561] [DEBUG] [LOCAL ] AEO: Saving primary data. [2025-10-28T17:04:11.320044] [DEBUG] [LOCAL ] AEO: Trimmed 77651 records to 53563 (keeping 200 days of data) [2025-10-28T17:04:11.639598] [DEBUG] [LOCAL ] AEO: Primary data saved (53563 records). [2025-10-28T17:04:11.639789] [INFO ] [MAIN ] AEO: Full history saved. [2025-10-28T17:04:11.639891] [INFO ] [MAIN ] Update Progress: 39/2366 symbols completed. AEO took 29.1s. Estimated remaining: 4h 7m 16s. Rate: 9.4 symbols/min [2025-10-28T17:04:12.275464] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-28T17:04:12.284889] [INFO ] [REMOTE ] AER: Full fetch complete (69903 records). [2025-10-28T17:04:12.285042] [DEBUG] [VALIDATOR ] AER: Validating primary data. [2025-10-28T17:04:12.684899] [DEBUG] [VALIDATOR ] AER: All expected trading days are present. [2025-10-28T17:04:12.684981] [DEBUG] [VALIDATOR ] AER: Primary data validation passed. [2025-10-28T17:04:12.685634] [INFO ] [MAIN ] AER: Fetched primary data is valid. [2025-10-28T17:04:12.685719] [DEBUG] [LOCAL ] AER: Saving primary data. [2025-10-28T17:04:12.687105] [DEBUG] [LOCAL ] AER: Trimmed 69903 records to 47659 (keeping 200 days of data) [2025-10-28T17:04:12.983219] [DEBUG] [LOCAL ] AER: Primary data saved (47659 records). [2025-10-28T17:04:12.983415] [INFO ] [MAIN ] AER: Full history saved. [2025-10-28T17:04:12.985177] [INFO ] [MAIN ] Update Progress: 40/2366 symbols completed. AER took 26.5s. Estimated remaining: 4h 2m 17s. Rate: 9.6 symbols/min [2025-10-28T17:04:13.594799] [INFO ] [MAIN ] AES: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:04:13.729580] [INFO ] [MAIN ] AEXA: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:04:13.734912] [INFO ] [MAIN ] AESI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:04:13.733879] [INFO ] [MAIN ] AFB: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:04:13.735471] [DEBUG] [LOCAL ] AEXA: No existing data file found in primary storage. [2025-10-28T17:04:13.735741] [WARN ] [MAIN ] AEXA: No existing data found, performing full refresh instead. [2025-10-28T17:04:13.736122] [INFO ] [MAIN ] AEXA: Wiping existing primary data before full refresh. [2025-10-28T17:04:13.736192] [INFO ] [LOCAL ] AEXA: Starting deletion of primary data. [2025-10-28T17:04:13.736245] [DEBUG] [LOCAL ] AEXA: No primary data file found to delete. [2025-10-28T17:04:13.736325] [INFO ] [MAIN ] AEXA: Starting full primary refresh. [2025-10-28T17:04:13.859226] [DEBUG] [LOCAL ] AFB: Loaded 10957 existing records from primary storage. [2025-10-28T17:04:13.881861] [INFO ] [MAIN ] AFB: Loaded 10957 existing records. [2025-10-28T17:04:14.206308] [DEBUG] [LOCAL ] AESI: Loaded 49777 existing records from primary storage. [2025-10-28T17:04:14.286977] [INFO ] [MAIN ] AESI: Loaded 49777 existing records. [2025-10-28T17:04:14.280956] [DEBUG] [LOCAL ] AES: Loaded 53663 existing records from primary storage. [2025-10-28T17:04:14.375001] [WARN ] [MAIN ] AFB: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:04:14.391303] [INFO ] [MAIN ] AFB: Wiping existing primary data before full refresh. [2025-10-28T17:04:14.380510] [INFO ] [MAIN ] AES: Loaded 53663 existing records. [2025-10-28T17:04:14.429061] [INFO ] [LOCAL ] AFB: Starting deletion of primary data. [2025-10-28T17:04:14.495293] [INFO ] [REMOTE ] AEXA: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:04:14.539961] [INFO ] [REMOTE ] AEXA: Fetching primary data for 2025-01. [2025-10-28T17:04:14.529174] [DEBUG] [LOCAL ] AFB: Deleted primary data file. [2025-10-28T17:04:14.571556] [INFO ] [MAIN ] AFB: Starting full primary refresh. [2025-10-28T17:04:14.785319] [DEBUG] [REMOTE ] AEXA: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-28T17:04:14.962235] [WARN ] [REMOTE ] AEXA: No data returned for month 2025-01 [2025-10-28T17:04:14.991229] [WARN ] [MAIN ] AESI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:04:15.039832] [INFO ] [MAIN ] AESI: Wiping existing primary data before full refresh. [2025-10-28T17:04:15.039720] [WARN ] [MAIN ] AES: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:04:15.049087] [INFO ] [LOCAL ] AESI: Starting deletion of primary data. [2025-10-28T17:04:14.991378] [FATAL] [REMOTE ] AEXA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-28T17:04:15.065152] [INFO ] [MAIN ] AES: Wiping existing primary data before full refresh. [2025-10-28T17:04:15.064933] [FATAL] [MAIN ] AEXA: Failed to fetch primary data. [2025-10-28T17:04:15.073834] [INFO ] [LOCAL ] AES: Starting deletion of primary data. [2025-10-28T17:04:15.074116] [WARN ] [MAIN ] AEXA: Deleting existing primary and derivative data due to fetch failure. [2025-10-28T17:04:15.073918] [DEBUG] [LOCAL ] AESI: Deleted primary data file. [2025-10-28T17:04:15.093791] [DEBUG] [LOCAL ] AES: Deleted primary data file. [2025-10-28T17:04:15.094114] [INFO ] [MAIN ] AESI: Starting full primary refresh. [2025-10-28T17:04:15.094060] [INFO ] [MAIN ] AES: Starting full primary refresh. [2025-10-28T17:04:15.093922] [INFO ] [LOCAL ] AEXA: Starting deletion of primary data. [2025-10-28T17:04:15.215921] [DEBUG] [LOCAL ] AEXA: No primary data file found to delete. [2025-10-28T17:04:15.365224] [INFO ] [LOCAL ] AEXA: Starting deletion of derivative data. [2025-10-28T17:04:15.381306] [DEBUG] [LOCAL ] AEXA: No derivative data file found to delete. [2025-10-28T17:04:15.470836] [INFO ] [MAIN ] Update Progress: 41/2366 symbols completed. AEXA took 2.5s. Estimated remaining: 3h 58m 37s. Rate: 9.7 symbols/min [2025-10-28T17:04:15.479935] [INFO ] [REMOTE ] AFB: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:04:15.485951] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-01. [2025-10-28T17:04:16.025596] [INFO ] [MAIN ] AFG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:04:16.090371] [INFO ] [REMOTE ] AES: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:04:16.111768] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-01. [2025-10-28T17:04:16.172767] [INFO ] [REMOTE ] AESI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:04:16.180909] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-01. [2025-10-28T17:04:16.195456] [DEBUG] [LOCAL ] AFG: Loaded 31571 existing records from primary storage. [2025-10-28T17:04:16.195744] [INFO ] [MAIN ] AFG: Loaded 31571 existing records. [2025-10-28T17:04:16.371416] [WARN ] [MAIN ] AFG: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:04:16.371670] [INFO ] [MAIN ] AFG: Wiping existing primary data before full refresh. [2025-10-28T17:04:16.371732] [INFO ] [LOCAL ] AFG: Starting deletion of primary data. [2025-10-28T17:04:16.372050] [DEBUG] [LOCAL ] AFG: Deleted primary data file. [2025-10-28T17:04:16.372091] [INFO ] [MAIN ] AFG: Starting full primary refresh. [2025-10-28T17:04:16.719412] [INFO ] [REMOTE ] AFG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:04:16.719752] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-01. [2025-10-28T17:04:16.744138] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-28T17:04:16.746915] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-02. [2025-10-28T17:04:17.179154] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-28T17:04:17.181866] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-03. [2025-10-28T17:04:17.358709] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-28T17:04:17.368233] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-02. [2025-10-28T17:04:18.068678] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-28T17:04:18.072134] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-04. [2025-10-28T17:04:18.087040] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-28T17:04:18.331476] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-01 (2.22 seconds). [2025-10-28T17:04:18.359301] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-02. [2025-10-28T17:04:18.725059] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-28T17:04:19.003052] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-28T17:04:19.159345] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-03. [2025-10-28T17:04:19.542699] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-28T17:04:19.959360] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-03. [2025-10-28T17:04:20.320606] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-28T17:04:20.759367] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-05. [2025-10-28T17:04:21.449562] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-28T17:04:21.559343] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-04. [2025-10-28T17:04:21.713731] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-28T17:04:22.359348] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-02. [2025-10-28T17:04:23.164416] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-04. [2025-10-28T17:04:23.180571] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-28T17:04:23.959359] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-06. [2025-10-28T17:04:24.178381] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-28T17:04:24.229379] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-28T17:04:24.402320] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-28T17:04:24.759341] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-03. [2025-10-28T17:04:25.559325] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-05. [2025-10-28T17:04:26.316889] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-28T17:04:26.359294] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-04. [2025-10-28T17:04:26.540721] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-28T17:04:27.159371] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-07. [2025-10-28T17:04:27.734259] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-28T17:04:27.959330] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-05. [2025-10-28T17:04:28.051607] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-28T17:04:28.759324] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-05. [2025-10-28T17:04:29.522993] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-28T17:04:29.559292] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-06. [2025-10-28T17:04:30.359383] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-06. [2025-10-28T17:04:30.467378] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-28T17:04:30.935318] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-28T17:04:31.159361] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-08. [2025-10-28T17:04:31.646060] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-28T17:04:31.645046] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-28T17:04:31.959340] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-06. [2025-10-28T17:04:32.759347] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-09. [2025-10-28T17:04:33.326212] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-28T17:04:33.326906] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-28T17:04:33.559338] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-10. [2025-10-28T17:04:34.280098] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-28T17:04:34.282699] [INFO ] [REMOTE ] AFB: Full fetch complete (16279 records). [2025-10-28T17:04:34.282774] [DEBUG] [VALIDATOR ] AFB: Validating primary data. [2025-10-28T17:04:34.364540] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-07. [2025-10-28T17:04:34.643408] [DEBUG] [VALIDATOR ] AFB: All expected trading days are present. [2025-10-28T17:04:34.643479] [DEBUG] [VALIDATOR ] AFB: Primary data validation passed. [2025-10-28T17:04:34.643734] [INFO ] [MAIN ] AFB: Fetched primary data is valid. [2025-10-28T17:04:34.643793] [DEBUG] [LOCAL ] AFB: Saving primary data. [2025-10-28T17:04:34.644281] [DEBUG] [LOCAL ] AFB: Trimmed 16279 records to 10993 (keeping 200 days of data) [2025-10-28T17:04:34.710235] [DEBUG] [LOCAL ] AFB: Primary data saved (10993 records). [2025-10-28T17:04:34.710357] [INFO ] [MAIN ] AFB: Full history saved. [2025-10-28T17:04:34.710438] [INFO ] [MAIN ] Update Progress: 42/2366 symbols completed. AFB took 21.7s. Estimated remaining: 4h 10m 35s. Rate: 9.3 symbols/min [2025-10-28T17:04:34.882821] [INFO ] [MAIN ] AFGB: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:04:34.882941] [DEBUG] [LOCAL ] AFGB: No existing data file found in primary storage. [2025-10-28T17:04:34.882977] [WARN ] [MAIN ] AFGB: No existing data found, performing full refresh instead. [2025-10-28T17:04:34.883102] [INFO ] [MAIN ] AFGB: Wiping existing primary data before full refresh. [2025-10-28T17:04:34.883156] [INFO ] [LOCAL ] AFGB: Starting deletion of primary data. [2025-10-28T17:04:34.883198] [DEBUG] [LOCAL ] AFGB: No primary data file found to delete. [2025-10-28T17:04:34.883231] [INFO ] [MAIN ] AFGB: Starting full primary refresh. [2025-10-28T17:04:35.164433] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-07. [2025-10-28T17:04:35.233251] [INFO ] [REMOTE ] AFGB: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:04:35.650202] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-28T17:04:35.959369] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-08. [2025-10-28T17:04:36.759970] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-28T17:04:36.760056] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-01. [2025-10-28T17:04:37.329557] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-28T17:04:37.443912] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-28T17:04:37.559296] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-02. [2025-10-28T17:04:37.849487] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-02 (0.29 seconds). [2025-10-28T17:04:38.359344] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-03. [2025-10-28T17:04:38.983911] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-28T17:04:39.159325] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-08. [2025-10-28T17:04:39.959429] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-09. [2025-10-28T17:04:40.564558] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-28T17:04:40.759376] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-09. [2025-10-28T17:04:41.321877] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-28T17:04:41.559340] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-04. [2025-10-28T17:04:42.055255] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-28T17:04:42.127379] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-28T17:04:42.359407] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-10. [2025-10-28T17:04:43.159377] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-10. [2025-10-28T17:04:43.959322] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-05. [2025-10-28T17:04:44.143511] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-28T17:04:44.154472] [INFO ] [REMOTE ] AESI: Full fetch complete (71929 records). [2025-10-28T17:04:44.154859] [DEBUG] [VALIDATOR ] AESI: Validating primary data. [2025-10-28T17:04:44.285833] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-28T17:04:44.301294] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-10-28T17:04:44.330421] [INFO ] [REMOTE ] AFG: Full fetch complete (46800 records). [2025-10-28T17:04:44.361209] [DEBUG] [VALIDATOR ] AFG: Validating primary data. [2025-10-28T17:04:44.763805] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-07. [2025-10-28T17:04:44.889775] [DEBUG] [VALIDATOR ] AESI: All expected trading days are present. [2025-10-28T17:04:44.906639] [DEBUG] [VALIDATOR ] AESI: Primary data validation passed. [2025-10-28T17:04:44.907463] [INFO ] [MAIN ] AESI: Fetched primary data is valid. [2025-10-28T17:04:44.907544] [DEBUG] [LOCAL ] AESI: Saving primary data. [2025-10-28T17:04:44.965774] [DEBUG] [LOCAL ] AESI: Trimmed 71929 records to 49737 (keeping 200 days of data) [2025-10-28T17:04:45.058436] [DEBUG] [VALIDATOR ] AFG: All expected trading days are present. [2025-10-28T17:04:45.083574] [DEBUG] [VALIDATOR ] AFG: Primary data validation passed. [2025-10-28T17:04:45.084377] [INFO ] [MAIN ] AFG: Fetched primary data is valid. [2025-10-28T17:04:45.084671] [DEBUG] [LOCAL ] AFG: Saving primary data. [2025-10-28T17:04:45.112577] [DEBUG] [LOCAL ] AFG: Trimmed 46800 records to 31464 (keeping 200 days of data) [2025-10-28T17:04:45.468738] [DEBUG] [LOCAL ] AFG: Primary data saved (31464 records). [2025-10-28T17:04:45.475323] [INFO ] [MAIN ] AFG: Full history saved. [2025-10-28T17:04:45.480712] [INFO ] [MAIN ] Update Progress: 43/2366 symbols completed. AFG took 30.0s. Estimated remaining: 4h 14m 21s. Rate: 9.1 symbols/min [2025-10-28T17:04:45.570096] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-06. [2025-10-28T17:04:45.559785] [DEBUG] [LOCAL ] AESI: Primary data saved (49737 records). [2025-10-28T17:04:45.571434] [INFO ] [MAIN ] AESI: Full history saved. [2025-10-28T17:04:45.577892] [INFO ] [MAIN ] Update Progress: 44/2366 symbols completed. AESI took 32.6s. Estimated remaining: 4h 8m 33s. Rate: 9.3 symbols/min [2025-10-28T17:04:45.777039] [INFO ] [MAIN ] AFGC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:04:45.832816] [INFO ] [MAIN ] AFGD: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:04:45.834804] [DEBUG] [LOCAL ] AFGC: Loaded 2550 existing records from primary storage. [2025-10-28T17:04:45.834906] [DEBUG] [LOCAL ] AFGD: No existing data file found in primary storage. [2025-10-28T17:04:45.834975] [WARN ] [MAIN ] AFGD: No existing data found, performing full refresh instead. [2025-10-28T17:04:45.835116] [INFO ] [MAIN ] AFGD: Wiping existing primary data before full refresh. [2025-10-28T17:04:45.835318] [INFO ] [MAIN ] AFGC: Loaded 2550 existing records. [2025-10-28T17:04:45.835183] [INFO ] [LOCAL ] AFGD: Starting deletion of primary data. [2025-10-28T17:04:45.835429] [DEBUG] [LOCAL ] AFGD: No primary data file found to delete. [2025-10-28T17:04:45.866290] [INFO ] [MAIN ] AFGD: Starting full primary refresh. [2025-10-28T17:04:45.990818] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-28T17:04:46.150720] [WARN ] [MAIN ] AFGC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:04:46.183019] [INFO ] [MAIN ] AFGC: Wiping existing primary data before full refresh. [2025-10-28T17:04:46.184871] [INFO ] [LOCAL ] AFGC: Starting deletion of primary data. [2025-10-28T17:04:46.236518] [DEBUG] [LOCAL ] AFGC: Deleted primary data file. [2025-10-28T17:04:46.269522] [INFO ] [MAIN ] AFGC: Starting full primary refresh. [2025-10-28T17:04:46.375169] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-07. [2025-10-28T17:04:46.546931] [INFO ] [REMOTE ] AFGD: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:04:46.845608] [INFO ] [REMOTE ] AFGC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:04:46.876744] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-10-28T17:04:46.916909] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-28T17:04:47.159372] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-01. [2025-10-28T17:04:47.634331] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-28T17:04:47.959394] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-08. [2025-10-28T17:04:48.344429] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-10-28T17:04:48.759356] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-09. [2025-10-28T17:04:49.061324] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-09 (0.30 seconds). [2025-10-28T17:04:49.559395] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-02. [2025-10-28T17:04:49.853927] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-02 (0.29 seconds). [2025-10-28T17:04:50.359402] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-10. [2025-10-28T17:04:50.805387] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-28T17:04:50.806690] [INFO ] [REMOTE ] AFGB: Full fetch complete (3390 records). [2025-10-28T17:04:50.806781] [DEBUG] [VALIDATOR ] AFGB: Validating primary data. [2025-10-28T17:04:51.160403] [DEBUG] [VALIDATOR ] AFGB: All expected trading days are present. [2025-10-28T17:04:51.160193] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-08. [2025-10-28T17:04:51.160768] [DEBUG] [VALIDATOR ] AFGB: Primary data validation passed. [2025-10-28T17:04:51.161795] [INFO ] [MAIN ] AFGB: Fetched primary data is valid. [2025-10-28T17:04:51.161859] [DEBUG] [LOCAL ] AFGB: Saving primary data. [2025-10-28T17:04:51.162206] [DEBUG] [LOCAL ] AFGB: Trimmed 3390 records to 2112 (keeping 200 days of data) [2025-10-28T17:04:51.175103] [DEBUG] [LOCAL ] AFGB: Primary data saved (2112 records). [2025-10-28T17:04:51.175172] [INFO ] [MAIN ] AFGB: Full history saved. [2025-10-28T17:04:51.175236] [INFO ] [MAIN ] Update Progress: 45/2366 symbols completed. AFGB took 16.5s. Estimated remaining: 4h 7m 44s. Rate: 9.4 symbols/min [2025-10-28T17:04:51.344293] [INFO ] [MAIN ] AFGE: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:04:51.349174] [DEBUG] [LOCAL ] AFGE: Loaded 2214 existing records from primary storage. [2025-10-28T17:04:51.349353] [INFO ] [MAIN ] AFGE: Loaded 2214 existing records. [2025-10-28T17:04:51.529945] [WARN ] [MAIN ] AFGE: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:04:51.530161] [INFO ] [MAIN ] AFGE: Wiping existing primary data before full refresh. [2025-10-28T17:04:51.530209] [INFO ] [LOCAL ] AFGE: Starting deletion of primary data. [2025-10-28T17:04:51.530362] [DEBUG] [LOCAL ] AFGE: Deleted primary data file. [2025-10-28T17:04:51.530405] [INFO ] [MAIN ] AFGE: Starting full primary refresh. [2025-10-28T17:04:51.894715] [INFO ] [REMOTE ] AFGE: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:04:51.959307] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-01. [2025-10-28T17:04:52.387148] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-28T17:04:52.507722] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-28T17:04:52.759359] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-02. [2025-10-28T17:04:53.028178] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-02 (0.27 seconds). [2025-10-28T17:04:53.559357] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-03. [2025-10-28T17:04:53.865137] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-03 (0.31 seconds). [2025-10-28T17:04:54.359364] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-04. [2025-10-28T17:04:54.850958] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-28T17:04:55.159368] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-09. [2025-10-28T17:04:55.959355] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-05. [2025-10-28T17:04:56.260839] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-05 (0.30 seconds). [2025-10-28T17:04:56.759326] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-03. [2025-10-28T17:04:56.805709] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-28T17:04:57.038984] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-03 (0.28 seconds). [2025-10-28T17:04:57.559346] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-10. [2025-10-28T17:04:58.359380] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-01. [2025-10-28T17:04:58.844617] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-28T17:04:59.159340] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-04. [2025-10-28T17:04:59.459965] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-28T17:04:59.470880] [INFO ] [REMOTE ] AES: Full fetch complete (77841 records). [2025-10-28T17:04:59.471039] [DEBUG] [VALIDATOR ] AES: Validating primary data. [2025-10-28T17:04:59.587777] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-28T17:04:59.880056] [DEBUG] [VALIDATOR ] AES: All expected trading days are present. [2025-10-28T17:04:59.880134] [DEBUG] [VALIDATOR ] AES: Primary data validation passed. [2025-10-28T17:04:59.880898] [INFO ] [MAIN ] AES: Fetched primary data is valid. [2025-10-28T17:04:59.880964] [DEBUG] [LOCAL ] AES: Saving primary data. [2025-10-28T17:04:59.882462] [DEBUG] [LOCAL ] AES: Trimmed 77841 records to 53663 (keeping 200 days of data) [2025-10-28T17:04:59.969079] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-06. [2025-10-28T17:05:00.213034] [DEBUG] [LOCAL ] AES: Primary data saved (53663 records). [2025-10-28T17:05:00.213190] [INFO ] [MAIN ] AES: Full history saved. [2025-10-28T17:05:00.213278] [INFO ] [MAIN ] Update Progress: 46/2366 symbols completed. AES took 47.2s. Estimated remaining: 4h 9m 50s. Rate: 9.3 symbols/min [2025-10-28T17:05:00.309316] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-28T17:05:00.408386] [INFO ] [MAIN ] AFL: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:05:00.457018] [DEBUG] [LOCAL ] AFL: Loaded 53160 existing records from primary storage. [2025-10-28T17:05:00.457368] [INFO ] [MAIN ] AFL: Loaded 53160 existing records. [2025-10-28T17:05:00.648553] [WARN ] [MAIN ] AFL: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:05:00.648825] [INFO ] [MAIN ] AFL: Wiping existing primary data before full refresh. [2025-10-28T17:05:00.648876] [INFO ] [LOCAL ] AFL: Starting deletion of primary data. [2025-10-28T17:05:00.650039] [DEBUG] [LOCAL ] AFL: Deleted primary data file. [2025-10-28T17:05:00.650113] [INFO ] [MAIN ] AFL: Starting full primary refresh. [2025-10-28T17:05:00.762007] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-02. [2025-10-28T17:05:01.044435] [INFO ] [REMOTE ] AFL: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:05:01.081556] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-10-28T17:05:01.559340] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-05. [2025-10-28T17:05:01.937576] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-10-28T17:05:02.359389] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-01. [2025-10-28T17:05:03.159393] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-06. [2025-10-28T17:05:03.450891] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-06 (0.29 seconds). [2025-10-28T17:05:03.959349] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-07. [2025-10-28T17:05:04.163404] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-28T17:05:04.441287] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-28T17:05:04.759352] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-03. [2025-10-28T17:05:05.013886] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-03 (0.25 seconds). [2025-10-28T17:05:05.559335] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-04. [2025-10-28T17:05:05.964454] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-10-28T17:05:06.359349] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-05. [2025-10-28T17:05:06.674955] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-10-28T17:05:07.159367] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-02. [2025-10-28T17:05:07.959364] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-07. [2025-10-28T17:05:08.272734] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-07 (0.31 seconds). [2025-10-28T17:05:08.560709] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-28T17:05:08.759337] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-08. [2025-10-28T17:05:09.050778] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-08 (0.29 seconds). [2025-10-28T17:05:09.559334] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-09. [2025-10-28T17:05:10.074071] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-28T17:05:10.359336] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-10. [2025-10-28T17:05:10.823234] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-28T17:05:10.824017] [INFO ] [REMOTE ] AFGD: Full fetch complete (2652 records). [2025-10-28T17:05:10.824086] [DEBUG] [VALIDATOR ] AFGD: Validating primary data. [2025-10-28T17:05:10.824418] [FATAL] [VALIDATOR ] AFGD: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T17:05:10.824500] [FATAL] [MAIN ] AFGD: Fetched primary data is invalid. Refusing to save it. [2025-10-28T17:05:10.824543] [WARN ] [MAIN ] AFGD: Deleting existing primary and derivative data due to validation failure. [2025-10-28T17:05:10.824582] [INFO ] [LOCAL ] AFGD: Starting deletion of primary data. [2025-10-28T17:05:10.824638] [DEBUG] [LOCAL ] AFGD: No primary data file found to delete. [2025-10-28T17:05:10.824731] [INFO ] [LOCAL ] AFGD: Starting deletion of derivative data. [2025-10-28T17:05:10.824786] [DEBUG] [LOCAL ] AFGD: No derivative data file found to delete. [2025-10-28T17:05:10.824841] [INFO ] [MAIN ] Update Progress: 47/2366 symbols completed. AFGD took 25.2s. Estimated remaining: 4h 13m 8s. Rate: 9.2 symbols/min [2025-10-28T17:05:10.993260] [INFO ] [MAIN ] AG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:05:11.054134] [DEBUG] [LOCAL ] AG: Loaded 53643 existing records from primary storage. [2025-10-28T17:05:11.054535] [INFO ] [MAIN ] AG: Loaded 53643 existing records. [2025-10-28T17:05:11.164540] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-08. [2025-10-28T17:05:11.254930] [WARN ] [MAIN ] AG: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:05:11.255161] [INFO ] [MAIN ] AG: Wiping existing primary data before full refresh. [2025-10-28T17:05:11.255210] [INFO ] [LOCAL ] AG: Starting deletion of primary data. [2025-10-28T17:05:11.255790] [DEBUG] [LOCAL ] AG: Deleted primary data file. [2025-10-28T17:05:11.255858] [INFO ] [MAIN ] AG: Starting full primary refresh. [2025-10-28T17:05:11.603208] [INFO ] [REMOTE ] AG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:05:11.885242] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-28T17:05:11.959310] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-09. [2025-10-28T17:05:12.201789] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-09 (0.24 seconds). [2025-10-28T17:05:12.759357] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-03. [2025-10-28T17:05:13.559339] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-10. [2025-10-28T17:05:13.983180] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-28T17:05:13.984382] [INFO ] [REMOTE ] AFGE: Full fetch complete (3270 records). [2025-10-28T17:05:13.984472] [DEBUG] [VALIDATOR ] AFGE: Validating primary data. [2025-10-28T17:05:14.264578] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-28T17:05:14.366678] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-04. [2025-10-28T17:05:14.391419] [DEBUG] [VALIDATOR ] AFGE: All expected trading days are present. [2025-10-28T17:05:14.391500] [DEBUG] [VALIDATOR ] AFGE: Primary data validation passed. [2025-10-28T17:05:14.391617] [INFO ] [MAIN ] AFGE: Fetched primary data is valid. [2025-10-28T17:05:14.391693] [DEBUG] [LOCAL ] AFGE: Saving primary data. [2025-10-28T17:05:14.392043] [DEBUG] [LOCAL ] AFGE: Trimmed 3270 records to 2204 (keeping 200 days of data) [2025-10-28T17:05:14.406065] [DEBUG] [LOCAL ] AFGE: Primary data saved (2204 records). [2025-10-28T17:05:14.406247] [INFO ] [MAIN ] AFGE: Full history saved. [2025-10-28T17:05:14.406334] [INFO ] [MAIN ] Update Progress: 48/2366 symbols completed. AFGE took 23.2s. Estimated remaining: 4h 10m 39s. Rate: 9.2 symbols/min [2025-10-28T17:05:14.573841] [INFO ] [MAIN ] AGCO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:05:14.619307] [DEBUG] [LOCAL ] AGCO: Loaded 41854 existing records from primary storage. [2025-10-28T17:05:14.619631] [INFO ] [MAIN ] AGCO: Loaded 41854 existing records. [2025-10-28T17:05:14.802503] [WARN ] [MAIN ] AGCO: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:05:14.802751] [INFO ] [MAIN ] AGCO: Wiping existing primary data before full refresh. [2025-10-28T17:05:14.802801] [INFO ] [LOCAL ] AGCO: Starting deletion of primary data. [2025-10-28T17:05:14.803292] [DEBUG] [LOCAL ] AGCO: Deleted primary data file. [2025-10-28T17:05:14.803349] [INFO ] [MAIN ] AGCO: Starting full primary refresh. [2025-10-28T17:05:15.154484] [INFO ] [REMOTE ] AGCO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:05:15.159301] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-01. [2025-10-28T17:05:15.959307] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-06. [2025-10-28T17:05:16.056120] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-28T17:05:16.305770] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-28T17:05:16.346996] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-28T17:05:16.759340] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-07. [2025-10-28T17:05:17.110768] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-10-28T17:05:17.559334] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-08. [2025-10-28T17:05:17.863724] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-08 (0.30 seconds). [2025-10-28T17:05:18.359347] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-01. [2025-10-28T17:05:19.159331] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-02. [2025-10-28T17:05:19.959310] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-09. [2025-10-28T17:05:20.040388] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-28T17:05:20.364382] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-28T17:05:20.400314] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-28T17:05:20.759332] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-10. [2025-10-28T17:05:21.210934] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-28T17:05:21.212299] [INFO ] [REMOTE ] AFGC: Full fetch complete (3572 records). [2025-10-28T17:05:21.212394] [DEBUG] [VALIDATOR ] AFGC: Validating primary data. [2025-10-28T17:05:21.563713] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-03. [2025-10-28T17:05:21.568374] [DEBUG] [VALIDATOR ] AFGC: All expected trading days are present. [2025-10-28T17:05:21.569220] [DEBUG] [VALIDATOR ] AFGC: Primary data validation passed. [2025-10-28T17:05:21.569338] [INFO ] [MAIN ] AFGC: Fetched primary data is valid. [2025-10-28T17:05:21.569377] [DEBUG] [LOCAL ] AFGC: Saving primary data. [2025-10-28T17:05:21.569756] [DEBUG] [LOCAL ] AFGC: Trimmed 3572 records to 2560 (keeping 200 days of data) [2025-10-28T17:05:21.585049] [DEBUG] [LOCAL ] AFGC: Primary data saved (2560 records). [2025-10-28T17:05:21.585110] [INFO ] [MAIN ] AFGC: Full history saved. [2025-10-28T17:05:21.585178] [INFO ] [MAIN ] Update Progress: 49/2366 symbols completed. AFGC took 36.1s. Estimated remaining: 4h 11m 5s. Rate: 9.2 symbols/min [2025-10-28T17:05:21.755731] [INFO ] [MAIN ] AGD: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:05:21.774040] [DEBUG] [LOCAL ] AGD: Loaded 19100 existing records from primary storage. [2025-10-28T17:05:21.774282] [INFO ] [MAIN ] AGD: Loaded 19100 existing records. [2025-10-28T17:05:21.949410] [WARN ] [MAIN ] AGD: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:05:21.949630] [INFO ] [MAIN ] AGD: Wiping existing primary data before full refresh. [2025-10-28T17:05:21.949711] [INFO ] [LOCAL ] AGD: Starting deletion of primary data. [2025-10-28T17:05:21.950104] [DEBUG] [LOCAL ] AGD: Deleted primary data file. [2025-10-28T17:05:21.950161] [INFO ] [MAIN ] AGD: Starting full primary refresh. [2025-10-28T17:05:22.295227] [INFO ] [REMOTE ] AGD: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:05:22.359294] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-01. [2025-10-28T17:05:22.664769] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-28T17:05:23.159318] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-02. [2025-10-28T17:05:23.256726] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-28T17:05:23.959405] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-05. [2025-10-28T17:05:24.644276] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-28T17:05:24.759331] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-02. [2025-10-28T17:05:25.271186] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-28T17:05:25.292573] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-28T17:05:25.559333] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-06. [2025-10-28T17:05:26.359356] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-03. [2025-10-28T17:05:27.168833] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-03. [2025-10-28T17:05:27.174162] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-28T17:05:27.771199] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-28T17:05:27.959346] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-04. [2025-10-28T17:05:28.060534] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-28T17:05:28.652518] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-28T17:05:28.759384] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-05. [2025-10-28T17:05:29.453937] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-28T17:05:29.560688] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-06. [2025-10-28T17:05:30.133039] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-28T17:05:30.359367] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-04. [2025-10-28T17:05:31.159360] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-07. [2025-10-28T17:05:31.902237] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-28T17:05:31.959342] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-07. [2025-10-28T17:05:32.692671] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-28T17:05:32.759330] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-05. [2025-10-28T17:05:32.835795] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-28T17:05:33.559344] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-08. [2025-10-28T17:05:34.294014] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-28T17:05:34.366629] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-09. [2025-10-28T17:05:34.372089] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-28T17:05:35.159307] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-04. [2025-10-28T17:05:35.251162] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-28T17:05:35.959341] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-08. [2025-10-28T17:05:36.759414] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-10. [2025-10-28T17:05:36.843395] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-28T17:05:37.481703] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-28T17:05:37.487536] [INFO ] [REMOTE ] AGD: Full fetch complete (26512 records). [2025-10-28T17:05:37.487801] [DEBUG] [VALIDATOR ] AGD: Validating primary data. [2025-10-28T17:05:37.569607] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-05. [2025-10-28T17:05:37.906869] [DEBUG] [VALIDATOR ] AGD: All expected trading days are present. [2025-10-28T17:05:37.906965] [DEBUG] [VALIDATOR ] AGD: Primary data validation passed. [2025-10-28T17:05:37.907473] [INFO ] [MAIN ] AGD: Fetched primary data is valid. [2025-10-28T17:05:37.907541] [DEBUG] [LOCAL ] AGD: Saving primary data. [2025-10-28T17:05:37.908486] [DEBUG] [LOCAL ] AGD: Trimmed 26512 records to 19061 (keeping 200 days of data) [2025-10-28T17:05:38.026962] [DEBUG] [LOCAL ] AGD: Primary data saved (19061 records). [2025-10-28T17:05:38.046768] [INFO ] [MAIN ] AGD: Full history saved. [2025-10-28T17:05:38.059412] [INFO ] [MAIN ] Update Progress: 50/2366 symbols completed. AGD took 16.5s. Estimated remaining: 4h 18m 40s. Rate: 9.0 symbols/min [2025-10-28T17:05:38.111992] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-10-28T17:05:38.277428] [INFO ] [MAIN ] AGI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:05:38.277681] [DEBUG] [LOCAL ] AGI: No existing data file found in primary storage. [2025-10-28T17:05:38.277736] [WARN ] [MAIN ] AGI: No existing data found, performing full refresh instead. [2025-10-28T17:05:38.277850] [INFO ] [MAIN ] AGI: Wiping existing primary data before full refresh. [2025-10-28T17:05:38.277908] [INFO ] [LOCAL ] AGI: Starting deletion of primary data. [2025-10-28T17:05:38.277949] [DEBUG] [LOCAL ] AGI: No primary data file found to delete. [2025-10-28T17:05:38.277981] [INFO ] [MAIN ] AGI: Starting full primary refresh. [2025-10-28T17:05:38.364634] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-06. [2025-10-28T17:05:38.650069] [INFO ] [REMOTE ] AGI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:05:39.159351] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-01. [2025-10-28T17:05:39.359948] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-28T17:05:39.542876] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-28T17:05:39.959346] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-07. [2025-10-28T17:05:40.441934] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-28T17:05:40.759353] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-09. [2025-10-28T17:05:41.215474] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-28T17:05:41.559353] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-08. [2025-10-28T17:05:42.056796] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-28T17:05:42.359375] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-02. [2025-10-28T17:05:43.159303] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-06. [2025-10-28T17:05:43.654090] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-10-28T17:05:43.841987] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-28T17:05:43.959383] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-03. [2025-10-28T17:05:44.652213] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-28T17:05:44.759326] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-10. [2025-10-28T17:05:45.406357] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-28T17:05:45.559336] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-07. [2025-10-28T17:05:46.207669] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-28T17:05:46.218317] [INFO ] [REMOTE ] AFL: Full fetch complete (77056 records). [2025-10-28T17:05:46.218487] [DEBUG] [VALIDATOR ] AFL: Validating primary data. [2025-10-28T17:05:46.366295] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-04. [2025-10-28T17:05:46.626738] [DEBUG] [VALIDATOR ] AFL: All expected trading days are present. [2025-10-28T17:05:46.626848] [DEBUG] [VALIDATOR ] AFL: Primary data validation passed. [2025-10-28T17:05:46.627674] [INFO ] [MAIN ] AFL: Fetched primary data is valid. [2025-10-28T17:05:46.627740] [DEBUG] [LOCAL ] AFL: Saving primary data. [2025-10-28T17:05:46.629225] [DEBUG] [LOCAL ] AFL: Trimmed 77056 records to 53148 (keeping 200 days of data) [2025-10-28T17:05:46.943536] [DEBUG] [LOCAL ] AFL: Primary data saved (53148 records). [2025-10-28T17:05:46.943702] [INFO ] [MAIN ] AFL: Full history saved. [2025-10-28T17:05:46.943793] [INFO ] [MAIN ] Update Progress: 51/2366 symbols completed. AFL took 46.7s. Estimated remaining: 4h 20m 13s. Rate: 8.9 symbols/min [2025-10-28T17:05:47.114099] [INFO ] [MAIN ] AGL: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:05:47.114362] [DEBUG] [LOCAL ] AGL: No existing data file found in primary storage. [2025-10-28T17:05:47.114531] [WARN ] [MAIN ] AGL: No existing data found, performing full refresh instead. [2025-10-28T17:05:47.114844] [INFO ] [MAIN ] AGL: Wiping existing primary data before full refresh. [2025-10-28T17:05:47.115019] [INFO ] [LOCAL ] AGL: Starting deletion of primary data. [2025-10-28T17:05:47.115277] [DEBUG] [LOCAL ] AGL: No primary data file found to delete. [2025-10-28T17:05:47.115346] [INFO ] [MAIN ] AGL: Starting full primary refresh. [2025-10-28T17:05:47.169742] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-09. [2025-10-28T17:05:47.514532] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-28T17:05:47.518540] [INFO ] [REMOTE ] AGL: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:05:47.959308] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-01. [2025-10-28T17:05:48.137852] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-28T17:05:48.175859] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-28T17:05:48.759328] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-08. [2025-10-28T17:05:49.495884] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-28T17:05:49.559314] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-02. [2025-10-28T17:05:50.359367] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-05. [2025-10-28T17:05:50.529247] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-28T17:05:50.705235] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-28T17:05:51.159342] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-10. [2025-10-28T17:05:51.959367] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-03. [2025-10-28T17:05:52.263094] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-10-28T17:05:52.500830] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-28T17:05:52.508807] [INFO ] [REMOTE ] AGCO: Full fetch complete (61424 records). [2025-10-28T17:05:52.508912] [DEBUG] [VALIDATOR ] AGCO: Validating primary data. [2025-10-28T17:05:52.766188] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-09. [2025-10-28T17:05:52.895570] [DEBUG] [VALIDATOR ] AGCO: All expected trading days are present. [2025-10-28T17:05:52.895658] [DEBUG] [VALIDATOR ] AGCO: Primary data validation passed. [2025-10-28T17:05:52.896258] [INFO ] [MAIN ] AGCO: Fetched primary data is valid. [2025-10-28T17:05:52.896300] [DEBUG] [LOCAL ] AGCO: Saving primary data. [2025-10-28T17:05:52.897494] [DEBUG] [LOCAL ] AGCO: Trimmed 61424 records to 41768 (keeping 200 days of data) [2025-10-28T17:05:53.156852] [DEBUG] [LOCAL ] AGCO: Primary data saved (41768 records). [2025-10-28T17:05:53.157007] [INFO ] [MAIN ] AGCO: Full history saved. [2025-10-28T17:05:53.158668] [INFO ] [MAIN ] Update Progress: 52/2366 symbols completed. AGCO took 38.8s. Estimated remaining: 4h 19m 42s. Rate: 8.9 symbols/min [2025-10-28T17:05:53.332702] [INFO ] [MAIN ] AGM: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:05:53.364170] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-28T17:05:53.379246] [DEBUG] [LOCAL ] AGM: Loaded 10480 existing records from primary storage. [2025-10-28T17:05:53.379429] [INFO ] [MAIN ] AGM: Loaded 10480 existing records. [2025-10-28T17:05:53.554912] [WARN ] [MAIN ] AGM: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:05:53.555088] [INFO ] [MAIN ] AGM: Wiping existing primary data before full refresh. [2025-10-28T17:05:53.555134] [INFO ] [LOCAL ] AGM: Starting deletion of primary data. [2025-10-28T17:05:53.555423] [DEBUG] [LOCAL ] AGM: Deleted primary data file. [2025-10-28T17:05:53.555513] [INFO ] [MAIN ] AGM: Starting full primary refresh. [2025-10-28T17:05:53.566700] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-06. [2025-10-28T17:05:53.912159] [INFO ] [REMOTE ] AGM: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:05:54.359328] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-04. [2025-10-28T17:05:54.395032] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-28T17:05:55.019209] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-28T17:05:55.159331] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-10. [2025-10-28T17:05:55.808290] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-28T17:05:55.959366] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-07. [2025-10-28T17:05:56.759404] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-01. [2025-10-28T17:05:57.236831] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-28T17:05:57.368303] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-10 (2.21 seconds). [2025-10-28T17:05:57.380782] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-28T17:05:57.392731] [INFO ] [REMOTE ] AG: Full fetch complete (77792 records). [2025-10-28T17:05:57.392994] [DEBUG] [VALIDATOR ] AG: Validating primary data. [2025-10-28T17:05:57.563112] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-05. [2025-10-28T17:05:57.802982] [DEBUG] [VALIDATOR ] AG: All expected trading days are present. [2025-10-28T17:05:57.803057] [DEBUG] [VALIDATOR ] AG: Primary data validation passed. [2025-10-28T17:05:57.803769] [INFO ] [MAIN ] AG: Fetched primary data is valid. [2025-10-28T17:05:57.803830] [DEBUG] [LOCAL ] AG: Saving primary data. [2025-10-28T17:05:57.805179] [DEBUG] [LOCAL ] AG: Trimmed 77792 records to 53643 (keeping 200 days of data) [2025-10-28T17:05:58.115820] [DEBUG] [LOCAL ] AG: Primary data saved (53643 records). [2025-10-28T17:05:58.115951] [INFO ] [MAIN ] AG: Full history saved. [2025-10-28T17:05:58.116731] [INFO ] [MAIN ] Update Progress: 53/2366 symbols completed. AG took 47.3s. Estimated remaining: 4h 18m 18s. Rate: 9.0 symbols/min [2025-10-28T17:05:58.281851] [INFO ] [MAIN ] AGO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:05:58.308395] [DEBUG] [LOCAL ] AGO: Loaded 27300 existing records from primary storage. [2025-10-28T17:05:58.308638] [INFO ] [MAIN ] AGO: Loaded 27300 existing records. [2025-10-28T17:05:58.370236] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-02. [2025-10-28T17:05:58.484344] [WARN ] [MAIN ] AGO: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:05:58.484539] [INFO ] [MAIN ] AGO: Wiping existing primary data before full refresh. [2025-10-28T17:05:58.484585] [INFO ] [LOCAL ] AGO: Starting deletion of primary data. [2025-10-28T17:05:58.485021] [DEBUG] [LOCAL ] AGO: Deleted primary data file. [2025-10-28T17:05:58.485079] [INFO ] [MAIN ] AGO: Starting full primary refresh. [2025-10-28T17:05:58.836898] [INFO ] [REMOTE ] AGO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:05:58.869579] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-28T17:05:58.955470] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-28T17:05:59.159328] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-01. [2025-10-28T17:05:59.959370] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-08. [2025-10-28T17:06:00.088770] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-28T17:06:00.759343] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-03. [2025-10-28T17:06:01.173147] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-10-28T17:06:01.559366] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-04. [2025-10-28T17:06:02.167755] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-28T17:06:02.359314] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-05. [2025-10-28T17:06:02.844226] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-28T17:06:03.159318] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-02. [2025-10-28T17:06:03.921416] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-28T17:06:03.959304] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-03. [2025-10-28T17:06:04.289006] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-08 (4.33 seconds). [2025-10-28T17:06:04.759330] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-09. [2025-10-28T17:06:04.831610] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-28T17:06:05.559357] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-06. [2025-10-28T17:06:06.184339] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-28T17:06:06.359354] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-06. [2025-10-28T17:06:06.547117] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-28T17:06:07.159351] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-10. [2025-10-28T17:06:07.888712] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-28T17:06:07.959359] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-07. [2025-10-28T17:06:08.759331] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-07. [2025-10-28T17:06:09.022961] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-28T17:06:09.034091] [INFO ] [REMOTE ] AGI: Full fetch complete (77358 records). [2025-10-28T17:06:09.034220] [DEBUG] [VALIDATOR ] AGI: Validating primary data. [2025-10-28T17:06:09.472199] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-28T17:06:09.504055] [DEBUG] [VALIDATOR ] AGI: All expected trading days are present. [2025-10-28T17:06:09.504824] [DEBUG] [VALIDATOR ] AGI: Primary data validation passed. [2025-10-28T17:06:09.506563] [INFO ] [MAIN ] AGI: Fetched primary data is valid. [2025-10-28T17:06:09.506961] [DEBUG] [LOCAL ] AGI: Saving primary data. [2025-10-28T17:06:09.516832] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-28T17:06:09.521139] [DEBUG] [LOCAL ] AGI: Trimmed 77358 records to 53421 (keeping 200 days of data) [2025-10-28T17:06:09.574691] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-08. [2025-10-28T17:06:09.840987] [DEBUG] [LOCAL ] AGI: Primary data saved (53421 records). [2025-10-28T17:06:09.841130] [INFO ] [MAIN ] AGI: Full history saved. [2025-10-28T17:06:09.841678] [INFO ] [MAIN ] Update Progress: 54/2366 symbols completed. AGI took 31.8s. Estimated remaining: 4h 21m 46s. Rate: 8.8 symbols/min [2025-10-28T17:06:10.064173] [INFO ] [MAIN ] AGRO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:06:10.096974] [DEBUG] [LOCAL ] AGRO: Loaded 32070 existing records from primary storage. [2025-10-28T17:06:10.097389] [INFO ] [MAIN ] AGRO: Loaded 32070 existing records. [2025-10-28T17:06:10.299970] [WARN ] [MAIN ] AGRO: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:06:10.301165] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-28T17:06:10.301372] [INFO ] [MAIN ] AGRO: Wiping existing primary data before full refresh. [2025-10-28T17:06:10.304037] [INFO ] [LOCAL ] AGRO: Starting deletion of primary data. [2025-10-28T17:06:10.305088] [DEBUG] [LOCAL ] AGRO: Deleted primary data file. [2025-10-28T17:06:10.305152] [INFO ] [MAIN ] AGRO: Starting full primary refresh. [2025-10-28T17:06:10.365709] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-04. [2025-10-28T17:06:10.659441] [INFO ] [REMOTE ] AGRO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:06:11.159348] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-01. [2025-10-28T17:06:11.528186] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-28T17:06:11.959341] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-05. [2025-10-28T17:06:12.198793] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-28T17:06:12.759344] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-02. [2025-10-28T17:06:12.863854] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-28T17:06:13.559347] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-08. [2025-10-28T17:06:13.839173] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-28T17:06:14.359345] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-03. [2025-10-28T17:06:15.121046] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-28T17:06:15.159301] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-09. [2025-10-28T17:06:15.348607] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-28T17:06:15.959332] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-04. [2025-10-28T17:06:16.398035] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-28T17:06:16.759346] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-06. [2025-10-28T17:06:17.028940] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-28T17:06:17.506798] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-28T17:06:17.559347] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-07. [2025-10-28T17:06:18.359353] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-10. [2025-10-28T17:06:18.464833] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-28T17:06:19.159325] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-09. [2025-10-28T17:06:19.964460] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-08. [2025-10-28T17:06:19.990704] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-28T17:06:19.995240] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-28T17:06:20.005036] [INFO ] [REMOTE ] AGL: Full fetch complete (76000 records). [2025-10-28T17:06:20.005183] [DEBUG] [VALIDATOR ] AGL: Validating primary data. [2025-10-28T17:06:20.402689] [DEBUG] [VALIDATOR ] AGL: All expected trading days are present. [2025-10-28T17:06:20.402785] [DEBUG] [VALIDATOR ] AGL: Primary data validation passed. [2025-10-28T17:06:20.403476] [INFO ] [MAIN ] AGL: Fetched primary data is valid. [2025-10-28T17:06:20.403518] [DEBUG] [LOCAL ] AGL: Saving primary data. [2025-10-28T17:06:20.404895] [DEBUG] [LOCAL ] AGL: Trimmed 76000 records to 52573 (keeping 200 days of data) [2025-10-28T17:06:20.700699] [DEBUG] [LOCAL ] AGL: Primary data saved (52573 records). [2025-10-28T17:06:20.700841] [INFO ] [MAIN ] AGL: Full history saved. [2025-10-28T17:06:20.700939] [INFO ] [MAIN ] Update Progress: 55/2366 symbols completed. AGL took 33.8s. Estimated remaining: 4h 24m 31s. Rate: 8.7 symbols/min [2025-10-28T17:06:20.769689] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-05. [2025-10-28T17:06:20.890451] [INFO ] [MAIN ] AGX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:06:20.890745] [DEBUG] [LOCAL ] AGX: No existing data file found in primary storage. [2025-10-28T17:06:20.890929] [WARN ] [MAIN ] AGX: No existing data found, performing full refresh instead. [2025-10-28T17:06:20.891110] [INFO ] [MAIN ] AGX: Wiping existing primary data before full refresh. [2025-10-28T17:06:20.891238] [INFO ] [LOCAL ] AGX: Starting deletion of primary data. [2025-10-28T17:06:20.891376] [DEBUG] [LOCAL ] AGX: No primary data file found to delete. [2025-10-28T17:06:20.891445] [INFO ] [MAIN ] AGX: Starting full primary refresh. [2025-10-28T17:06:20.994623] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-28T17:06:21.300381] [INFO ] [REMOTE ] AGX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:06:21.559337] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-10. [2025-10-28T17:06:21.755990] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-28T17:06:22.359361] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-06. [2025-10-28T17:06:22.380398] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-28T17:06:22.382960] [INFO ] [REMOTE ] AGM: Full fetch complete (13256 records). [2025-10-28T17:06:22.383038] [DEBUG] [VALIDATOR ] AGM: Validating primary data. [2025-10-28T17:06:22.756546] [DEBUG] [VALIDATOR ] AGM: All expected trading days are present. [2025-10-28T17:06:22.756677] [DEBUG] [VALIDATOR ] AGM: Primary data validation passed. [2025-10-28T17:06:22.757079] [INFO ] [MAIN ] AGM: Fetched primary data is valid. [2025-10-28T17:06:22.757129] [DEBUG] [LOCAL ] AGM: Saving primary data. [2025-10-28T17:06:22.758201] [DEBUG] [LOCAL ] AGM: Trimmed 13256 records to 10454 (keeping 200 days of data) [2025-10-28T17:06:22.825463] [DEBUG] [LOCAL ] AGM: Primary data saved (10454 records). [2025-10-28T17:06:22.825620] [INFO ] [MAIN ] AGM: Full history saved. [2025-10-28T17:06:22.825748] [INFO ] [MAIN ] Update Progress: 56/2366 symbols completed. AGM took 29.7s. Estimated remaining: 4h 21m 8s. Rate: 8.8 symbols/min [2025-10-28T17:06:22.995371] [INFO ] [MAIN ] AHH: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:06:23.036162] [DEBUG] [LOCAL ] AHH: Loaded 39774 existing records from primary storage. [2025-10-28T17:06:23.036439] [INFO ] [MAIN ] AHH: Loaded 39774 existing records. [2025-10-28T17:06:23.164463] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-01. [2025-10-28T17:06:23.216634] [WARN ] [MAIN ] AHH: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:06:23.216911] [INFO ] [MAIN ] AHH: Wiping existing primary data before full refresh. [2025-10-28T17:06:23.216962] [INFO ] [LOCAL ] AHH: Starting deletion of primary data. [2025-10-28T17:06:23.217576] [DEBUG] [LOCAL ] AHH: Deleted primary data file. [2025-10-28T17:06:23.217635] [INFO ] [MAIN ] AHH: Starting full primary refresh. [2025-10-28T17:06:23.539523] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-28T17:06:23.650810] [INFO ] [REMOTE ] AHH: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:06:23.959332] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-01. [2025-10-28T17:06:24.759382] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-07. [2025-10-28T17:06:24.943598] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-28T17:06:25.321534] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-28T17:06:25.559309] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-02. [2025-10-28T17:06:25.666636] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-28T17:06:26.359357] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-09. [2025-10-28T17:06:26.649444] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-28T17:06:27.159345] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-02. [2025-10-28T17:06:27.255313] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-28T17:06:27.959352] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-03. [2025-10-28T17:06:28.759323] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-08. [2025-10-28T17:06:28.911705] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-28T17:06:29.559308] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-10. [2025-10-28T17:06:29.718033] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-28T17:06:29.933394] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-02 (2.77 seconds). [2025-10-28T17:06:30.359371] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-04. [2025-10-28T17:06:30.775324] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-28T17:06:30.781134] [INFO ] [REMOTE ] AGO: Full fetch complete (39623 records). [2025-10-28T17:06:30.781221] [DEBUG] [VALIDATOR ] AGO: Validating primary data. [2025-10-28T17:06:31.157376] [DEBUG] [VALIDATOR ] AGO: All expected trading days are present. [2025-10-28T17:06:31.157454] [DEBUG] [VALIDATOR ] AGO: Primary data validation passed. [2025-10-28T17:06:31.157933] [INFO ] [MAIN ] AGO: Fetched primary data is valid. [2025-10-28T17:06:31.158007] [DEBUG] [LOCAL ] AGO: Saving primary data. [2025-10-28T17:06:31.158875] [DEBUG] [LOCAL ] AGO: Trimmed 39623 records to 27199 (keeping 200 days of data) [2025-10-28T17:06:31.159341] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-09. [2025-10-28T17:06:31.342294] [DEBUG] [LOCAL ] AGO: Primary data saved (27199 records). [2025-10-28T17:06:31.342520] [INFO ] [MAIN ] AGO: Full history saved. [2025-10-28T17:06:31.342618] [INFO ] [MAIN ] Update Progress: 57/2366 symbols completed. AGO took 33.2s. Estimated remaining: 4h 22m 11s. Rate: 8.8 symbols/min [2025-10-28T17:06:31.513816] [INFO ] [MAIN ] AHL: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:06:31.514009] [DEBUG] [LOCAL ] AHL: No existing data file found in primary storage. [2025-10-28T17:06:31.514075] [WARN ] [MAIN ] AHL: No existing data found, performing full refresh instead. [2025-10-28T17:06:31.514237] [INFO ] [MAIN ] AHL: Wiping existing primary data before full refresh. [2025-10-28T17:06:31.514282] [INFO ] [LOCAL ] AHL: Starting deletion of primary data. [2025-10-28T17:06:31.514334] [DEBUG] [LOCAL ] AHL: No primary data file found to delete. [2025-10-28T17:06:31.514365] [INFO ] [MAIN ] AHL: Starting full primary refresh. [2025-10-28T17:06:31.675444] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-28T17:06:31.889097] [INFO ] [REMOTE ] AHL: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:06:31.959292] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-01. [2025-10-28T17:06:32.142375] [DEBUG] [REMOTE ] AHL: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-28T17:06:32.142627] [WARN ] [REMOTE ] AHL: No data returned for month 2025-01 [2025-10-28T17:06:32.142746] [FATAL] [REMOTE ] AHL: API call failed - aborting fetch to avoid wasting further API calls [2025-10-28T17:06:32.142796] [FATAL] [MAIN ] AHL: Failed to fetch primary data. [2025-10-28T17:06:32.142830] [WARN ] [MAIN ] AHL: Deleting existing primary and derivative data due to fetch failure. [2025-10-28T17:06:32.142893] [INFO ] [LOCAL ] AHL: Starting deletion of primary data. [2025-10-28T17:06:32.142954] [DEBUG] [LOCAL ] AHL: No primary data file found to delete. [2025-10-28T17:06:32.142990] [INFO ] [LOCAL ] AHL: Starting deletion of derivative data. [2025-10-28T17:06:32.143053] [DEBUG] [LOCAL ] AHL: No derivative data file found to delete. [2025-10-28T17:06:32.143099] [INFO ] [MAIN ] Update Progress: 58/2366 symbols completed. AHL took 0.8s. Estimated remaining: 4h 18m 5s. Rate: 8.9 symbols/min [2025-10-28T17:06:32.310348] [INFO ] [MAIN ] AHR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:06:32.310480] [DEBUG] [LOCAL ] AHR: No existing data file found in primary storage. [2025-10-28T17:06:32.310516] [WARN ] [MAIN ] AHR: No existing data found, performing full refresh instead. [2025-10-28T17:06:32.310618] [INFO ] [MAIN ] AHR: Wiping existing primary data before full refresh. [2025-10-28T17:06:32.310692] [INFO ] [LOCAL ] AHR: Starting deletion of primary data. [2025-10-28T17:06:32.310753] [DEBUG] [LOCAL ] AHR: No primary data file found to delete. [2025-10-28T17:06:32.310786] [INFO ] [MAIN ] AHR: Starting full primary refresh. [2025-10-28T17:06:32.568003] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-28T17:06:32.690241] [INFO ] [REMOTE ] AHR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:06:32.759314] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-05. [2025-10-28T17:06:33.559415] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-10. [2025-10-28T17:06:33.709598] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-28T17:06:34.359350] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-06. [2025-10-28T17:06:34.575683] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-28T17:06:34.581942] [INFO ] [REMOTE ] AGRO: Full fetch complete (48616 records). [2025-10-28T17:06:34.582059] [DEBUG] [VALIDATOR ] AGRO: Validating primary data. [2025-10-28T17:06:34.956588] [DEBUG] [VALIDATOR ] AGRO: All expected trading days are present. [2025-10-28T17:06:34.956689] [DEBUG] [VALIDATOR ] AGRO: Primary data validation passed. [2025-10-28T17:06:34.957221] [INFO ] [MAIN ] AGRO: Fetched primary data is valid. [2025-10-28T17:06:34.957295] [DEBUG] [LOCAL ] AGRO: Saving primary data. [2025-10-28T17:06:34.958278] [DEBUG] [LOCAL ] AGRO: Trimmed 48616 records to 32033 (keeping 200 days of data) [2025-10-28T17:06:35.134306] [DEBUG] [LOCAL ] AGRO: Primary data saved (32033 records). [2025-10-28T17:06:35.134441] [INFO ] [MAIN ] AGRO: Full history saved. [2025-10-28T17:06:35.134522] [INFO ] [MAIN ] Update Progress: 59/2366 symbols completed. AGRO took 25.3s. Estimated remaining: 4h 15m 33s. Rate: 9.0 symbols/min [2025-10-28T17:06:35.167858] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-01. [2025-10-28T17:06:35.305676] [INFO ] [MAIN ] AHT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:06:35.314409] [DEBUG] [LOCAL ] AHT: Loaded 6347 existing records from primary storage. [2025-10-28T17:06:35.314615] [INFO ] [MAIN ] AHT: Loaded 6347 existing records. [2025-10-28T17:06:35.487258] [WARN ] [MAIN ] AHT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:06:35.487480] [INFO ] [MAIN ] AHT: Wiping existing primary data before full refresh. [2025-10-28T17:06:35.487529] [INFO ] [LOCAL ] AHT: Starting deletion of primary data. [2025-10-28T17:06:35.487799] [DEBUG] [LOCAL ] AHT: Deleted primary data file. [2025-10-28T17:06:35.487861] [INFO ] [MAIN ] AHT: Starting full primary refresh. [2025-10-28T17:06:35.840206] [INFO ] [REMOTE ] AHT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:06:35.893172] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-28T17:06:35.959319] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-07. [2025-10-28T17:06:36.404007] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-28T17:06:36.759351] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-02. [2025-10-28T17:06:37.027763] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-28T17:06:37.559343] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-08. [2025-10-28T17:06:37.807223] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-28T17:06:38.359331] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-03. [2025-10-28T17:06:38.567558] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-28T17:06:39.159344] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-09. [2025-10-28T17:06:39.491350] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-28T17:06:39.959405] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-01. [2025-10-28T17:06:40.457797] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-10-28T17:06:40.696467] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-28T17:06:40.759370] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-02. [2025-10-28T17:06:41.366202] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-28T17:06:41.559539] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-03. [2025-10-28T17:06:42.047518] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-28T17:06:42.359365] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-03. [2025-10-28T17:06:43.159344] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-04. [2025-10-28T17:06:43.934481] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-28T17:06:43.959297] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-04. [2025-10-28T17:06:44.341888] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-28T17:06:44.759355] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-05. [2025-10-28T17:06:45.038347] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-28T17:06:45.559389] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-05. [2025-10-28T17:06:45.952587] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-28T17:06:46.359354] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-06. [2025-10-28T17:06:46.806452] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-28T17:06:47.159405] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-10. [2025-10-28T17:06:47.675424] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-28T17:06:47.959397] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-07. [2025-10-28T17:06:48.193719] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-28T17:06:48.199562] [INFO ] [REMOTE ] AGX: Full fetch complete (48559 records). [2025-10-28T17:06:48.199721] [DEBUG] [VALIDATOR ] AGX: Validating primary data. [2025-10-28T17:06:48.591294] [DEBUG] [VALIDATOR ] AGX: All expected trading days are present. [2025-10-28T17:06:48.591389] [DEBUG] [VALIDATOR ] AGX: Primary data validation passed. [2025-10-28T17:06:48.591930] [INFO ] [MAIN ] AGX: Fetched primary data is valid. [2025-10-28T17:06:48.591994] [DEBUG] [LOCAL ] AGX: Saving primary data. [2025-10-28T17:06:48.593005] [DEBUG] [LOCAL ] AGX: Trimmed 48559 records to 32137 (keeping 200 days of data) [2025-10-28T17:06:48.768613] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-06. [2025-10-28T17:06:48.795207] [DEBUG] [LOCAL ] AGX: Primary data saved (32137 records). [2025-10-28T17:06:48.795390] [INFO ] [MAIN ] AGX: Full history saved. [2025-10-28T17:06:48.795476] [INFO ] [MAIN ] Update Progress: 60/2366 symbols completed. AGX took 28.1s. Estimated remaining: 4h 19m 56s. Rate: 8.9 symbols/min [2025-10-28T17:06:48.965324] [INFO ] [MAIN ] AI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:06:49.014791] [DEBUG] [LOCAL ] AI: Loaded 53764 existing records from primary storage. [2025-10-28T17:06:49.015148] [INFO ] [MAIN ] AI: Loaded 53764 existing records. [2025-10-28T17:06:49.202345] [WARN ] [MAIN ] AI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:06:49.202686] [INFO ] [MAIN ] AI: Wiping existing primary data before full refresh. [2025-10-28T17:06:49.202761] [INFO ] [LOCAL ] AI: Starting deletion of primary data. [2025-10-28T17:06:49.203660] [DEBUG] [LOCAL ] AI: Deleted primary data file. [2025-10-28T17:06:49.203723] [INFO ] [MAIN ] AI: Starting full primary refresh. [2025-10-28T17:06:49.333940] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-28T17:06:49.564518] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-04. [2025-10-28T17:06:49.603495] [INFO ] [REMOTE ] AI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:06:50.034242] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-28T17:06:50.043247] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-28T17:06:50.359347] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-05. [2025-10-28T17:06:50.845275] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-28T17:06:51.159428] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-07. [2025-10-28T17:06:51.959387] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-06. [2025-10-28T17:06:52.759395] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-08. [2025-10-28T17:06:52.790088] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-28T17:06:52.819472] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-28T17:06:53.559363] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-07. [2025-10-28T17:06:53.876772] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-28T17:06:53.998074] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-28T17:06:54.359364] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-08. [2025-10-28T17:06:54.889859] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-28T17:06:55.159336] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-09. [2025-10-28T17:06:55.627801] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-28T17:06:55.959394] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-08. [2025-10-28T17:06:56.759390] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-01. [2025-10-28T17:06:56.942629] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-28T17:06:57.559358] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-09. [2025-10-28T17:06:58.359349] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-09. [2025-10-28T17:06:58.737557] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-28T17:06:58.800350] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-28T17:06:59.159352] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-02. [2025-10-28T17:06:59.696010] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-28T17:06:59.959366] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-10. [2025-10-28T17:07:00.693321] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-28T17:07:00.695288] [INFO ] [REMOTE ] AHT: Full fetch complete (9057 records). [2025-10-28T17:07:00.695356] [DEBUG] [VALIDATOR ] AHT: Validating primary data. [2025-10-28T17:07:00.764559] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-10. [2025-10-28T17:07:01.062179] [DEBUG] [VALIDATOR ] AHT: All expected trading days are present. [2025-10-28T17:07:01.062328] [DEBUG] [VALIDATOR ] AHT: Primary data validation passed. [2025-10-28T17:07:01.062573] [INFO ] [MAIN ] AHT: Fetched primary data is valid. [2025-10-28T17:07:01.062615] [DEBUG] [LOCAL ] AHT: Saving primary data. [2025-10-28T17:07:01.063076] [DEBUG] [LOCAL ] AHT: Trimmed 9057 records to 6372 (keeping 200 days of data) [2025-10-28T17:07:01.098527] [DEBUG] [LOCAL ] AHT: Primary data saved (6372 records). [2025-10-28T17:07:01.098687] [INFO ] [MAIN ] AHT: Full history saved. [2025-10-28T17:07:01.098787] [INFO ] [MAIN ] Update Progress: 61/2366 symbols completed. AHT took 26.0s. Estimated remaining: 4h 23m 19s. Rate: 8.8 symbols/min [2025-10-28T17:07:01.273375] [INFO ] [MAIN ] AIG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:07:01.319801] [DEBUG] [LOCAL ] AIG: Loaded 53450 existing records from primary storage. [2025-10-28T17:07:01.320123] [INFO ] [MAIN ] AIG: Loaded 53450 existing records. [2025-10-28T17:07:01.503406] [WARN ] [MAIN ] AIG: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:07:01.503832] [INFO ] [MAIN ] AIG: Wiping existing primary data before full refresh. [2025-10-28T17:07:01.503996] [INFO ] [LOCAL ] AIG: Starting deletion of primary data. [2025-10-28T17:07:01.513576] [DEBUG] [LOCAL ] AIG: Deleted primary data file. [2025-10-28T17:07:01.518778] [INFO ] [MAIN ] AIG: Starting full primary refresh. [2025-10-28T17:07:01.568535] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-10. [2025-10-28T17:07:01.610713] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-02 (2.45 seconds). [2025-10-28T17:07:01.935033] [INFO ] [REMOTE ] AIG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:07:01.956432] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-28T17:07:01.964161] [INFO ] [REMOTE ] AHH: Full fetch complete (59322 records). [2025-10-28T17:07:01.964303] [DEBUG] [VALIDATOR ] AHH: Validating primary data. [2025-10-28T17:07:02.346997] [DEBUG] [VALIDATOR ] AHH: All expected trading days are present. [2025-10-28T17:07:02.347100] [DEBUG] [VALIDATOR ] AHH: Primary data validation passed. [2025-10-28T17:07:02.347790] [INFO ] [MAIN ] AHH: Fetched primary data is valid. [2025-10-28T17:07:02.347852] [DEBUG] [LOCAL ] AHH: Saving primary data. [2025-10-28T17:07:02.349080] [DEBUG] [LOCAL ] AHH: Trimmed 59322 records to 39694 (keeping 200 days of data) [2025-10-28T17:07:02.397861] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-03. [2025-10-28T17:07:02.575462] [DEBUG] [LOCAL ] AHH: Primary data saved (39694 records). [2025-10-28T17:07:02.575623] [INFO ] [MAIN ] AHH: Full history saved. [2025-10-28T17:07:02.576513] [INFO ] [MAIN ] Update Progress: 62/2366 symbols completed. AHH took 39.8s. Estimated remaining: 4h 19m 52s. Rate: 8.9 symbols/min [2025-10-28T17:07:02.764510] [INFO ] [MAIN ] AII: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:07:02.764790] [DEBUG] [LOCAL ] AII: No existing data file found in primary storage. [2025-10-28T17:07:02.764841] [WARN ] [MAIN ] AII: No existing data found, performing full refresh instead. [2025-10-28T17:07:02.764948] [INFO ] [MAIN ] AII: Wiping existing primary data before full refresh. [2025-10-28T17:07:02.764989] [INFO ] [LOCAL ] AII: Starting deletion of primary data. [2025-10-28T17:07:02.765030] [DEBUG] [LOCAL ] AII: No primary data file found to delete. [2025-10-28T17:07:02.765063] [INFO ] [MAIN ] AII: Starting full primary refresh. [2025-10-28T17:07:03.157422] [INFO ] [REMOTE ] AII: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:07:03.166874] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-01. [2025-10-28T17:07:03.174124] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-28T17:07:03.185721] [INFO ] [REMOTE ] AHR: Full fetch complete (70469 records). [2025-10-28T17:07:03.185960] [DEBUG] [VALIDATOR ] AHR: Validating primary data. [2025-10-28T17:07:03.186943] [FATAL] [VALIDATOR ] AHR: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T17:07:03.187034] [FATAL] [MAIN ] AHR: Fetched primary data is invalid. Refusing to save it. [2025-10-28T17:07:03.187079] [WARN ] [MAIN ] AHR: Deleting existing primary and derivative data due to validation failure. [2025-10-28T17:07:03.187123] [INFO ] [LOCAL ] AHR: Starting deletion of primary data. [2025-10-28T17:07:03.187190] [DEBUG] [LOCAL ] AHR: No primary data file found to delete. [2025-10-28T17:07:03.187228] [INFO ] [LOCAL ] AHR: Starting deletion of derivative data. [2025-10-28T17:07:03.187323] [DEBUG] [LOCAL ] AHR: No derivative data file found to delete. [2025-10-28T17:07:03.187433] [INFO ] [MAIN ] Update Progress: 63/2366 symbols completed. AHR took 31.0s. Estimated remaining: 4h 16m 0s. Rate: 9.0 symbols/min [2025-10-28T17:07:03.376783] [INFO ] [MAIN ] AIN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:07:03.400940] [DEBUG] [LOCAL ] AIN: Loaded 24135 existing records from primary storage. [2025-10-28T17:07:03.401264] [INFO ] [MAIN ] AIN: Loaded 24135 existing records. [2025-10-28T17:07:03.651824] [WARN ] [MAIN ] AIN: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:07:03.652116] [INFO ] [MAIN ] AIN: Wiping existing primary data before full refresh. [2025-10-28T17:07:03.652169] [INFO ] [LOCAL ] AIN: Starting deletion of primary data. [2025-10-28T17:07:03.652905] [DEBUG] [LOCAL ] AIN: Deleted primary data file. [2025-10-28T17:07:03.652967] [INFO ] [MAIN ] AIN: Starting full primary refresh. [2025-10-28T17:07:03.969088] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-01. [2025-10-28T17:07:04.093344] [INFO ] [REMOTE ] AIN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:07:04.232029] [DEBUG] [REMOTE ] AII: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-28T17:07:04.232359] [WARN ] [REMOTE ] AII: No data returned for month 2025-01 [2025-10-28T17:07:04.232455] [FATAL] [REMOTE ] AII: API call failed - aborting fetch to avoid wasting further API calls [2025-10-28T17:07:04.232504] [FATAL] [MAIN ] AII: Failed to fetch primary data. [2025-10-28T17:07:04.232565] [WARN ] [MAIN ] AII: Deleting existing primary and derivative data due to fetch failure. [2025-10-28T17:07:04.232638] [INFO ] [LOCAL ] AII: Starting deletion of primary data. [2025-10-28T17:07:04.232743] [DEBUG] [LOCAL ] AII: No primary data file found to delete. [2025-10-28T17:07:04.232784] [INFO ] [LOCAL ] AII: Starting deletion of derivative data. [2025-10-28T17:07:04.232824] [DEBUG] [LOCAL ] AII: No derivative data file found to delete. [2025-10-28T17:07:04.232873] [INFO ] [MAIN ] Update Progress: 64/2366 symbols completed. AII took 1.7s. Estimated remaining: 4h 12m 31s. Rate: 9.1 symbols/min [2025-10-28T17:07:04.412381] [INFO ] [MAIN ] AIO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:07:04.468018] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-10-28T17:07:04.488145] [DEBUG] [LOCAL ] AIO: Loaded 12787 existing records from primary storage. [2025-10-28T17:07:04.488508] [INFO ] [MAIN ] AIO: Loaded 12787 existing records. [2025-10-28T17:07:04.644728] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-28T17:07:04.721630] [WARN ] [MAIN ] AIO: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:07:04.721884] [INFO ] [MAIN ] AIO: Wiping existing primary data before full refresh. [2025-10-28T17:07:04.721934] [INFO ] [LOCAL ] AIO: Starting deletion of primary data. [2025-10-28T17:07:04.722256] [DEBUG] [LOCAL ] AIO: Deleted primary data file. [2025-10-28T17:07:04.722297] [INFO ] [MAIN ] AIO: Starting full primary refresh. [2025-10-28T17:07:04.764518] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-04. [2025-10-28T17:07:05.083941] [INFO ] [REMOTE ] AIO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:07:05.559347] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-01. [2025-10-28T17:07:06.338911] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-28T17:07:06.359313] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-02. [2025-10-28T17:07:06.580933] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-10-28T17:07:06.813831] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-28T17:07:07.159349] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-02. [2025-10-28T17:07:07.959351] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-03. [2025-10-28T17:07:08.549494] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-28T17:07:08.709874] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-28T17:07:08.759339] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-03. [2025-10-28T17:07:09.559348] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-04. [2025-10-28T17:07:10.154702] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-28T17:07:10.259791] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-28T17:07:10.359305] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-04. [2025-10-28T17:07:11.159356] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-05. [2025-10-28T17:07:11.667696] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-28T17:07:11.712459] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-28T17:07:11.959327] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-06. [2025-10-28T17:07:12.543602] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-28T17:07:12.759338] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-05. [2025-10-28T17:07:13.559339] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-01. [2025-10-28T17:07:14.033762] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-28T17:07:14.139790] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-28T17:07:14.359328] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-06. [2025-10-28T17:07:15.159392] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-05. [2025-10-28T17:07:15.656033] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-28T17:07:15.959342] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-07. [2025-10-28T17:07:16.570155] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-28T17:07:16.759338] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-02. [2025-10-28T17:07:16.857895] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-28T17:07:17.479575] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-28T17:07:17.559327] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-06. [2025-10-28T17:07:18.359326] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-08. [2025-10-28T17:07:18.960821] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-28T17:07:19.159380] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-07. [2025-10-28T17:07:19.657503] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-10-28T17:07:19.959346] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-03. [2025-10-28T17:07:20.498521] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-28T17:07:20.759344] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-09. [2025-10-28T17:07:21.101795] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-28T17:07:21.277512] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-28T17:07:21.559341] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-10. [2025-10-28T17:07:22.361930] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-07. [2025-10-28T17:07:22.362788] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-28T17:07:22.366926] [INFO ] [REMOTE ] AIO: Full fetch complete (20030 records). [2025-10-28T17:07:22.367019] [DEBUG] [VALIDATOR ] AIO: Validating primary data. [2025-10-28T17:07:22.733604] [DEBUG] [VALIDATOR ] AIO: All expected trading days are present. [2025-10-28T17:07:22.733706] [DEBUG] [VALIDATOR ] AIO: Primary data validation passed. [2025-10-28T17:07:22.734001] [INFO ] [MAIN ] AIO: Fetched primary data is valid. [2025-10-28T17:07:22.734060] [DEBUG] [LOCAL ] AIO: Saving primary data. [2025-10-28T17:07:22.734608] [DEBUG] [LOCAL ] AIO: Trimmed 20030 records to 12744 (keeping 200 days of data) [2025-10-28T17:07:22.809346] [DEBUG] [LOCAL ] AIO: Primary data saved (12744 records). [2025-10-28T17:07:22.809475] [INFO ] [MAIN ] AIO: Full history saved. [2025-10-28T17:07:22.809550] [INFO ] [MAIN ] Update Progress: 65/2366 symbols completed. AIO took 18.6s. Estimated remaining: 4h 19m 29s. Rate: 8.9 symbols/min [2025-10-28T17:07:22.984572] [INFO ] [MAIN ] AIR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:07:23.015203] [DEBUG] [LOCAL ] AIR: Loaded 28344 existing records from primary storage. [2025-10-28T17:07:23.015555] [INFO ] [MAIN ] AIR: Loaded 28344 existing records. [2025-10-28T17:07:23.164532] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-04. [2025-10-28T17:07:23.229843] [WARN ] [MAIN ] AIR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:07:23.230171] [INFO ] [MAIN ] AIR: Wiping existing primary data before full refresh. [2025-10-28T17:07:23.230226] [INFO ] [LOCAL ] AIR: Starting deletion of primary data. [2025-10-28T17:07:23.230830] [DEBUG] [LOCAL ] AIR: Deleted primary data file. [2025-10-28T17:07:23.230920] [INFO ] [MAIN ] AIR: Starting full primary refresh. [2025-10-28T17:07:23.630758] [INFO ] [REMOTE ] AIR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:07:23.959351] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-08. [2025-10-28T17:07:24.446884] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-28T17:07:24.572212] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-10-28T17:07:24.759400] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-05. [2025-10-28T17:07:25.535063] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-28T17:07:25.559303] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-06. [2025-10-28T17:07:25.692021] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-28T17:07:26.338397] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-28T17:07:26.359347] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-08. [2025-10-28T17:07:27.159322] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-07. [2025-10-28T17:07:27.832349] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-28T17:07:27.959381] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-01. [2025-10-28T17:07:28.434238] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-10-28T17:07:28.759303] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-09. [2025-10-28T17:07:28.785455] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-28T17:07:29.559413] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-02. [2025-10-28T17:07:30.330724] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-28T17:07:30.359293] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-03. [2025-10-28T17:07:30.605102] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-28T17:07:31.159421] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-08. [2025-10-28T17:07:31.491065] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-28T17:07:31.959349] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-10. [2025-10-28T17:07:32.067146] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-28T17:07:32.759376] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-09. [2025-10-28T17:07:33.559351] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-09. [2025-10-28T17:07:33.987605] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-10 (2.03 seconds). [2025-10-28T17:07:33.998882] [INFO ] [REMOTE ] AI: Full fetch complete (77915 records). [2025-10-28T17:07:33.999042] [DEBUG] [VALIDATOR ] AI: Validating primary data. [2025-10-28T17:07:34.361552] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-04. [2025-10-28T17:07:34.468684] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-28T17:07:34.477969] [DEBUG] [VALIDATOR ] AI: All expected trading days are present. [2025-10-28T17:07:34.479349] [DEBUG] [VALIDATOR ] AI: Primary data validation passed. [2025-10-28T17:07:34.481155] [INFO ] [MAIN ] AI: Fetched primary data is valid. [2025-10-28T17:07:34.481312] [DEBUG] [LOCAL ] AI: Saving primary data. [2025-10-28T17:07:34.537328] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-28T17:07:34.534073] [DEBUG] [LOCAL ] AI: Trimmed 77915 records to 53764 (keeping 200 days of data) [2025-10-28T17:07:34.983612] [DEBUG] [LOCAL ] AI: Primary data saved (53764 records). [2025-10-28T17:07:34.983815] [INFO ] [MAIN ] AI: Full history saved. [2025-10-28T17:07:34.983926] [INFO ] [MAIN ] Update Progress: 66/2366 symbols completed. AI took 46.2s. Estimated remaining: 4h 22m 31s. Rate: 8.8 symbols/min [2025-10-28T17:07:35.173758] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-10. [2025-10-28T17:07:35.212831] [INFO ] [MAIN ] AIT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:07:35.246597] [DEBUG] [LOCAL ] AIT: Loaded 26203 existing records from primary storage. [2025-10-28T17:07:35.246903] [INFO ] [MAIN ] AIT: Loaded 26203 existing records. [2025-10-28T17:07:35.430241] [WARN ] [MAIN ] AIT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:07:35.430507] [INFO ] [MAIN ] AIT: Wiping existing primary data before full refresh. [2025-10-28T17:07:35.430774] [INFO ] [LOCAL ] AIT: Starting deletion of primary data. [2025-10-28T17:07:35.431252] [DEBUG] [LOCAL ] AIT: Deleted primary data file. [2025-10-28T17:07:35.431356] [INFO ] [MAIN ] AIT: Starting full primary refresh. [2025-10-28T17:07:35.572533] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-28T17:07:35.822026] [INFO ] [REMOTE ] AIT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:07:35.858763] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-28T17:07:35.869890] [INFO ] [REMOTE ] AIG: Full fetch complete (77557 records). [2025-10-28T17:07:35.870067] [DEBUG] [VALIDATOR ] AIG: Validating primary data. [2025-10-28T17:07:35.964720] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-05. [2025-10-28T17:07:36.269397] [DEBUG] [VALIDATOR ] AIG: All expected trading days are present. [2025-10-28T17:07:36.269490] [DEBUG] [VALIDATOR ] AIG: Primary data validation passed. [2025-10-28T17:07:36.270248] [INFO ] [MAIN ] AIG: Fetched primary data is valid. [2025-10-28T17:07:36.270319] [DEBUG] [LOCAL ] AIG: Saving primary data. [2025-10-28T17:07:36.271839] [DEBUG] [LOCAL ] AIG: Trimmed 77557 records to 53447 (keeping 200 days of data) [2025-10-28T17:07:36.588812] [DEBUG] [LOCAL ] AIG: Primary data saved (53447 records). [2025-10-28T17:07:36.588945] [INFO ] [MAIN ] AIG: Full history saved. [2025-10-28T17:07:36.589025] [INFO ] [MAIN ] Update Progress: 67/2366 symbols completed. AIG took 35.5s. Estimated remaining: 4h 19m 24s. Rate: 8.9 symbols/min [2025-10-28T17:07:36.765292] [INFO ] [MAIN ] AIV: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:07:36.762415] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-01. [2025-10-28T17:07:36.782751] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-28T17:07:36.822227] [DEBUG] [LOCAL ] AIV: Loaded 41782 existing records from primary storage. [2025-10-28T17:07:36.822930] [INFO ] [MAIN ] AIV: Loaded 41782 existing records. [2025-10-28T17:07:37.018480] [WARN ] [MAIN ] AIV: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:07:37.018810] [INFO ] [MAIN ] AIV: Wiping existing primary data before full refresh. [2025-10-28T17:07:37.018881] [INFO ] [LOCAL ] AIV: Starting deletion of primary data. [2025-10-28T17:07:37.019626] [DEBUG] [LOCAL ] AIV: Deleted primary data file. [2025-10-28T17:07:37.019732] [INFO ] [MAIN ] AIV: Starting full primary refresh. [2025-10-28T17:07:37.418992] [INFO ] [REMOTE ] AIV: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:07:37.559399] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-06. [2025-10-28T17:07:37.783940] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-28T17:07:38.290914] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-28T17:07:38.359358] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-02. [2025-10-28T17:07:39.159298] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-01. [2025-10-28T17:07:39.247434] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-28T17:07:39.959377] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-03. [2025-10-28T17:07:40.205949] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-28T17:07:40.759313] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-07. [2025-10-28T17:07:40.821878] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-28T17:07:41.559359] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-10. [2025-10-28T17:07:41.925984] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-28T17:07:42.359339] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-02. [2025-10-28T17:07:42.568410] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-28T17:07:42.573428] [INFO ] [REMOTE ] AIN: Full fetch complete (33791 records). [2025-10-28T17:07:42.573536] [DEBUG] [VALIDATOR ] AIN: Validating primary data. [2025-10-28T17:07:42.951199] [DEBUG] [VALIDATOR ] AIN: All expected trading days are present. [2025-10-28T17:07:42.951284] [DEBUG] [VALIDATOR ] AIN: Primary data validation passed. [2025-10-28T17:07:42.951723] [INFO ] [MAIN ] AIN: Fetched primary data is valid. [2025-10-28T17:07:42.951801] [DEBUG] [LOCAL ] AIN: Saving primary data. [2025-10-28T17:07:42.952697] [DEBUG] [LOCAL ] AIN: Trimmed 33791 records to 24147 (keeping 200 days of data) [2025-10-28T17:07:43.095057] [DEBUG] [LOCAL ] AIN: Primary data saved (24147 records). [2025-10-28T17:07:43.095206] [INFO ] [MAIN ] AIN: Full history saved. [2025-10-28T17:07:43.095304] [INFO ] [MAIN ] Update Progress: 68/2366 symbols completed. AIN took 39.9s. Estimated remaining: 4h 19m 9s. Rate: 8.9 symbols/min [2025-10-28T17:07:43.165527] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-04. [2025-10-28T17:07:43.279101] [INFO ] [MAIN ] AIZ: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:07:43.308028] [DEBUG] [LOCAL ] AIZ: Loaded 28903 existing records from primary storage. [2025-10-28T17:07:43.308296] [INFO ] [MAIN ] AIZ: Loaded 28903 existing records. [2025-10-28T17:07:43.493280] [WARN ] [MAIN ] AIZ: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:07:43.493574] [INFO ] [MAIN ] AIZ: Wiping existing primary data before full refresh. [2025-10-28T17:07:43.493726] [INFO ] [LOCAL ] AIZ: Starting deletion of primary data. [2025-10-28T17:07:43.494283] [DEBUG] [LOCAL ] AIZ: Deleted primary data file. [2025-10-28T17:07:43.494351] [INFO ] [MAIN ] AIZ: Starting full primary refresh. [2025-10-28T17:07:43.587596] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-28T17:07:43.885277] [INFO ] [REMOTE ] AIZ: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:07:43.959336] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-03. [2025-10-28T17:07:44.227403] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-28T17:07:44.759337] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-08. [2025-10-28T17:07:44.988004] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-28T17:07:45.559328] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-01. [2025-10-28T17:07:45.659303] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-28T17:07:46.359387] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-09. [2025-10-28T17:07:46.635263] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-28T17:07:47.159320] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-04. [2025-10-28T17:07:47.418374] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-28T17:07:47.959389] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-10. [2025-10-28T17:07:48.224122] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-28T17:07:48.759359] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-05. [2025-10-28T17:07:49.028370] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-28T17:07:49.035268] [INFO ] [REMOTE ] AIR: Full fetch complete (40148 records). [2025-10-28T17:07:49.035364] [DEBUG] [VALIDATOR ] AIR: Validating primary data. [2025-10-28T17:07:49.416945] [DEBUG] [VALIDATOR ] AIR: All expected trading days are present. [2025-10-28T17:07:49.417026] [DEBUG] [VALIDATOR ] AIR: Primary data validation passed. [2025-10-28T17:07:49.417485] [INFO ] [MAIN ] AIR: Fetched primary data is valid. [2025-10-28T17:07:49.417548] [DEBUG] [LOCAL ] AIR: Saving primary data. [2025-10-28T17:07:49.418503] [DEBUG] [LOCAL ] AIR: Trimmed 40148 records to 28331 (keeping 200 days of data) [2025-10-28T17:07:49.568163] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-05. [2025-10-28T17:07:49.583484] [DEBUG] [LOCAL ] AIR: Primary data saved (28331 records). [2025-10-28T17:07:49.583703] [INFO ] [MAIN ] AIR: Full history saved. [2025-10-28T17:07:49.583810] [INFO ] [MAIN ] Update Progress: 69/2366 symbols completed. AIR took 26.8s. Estimated remaining: 4h 18m 53s. Rate: 8.9 symbols/min [2025-10-28T17:07:49.755897] [INFO ] [MAIN ] AIZN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:07:49.778567] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-28T17:07:49.780855] [DEBUG] [LOCAL ] AIZN: Loaded 3678 existing records from primary storage. [2025-10-28T17:07:49.788327] [INFO ] [MAIN ] AIZN: Loaded 3678 existing records. [2025-10-28T17:07:49.962934] [WARN ] [MAIN ] AIZN: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:07:49.963130] [INFO ] [MAIN ] AIZN: Wiping existing primary data before full refresh. [2025-10-28T17:07:49.963177] [INFO ] [LOCAL ] AIZN: Starting deletion of primary data. [2025-10-28T17:07:49.963328] [DEBUG] [LOCAL ] AIZN: Deleted primary data file. [2025-10-28T17:07:49.963368] [INFO ] [MAIN ] AIZN: Starting full primary refresh. [2025-10-28T17:07:50.319463] [INFO ] [REMOTE ] AIZN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:07:50.359308] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-01. [2025-10-28T17:07:50.775685] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-28T17:07:50.873929] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-28T17:07:51.159341] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-02. [2025-10-28T17:07:51.959319] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-06. [2025-10-28T17:07:52.195025] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-28T17:07:52.759345] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-02. [2025-10-28T17:07:52.912378] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-28T17:07:53.277368] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-28T17:07:53.559347] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-06. [2025-10-28T17:07:54.359330] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-03. [2025-10-28T17:07:54.686942] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-28T17:07:54.787935] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-28T17:07:55.159353] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-04. [2025-10-28T17:07:55.555201] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-10-28T17:07:55.959328] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-05. [2025-10-28T17:07:56.261544] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-05 (0.30 seconds). [2025-10-28T17:07:56.759367] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-07. [2025-10-28T17:07:57.559295] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-03. [2025-10-28T17:07:57.818622] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-28T17:07:58.359377] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-07. [2025-10-28T17:07:58.666997] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-28T17:07:59.159325] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-06. [2025-10-28T17:07:59.492074] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-28T17:07:59.514523] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-10-28T17:07:59.959348] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-04. [2025-10-28T17:08:00.759345] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-08. [2025-10-28T17:08:00.933460] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-28T17:08:01.559334] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-07. [2025-10-28T17:08:01.894835] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-28T17:08:02.002213] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-28T17:08:02.359351] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-05. [2025-10-28T17:08:03.159345] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-08. [2025-10-28T17:08:03.282963] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-28T17:08:03.513959] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-10-28T17:08:03.959355] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-09. [2025-10-28T17:08:04.759333] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-06. [2025-10-28T17:08:05.227177] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-28T17:08:05.559323] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-09. [2025-10-28T17:08:05.733071] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-28T17:08:05.957291] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-10-28T17:08:06.359338] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-10. [2025-10-28T17:08:07.159351] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-10. [2025-10-28T17:08:07.540531] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-28T17:08:07.549982] [INFO ] [REMOTE ] AIV: Full fetch complete (60330 records). [2025-10-28T17:08:07.550098] [DEBUG] [VALIDATOR ] AIV: Validating primary data. [2025-10-28T17:08:07.660188] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-28T17:08:07.677355] [INFO ] [REMOTE ] AIZN: Full fetch complete (5649 records). [2025-10-28T17:08:07.687697] [DEBUG] [VALIDATOR ] AIZN: Validating primary data. [2025-10-28T17:08:07.966399] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-07. [2025-10-28T17:08:08.347004] [DEBUG] [VALIDATOR ] AIV: All expected trading days are present. [2025-10-28T17:08:08.372006] [DEBUG] [VALIDATOR ] AIZN: All expected trading days are present. [2025-10-28T17:08:08.371687] [DEBUG] [VALIDATOR ] AIV: Primary data validation passed. [2025-10-28T17:08:08.372121] [DEBUG] [VALIDATOR ] AIZN: Primary data validation passed. [2025-10-28T17:08:08.372878] [INFO ] [MAIN ] AIV: Fetched primary data is valid. [2025-10-28T17:08:08.373016] [DEBUG] [LOCAL ] AIV: Saving primary data. [2025-10-28T17:08:08.373221] [INFO ] [MAIN ] AIZN: Fetched primary data is valid. [2025-10-28T17:08:08.373508] [DEBUG] [LOCAL ] AIZN: Saving primary data. [2025-10-28T17:08:08.374430] [DEBUG] [LOCAL ] AIZN: Trimmed 5649 records to 3629 (keeping 200 days of data) [2025-10-28T17:08:08.384301] [DEBUG] [LOCAL ] AIV: Trimmed 60330 records to 41743 (keeping 200 days of data) [2025-10-28T17:08:08.398685] [DEBUG] [LOCAL ] AIZN: Primary data saved (3629 records). [2025-10-28T17:08:08.399177] [INFO ] [MAIN ] AIZN: Full history saved. [2025-10-28T17:08:08.399331] [INFO ] [MAIN ] Update Progress: 70/2366 symbols completed. AIZN took 18.8s. Estimated remaining: 4h 25m 21s. Rate: 8.7 symbols/min [2025-10-28T17:08:08.768030] [INFO ] [MAIN ] AJG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:08:08.768098] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-08. [2025-10-28T17:08:08.857309] [DEBUG] [LOCAL ] AIV: Primary data saved (41743 records). [2025-10-28T17:08:08.857447] [INFO ] [MAIN ] AIV: Full history saved. [2025-10-28T17:08:08.857539] [INFO ] [MAIN ] Update Progress: 71/2366 symbols completed. AIV took 32.3s. Estimated remaining: 4h 21m 45s. Rate: 8.8 symbols/min [2025-10-28T17:08:08.984303] [DEBUG] [LOCAL ] AJG: Loaded 46202 existing records from primary storage. [2025-10-28T17:08:08.984876] [INFO ] [MAIN ] AJG: Loaded 46202 existing records. [2025-10-28T17:08:09.142824] [INFO ] [MAIN ] AKA: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:08:09.148475] [DEBUG] [LOCAL ] AKA: No existing data file found in primary storage. [2025-10-28T17:08:09.160856] [WARN ] [MAIN ] AKA: No existing data found, performing full refresh instead. [2025-10-28T17:08:09.172446] [INFO ] [MAIN ] AKA: Wiping existing primary data before full refresh. [2025-10-28T17:08:09.172565] [INFO ] [LOCAL ] AKA: Starting deletion of primary data. [2025-10-28T17:08:09.172731] [DEBUG] [LOCAL ] AKA: No primary data file found to delete. [2025-10-28T17:08:09.173203] [INFO ] [MAIN ] AKA: Starting full primary refresh. [2025-10-28T17:08:09.382045] [WARN ] [MAIN ] AJG: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:08:09.393675] [INFO ] [MAIN ] AJG: Wiping existing primary data before full refresh. [2025-10-28T17:08:09.399432] [INFO ] [LOCAL ] AJG: Starting deletion of primary data. [2025-10-28T17:08:09.406411] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-28T17:08:09.452624] [DEBUG] [LOCAL ] AJG: Deleted primary data file. [2025-10-28T17:08:09.453152] [INFO ] [MAIN ] AJG: Starting full primary refresh. [2025-10-28T17:08:09.563416] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-08. [2025-10-28T17:08:09.839329] [INFO ] [REMOTE ] AKA: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:08:10.011803] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-28T17:08:10.072526] [INFO ] [REMOTE ] AJG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:08:10.359335] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-09. [2025-10-28T17:08:10.802418] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-28T17:08:11.031129] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-28T17:08:11.159303] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-10. [2025-10-28T17:08:11.959340] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-01. [2025-10-28T17:08:12.229073] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-28T17:08:12.236260] [INFO ] [REMOTE ] AIT: Full fetch complete (38930 records). [2025-10-28T17:08:12.236356] [DEBUG] [VALIDATOR ] AIT: Validating primary data. [2025-10-28T17:08:12.351190] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-10-28T17:08:12.625977] [DEBUG] [VALIDATOR ] AIT: All expected trading days are present. [2025-10-28T17:08:12.626061] [DEBUG] [VALIDATOR ] AIT: Primary data validation passed. [2025-10-28T17:08:12.626492] [INFO ] [MAIN ] AIT: Fetched primary data is valid. [2025-10-28T17:08:12.626534] [DEBUG] [LOCAL ] AIT: Saving primary data. [2025-10-28T17:08:12.627526] [DEBUG] [LOCAL ] AIT: Trimmed 38930 records to 26110 (keeping 200 days of data) [2025-10-28T17:08:12.764056] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-09. [2025-10-28T17:08:12.790899] [DEBUG] [LOCAL ] AIT: Primary data saved (26110 records). [2025-10-28T17:08:12.791061] [INFO ] [MAIN ] AIT: Full history saved. [2025-10-28T17:08:12.791197] [INFO ] [MAIN ] Update Progress: 72/2366 symbols completed. AIT took 37.8s. Estimated remaining: 4h 20m 5s. Rate: 8.8 symbols/min [2025-10-28T17:08:12.958558] [INFO ] [MAIN ] AKR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:08:13.000419] [DEBUG] [LOCAL ] AKR: Loaded 45897 existing records from primary storage. [2025-10-28T17:08:13.000779] [INFO ] [MAIN ] AKR: Loaded 45897 existing records. [2025-10-28T17:08:13.175443] [WARN ] [MAIN ] AKR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:08:13.175693] [INFO ] [MAIN ] AKR: Wiping existing primary data before full refresh. [2025-10-28T17:08:13.175751] [INFO ] [LOCAL ] AKR: Starting deletion of primary data. [2025-10-28T17:08:13.176235] [DEBUG] [LOCAL ] AKR: Deleted primary data file. [2025-10-28T17:08:13.176277] [INFO ] [MAIN ] AKR: Starting full primary refresh. [2025-10-28T17:08:13.542461] [INFO ] [REMOTE ] AKR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:08:13.559340] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-01. [2025-10-28T17:08:13.619512] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-28T17:08:14.359335] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-10. [2025-10-28T17:08:14.909739] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-28T17:08:15.139198] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-28T17:08:15.144351] [INFO ] [REMOTE ] AIZ: Full fetch complete (42612 records). [2025-10-28T17:08:15.144470] [DEBUG] [VALIDATOR ] AIZ: Validating primary data. [2025-10-28T17:08:15.165412] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-02. [2025-10-28T17:08:15.535531] [DEBUG] [VALIDATOR ] AIZ: All expected trading days are present. [2025-10-28T17:08:15.535610] [DEBUG] [VALIDATOR ] AIZ: Primary data validation passed. [2025-10-28T17:08:15.536139] [INFO ] [MAIN ] AIZ: Fetched primary data is valid. [2025-10-28T17:08:15.536217] [DEBUG] [LOCAL ] AIZ: Saving primary data. [2025-10-28T17:08:15.537168] [DEBUG] [LOCAL ] AIZ: Trimmed 42612 records to 28784 (keeping 200 days of data) [2025-10-28T17:08:15.627630] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-28T17:08:15.716011] [DEBUG] [LOCAL ] AIZ: Primary data saved (28784 records). [2025-10-28T17:08:15.716137] [INFO ] [MAIN ] AIZ: Full history saved. [2025-10-28T17:08:15.716228] [INFO ] [MAIN ] Update Progress: 73/2366 symbols completed. AIZ took 32.6s. Estimated remaining: 4h 17m 57s. Rate: 8.9 symbols/min [2025-10-28T17:08:15.883682] [INFO ] [MAIN ] AL: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:08:15.929743] [DEBUG] [LOCAL ] AL: Loaded 44745 existing records from primary storage. [2025-10-28T17:08:15.930028] [INFO ] [MAIN ] AL: Loaded 44745 existing records. [2025-10-28T17:08:15.964507] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-02. [2025-10-28T17:08:16.121051] [WARN ] [MAIN ] AL: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:08:16.121269] [INFO ] [MAIN ] AL: Wiping existing primary data before full refresh. [2025-10-28T17:08:16.121318] [INFO ] [LOCAL ] AL: Starting deletion of primary data. [2025-10-28T17:08:16.121983] [DEBUG] [LOCAL ] AL: Deleted primary data file. [2025-10-28T17:08:16.122042] [INFO ] [MAIN ] AL: Starting full primary refresh. [2025-10-28T17:08:16.479382] [INFO ] [REMOTE ] AL: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:08:16.759332] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-01. [2025-10-28T17:08:17.362262] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-28T17:08:17.559346] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-03. [2025-10-28T17:08:17.861182] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-28T17:08:18.359342] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-01. [2025-10-28T17:08:18.592946] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-28T17:08:19.159331] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-04. [2025-10-28T17:08:19.959411] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-02. [2025-10-28T17:08:20.278289] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-28T17:08:20.355286] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-10-28T17:08:20.759344] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-03. [2025-10-28T17:08:20.899374] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-28T17:08:21.052500] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-03 (0.29 seconds). [2025-10-28T17:08:21.559320] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-03. [2025-10-28T17:08:22.359341] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-05. [2025-10-28T17:08:22.662366] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-28T17:08:23.159350] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-04. [2025-10-28T17:08:23.801936] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-28T17:08:23.959369] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-02. [2025-10-28T17:08:24.240068] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-28T17:08:24.759386] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-06. [2025-10-28T17:08:25.163602] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-28T17:08:25.559332] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-03. [2025-10-28T17:08:26.002800] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-28T17:08:26.359392] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-07. [2025-10-28T17:08:27.082520] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-28T17:08:27.159397] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-05. [2025-10-28T17:08:27.662891] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-28T17:08:27.959362] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-04. [2025-10-28T17:08:28.759331] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-04. [2025-10-28T17:08:28.862758] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-28T17:08:28.864291] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-28T17:08:29.559336] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-08. [2025-10-28T17:08:30.024795] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-28T17:08:30.359352] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-05. [2025-10-28T17:08:30.695165] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-10-28T17:08:30.877308] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-28T17:08:31.159358] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-06. [2025-10-28T17:08:31.551093] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-10-28T17:08:31.959342] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-06. [2025-10-28T17:08:32.759352] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-09. [2025-10-28T17:08:33.109912] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-28T17:08:33.559312] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-07. [2025-10-28T17:08:33.816905] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-07 (0.26 seconds). [2025-10-28T17:08:34.241293] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-28T17:08:34.359291] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-10. [2025-10-28T17:08:35.159332] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-05. [2025-10-28T17:08:35.652372] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-28T17:08:35.661864] [INFO ] [REMOTE ] AKR: Full fetch complete (65455 records). [2025-10-28T17:08:35.661972] [DEBUG] [VALIDATOR ] AKR: Validating primary data. [2025-10-28T17:08:35.963086] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-07. [2025-10-28T17:08:36.057674] [DEBUG] [VALIDATOR ] AKR: All expected trading days are present. [2025-10-28T17:08:36.057753] [DEBUG] [VALIDATOR ] AKR: Primary data validation passed. [2025-10-28T17:08:36.058370] [INFO ] [MAIN ] AKR: Fetched primary data is valid. [2025-10-28T17:08:36.058411] [DEBUG] [LOCAL ] AKR: Saving primary data. [2025-10-28T17:08:36.059551] [DEBUG] [LOCAL ] AKR: Trimmed 65455 records to 45895 (keeping 200 days of data) [2025-10-28T17:08:36.323764] [DEBUG] [LOCAL ] AKR: Primary data saved (45895 records). [2025-10-28T17:08:36.323873] [INFO ] [MAIN ] AKR: Full history saved. [2025-10-28T17:08:36.323944] [INFO ] [MAIN ] Update Progress: 74/2366 symbols completed. AKR took 23.5s. Estimated remaining: 4h 24m 59s. Rate: 8.6 symbols/min [2025-10-28T17:08:36.499988] [INFO ] [MAIN ] ALB: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:08:36.551335] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-28T17:08:36.577499] [DEBUG] [LOCAL ] ALB: Loaded 53362 existing records from primary storage. [2025-10-28T17:08:36.577859] [INFO ] [MAIN ] ALB: Loaded 53362 existing records. [2025-10-28T17:08:36.754273] [WARN ] [MAIN ] ALB: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:08:36.754523] [INFO ] [MAIN ] ALB: Wiping existing primary data before full refresh. [2025-10-28T17:08:36.754569] [INFO ] [LOCAL ] ALB: Starting deletion of primary data. [2025-10-28T17:08:36.755574] [DEBUG] [LOCAL ] ALB: Deleted primary data file. [2025-10-28T17:08:36.755634] [INFO ] [MAIN ] ALB: Starting full primary refresh. [2025-10-28T17:08:36.766869] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-08. [2025-10-28T17:08:37.116498] [INFO ] [REMOTE ] ALB: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:08:37.143596] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-28T17:08:37.186333] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-10-28T17:08:37.559391] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-06. [2025-10-28T17:08:38.359365] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-01. [2025-10-28T17:08:38.855846] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-28T17:08:39.159337] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-08. [2025-10-28T17:08:39.773571] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-28T17:08:39.959342] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-07. [2025-10-28T17:08:40.720494] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-28T17:08:40.759301] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-02. [2025-10-28T17:08:41.304472] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-28T17:08:41.559353] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-09. [2025-10-28T17:08:41.885462] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-10-28T17:08:42.359595] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-10. [2025-10-28T17:08:42.359527] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-28T17:08:42.886721] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-28T17:08:42.888256] [INFO ] [REMOTE ] AKA: Full fetch complete (2838 records). [2025-10-28T17:08:42.888328] [DEBUG] [VALIDATOR ] AKA: Validating primary data. [2025-10-28T17:08:43.066731] [WARN ] [VALIDATOR ] AKA: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-28T17:08:43.066936] [FATAL] [MAIN ] AKA: Fetched primary data is invalid. Refusing to save it. [2025-10-28T17:08:43.067005] [WARN ] [MAIN ] AKA: Deleting existing primary and derivative data due to validation failure. [2025-10-28T17:08:43.067095] [INFO ] [LOCAL ] AKA: Starting deletion of primary data. [2025-10-28T17:08:43.067168] [DEBUG] [LOCAL ] AKA: No primary data file found to delete. [2025-10-28T17:08:43.067207] [INFO ] [LOCAL ] AKA: Starting deletion of derivative data. [2025-10-28T17:08:43.067278] [DEBUG] [LOCAL ] AKA: No derivative data file found to delete. [2025-10-28T17:08:43.067353] [INFO ] [MAIN ] Update Progress: 75/2366 symbols completed. AKA took 34.2s. Estimated remaining: 4h 24m 46s. Rate: 8.7 symbols/min [2025-10-28T17:08:43.164484] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-03. [2025-10-28T17:08:43.253048] [INFO ] [MAIN ] ALC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:08:43.253220] [DEBUG] [LOCAL ] ALC: No existing data file found in primary storage. [2025-10-28T17:08:43.253258] [WARN ] [MAIN ] ALC: No existing data found, performing full refresh instead. [2025-10-28T17:08:43.253398] [INFO ] [MAIN ] ALC: Wiping existing primary data before full refresh. [2025-10-28T17:08:43.253464] [INFO ] [LOCAL ] ALC: Starting deletion of primary data. [2025-10-28T17:08:43.253519] [DEBUG] [LOCAL ] ALC: No primary data file found to delete. [2025-10-28T17:08:43.253553] [INFO ] [MAIN ] ALC: Starting full primary refresh. [2025-10-28T17:08:43.623783] [INFO ] [REMOTE ] ALC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:08:43.959349] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-01. [2025-10-28T17:08:44.602520] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-28T17:08:44.759317] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-04. [2025-10-28T17:08:45.368287] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-28T17:08:45.559351] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-02. [2025-10-28T17:08:46.359380] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-09. [2025-10-28T17:08:46.812089] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-28T17:08:46.828983] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-10-28T17:08:47.159341] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-03. [2025-10-28T17:08:47.601594] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-28T17:08:47.959388] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-05. [2025-10-28T17:08:48.543975] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-28T17:08:48.759385] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-04. [2025-10-28T17:08:49.468698] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-28T17:08:49.559322] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-08. [2025-10-28T17:08:50.115584] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-28T17:08:50.359345] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-05. [2025-10-28T17:08:50.751905] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-28T17:08:51.159341] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-10. [2025-10-28T17:08:51.770128] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-28T17:08:51.959388] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-09. [2025-10-28T17:08:52.560640] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-28T17:08:52.572339] [INFO ] [REMOTE ] AL: Full fetch complete (63852 records). [2025-10-28T17:08:52.572483] [DEBUG] [VALIDATOR ] AL: Validating primary data. [2025-10-28T17:08:52.764679] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-06. [2025-10-28T17:08:52.959043] [DEBUG] [VALIDATOR ] AL: All expected trading days are present. [2025-10-28T17:08:52.959115] [DEBUG] [VALIDATOR ] AL: Primary data validation passed. [2025-10-28T17:08:52.959741] [INFO ] [MAIN ] AL: Fetched primary data is valid. [2025-10-28T17:08:52.959802] [DEBUG] [LOCAL ] AL: Saving primary data. [2025-10-28T17:08:52.960974] [DEBUG] [LOCAL ] AL: Trimmed 63852 records to 44696 (keeping 200 days of data) [2025-10-28T17:08:53.226404] [DEBUG] [LOCAL ] AL: Primary data saved (44696 records). [2025-10-28T17:08:53.226541] [INFO ] [MAIN ] AL: Full history saved. [2025-10-28T17:08:53.227703] [INFO ] [MAIN ] Update Progress: 76/2366 symbols completed. AL took 37.5s. Estimated remaining: 4h 26m 17s. Rate: 8.6 symbols/min [2025-10-28T17:08:53.396761] [INFO ] [MAIN ] ALE: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:08:53.431475] [DEBUG] [LOCAL ] ALE: Loaded 31792 existing records from primary storage. [2025-10-28T17:08:53.431796] [INFO ] [MAIN ] ALE: Loaded 31792 existing records. [2025-10-28T17:08:53.578897] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-06. [2025-10-28T17:08:53.633624] [WARN ] [MAIN ] ALE: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:08:53.634849] [INFO ] [MAIN ] ALE: Wiping existing primary data before full refresh. [2025-10-28T17:08:53.635238] [INFO ] [LOCAL ] ALE: Starting deletion of primary data. [2025-10-28T17:08:53.636499] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-28T17:08:53.645382] [DEBUG] [LOCAL ] ALE: Deleted primary data file. [2025-10-28T17:08:53.645904] [INFO ] [MAIN ] ALE: Starting full primary refresh. [2025-10-28T17:08:53.998277] [INFO ] [REMOTE ] ALE: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:08:54.221782] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-28T17:08:54.359342] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-07. [2025-10-28T17:08:54.828227] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-28T17:08:55.159362] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-10. [2025-10-28T17:08:55.959359] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-07. [2025-10-28T17:08:56.543953] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-28T17:08:56.553415] [INFO ] [REMOTE ] AJG: Full fetch complete (68703 records). [2025-10-28T17:08:56.553556] [DEBUG] [VALIDATOR ] AJG: Validating primary data. [2025-10-28T17:08:56.783563] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-01. [2025-10-28T17:08:56.886664] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-07 (2.53 seconds). [2025-10-28T17:08:57.051511] [DEBUG] [VALIDATOR ] AJG: All expected trading days are present. [2025-10-28T17:08:57.052231] [DEBUG] [VALIDATOR ] AJG: Primary data validation passed. [2025-10-28T17:08:57.053008] [INFO ] [MAIN ] AJG: Fetched primary data is valid. [2025-10-28T17:08:57.053135] [DEBUG] [LOCAL ] AJG: Saving primary data. [2025-10-28T17:08:57.054714] [DEBUG] [LOCAL ] AJG: Trimmed 68703 records to 46201 (keeping 200 days of data) [2025-10-28T17:08:57.315828] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-28T17:08:57.384592] [DEBUG] [LOCAL ] AJG: Primary data saved (46201 records). [2025-10-28T17:08:57.384763] [INFO ] [MAIN ] AJG: Full history saved. [2025-10-28T17:08:57.385871] [INFO ] [MAIN ] Update Progress: 77/2366 symbols completed. AJG took 49.0s. Estimated remaining: 4h 24m 46s. Rate: 8.6 symbols/min [2025-10-28T17:08:57.559392] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-08. [2025-10-28T17:08:57.915155] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-28T17:08:58.359446] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-02. [2025-10-28T17:08:59.007733] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-28T17:08:59.036364] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-28T17:08:59.159331] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-09. [2025-10-28T17:08:59.959408] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-08. [2025-10-28T17:09:00.595546] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-28T17:09:00.759313] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-10. [2025-10-28T17:09:01.559312] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-03. [2025-10-28T17:09:01.699155] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-28T17:09:02.359369] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-09. [2025-10-28T17:09:02.401143] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-28T17:09:02.607387] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-28T17:09:02.618552] [INFO ] [REMOTE ] ALC: Full fetch complete (73587 records). [2025-10-28T17:09:02.618790] [DEBUG] [VALIDATOR ] ALC: Validating primary data. [2025-10-28T17:09:02.620143] [FATAL] [VALIDATOR ] ALC: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T17:09:02.620240] [FATAL] [MAIN ] ALC: Fetched primary data is invalid. Refusing to save it. [2025-10-28T17:09:02.620288] [WARN ] [MAIN ] ALC: Deleting existing primary and derivative data due to validation failure. [2025-10-28T17:09:02.620332] [INFO ] [LOCAL ] ALC: Starting deletion of primary data. [2025-10-28T17:09:02.620400] [DEBUG] [LOCAL ] ALC: No primary data file found to delete. [2025-10-28T17:09:02.620439] [INFO ] [LOCAL ] ALC: Starting deletion of derivative data. [2025-10-28T17:09:02.620546] [DEBUG] [LOCAL ] ALC: No derivative data file found to delete. [2025-10-28T17:09:02.620621] [INFO ] [MAIN ] Update Progress: 78/2366 symbols completed. ALC took 19.6s. Estimated remaining: 4h 23m 49s. Rate: 8.7 symbols/min [2025-10-28T17:09:03.159383] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-04. [2025-10-28T17:09:03.989407] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-28T17:09:04.001096] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-10. [2025-10-28T17:09:04.032998] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-28T17:09:04.759405] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-05. [2025-10-28T17:09:05.837545] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-28T17:09:05.843261] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-06. [2025-10-28T17:09:06.254561] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-10 (2.25 seconds). [2025-10-28T17:09:06.265189] [INFO ] [REMOTE ] ALB: Full fetch complete (77120 records). [2025-10-28T17:09:06.265346] [DEBUG] [VALIDATOR ] ALB: Validating primary data. [2025-10-28T17:09:06.671361] [DEBUG] [VALIDATOR ] ALB: All expected trading days are present. [2025-10-28T17:09:06.671518] [DEBUG] [VALIDATOR ] ALB: Primary data validation passed. [2025-10-28T17:09:06.672507] [INFO ] [MAIN ] ALB: Fetched primary data is valid. [2025-10-28T17:09:06.672607] [DEBUG] [LOCAL ] ALB: Saving primary data. [2025-10-28T17:09:06.688079] [DEBUG] [LOCAL ] ALB: Trimmed 77120 records to 53356 (keeping 200 days of data) [2025-10-28T17:09:06.688983] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-28T17:09:06.695533] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-07. [2025-10-28T17:09:07.028680] [DEBUG] [LOCAL ] ALB: Primary data saved (53356 records). [2025-10-28T17:09:07.028822] [INFO ] [MAIN ] ALB: Full history saved. [2025-10-28T17:09:07.028902] [INFO ] [MAIN ] Update Progress: 79/2366 symbols completed. ALB took 30.7s. Estimated remaining: 4h 22m 29s. Rate: 8.7 symbols/min [2025-10-28T17:09:07.890818] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-28T17:09:07.898333] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-08. [2025-10-28T17:09:09.052049] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-28T17:09:09.060135] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-09. [2025-10-28T17:09:10.257960] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-28T17:09:10.265760] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-10. [2025-10-28T17:09:11.596264] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-28T17:09:11.603549] [INFO ] [REMOTE ] ALE: Full fetch complete (44310 records). [2025-10-28T17:09:11.603634] [DEBUG] [VALIDATOR ] ALE: Validating primary data. [2025-10-28T17:09:11.973811] [DEBUG] [VALIDATOR ] ALE: All expected trading days are present. [2025-10-28T17:09:11.973879] [DEBUG] [VALIDATOR ] ALE: Primary data validation passed. [2025-10-28T17:09:11.974392] [INFO ] [MAIN ] ALE: Fetched primary data is valid. [2025-10-28T17:09:11.974452] [DEBUG] [LOCAL ] ALE: Saving primary data. [2025-10-28T17:09:11.975398] [DEBUG] [LOCAL ] ALE: Trimmed 44310 records to 31763 (keeping 200 days of data) [2025-10-28T17:09:12.158672] [DEBUG] [LOCAL ] ALE: Primary data saved (31763 records). [2025-10-28T17:09:12.158812] [INFO ] [MAIN ] ALE: Full history saved. [2025-10-28T17:09:12.159775] [INFO ] [MAIN ] Update Progress: 80/2366 symbols completed. ALE took 18.9s. Estimated remaining: 4h 21m 32s. Rate: 8.7 symbols/min [2025-10-28T17:09:12.750604] [INFO ] [MAIN ] ALH: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:09:12.802824] [DEBUG] [LOCAL ] ALH: No existing data file found in primary storage. [2025-10-28T17:09:12.862357] [INFO ] [MAIN ] ALEX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:09:12.835074] [WARN ] [MAIN ] ALH: No existing data found, performing full refresh instead. [2025-10-28T17:09:12.882496] [INFO ] [MAIN ] ALH: Wiping existing primary data before full refresh. [2025-10-28T17:09:12.882607] [INFO ] [LOCAL ] ALH: Starting deletion of primary data. [2025-10-28T17:09:12.882322] [INFO ] [MAIN ] ALIT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:09:12.883621] [DEBUG] [LOCAL ] ALH: No primary data file found to delete. [2025-10-28T17:09:12.885261] [INFO ] [MAIN ] ALG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:09:12.885481] [INFO ] [MAIN ] ALH: Starting full primary refresh. [2025-10-28T17:09:13.034458] [DEBUG] [LOCAL ] ALG: Loaded 9543 existing records from primary storage. [2025-10-28T17:09:13.053101] [INFO ] [MAIN ] ALG: Loaded 9543 existing records. [2025-10-28T17:09:13.295266] [DEBUG] [LOCAL ] ALEX: Loaded 30369 existing records from primary storage. [2025-10-28T17:09:13.295681] [INFO ] [MAIN ] ALEX: Loaded 30369 existing records. [2025-10-28T17:09:13.359359] [DEBUG] [LOCAL ] ALIT: Loaded 52760 existing records from primary storage. [2025-10-28T17:09:13.388941] [INFO ] [MAIN ] ALIT: Loaded 52760 existing records. [2025-10-28T17:09:13.724994] [WARN ] [MAIN ] ALG: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:09:13.777501] [INFO ] [MAIN ] ALG: Wiping existing primary data before full refresh. [2025-10-28T17:09:13.802770] [INFO ] [LOCAL ] ALG: Starting deletion of primary data. [2025-10-28T17:09:13.830235] [INFO ] [REMOTE ] ALH: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:09:13.841403] [DEBUG] [LOCAL ] ALG: Deleted primary data file. [2025-10-28T17:09:13.841772] [INFO ] [MAIN ] ALG: Starting full primary refresh. [2025-10-28T17:09:13.847794] [INFO ] [REMOTE ] ALH: Fetching primary data for 2025-01. [2025-10-28T17:09:14.149562] [DEBUG] [REMOTE ] ALH: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-28T17:09:14.205941] [WARN ] [MAIN ] ALIT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:09:14.212539] [WARN ] [MAIN ] ALEX: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:09:14.229801] [INFO ] [MAIN ] ALEX: Wiping existing primary data before full refresh. [2025-10-28T17:09:14.229870] [INFO ] [LOCAL ] ALEX: Starting deletion of primary data. [2025-10-28T17:09:14.229525] [WARN ] [REMOTE ] ALH: No data returned for month 2025-01 [2025-10-28T17:09:14.230035] [FATAL] [REMOTE ] ALH: API call failed - aborting fetch to avoid wasting further API calls [2025-10-28T17:09:14.230124] [FATAL] [MAIN ] ALH: Failed to fetch primary data. [2025-10-28T17:09:14.230307] [INFO ] [MAIN ] ALIT: Wiping existing primary data before full refresh. [2025-10-28T17:09:14.230512] [WARN ] [MAIN ] ALH: Deleting existing primary and derivative data due to fetch failure. [2025-10-28T17:09:14.247213] [INFO ] [LOCAL ] ALH: Starting deletion of primary data. [2025-10-28T17:09:14.247141] [INFO ] [LOCAL ] ALIT: Starting deletion of primary data. [2025-10-28T17:09:14.247040] [DEBUG] [LOCAL ] ALEX: Deleted primary data file. [2025-10-28T17:09:14.252830] [INFO ] [MAIN ] ALEX: Starting full primary refresh. [2025-10-28T17:09:14.261848] [DEBUG] [LOCAL ] ALH: No primary data file found to delete. [2025-10-28T17:09:14.277535] [DEBUG] [LOCAL ] ALIT: Deleted primary data file. [2025-10-28T17:09:14.290302] [INFO ] [LOCAL ] ALH: Starting deletion of derivative data. [2025-10-28T17:09:14.295826] [INFO ] [MAIN ] ALIT: Starting full primary refresh. [2025-10-28T17:09:14.381526] [DEBUG] [LOCAL ] ALH: No derivative data file found to delete. [2025-10-28T17:09:14.392236] [INFO ] [MAIN ] Update Progress: 81/2366 symbols completed. ALH took 2.2s. Estimated remaining: 4h 19m 15s. Rate: 8.8 symbols/min [2025-10-28T17:09:15.140314] [INFO ] [MAIN ] ALK: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:09:15.372200] [INFO ] [REMOTE ] ALG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:09:15.418585] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-01. [2025-10-28T17:09:15.469583] [INFO ] [REMOTE ] ALEX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:09:15.480758] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-01. [2025-10-28T17:09:15.563133] [INFO ] [REMOTE ] ALIT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:09:15.563478] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-01. [2025-10-28T17:09:15.581886] [DEBUG] [LOCAL ] ALK: Loaded 53087 existing records from primary storage. [2025-10-28T17:09:15.582184] [INFO ] [MAIN ] ALK: Loaded 53087 existing records. [2025-10-28T17:09:15.758525] [WARN ] [MAIN ] ALK: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:09:15.758745] [INFO ] [MAIN ] ALK: Wiping existing primary data before full refresh. [2025-10-28T17:09:15.758796] [INFO ] [LOCAL ] ALK: Starting deletion of primary data. [2025-10-28T17:09:15.759549] [DEBUG] [LOCAL ] ALK: Deleted primary data file. [2025-10-28T17:09:15.759607] [INFO ] [MAIN ] ALK: Starting full primary refresh. [2025-10-28T17:09:16.101793] [INFO ] [REMOTE ] ALK: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:09:16.102059] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-01. [2025-10-28T17:09:16.306126] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-28T17:09:16.309135] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-02. [2025-10-28T17:09:16.622335] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-28T17:09:16.628150] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-02. [2025-10-28T17:09:16.799020] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-28T17:09:16.801828] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-03. [2025-10-28T17:09:17.340530] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-28T17:09:17.351495] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-02. [2025-10-28T17:09:17.384855] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-28T17:09:17.391109] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-03. [2025-10-28T17:09:17.459128] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-28T17:09:17.559312] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-02. [2025-10-28T17:09:18.223853] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-28T17:09:18.359353] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-04. [2025-10-28T17:09:18.863984] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-28T17:09:18.996519] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-28T17:09:19.159324] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-04. [2025-10-28T17:09:19.629371] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-10-28T17:09:19.846440] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-28T17:09:19.959348] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-05. [2025-10-28T17:09:20.268800] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-28T17:09:20.512034] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-28T17:09:20.759341] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-03. [2025-10-28T17:09:21.559353] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-05. [2025-10-28T17:09:22.122414] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-28T17:09:22.347151] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-28T17:09:22.359296] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-06. [2025-10-28T17:09:23.159342] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-06. [2025-10-28T17:09:23.519821] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-28T17:09:23.672269] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-28T17:09:23.959354] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-07. [2025-10-28T17:09:24.759310] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-07. [2025-10-28T17:09:24.954528] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-28T17:09:25.218772] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-28T17:09:25.559374] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-08. [2025-10-28T17:09:26.074109] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-28T17:09:26.359332] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-09. [2025-10-28T17:09:26.939173] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-28T17:09:27.159341] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-04. [2025-10-28T17:09:27.959309] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-03. [2025-10-28T17:09:28.548554] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-28T17:09:28.759324] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-10. [2025-10-28T17:09:29.236161] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-28T17:09:29.317108] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-28T17:09:29.319197] [INFO ] [REMOTE ] ALG: Full fetch complete (15054 records). [2025-10-28T17:09:29.319271] [DEBUG] [VALIDATOR ] ALG: Validating primary data. [2025-10-28T17:09:29.565816] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-08. [2025-10-28T17:09:29.689691] [DEBUG] [VALIDATOR ] ALG: All expected trading days are present. [2025-10-28T17:09:29.689771] [DEBUG] [VALIDATOR ] ALG: Primary data validation passed. [2025-10-28T17:09:29.690022] [INFO ] [MAIN ] ALG: Fetched primary data is valid. [2025-10-28T17:09:29.690059] [DEBUG] [LOCAL ] ALG: Saving primary data. [2025-10-28T17:09:29.690516] [DEBUG] [LOCAL ] ALG: Trimmed 15054 records to 9482 (keeping 200 days of data) [2025-10-28T17:09:29.748735] [DEBUG] [LOCAL ] ALG: Primary data saved (9482 records). [2025-10-28T17:09:29.748857] [INFO ] [MAIN ] ALG: Full history saved. [2025-10-28T17:09:29.748946] [INFO ] [MAIN ] Update Progress: 82/2366 symbols completed. ALG took 17.6s. Estimated remaining: 4h 23m 6s. Rate: 8.7 symbols/min [2025-10-28T17:09:29.916502] [INFO ] [MAIN ] ALL: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:09:29.916680] [DEBUG] [LOCAL ] ALL: No existing data file found in primary storage. [2025-10-28T17:09:29.916732] [WARN ] [MAIN ] ALL: No existing data found, performing full refresh instead. [2025-10-28T17:09:29.916843] [INFO ] [MAIN ] ALL: Wiping existing primary data before full refresh. [2025-10-28T17:09:29.916899] [INFO ] [LOCAL ] ALL: Starting deletion of primary data. [2025-10-28T17:09:29.916940] [DEBUG] [LOCAL ] ALL: No primary data file found to delete. [2025-10-28T17:09:29.916972] [INFO ] [MAIN ] ALL: Starting full primary refresh. [2025-10-28T17:09:30.265388] [INFO ] [REMOTE ] ALL: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:09:30.359345] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-01. [2025-10-28T17:09:30.493061] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-28T17:09:31.159340] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-05. [2025-10-28T17:09:31.729480] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-28T17:09:31.959355] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-04. [2025-10-28T17:09:32.536800] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-28T17:09:32.759315] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-06. [2025-10-28T17:09:33.374315] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-28T17:09:33.559325] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-05. [2025-10-28T17:09:34.285544] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-28T17:09:34.359302] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-07. [2025-10-28T17:09:34.938220] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-28T17:09:35.159331] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-02. [2025-10-28T17:09:35.710298] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-28T17:09:35.959322] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-08. [2025-10-28T17:09:36.515459] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-28T17:09:36.759362] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-06. [2025-10-28T17:09:37.559392] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-09. [2025-10-28T17:09:37.750378] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-10-28T17:09:38.150501] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-28T17:09:38.359378] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-03. [2025-10-28T17:09:38.628109] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-28T17:09:39.159339] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-10. [2025-10-28T17:09:39.788249] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-28T17:09:39.959329] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-04. [2025-10-28T17:09:40.206588] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-28T17:09:40.213164] [INFO ] [REMOTE ] ALEX: Full fetch complete (44529 records). [2025-10-28T17:09:40.213249] [DEBUG] [VALIDATOR ] ALEX: Validating primary data. [2025-10-28T17:09:40.613017] [DEBUG] [VALIDATOR ] ALEX: All expected trading days are present. [2025-10-28T17:09:40.613097] [DEBUG] [VALIDATOR ] ALEX: Primary data validation passed. [2025-10-28T17:09:40.613613] [INFO ] [MAIN ] ALEX: Fetched primary data is valid. [2025-10-28T17:09:40.613684] [DEBUG] [LOCAL ] ALEX: Saving primary data. [2025-10-28T17:09:40.614719] [DEBUG] [LOCAL ] ALEX: Trimmed 44529 records to 30222 (keeping 200 days of data) [2025-10-28T17:09:40.769704] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-09. [2025-10-28T17:09:40.807843] [DEBUG] [LOCAL ] ALEX: Primary data saved (30222 records). [2025-10-28T17:09:40.807964] [INFO ] [MAIN ] ALEX: Full history saved. [2025-10-28T17:09:40.808046] [INFO ] [MAIN ] Update Progress: 83/2366 symbols completed. ALEX took 28.6s. Estimated remaining: 4h 24m 53s. Rate: 8.6 symbols/min [2025-10-28T17:09:40.987880] [INFO ] [MAIN ] ALLE: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:09:40.988036] [DEBUG] [LOCAL ] ALLE: No existing data file found in primary storage. [2025-10-28T17:09:40.988075] [WARN ] [MAIN ] ALLE: No existing data found, performing full refresh instead. [2025-10-28T17:09:40.988188] [INFO ] [MAIN ] ALLE: Wiping existing primary data before full refresh. [2025-10-28T17:09:40.988232] [INFO ] [LOCAL ] ALLE: Starting deletion of primary data. [2025-10-28T17:09:40.988276] [DEBUG] [LOCAL ] ALLE: No primary data file found to delete. [2025-10-28T17:09:40.988310] [INFO ] [MAIN ] ALLE: Starting full primary refresh. [2025-10-28T17:09:41.377489] [INFO ] [REMOTE ] ALLE: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:09:41.453546] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-28T17:09:41.559342] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-05. [2025-10-28T17:09:42.135367] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-28T17:09:42.359305] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-01. [2025-10-28T17:09:42.930584] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-28T17:09:43.159387] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-06. [2025-10-28T17:09:43.757635] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-28T17:09:43.959290] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-02. [2025-10-28T17:09:44.426958] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-28T17:09:44.759340] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-07. [2025-10-28T17:09:45.329414] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-28T17:09:45.559322] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-03. [2025-10-28T17:09:46.051143] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-28T17:09:46.359367] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-08. [2025-10-28T17:09:46.949798] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-28T17:09:47.159315] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-04. [2025-10-28T17:09:47.457040] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-28T17:09:47.959372] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-09. [2025-10-28T17:09:48.264260] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-28T17:09:48.759347] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-07. [2025-10-28T17:09:49.113898] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-28T17:09:49.559338] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-05. [2025-10-28T17:09:50.142096] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-28T17:09:50.359336] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-10. [2025-10-28T17:09:50.740306] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-28T17:09:51.159333] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-08. [2025-10-28T17:09:51.604242] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-28T17:09:51.615317] [INFO ] [REMOTE ] ALIT: Full fetch complete (76616 records). [2025-10-28T17:09:51.615451] [DEBUG] [VALIDATOR ] ALIT: Validating primary data. [2025-10-28T17:09:51.964465] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-06. [2025-10-28T17:09:52.010672] [DEBUG] [VALIDATOR ] ALIT: All expected trading days are present. [2025-10-28T17:09:52.010758] [DEBUG] [VALIDATOR ] ALIT: Primary data validation passed. [2025-10-28T17:09:52.011473] [INFO ] [MAIN ] ALIT: Fetched primary data is valid. [2025-10-28T17:09:52.011515] [DEBUG] [LOCAL ] ALIT: Saving primary data. [2025-10-28T17:09:52.012876] [DEBUG] [LOCAL ] ALIT: Trimmed 76616 records to 52756 (keeping 200 days of data) [2025-10-28T17:09:52.326413] [DEBUG] [LOCAL ] ALIT: Primary data saved (52756 records). [2025-10-28T17:09:52.326542] [INFO ] [MAIN ] ALIT: Full history saved. [2025-10-28T17:09:52.327109] [INFO ] [MAIN ] Update Progress: 84/2366 symbols completed. ALIT took 40.1s. Estimated remaining: 4h 26m 50s. Rate: 8.6 symbols/min [2025-10-28T17:09:52.501462] [INFO ] [MAIN ] ALLY: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:09:52.501693] [DEBUG] [LOCAL ] ALLY: No existing data file found in primary storage. [2025-10-28T17:09:52.501857] [WARN ] [MAIN ] ALLY: No existing data found, performing full refresh instead. [2025-10-28T17:09:52.502008] [INFO ] [MAIN ] ALLY: Wiping existing primary data before full refresh. [2025-10-28T17:09:52.502074] [INFO ] [LOCAL ] ALLY: Starting deletion of primary data. [2025-10-28T17:09:52.502200] [DEBUG] [LOCAL ] ALLY: No primary data file found to delete. [2025-10-28T17:09:52.502338] [INFO ] [MAIN ] ALLY: Starting full primary refresh. [2025-10-28T17:09:52.761687] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-10. [2025-10-28T17:09:52.829558] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-28T17:09:52.923866] [INFO ] [REMOTE ] ALLY: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:09:53.533178] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-28T17:09:53.559308] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-07. [2025-10-28T17:09:54.240022] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-28T17:09:54.249637] [INFO ] [REMOTE ] ALL: Full fetch complete (72262 records). [2025-10-28T17:09:54.249815] [DEBUG] [VALIDATOR ] ALL: Validating primary data. [2025-10-28T17:09:54.364533] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-09. [2025-10-28T17:09:54.629472] [DEBUG] [VALIDATOR ] ALL: All expected trading days are present. [2025-10-28T17:09:54.629536] [DEBUG] [VALIDATOR ] ALL: Primary data validation passed. [2025-10-28T17:09:54.630242] [INFO ] [MAIN ] ALL: Fetched primary data is valid. [2025-10-28T17:09:54.630305] [DEBUG] [LOCAL ] ALL: Saving primary data. [2025-10-28T17:09:54.631765] [DEBUG] [LOCAL ] ALL: Trimmed 72262 records to 49407 (keeping 200 days of data) [2025-10-28T17:09:54.891473] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-28T17:09:54.969959] [DEBUG] [LOCAL ] ALL: Primary data saved (49407 records). [2025-10-28T17:09:54.970087] [INFO ] [MAIN ] ALL: Full history saved. [2025-10-28T17:09:54.970157] [INFO ] [MAIN ] Update Progress: 85/2366 symbols completed. ALL took 25.2s. Estimated remaining: 4h 24m 46s. Rate: 8.6 symbols/min [2025-10-28T17:09:55.140983] [INFO ] [MAIN ] ALSN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:09:55.160010] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-08. [2025-10-28T17:09:55.177156] [DEBUG] [LOCAL ] ALSN: Loaded 43052 existing records from primary storage. [2025-10-28T17:09:55.177450] [INFO ] [MAIN ] ALSN: Loaded 43052 existing records. [2025-10-28T17:09:55.350975] [WARN ] [MAIN ] ALSN: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:09:55.351169] [INFO ] [MAIN ] ALSN: Wiping existing primary data before full refresh. [2025-10-28T17:09:55.351215] [INFO ] [LOCAL ] ALSN: Starting deletion of primary data. [2025-10-28T17:09:55.351914] [DEBUG] [LOCAL ] ALSN: Deleted primary data file. [2025-10-28T17:09:55.351970] [INFO ] [MAIN ] ALSN: Starting full primary refresh. [2025-10-28T17:09:55.692710] [INFO ] [REMOTE ] ALSN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:09:55.959310] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-01. [2025-10-28T17:09:56.018312] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-28T17:09:56.452416] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-28T17:09:56.759323] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-01. [2025-10-28T17:09:57.559321] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-10. [2025-10-28T17:09:57.765983] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-28T17:09:57.943724] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-28T17:09:58.359356] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-09. [2025-10-28T17:09:59.159345] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-02. [2025-10-28T17:09:59.618253] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-10 (2.06 seconds). [2025-10-28T17:09:59.651174] [INFO ] [REMOTE ] ALK: Full fetch complete (77042 records). [2025-10-28T17:09:59.652752] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-28T17:09:59.651862] [DEBUG] [VALIDATOR ] ALK: Validating primary data. [2025-10-28T17:09:59.962787] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-10. [2025-10-28T17:10:00.058992] [DEBUG] [VALIDATOR ] ALK: All expected trading days are present. [2025-10-28T17:10:00.059183] [DEBUG] [VALIDATOR ] ALK: Primary data validation passed. [2025-10-28T17:10:00.059948] [INFO ] [MAIN ] ALK: Fetched primary data is valid. [2025-10-28T17:10:00.060009] [DEBUG] [LOCAL ] ALK: Saving primary data. [2025-10-28T17:10:00.061380] [DEBUG] [LOCAL ] ALK: Trimmed 77042 records to 53087 (keeping 200 days of data) [2025-10-28T17:10:00.368474] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-28T17:10:00.398029] [DEBUG] [LOCAL ] ALK: Primary data saved (53087 records). [2025-10-28T17:10:00.398145] [INFO ] [MAIN ] ALK: Full history saved. [2025-10-28T17:10:00.398235] [INFO ] [MAIN ] Update Progress: 86/2366 symbols completed. ALK took 45.9s. Estimated remaining: 4h 23m 58s. Rate: 8.6 symbols/min [2025-10-28T17:10:00.571049] [INFO ] [MAIN ] ALTG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:10:00.592498] [DEBUG] [LOCAL ] ALTG: Loaded 22760 existing records from primary storage. [2025-10-28T17:10:00.592768] [INFO ] [MAIN ] ALTG: Loaded 22760 existing records. [2025-10-28T17:10:00.776930] [WARN ] [MAIN ] ALTG: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:10:00.771225] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-03. [2025-10-28T17:10:00.777999] [INFO ] [MAIN ] ALTG: Wiping existing primary data before full refresh. [2025-10-28T17:10:00.778059] [INFO ] [LOCAL ] ALTG: Starting deletion of primary data. [2025-10-28T17:10:00.778487] [DEBUG] [LOCAL ] ALTG: Deleted primary data file. [2025-10-28T17:10:00.778546] [INFO ] [MAIN ] ALTG: Starting full primary refresh. [2025-10-28T17:10:01.132675] [INFO ] [REMOTE ] ALTG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:10:01.438346] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-28T17:10:01.446468] [INFO ] [REMOTE ] ALLE: Full fetch complete (64541 records). [2025-10-28T17:10:01.446625] [DEBUG] [VALIDATOR ] ALLE: Validating primary data. [2025-10-28T17:10:01.447391] [FATAL] [VALIDATOR ] ALLE: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T17:10:01.447497] [FATAL] [MAIN ] ALLE: Fetched primary data is invalid. Refusing to save it. [2025-10-28T17:10:01.447563] [WARN ] [MAIN ] ALLE: Deleting existing primary and derivative data due to validation failure. [2025-10-28T17:10:01.447661] [INFO ] [LOCAL ] ALLE: Starting deletion of primary data. [2025-10-28T17:10:01.447760] [DEBUG] [LOCAL ] ALLE: No primary data file found to delete. [2025-10-28T17:10:01.447826] [INFO ] [LOCAL ] ALLE: Starting deletion of derivative data. [2025-10-28T17:10:01.447876] [DEBUG] [LOCAL ] ALLE: No derivative data file found to delete. [2025-10-28T17:10:01.447941] [INFO ] [MAIN ] Update Progress: 87/2366 symbols completed. ALLE took 20.6s. Estimated remaining: 4h 21m 17s. Rate: 8.7 symbols/min [2025-10-28T17:10:01.564467] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-02. [2025-10-28T17:10:01.633922] [INFO ] [MAIN ] ALUR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:10:01.644265] [DEBUG] [LOCAL ] ALUR: Loaded 9135 existing records from primary storage. [2025-10-28T17:10:01.644513] [INFO ] [MAIN ] ALUR: Loaded 9135 existing records. [2025-10-28T17:10:01.865903] [WARN ] [MAIN ] ALUR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:10:01.866169] [INFO ] [MAIN ] ALUR: Wiping existing primary data before full refresh. [2025-10-28T17:10:01.866245] [INFO ] [LOCAL ] ALUR: Starting deletion of primary data. [2025-10-28T17:10:01.866508] [DEBUG] [LOCAL ] ALUR: Deleted primary data file. [2025-10-28T17:10:01.866566] [INFO ] [MAIN ] ALUR: Starting full primary refresh. [2025-10-28T17:10:02.236721] [INFO ] [REMOTE ] ALUR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:10:02.276033] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-28T17:10:02.359334] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-04. [2025-10-28T17:10:03.159314] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-01. [2025-10-28T17:10:03.226588] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-28T17:10:03.540860] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-28T17:10:03.959358] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-01. [2025-10-28T17:10:04.280843] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-28T17:10:04.759356] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-02. [2025-10-28T17:10:05.298961] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-28T17:10:05.443806] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-28T17:10:05.559340] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-05. [2025-10-28T17:10:06.359334] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-02. [2025-10-28T17:10:06.980202] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-28T17:10:07.159326] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-06. [2025-10-28T17:10:07.372528] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-28T17:10:07.959328] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-03. [2025-10-28T17:10:08.312352] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-28T17:10:08.759346] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-03. [2025-10-28T17:10:08.872881] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-28T17:10:09.559330] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-03. [2025-10-28T17:10:10.030068] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-28T17:10:10.359307] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-04. [2025-10-28T17:10:10.427538] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-28T17:10:11.159346] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-04. [2025-10-28T17:10:11.468630] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-28T17:10:11.959337] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-05. [2025-10-28T17:10:12.541181] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-28T17:10:12.736047] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-28T17:10:12.759334] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-07. [2025-10-28T17:10:13.559332] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-05. [2025-10-28T17:10:14.036627] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-28T17:10:14.359335] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-04. [2025-10-28T17:10:14.696586] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-28T17:10:14.894815] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-28T17:10:15.159332] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-05. [2025-10-28T17:10:15.959304] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-06. [2025-10-28T17:10:16.052224] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-28T17:10:16.759337] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-08. [2025-10-28T17:10:17.559340] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-06. [2025-10-28T17:10:17.840670] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-10-28T17:10:17.927678] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-28T17:10:18.359398] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-09. [2025-10-28T17:10:18.614843] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-28T17:10:19.159332] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-07. [2025-10-28T17:10:19.718256] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-28T17:10:19.959337] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-10. [2025-10-28T17:10:20.444452] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-28T17:10:20.759342] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-08. [2025-10-28T17:10:21.546489] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-28T17:10:21.556520] [INFO ] [REMOTE ] ALSN: Full fetch complete (62826 records). [2025-10-28T17:10:21.556728] [DEBUG] [VALIDATOR ] ALSN: Validating primary data. [2025-10-28T17:10:21.564692] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-06. [2025-10-28T17:10:21.753917] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-28T17:10:22.188119] [DEBUG] [VALIDATOR ] ALSN: All expected trading days are present. [2025-10-28T17:10:22.188215] [DEBUG] [VALIDATOR ] ALSN: Primary data validation passed. [2025-10-28T17:10:22.188905] [INFO ] [MAIN ] ALSN: Fetched primary data is valid. [2025-10-28T17:10:22.188973] [DEBUG] [LOCAL ] ALSN: Saving primary data. [2025-10-28T17:10:22.190520] [DEBUG] [LOCAL ] ALSN: Trimmed 62826 records to 42985 (keeping 200 days of data) [2025-10-28T17:10:22.294096] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-28T17:10:22.386581] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-07. [2025-10-28T17:10:22.481830] [DEBUG] [LOCAL ] ALSN: Primary data saved (42985 records). [2025-10-28T17:10:22.481973] [INFO ] [MAIN ] ALSN: Full history saved. [2025-10-28T17:10:22.482055] [INFO ] [MAIN ] Update Progress: 88/2366 symbols completed. ALSN took 27.5s. Estimated remaining: 4h 27m 16s. Rate: 8.5 symbols/min [2025-10-28T17:10:22.669294] [INFO ] [MAIN ] ALV: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:10:22.708037] [DEBUG] [LOCAL ] ALV: Loaded 42134 existing records from primary storage. [2025-10-28T17:10:22.708319] [INFO ] [MAIN ] ALV: Loaded 42134 existing records. [2025-10-28T17:10:22.889863] [WARN ] [MAIN ] ALV: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:10:22.890126] [INFO ] [MAIN ] ALV: Wiping existing primary data before full refresh. [2025-10-28T17:10:22.890190] [INFO ] [LOCAL ] ALV: Starting deletion of primary data. [2025-10-28T17:10:22.891044] [DEBUG] [LOCAL ] ALV: Deleted primary data file. [2025-10-28T17:10:22.891106] [INFO ] [MAIN ] ALV: Starting full primary refresh. [2025-10-28T17:10:23.164613] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-07. [2025-10-28T17:10:23.263693] [INFO ] [REMOTE ] ALV: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:10:23.872042] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-28T17:10:23.951627] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-28T17:10:23.965731] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-08. [2025-10-28T17:10:24.487407] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-28T17:10:24.759376] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-08. [2025-10-28T17:10:25.559352] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-01. [2025-10-28T17:10:26.365135] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-09. [2025-10-28T17:10:26.378347] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-28T17:10:26.835854] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-28T17:10:27.159341] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-09. [2025-10-28T17:10:27.459401] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-28T17:10:27.734291] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-28T17:10:27.959352] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-10. [2025-10-28T17:10:28.556338] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-28T17:10:28.559234] [INFO ] [REMOTE ] ALUR: Full fetch complete (18202 records). [2025-10-28T17:10:28.559320] [DEBUG] [VALIDATOR ] ALUR: Validating primary data. [2025-10-28T17:10:28.759346] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-09. [2025-10-28T17:10:28.935787] [DEBUG] [VALIDATOR ] ALUR: All expected trading days are present. [2025-10-28T17:10:28.935861] [DEBUG] [VALIDATOR ] ALUR: Primary data validation passed. [2025-10-28T17:10:28.936140] [INFO ] [MAIN ] ALUR: Fetched primary data is valid. [2025-10-28T17:10:28.936178] [DEBUG] [LOCAL ] ALUR: Saving primary data. [2025-10-28T17:10:28.936743] [DEBUG] [LOCAL ] ALUR: Trimmed 18202 records to 9120 (keeping 200 days of data) [2025-10-28T17:10:28.985219] [DEBUG] [LOCAL ] ALUR: Primary data saved (9120 records). [2025-10-28T17:10:28.985340] [INFO ] [MAIN ] ALUR: Full history saved. [2025-10-28T17:10:28.985414] [INFO ] [MAIN ] Update Progress: 89/2366 symbols completed. ALUR took 27.5s. Estimated remaining: 4h 26m 56s. Rate: 8.5 symbols/min [2025-10-28T17:10:29.152178] [INFO ] [MAIN ] ALX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:10:29.152338] [DEBUG] [LOCAL ] ALX: No existing data file found in primary storage. [2025-10-28T17:10:29.152373] [WARN ] [MAIN ] ALX: No existing data found, performing full refresh instead. [2025-10-28T17:10:29.152482] [INFO ] [MAIN ] ALX: Wiping existing primary data before full refresh. [2025-10-28T17:10:29.152522] [INFO ] [LOCAL ] ALX: Starting deletion of primary data. [2025-10-28T17:10:29.152561] [DEBUG] [LOCAL ] ALX: No primary data file found to delete. [2025-10-28T17:10:29.152592] [INFO ] [MAIN ] ALX: Starting full primary refresh. [2025-10-28T17:10:29.501159] [INFO ] [REMOTE ] ALX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:10:29.559393] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-02. [2025-10-28T17:10:30.251714] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-28T17:10:30.359308] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-10. [2025-10-28T17:10:30.900376] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-28T17:10:31.159331] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-10. [2025-10-28T17:10:31.959322] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-01. [2025-10-28T17:10:32.082021] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-28T17:10:32.092927] [INFO ] [REMOTE ] ALLY: Full fetch complete (77243 records). [2025-10-28T17:10:32.093076] [DEBUG] [VALIDATOR ] ALLY: Validating primary data. [2025-10-28T17:10:32.384244] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-28T17:10:32.423133] [INFO ] [REMOTE ] ALTG: Full fetch complete (33293 records). [2025-10-28T17:10:32.428976] [DEBUG] [VALIDATOR ] ALTG: Validating primary data. [2025-10-28T17:10:32.517437] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-28T17:10:32.634405] [DEBUG] [VALIDATOR ] ALLY: All expected trading days are present. [2025-10-28T17:10:32.634800] [DEBUG] [VALIDATOR ] ALLY: Primary data validation passed. [2025-10-28T17:10:32.635588] [INFO ] [MAIN ] ALLY: Fetched primary data is valid. [2025-10-28T17:10:32.635702] [DEBUG] [LOCAL ] ALLY: Saving primary data. [2025-10-28T17:10:32.694539] [DEBUG] [LOCAL ] ALLY: Trimmed 77243 records to 53200 (keeping 200 days of data) [2025-10-28T17:10:32.811403] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-02. [2025-10-28T17:10:33.042270] [DEBUG] [VALIDATOR ] ALTG: All expected trading days are present. [2025-10-28T17:10:33.042425] [DEBUG] [VALIDATOR ] ALTG: Primary data validation passed. [2025-10-28T17:10:33.043135] [INFO ] [MAIN ] ALTG: Fetched primary data is valid. [2025-10-28T17:10:33.043230] [DEBUG] [LOCAL ] ALTG: Saving primary data. [2025-10-28T17:10:33.129761] [DEBUG] [LOCAL ] ALTG: Trimmed 33293 records to 22694 (keeping 200 days of data) [2025-10-28T17:10:33.271546] [DEBUG] [LOCAL ] ALTG: Primary data saved (22694 records). [2025-10-28T17:10:33.280194] [INFO ] [MAIN ] ALTG: Full history saved. [2025-10-28T17:10:33.287310] [INFO ] [MAIN ] Update Progress: 90/2366 symbols completed. ALTG took 32.9s. Estimated remaining: 4h 25m 39s. Rate: 8.6 symbols/min [2025-10-28T17:10:33.370086] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-28T17:10:33.536616] [INFO ] [MAIN ] AM: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:10:33.542313] [DEBUG] [LOCAL ] ALLY: Primary data saved (53200 records). [2025-10-28T17:10:33.542403] [INFO ] [MAIN ] ALLY: Full history saved. [2025-10-28T17:10:33.542467] [INFO ] [MAIN ] Update Progress: 91/2366 symbols completed. ALLY took 41.2s. Estimated remaining: 4h 22m 44s. Rate: 8.7 symbols/min [2025-10-28T17:10:33.564398] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-03. [2025-10-28T17:10:33.730690] [INFO ] [MAIN ] AMBC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:10:33.754376] [DEBUG] [LOCAL ] AM: Loaded 51802 existing records from primary storage. [2025-10-28T17:10:33.754759] [INFO ] [MAIN ] AM: Loaded 51802 existing records. [2025-10-28T17:10:33.896785] [DEBUG] [LOCAL ] AMBC: Loaded 35502 existing records from primary storage. [2025-10-28T17:10:33.934483] [INFO ] [MAIN ] AMBC: Loaded 35502 existing records. [2025-10-28T17:10:33.996765] [WARN ] [MAIN ] AM: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:10:34.034570] [INFO ] [MAIN ] AM: Wiping existing primary data before full refresh. [2025-10-28T17:10:34.040386] [INFO ] [LOCAL ] AM: Starting deletion of primary data. [2025-10-28T17:10:34.056236] [DEBUG] [LOCAL ] AM: Deleted primary data file. [2025-10-28T17:10:34.066464] [INFO ] [MAIN ] AM: Starting full primary refresh. [2025-10-28T17:10:34.257975] [WARN ] [MAIN ] AMBC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:10:34.278876] [INFO ] [MAIN ] AMBC: Wiping existing primary data before full refresh. [2025-10-28T17:10:34.306679] [INFO ] [LOCAL ] AMBC: Starting deletion of primary data. [2025-10-28T17:10:34.316379] [DEBUG] [LOCAL ] AMBC: Deleted primary data file. [2025-10-28T17:10:34.366928] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-03. [2025-10-28T17:10:34.340798] [INFO ] [MAIN ] AMBC: Starting full primary refresh. [2025-10-28T17:10:34.679964] [INFO ] [REMOTE ] AM: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:10:34.804792] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-28T17:10:34.881312] [INFO ] [REMOTE ] AMBC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:10:35.049144] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-28T17:10:35.159310] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-04. [2025-10-28T17:10:35.959350] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-01. [2025-10-28T17:10:36.517525] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-28T17:10:36.759318] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-05. [2025-10-28T17:10:36.918883] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-28T17:10:37.559331] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-02. [2025-10-28T17:10:38.285816] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-28T17:10:38.359330] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-01. [2025-10-28T17:10:38.449431] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-28T17:10:39.159319] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-03. [2025-10-28T17:10:39.938749] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-28T17:10:39.959297] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-02. [2025-10-28T17:10:40.765963] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-04. [2025-10-28T17:10:40.770672] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-28T17:10:41.123464] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-10-28T17:10:41.559302] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-06. [2025-10-28T17:10:41.728719] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-10-28T17:10:42.359337] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-05. [2025-10-28T17:10:42.711548] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-28T17:10:42.883848] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-28T17:10:43.159373] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-07. [2025-10-28T17:10:43.959406] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-06. [2025-10-28T17:10:44.472873] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-28T17:10:44.660062] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-28T17:10:44.759344] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-08. [2025-10-28T17:10:45.559353] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-03. [2025-10-28T17:10:45.873191] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-28T17:10:46.359333] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-07. [2025-10-28T17:10:46.838532] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-28T17:10:46.988479] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-28T17:10:47.159334] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-04. [2025-10-28T17:10:47.959346] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-04. [2025-10-28T17:10:48.466475] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-28T17:10:48.759326] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-05. [2025-10-28T17:10:49.312419] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-28T17:10:49.559319] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-08. [2025-10-28T17:10:49.960716] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-28T17:10:50.101087] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-28T17:10:50.359391] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-09. [2025-10-28T17:10:50.905034] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-28T17:10:51.159338] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-06. [2025-10-28T17:10:51.959315] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-05. [2025-10-28T17:10:52.150435] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-28T17:10:52.759328] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-09. [2025-10-28T17:10:53.295554] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-28T17:10:53.559351] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-06. [2025-10-28T17:10:53.885315] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-28T17:10:54.359352] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-10. [2025-10-28T17:10:55.159320] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-07. [2025-10-28T17:10:55.226827] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-28T17:10:55.685744] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-28T17:10:55.694454] [INFO ] [REMOTE ] ALV: Full fetch complete (62441 records). [2025-10-28T17:10:55.694562] [DEBUG] [VALIDATOR ] ALV: Validating primary data. [2025-10-28T17:10:55.964528] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-07. [2025-10-28T17:10:56.077714] [DEBUG] [VALIDATOR ] ALV: All expected trading days are present. [2025-10-28T17:10:56.077806] [DEBUG] [VALIDATOR ] ALV: Primary data validation passed. [2025-10-28T17:10:56.078442] [INFO ] [MAIN ] ALV: Fetched primary data is valid. [2025-10-28T17:10:56.078483] [DEBUG] [LOCAL ] ALV: Saving primary data. [2025-10-28T17:10:56.079783] [DEBUG] [LOCAL ] ALV: Trimmed 62441 records to 42070 (keeping 200 days of data) [2025-10-28T17:10:56.323691] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-28T17:10:56.378296] [DEBUG] [LOCAL ] ALV: Primary data saved (42070 records). [2025-10-28T17:10:56.378429] [INFO ] [MAIN ] ALV: Full history saved. [2025-10-28T17:10:56.378524] [INFO ] [MAIN ] Update Progress: 92/2366 symbols completed. ALV took 33.9s. Estimated remaining: 4h 29m 10s. Rate: 8.4 symbols/min [2025-10-28T17:10:56.546305] [INFO ] [MAIN ] AMBP: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:10:56.583686] [DEBUG] [LOCAL ] AMBP: Loaded 44283 existing records from primary storage. [2025-10-28T17:10:56.583976] [INFO ] [MAIN ] AMBP: Loaded 44283 existing records. [2025-10-28T17:10:56.779016] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-08. [2025-10-28T17:10:56.784948] [WARN ] [MAIN ] AMBP: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:10:56.785950] [INFO ] [MAIN ] AMBP: Wiping existing primary data before full refresh. [2025-10-28T17:10:56.786022] [INFO ] [LOCAL ] AMBP: Starting deletion of primary data. [2025-10-28T17:10:56.786857] [DEBUG] [LOCAL ] AMBP: Deleted primary data file. [2025-10-28T17:10:56.786914] [INFO ] [MAIN ] AMBP: Starting full primary refresh. [2025-10-28T17:10:57.153078] [INFO ] [REMOTE ] AMBP: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:10:57.448770] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-28T17:10:57.559301] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-08. [2025-10-28T17:10:57.912237] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-28T17:10:58.359328] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-10. [2025-10-28T17:10:58.848165] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-28T17:10:59.114207] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-28T17:10:59.117102] [INFO ] [REMOTE ] ALX: Full fetch complete (8441 records). [2025-10-28T17:10:59.117176] [DEBUG] [VALIDATOR ] ALX: Validating primary data. [2025-10-28T17:10:59.164456] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-09. [2025-10-28T17:10:59.510568] [DEBUG] [VALIDATOR ] ALX: All expected trading days are present. [2025-10-28T17:10:59.510679] [DEBUG] [VALIDATOR ] ALX: Primary data validation passed. [2025-10-28T17:10:59.510934] [INFO ] [MAIN ] ALX: Fetched primary data is valid. [2025-10-28T17:10:59.510980] [DEBUG] [LOCAL ] ALX: Saving primary data. [2025-10-28T17:10:59.511408] [DEBUG] [LOCAL ] ALX: Trimmed 8441 records to 7568 (keeping 200 days of data) [2025-10-28T17:10:59.558020] [DEBUG] [LOCAL ] ALX: Primary data saved (7568 records). [2025-10-28T17:10:59.558161] [INFO ] [MAIN ] ALX: Full history saved. [2025-10-28T17:10:59.558231] [INFO ] [MAIN ] Update Progress: 93/2366 symbols completed. ALX took 30.6s. Estimated remaining: 4h 27m 27s. Rate: 8.5 symbols/min [2025-10-28T17:10:59.725256] [INFO ] [MAIN ] AMBQ: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:10:59.725436] [DEBUG] [LOCAL ] AMBQ: No existing data file found in primary storage. [2025-10-28T17:10:59.725473] [WARN ] [MAIN ] AMBQ: No existing data found, performing full refresh instead. [2025-10-28T17:10:59.725580] [INFO ] [MAIN ] AMBQ: Wiping existing primary data before full refresh. [2025-10-28T17:10:59.725621] [INFO ] [LOCAL ] AMBQ: Starting deletion of primary data. [2025-10-28T17:10:59.725697] [DEBUG] [LOCAL ] AMBQ: No primary data file found to delete. [2025-10-28T17:10:59.725743] [INFO ] [MAIN ] AMBQ: Starting full primary refresh. [2025-10-28T17:10:59.964475] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-09. [2025-10-28T17:11:00.108686] [INFO ] [REMOTE ] AMBQ: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:11:00.350849] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-28T17:11:00.759392] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-01. [2025-10-28T17:11:01.320435] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-28T17:11:01.559367] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-10. [2025-10-28T17:11:02.364007] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-10. [2025-10-28T17:11:02.369573] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-28T17:11:03.159304] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-01. [2025-10-28T17:11:03.236558] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-28T17:11:03.243677] [INFO ] [REMOTE ] AMBC: Full fetch complete (51824 records). [2025-10-28T17:11:03.243770] [DEBUG] [VALIDATOR ] AMBC: Validating primary data. [2025-10-28T17:11:03.372685] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-28T17:11:03.420808] [WARN ] [REMOTE ] AMBQ: No data returned for month 2025-01 [2025-10-28T17:11:03.426048] [FATAL] [REMOTE ] AMBQ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-28T17:11:03.441204] [FATAL] [MAIN ] AMBQ: Failed to fetch primary data. [2025-10-28T17:11:03.480058] [WARN ] [MAIN ] AMBQ: Deleting existing primary and derivative data due to fetch failure. [2025-10-28T17:11:03.500505] [INFO ] [LOCAL ] AMBQ: Starting deletion of primary data. [2025-10-28T17:11:03.506159] [DEBUG] [LOCAL ] AMBQ: No primary data file found to delete. [2025-10-28T17:11:03.511843] [INFO ] [LOCAL ] AMBQ: Starting deletion of derivative data. [2025-10-28T17:11:03.511933] [DEBUG] [LOCAL ] AMBQ: No derivative data file found to delete. [2025-10-28T17:11:03.527832] [INFO ] [MAIN ] Update Progress: 94/2366 symbols completed. AMBQ took 4.0s. Estimated remaining: 4h 26m 5s. Rate: 8.5 symbols/min [2025-10-28T17:11:03.779219] [DEBUG] [VALIDATOR ] AMBC: All expected trading days are present. [2025-10-28T17:11:03.794065] [DEBUG] [VALIDATOR ] AMBC: Primary data validation passed. [2025-10-28T17:11:03.796748] [INFO ] [MAIN ] AMC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:11:03.797328] [INFO ] [MAIN ] AMBC: Fetched primary data is valid. [2025-10-28T17:11:03.797435] [DEBUG] [LOCAL ] AMBC: Saving primary data. [2025-10-28T17:11:03.798983] [DEBUG] [LOCAL ] AMBC: Trimmed 51824 records to 35400 (keeping 200 days of data) [2025-10-28T17:11:03.963538] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-02. [2025-10-28T17:11:04.020708] [DEBUG] [LOCAL ] AMC: Loaded 53766 existing records from primary storage. [2025-10-28T17:11:04.024959] [INFO ] [MAIN ] AMC: Loaded 53766 existing records. [2025-10-28T17:11:04.094122] [DEBUG] [LOCAL ] AMBC: Primary data saved (35400 records). [2025-10-28T17:11:04.108806] [INFO ] [MAIN ] AMBC: Full history saved. [2025-10-28T17:11:04.133885] [INFO ] [MAIN ] Update Progress: 95/2366 symbols completed. AMBC took 30.6s. Estimated remaining: 4h 23m 25s. Rate: 8.6 symbols/min [2025-10-28T17:11:04.295925] [WARN ] [MAIN ] AMC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:11:04.351793] [INFO ] [MAIN ] AMC: Wiping existing primary data before full refresh. [2025-10-28T17:11:04.359778] [INFO ] [LOCAL ] AMC: Starting deletion of primary data. [2025-10-28T17:11:04.382183] [DEBUG] [LOCAL ] AMC: Deleted primary data file. [2025-10-28T17:11:04.382107] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-10 (2.02 seconds). [2025-10-28T17:11:04.382328] [INFO ] [MAIN ] AMC: Starting full primary refresh. [2025-10-28T17:11:04.448544] [INFO ] [REMOTE ] AM: Full fetch complete (75276 records). [2025-10-28T17:11:04.470731] [DEBUG] [VALIDATOR ] AM: Validating primary data. [2025-10-28T17:11:04.470619] [INFO ] [MAIN ] AMCR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:11:04.490390] [FATAL] [VALIDATOR ] AM: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T17:11:04.505674] [FATAL] [MAIN ] AM: Fetched primary data is invalid. Refusing to save it. [2025-10-28T17:11:04.522166] [WARN ] [MAIN ] AM: Deleting existing primary and derivative data due to validation failure. [2025-10-28T17:11:04.539683] [INFO ] [LOCAL ] AM: Starting deletion of primary data. [2025-10-28T17:11:04.550720] [DEBUG] [LOCAL ] AM: No primary data file found to delete. [2025-10-28T17:11:04.561171] [INFO ] [LOCAL ] AM: Starting deletion of derivative data. [2025-10-28T17:11:04.599473] [DEBUG] [LOCAL ] AM: Deleted derivative data file. [2025-10-28T17:11:04.616444] [INFO ] [MAIN ] Update Progress: 96/2366 symbols completed. AM took 31.3s. Estimated remaining: 4h 20m 45s. Rate: 8.7 symbols/min [2025-10-28T17:11:04.974753] [INFO ] [MAIN ] AME: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:11:05.007114] [INFO ] [REMOTE ] AMC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:11:05.026319] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-01. [2025-10-28T17:11:05.029198] [DEBUG] [LOCAL ] AMCR: Loaded 53670 existing records from primary storage. [2025-10-28T17:11:05.029858] [INFO ] [MAIN ] AMCR: Loaded 53670 existing records. [2025-10-28T17:11:05.217816] [WARN ] [MAIN ] AMCR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:11:05.247964] [INFO ] [MAIN ] AMCR: Wiping existing primary data before full refresh. [2025-10-28T17:11:05.250659] [INFO ] [LOCAL ] AMCR: Starting deletion of primary data. [2025-10-28T17:11:05.252420] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-28T17:11:05.252538] [DEBUG] [LOCAL ] AMCR: Deleted primary data file. [2025-10-28T17:11:05.261054] [INFO ] [MAIN ] AMCR: Starting full primary refresh. [2025-10-28T17:11:05.381131] [DEBUG] [LOCAL ] AME: Loaded 48327 existing records from primary storage. [2025-10-28T17:11:05.392068] [INFO ] [MAIN ] AME: Loaded 48327 existing records. [2025-10-28T17:11:05.583179] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-03. [2025-10-28T17:11:05.780448] [WARN ] [MAIN ] AME: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:11:05.796014] [INFO ] [MAIN ] AME: Wiping existing primary data before full refresh. [2025-10-28T17:11:05.801198] [INFO ] [LOCAL ] AME: Starting deletion of primary data. [2025-10-28T17:11:05.827612] [DEBUG] [LOCAL ] AME: Deleted primary data file. [2025-10-28T17:11:05.857825] [INFO ] [MAIN ] AME: Starting full primary refresh. [2025-10-28T17:11:05.857770] [INFO ] [REMOTE ] AMCR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:11:06.204366] [INFO ] [REMOTE ] AME: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:11:06.359317] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-01. [2025-10-28T17:11:06.878142] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-28T17:11:07.038222] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-10-28T17:11:07.159334] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-04. [2025-10-28T17:11:07.539153] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-28T17:11:07.959354] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-02. [2025-10-28T17:11:08.371738] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-28T17:11:08.759366] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-02. [2025-10-28T17:11:09.559423] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-05. [2025-10-28T17:11:09.934158] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-10-28T17:11:10.114996] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-28T17:11:10.359344] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-03. [2025-10-28T17:11:10.869359] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-28T17:11:11.159336] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-06. [2025-10-28T17:11:11.817154] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-28T17:11:11.959352] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-01. [2025-10-28T17:11:12.308516] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-28T17:11:12.759346] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-04. [2025-10-28T17:11:13.434187] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-28T17:11:13.559317] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-02. [2025-10-28T17:11:14.275487] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-28T17:11:14.359295] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-05. [2025-10-28T17:11:14.816906] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-28T17:11:15.159335] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-03. [2025-10-28T17:11:15.906771] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-28T17:11:15.959299] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-06. [2025-10-28T17:11:16.757027] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-28T17:11:16.767136] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-03. [2025-10-28T17:11:17.330445] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-28T17:11:17.559355] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-04. [2025-10-28T17:11:18.359333] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-07. [2025-10-28T17:11:19.159294] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-07. [2025-10-28T17:11:19.461464] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-03 (2.69 seconds). [2025-10-28T17:11:19.675467] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-10-28T17:11:19.789706] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-28T17:11:19.959333] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-04. [2025-10-28T17:11:20.435498] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-28T17:11:20.759347] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-05. [2025-10-28T17:11:21.559334] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-08. [2025-10-28T17:11:22.113563] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-10-28T17:11:22.359316] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-05. [2025-10-28T17:11:22.415607] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-28T17:11:22.893205] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-28T17:11:23.159317] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-08. [2025-10-28T17:11:23.959358] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-06. [2025-10-28T17:11:24.515809] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-10-28T17:11:24.542995] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-28T17:11:24.759318] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-09. [2025-10-28T17:11:25.435584] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-28T17:11:25.559315] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-07. [2025-10-28T17:11:26.186479] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-28T17:11:26.359338] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-06. [2025-10-28T17:11:26.979030] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-28T17:11:27.159354] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-08. [2025-10-28T17:11:27.959408] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-09. [2025-10-28T17:11:28.351530] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-10-28T17:11:28.704268] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-28T17:11:28.759306] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-09. [2025-10-28T17:11:29.128352] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-28T17:11:29.559363] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-10. [2025-10-28T17:11:30.359317] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-07. [2025-10-28T17:11:30.400358] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-28T17:11:30.965816] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-28T17:11:30.975354] [INFO ] [REMOTE ] AME: Full fetch complete (70263 records). [2025-10-28T17:11:30.975493] [DEBUG] [VALIDATOR ] AME: Validating primary data. [2025-10-28T17:11:31.166512] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-10. [2025-10-28T17:11:31.359276] [DEBUG] [VALIDATOR ] AME: All expected trading days are present. [2025-10-28T17:11:31.359348] [DEBUG] [VALIDATOR ] AME: Primary data validation passed. [2025-10-28T17:11:31.360018] [INFO ] [MAIN ] AME: Fetched primary data is valid. [2025-10-28T17:11:31.360081] [DEBUG] [LOCAL ] AME: Saving primary data. [2025-10-28T17:11:31.361315] [DEBUG] [LOCAL ] AME: Trimmed 70263 records to 48323 (keeping 200 days of data) [2025-10-28T17:11:31.652948] [DEBUG] [LOCAL ] AME: Primary data saved (48323 records). [2025-10-28T17:11:31.653088] [INFO ] [MAIN ] AME: Full history saved. [2025-10-28T17:11:31.653169] [INFO ] [MAIN ] Update Progress: 97/2366 symbols completed. AME took 27.0s. Estimated remaining: 4h 28m 29s. Rate: 8.5 symbols/min [2025-10-28T17:11:31.821447] [INFO ] [MAIN ] AMG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:11:31.842290] [DEBUG] [LOCAL ] AMG: Loaded 19768 existing records from primary storage. [2025-10-28T17:11:31.842502] [INFO ] [MAIN ] AMG: Loaded 19768 existing records. [2025-10-28T17:11:31.964476] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-10. [2025-10-28T17:11:32.018543] [WARN ] [MAIN ] AMG: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:11:32.018723] [INFO ] [MAIN ] AMG: Wiping existing primary data before full refresh. [2025-10-28T17:11:32.018777] [INFO ] [LOCAL ] AMG: Starting deletion of primary data. [2025-10-28T17:11:32.019073] [DEBUG] [LOCAL ] AMG: Deleted primary data file. [2025-10-28T17:11:32.019131] [INFO ] [MAIN ] AMG: Starting full primary refresh. [2025-10-28T17:11:32.371676] [INFO ] [REMOTE ] AMG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:11:32.445540] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-28T17:11:32.759308] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-01. [2025-10-28T17:11:33.198796] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-10 (2.03 seconds). [2025-10-28T17:11:33.209602] [INFO ] [REMOTE ] AMCR: Full fetch complete (77843 records). [2025-10-28T17:11:33.209791] [DEBUG] [VALIDATOR ] AMCR: Validating primary data. [2025-10-28T17:11:33.568818] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-08. [2025-10-28T17:11:33.641716] [DEBUG] [VALIDATOR ] AMCR: All expected trading days are present. [2025-10-28T17:11:33.642615] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-28T17:11:33.642803] [DEBUG] [VALIDATOR ] AMCR: Primary data validation passed. [2025-10-28T17:11:33.651849] [INFO ] [MAIN ] AMCR: Fetched primary data is valid. [2025-10-28T17:11:33.652232] [DEBUG] [LOCAL ] AMCR: Saving primary data. [2025-10-28T17:11:33.652724] [INFO ] [REMOTE ] AMBP: Full fetch complete (64941 records). [2025-10-28T17:11:33.653040] [DEBUG] [VALIDATOR ] AMBP: Validating primary data. [2025-10-28T17:11:33.665562] [DEBUG] [LOCAL ] AMCR: Trimmed 77843 records to 53670 (keeping 200 days of data) [2025-10-28T17:11:33.830889] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-28T17:11:34.298624] [DEBUG] [VALIDATOR ] AMBP: All expected trading days are present. [2025-10-28T17:11:34.301036] [DEBUG] [VALIDATOR ] AMBP: Primary data validation passed. [2025-10-28T17:11:34.303583] [INFO ] [MAIN ] AMBP: Fetched primary data is valid. [2025-10-28T17:11:34.303687] [DEBUG] [LOCAL ] AMBP: Saving primary data. [2025-10-28T17:11:34.324237] [DEBUG] [LOCAL ] AMBP: Trimmed 64941 records to 44285 (keeping 200 days of data) [2025-10-28T17:11:34.409157] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-02. [2025-10-28T17:11:34.488023] [DEBUG] [LOCAL ] AMCR: Primary data saved (53670 records). [2025-10-28T17:11:34.491904] [INFO ] [MAIN ] AMCR: Full history saved. [2025-10-28T17:11:34.496367] [INFO ] [MAIN ] Update Progress: 98/2366 symbols completed. AMCR took 30.4s. Estimated remaining: 4h 26m 43s. Rate: 8.5 symbols/min [2025-10-28T17:11:34.817890] [INFO ] [MAIN ] AMH: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:11:34.831059] [DEBUG] [LOCAL ] AMBP: Primary data saved (44285 records). [2025-10-28T17:11:34.831289] [INFO ] [MAIN ] AMBP: Full history saved. [2025-10-28T17:11:34.831377] [INFO ] [MAIN ] Update Progress: 99/2366 symbols completed. AMBP took 38.5s. Estimated remaining: 4h 24m 2s. Rate: 8.6 symbols/min [2025-10-28T17:11:35.001541] [INFO ] [MAIN ] AMN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:11:35.039016] [DEBUG] [LOCAL ] AMH: Loaded 51793 existing records from primary storage. [2025-10-28T17:11:35.039425] [INFO ] [MAIN ] AMH: Loaded 51793 existing records. [2025-10-28T17:11:35.263195] [DEBUG] [LOCAL ] AMN: Loaded 41409 existing records from primary storage. [2025-10-28T17:11:35.261907] [WARN ] [MAIN ] AMH: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:11:35.263467] [INFO ] [MAIN ] AMH: Wiping existing primary data before full refresh. [2025-10-28T17:11:35.263823] [INFO ] [MAIN ] AMN: Loaded 41409 existing records. [2025-10-28T17:11:35.263735] [INFO ] [LOCAL ] AMH: Starting deletion of primary data. [2025-10-28T17:11:35.297933] [DEBUG] [LOCAL ] AMH: Deleted primary data file. [2025-10-28T17:11:35.298033] [INFO ] [MAIN ] AMH: Starting full primary refresh. [2025-10-28T17:11:35.549387] [WARN ] [MAIN ] AMN: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:11:35.595541] [INFO ] [MAIN ] AMN: Wiping existing primary data before full refresh. [2025-10-28T17:11:35.628011] [INFO ] [LOCAL ] AMN: Starting deletion of primary data. [2025-10-28T17:11:35.621407] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-28T17:11:35.654018] [DEBUG] [LOCAL ] AMN: Deleted primary data file. [2025-10-28T17:11:35.676156] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-03. [2025-10-28T17:11:35.676234] [INFO ] [MAIN ] AMN: Starting full primary refresh. [2025-10-28T17:11:35.984721] [INFO ] [REMOTE ] AMH: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:11:35.995373] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-01. [2025-10-28T17:11:36.240079] [INFO ] [REMOTE ] AMN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:11:36.271676] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-08 (2.70 seconds). [2025-10-28T17:11:36.759337] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-09. [2025-10-28T17:11:36.829351] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-28T17:11:37.432371] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-28T17:11:37.559340] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-01. [2025-10-28T17:11:38.359390] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-02. [2025-10-28T17:11:38.658573] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-28T17:11:38.689114] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-28T17:11:39.159320] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-10. [2025-10-28T17:11:39.631418] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-28T17:11:39.959328] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-03. [2025-10-28T17:11:40.759323] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-04. [2025-10-28T17:11:41.443591] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-28T17:11:41.486036] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-10 (2.33 seconds). [2025-10-28T17:11:41.496716] [INFO ] [REMOTE ] AMC: Full fetch complete (77930 records). [2025-10-28T17:11:41.496849] [DEBUG] [VALIDATOR ] AMC: Validating primary data. [2025-10-28T17:11:41.564522] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-04. [2025-10-28T17:11:41.922098] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-28T17:11:41.921172] [DEBUG] [VALIDATOR ] AMC: All expected trading days are present. [2025-10-28T17:11:41.922341] [DEBUG] [VALIDATOR ] AMC: Primary data validation passed. [2025-10-28T17:11:41.928741] [INFO ] [MAIN ] AMC: Fetched primary data is valid. [2025-10-28T17:11:41.929168] [DEBUG] [LOCAL ] AMC: Saving primary data. [2025-10-28T17:11:41.930832] [DEBUG] [LOCAL ] AMC: Trimmed 77930 records to 53766 (keeping 200 days of data) [2025-10-28T17:11:42.228034] [DEBUG] [LOCAL ] AMC: Primary data saved (53766 records). [2025-10-28T17:11:42.228173] [INFO ] [MAIN ] AMC: Full history saved. [2025-10-28T17:11:42.228252] [INFO ] [MAIN ] Update Progress: 100/2366 symbols completed. AMC took 38.7s. Estimated remaining: 4h 24m 5s. Rate: 8.6 symbols/min [2025-10-28T17:11:42.365624] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-05. [2025-10-28T17:11:42.396623] [INFO ] [MAIN ] AMP: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:11:42.425089] [DEBUG] [LOCAL ] AMP: Loaded 31375 existing records from primary storage. [2025-10-28T17:11:42.425339] [INFO ] [MAIN ] AMP: Loaded 31375 existing records. [2025-10-28T17:11:42.598263] [WARN ] [MAIN ] AMP: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:11:42.598440] [INFO ] [MAIN ] AMP: Wiping existing primary data before full refresh. [2025-10-28T17:11:42.598484] [INFO ] [LOCAL ] AMP: Starting deletion of primary data. [2025-10-28T17:11:42.599090] [DEBUG] [LOCAL ] AMP: Deleted primary data file. [2025-10-28T17:11:42.599146] [INFO ] [MAIN ] AMP: Starting full primary refresh. [2025-10-28T17:11:42.955982] [INFO ] [REMOTE ] AMP: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:11:42.998446] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-28T17:11:43.159343] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-01. [2025-10-28T17:11:43.317384] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-28T17:11:43.959327] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-02. [2025-10-28T17:11:44.362493] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-28T17:11:44.759386] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-06. [2025-10-28T17:11:45.084516] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-28T17:11:45.541476] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-28T17:11:45.559307] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-07. [2025-10-28T17:11:46.334190] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-28T17:11:46.359303] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-02. [2025-10-28T17:11:47.159383] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-03. [2025-10-28T17:11:47.403682] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-28T17:11:47.959395] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-05. [2025-10-28T17:11:48.182510] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-28T17:11:48.759338] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-03. [2025-10-28T17:11:49.484524] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-28T17:11:49.559379] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-04. [2025-10-28T17:11:49.946286] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-28T17:11:50.359559] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-08. [2025-10-28T17:11:50.945422] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-28T17:11:51.029750] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-28T17:11:51.159293] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-05. [2025-10-28T17:11:51.959344] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-09. [2025-10-28T17:11:52.327681] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-28T17:11:52.759303] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-06. [2025-10-28T17:11:52.773784] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-28T17:11:53.559334] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-04. [2025-10-28T17:11:53.890757] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-28T17:11:54.359391] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-06. [2025-10-28T17:11:54.649010] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-28T17:11:55.159344] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-05. [2025-10-28T17:11:55.432237] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-28T17:11:55.959322] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-10. [2025-10-28T17:11:56.294430] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-28T17:11:56.759346] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-07. [2025-10-28T17:11:57.320849] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-28T17:11:57.325223] [INFO ] [REMOTE ] AMG: Full fetch complete (29473 records). [2025-10-28T17:11:57.325323] [DEBUG] [VALIDATOR ] AMG: Validating primary data. [2025-10-28T17:11:57.567316] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-07. [2025-10-28T17:11:57.687064] [DEBUG] [VALIDATOR ] AMG: All expected trading days are present. [2025-10-28T17:11:57.687130] [DEBUG] [VALIDATOR ] AMG: Primary data validation passed. [2025-10-28T17:11:57.687507] [INFO ] [MAIN ] AMG: Fetched primary data is valid. [2025-10-28T17:11:57.687567] [DEBUG] [LOCAL ] AMG: Saving primary data. [2025-10-28T17:11:57.688241] [DEBUG] [LOCAL ] AMG: Trimmed 29473 records to 19679 (keeping 200 days of data) [2025-10-28T17:11:57.808069] [DEBUG] [LOCAL ] AMG: Primary data saved (19679 records). [2025-10-28T17:11:57.808272] [INFO ] [MAIN ] AMG: Full history saved. [2025-10-28T17:11:57.808386] [INFO ] [MAIN ] Update Progress: 101/2366 symbols completed. AMG took 26.2s. Estimated remaining: 4h 27m 10s. Rate: 8.5 symbols/min [2025-10-28T17:11:57.977956] [INFO ] [MAIN ] AMPX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:11:57.978178] [DEBUG] [LOCAL ] AMPX: No existing data file found in primary storage. [2025-10-28T17:11:57.978251] [WARN ] [MAIN ] AMPX: No existing data found, performing full refresh instead. [2025-10-28T17:11:57.978426] [INFO ] [MAIN ] AMPX: Wiping existing primary data before full refresh. [2025-10-28T17:11:57.978506] [INFO ] [LOCAL ] AMPX: Starting deletion of primary data. [2025-10-28T17:11:57.978594] [DEBUG] [LOCAL ] AMPX: No primary data file found to delete. [2025-10-28T17:11:57.978671] [INFO ] [MAIN ] AMPX: Starting full primary refresh. [2025-10-28T17:11:58.102987] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-28T17:11:58.364096] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-08. [2025-10-28T17:11:58.364044] [INFO ] [REMOTE ] AMPX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:11:59.012257] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-28T17:11:59.159318] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-08. [2025-10-28T17:11:59.529924] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-28T17:11:59.959360] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-09. [2025-10-28T17:12:00.688158] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-28T17:12:00.759332] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-09. [2025-10-28T17:12:01.350176] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-28T17:12:01.559395] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-06. [2025-10-28T17:12:02.274860] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-28T17:12:02.359353] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-10. [2025-10-28T17:12:02.757008] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-28T17:12:03.159345] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-07. [2025-10-28T17:12:03.967479] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-01. [2025-10-28T17:12:03.986667] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-10 (1.63 seconds). [2025-10-28T17:12:03.997433] [INFO ] [REMOTE ] AMH: Full fetch complete (75137 records). [2025-10-28T17:12:03.997596] [DEBUG] [VALIDATOR ] AMH: Validating primary data. [2025-10-28T17:12:04.408785] [DEBUG] [VALIDATOR ] AMH: All expected trading days are present. [2025-10-28T17:12:04.408914] [DEBUG] [VALIDATOR ] AMH: Primary data validation passed. [2025-10-28T17:12:04.409674] [INFO ] [MAIN ] AMH: Fetched primary data is valid. [2025-10-28T17:12:04.409755] [DEBUG] [LOCAL ] AMH: Saving primary data. [2025-10-28T17:12:04.411265] [DEBUG] [LOCAL ] AMH: Trimmed 75137 records to 51788 (keeping 200 days of data) [2025-10-28T17:12:04.557099] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-28T17:12:04.757082] [DEBUG] [LOCAL ] AMH: Primary data saved (51788 records). [2025-10-28T17:12:04.757223] [INFO ] [MAIN ] AMH: Full history saved. [2025-10-28T17:12:04.758063] [INFO ] [MAIN ] Update Progress: 102/2366 symbols completed. AMH took 30.3s. Estimated remaining: 4h 27m 0s. Rate: 8.5 symbols/min [2025-10-28T17:12:04.769572] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-08. [2025-10-28T17:12:04.934169] [INFO ] [MAIN ] AMPY: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:12:04.972625] [DEBUG] [LOCAL ] AMPY: Loaded 39370 existing records from primary storage. [2025-10-28T17:12:04.972951] [INFO ] [MAIN ] AMPY: Loaded 39370 existing records. [2025-10-28T17:12:05.148152] [WARN ] [MAIN ] AMPY: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:12:05.148344] [INFO ] [MAIN ] AMPY: Wiping existing primary data before full refresh. [2025-10-28T17:12:05.148396] [INFO ] [LOCAL ] AMPY: Starting deletion of primary data. [2025-10-28T17:12:05.148903] [DEBUG] [LOCAL ] AMPY: Deleted primary data file. [2025-10-28T17:12:05.148960] [INFO ] [MAIN ] AMPY: Starting full primary refresh. [2025-10-28T17:12:05.508044] [INFO ] [REMOTE ] AMPY: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:12:05.559326] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-01. [2025-10-28T17:12:05.753367] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-28T17:12:05.785976] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-28T17:12:06.310823] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-28T17:12:06.359344] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-09. [2025-10-28T17:12:07.159357] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-02. [2025-10-28T17:12:07.278954] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-28T17:12:07.785970] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-28T17:12:07.959308] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-03. [2025-10-28T17:12:08.759337] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-02. [2025-10-28T17:12:09.019238] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-28T17:12:09.559336] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-04. [2025-10-28T17:12:10.168983] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-28T17:12:10.359341] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-10. [2025-10-28T17:12:10.616780] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-28T17:12:11.159344] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-10. [2025-10-28T17:12:11.586121] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-28T17:12:11.594123] [INFO ] [REMOTE ] AMN: Full fetch complete (60183 records). [2025-10-28T17:12:11.594250] [DEBUG] [VALIDATOR ] AMN: Validating primary data. [2025-10-28T17:12:11.968580] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-05. [2025-10-28T17:12:11.989707] [DEBUG] [VALIDATOR ] AMN: All expected trading days are present. [2025-10-28T17:12:11.990811] [DEBUG] [VALIDATOR ] AMN: Primary data validation passed. [2025-10-28T17:12:11.991452] [INFO ] [MAIN ] AMN: Fetched primary data is valid. [2025-10-28T17:12:11.991501] [DEBUG] [LOCAL ] AMN: Saving primary data. [2025-10-28T17:12:11.993059] [DEBUG] [LOCAL ] AMN: Trimmed 60183 records to 41432 (keeping 200 days of data) [2025-10-28T17:12:12.232455] [DEBUG] [LOCAL ] AMN: Primary data saved (41432 records). [2025-10-28T17:12:12.232623] [INFO ] [MAIN ] AMN: Full history saved. [2025-10-28T17:12:12.232759] [INFO ] [MAIN ] Update Progress: 103/2366 symbols completed. AMN took 37.4s. Estimated remaining: 4h 27m 2s. Rate: 8.5 symbols/min [2025-10-28T17:12:12.351714] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-28T17:12:12.379232] [INFO ] [REMOTE ] AMP: Full fetch complete (47473 records). [2025-10-28T17:12:12.396809] [DEBUG] [VALIDATOR ] AMP: Validating primary data. [2025-10-28T17:12:12.462231] [INFO ] [MAIN ] AMR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:12:12.741854] [DEBUG] [LOCAL ] AMR: Loaded 28408 existing records from primary storage. [2025-10-28T17:12:12.742413] [INFO ] [MAIN ] AMR: Loaded 28408 existing records. [2025-10-28T17:12:12.775119] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-03. [2025-10-28T17:12:12.928854] [DEBUG] [VALIDATOR ] AMP: All expected trading days are present. [2025-10-28T17:12:12.940096] [DEBUG] [VALIDATOR ] AMP: Primary data validation passed. [2025-10-28T17:12:12.941139] [INFO ] [MAIN ] AMP: Fetched primary data is valid. [2025-10-28T17:12:12.941240] [DEBUG] [LOCAL ] AMP: Saving primary data. [2025-10-28T17:12:13.021502] [DEBUG] [LOCAL ] AMP: Trimmed 47473 records to 31273 (keeping 200 days of data) [2025-10-28T17:12:13.021360] [WARN ] [MAIN ] AMR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:12:13.022088] [INFO ] [MAIN ] AMR: Wiping existing primary data before full refresh. [2025-10-28T17:12:13.022444] [INFO ] [LOCAL ] AMR: Starting deletion of primary data. [2025-10-28T17:12:13.030568] [DEBUG] [LOCAL ] AMR: Deleted primary data file. [2025-10-28T17:12:13.114119] [INFO ] [MAIN ] AMR: Starting full primary refresh. [2025-10-28T17:12:13.153796] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-28T17:12:13.597580] [INFO ] [REMOTE ] AMR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:12:13.577012] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-06. [2025-10-28T17:12:13.651789] [DEBUG] [LOCAL ] AMP: Primary data saved (31273 records). [2025-10-28T17:12:13.651932] [INFO ] [MAIN ] AMP: Full history saved. [2025-10-28T17:12:13.653370] [INFO ] [MAIN ] Update Progress: 104/2366 symbols completed. AMP took 31.4s. Estimated remaining: 4h 24m 52s. Rate: 8.5 symbols/min [2025-10-28T17:12:13.821397] [INFO ] [MAIN ] AMRC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:12:13.868322] [DEBUG] [LOCAL ] AMRC: Loaded 38274 existing records from primary storage. [2025-10-28T17:12:13.868581] [INFO ] [MAIN ] AMRC: Loaded 38274 existing records. [2025-10-28T17:12:14.040539] [WARN ] [MAIN ] AMRC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:12:14.040762] [INFO ] [MAIN ] AMRC: Wiping existing primary data before full refresh. [2025-10-28T17:12:14.040812] [INFO ] [LOCAL ] AMRC: Starting deletion of primary data. [2025-10-28T17:12:14.041371] [DEBUG] [LOCAL ] AMRC: Deleted primary data file. [2025-10-28T17:12:14.041426] [INFO ] [MAIN ] AMRC: Starting full primary refresh. [2025-10-28T17:12:14.364591] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-01. [2025-10-28T17:12:14.415707] [INFO ] [REMOTE ] AMRC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:12:14.618705] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-10-28T17:12:14.732284] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-28T17:12:15.159345] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-01. [2025-10-28T17:12:15.282415] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-28T17:12:15.959348] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-07. [2025-10-28T17:12:16.497600] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-28T17:12:16.759330] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-02. [2025-10-28T17:12:17.028752] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-28T17:12:17.559332] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-02. [2025-10-28T17:12:18.208248] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-28T17:12:18.359333] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-08. [2025-10-28T17:12:18.968413] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-28T17:12:19.159310] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-03. [2025-10-28T17:12:19.294075] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-28T17:12:19.959328] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-09. [2025-10-28T17:12:20.609446] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-28T17:12:20.759332] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-04. [2025-10-28T17:12:21.546464] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-28T17:12:21.559293] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-10. [2025-10-28T17:12:22.124777] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-28T17:12:22.359324] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-04. [2025-10-28T17:12:23.027435] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-28T17:12:23.036411] [INFO ] [REMOTE ] AMPY: Full fetch complete (53505 records). [2025-10-28T17:12:23.036531] [DEBUG] [VALIDATOR ] AMPY: Validating primary data. [2025-10-28T17:12:23.037246] [FATAL] [VALIDATOR ] AMPY: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T17:12:23.037339] [FATAL] [MAIN ] AMPY: Fetched primary data is invalid. Refusing to save it. [2025-10-28T17:12:23.037383] [WARN ] [MAIN ] AMPY: Deleting existing primary and derivative data due to validation failure. [2025-10-28T17:12:23.037451] [INFO ] [LOCAL ] AMPY: Starting deletion of primary data. [2025-10-28T17:12:23.037516] [DEBUG] [LOCAL ] AMPY: No primary data file found to delete. [2025-10-28T17:12:23.037552] [INFO ] [LOCAL ] AMPY: Starting deletion of derivative data. [2025-10-28T17:12:23.037765] [DEBUG] [LOCAL ] AMPY: Deleted derivative data file. [2025-10-28T17:12:23.038310] [INFO ] [MAIN ] Update Progress: 105/2366 symbols completed. AMPY took 18.3s. Estimated remaining: 4h 25m 36s. Rate: 8.5 symbols/min [2025-10-28T17:12:23.164582] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-05. [2025-10-28T17:12:23.221934] [INFO ] [MAIN ] AMRZ: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:12:23.222114] [DEBUG] [LOCAL ] AMRZ: No existing data file found in primary storage. [2025-10-28T17:12:23.222173] [WARN ] [MAIN ] AMRZ: No existing data found, performing full refresh instead. [2025-10-28T17:12:23.222318] [INFO ] [MAIN ] AMRZ: Wiping existing primary data before full refresh. [2025-10-28T17:12:23.222392] [INFO ] [LOCAL ] AMRZ: Starting deletion of primary data. [2025-10-28T17:12:23.222466] [DEBUG] [LOCAL ] AMRZ: No primary data file found to delete. [2025-10-28T17:12:23.222516] [INFO ] [MAIN ] AMRZ: Starting full primary refresh. [2025-10-28T17:12:23.585808] [INFO ] [REMOTE ] AMRZ: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:12:23.910772] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-28T17:12:23.959327] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-01. [2025-10-28T17:12:24.176916] [DEBUG] [REMOTE ] AMRZ: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-28T17:12:24.177289] [WARN ] [REMOTE ] AMRZ: No data returned for month 2025-01 [2025-10-28T17:12:24.177375] [FATAL] [REMOTE ] AMRZ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-28T17:12:24.177452] [FATAL] [MAIN ] AMRZ: Failed to fetch primary data. [2025-10-28T17:12:24.177522] [WARN ] [MAIN ] AMRZ: Deleting existing primary and derivative data due to fetch failure. [2025-10-28T17:12:24.177601] [INFO ] [LOCAL ] AMRZ: Starting deletion of primary data. [2025-10-28T17:12:24.177715] [DEBUG] [LOCAL ] AMRZ: No primary data file found to delete. [2025-10-28T17:12:24.177776] [INFO ] [LOCAL ] AMRZ: Starting deletion of derivative data. [2025-10-28T17:12:24.177836] [DEBUG] [LOCAL ] AMRZ: No derivative data file found to delete. [2025-10-28T17:12:24.177898] [INFO ] [MAIN ] Update Progress: 106/2366 symbols completed. AMRZ took 1.1s. Estimated remaining: 4h 23m 23s. Rate: 8.6 symbols/min [2025-10-28T17:12:24.356116] [INFO ] [MAIN ] AMT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:12:24.378255] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-28T17:12:24.438203] [DEBUG] [LOCAL ] AMT: Loaded 52406 existing records from primary storage. [2025-10-28T17:12:24.438497] [INFO ] [MAIN ] AMT: Loaded 52406 existing records. [2025-10-28T17:12:24.616629] [WARN ] [MAIN ] AMT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:12:24.616847] [INFO ] [MAIN ] AMT: Wiping existing primary data before full refresh. [2025-10-28T17:12:24.616892] [INFO ] [LOCAL ] AMT: Starting deletion of primary data. [2025-10-28T17:12:24.617755] [DEBUG] [LOCAL ] AMT: Deleted primary data file. [2025-10-28T17:12:24.617813] [INFO ] [MAIN ] AMT: Starting full primary refresh. [2025-10-28T17:12:24.759313] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-03. [2025-10-28T17:12:24.983208] [INFO ] [REMOTE ] AMT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:12:25.559308] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-01. [2025-10-28T17:12:25.828098] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-28T17:12:26.359352] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-05. [2025-10-28T17:12:27.159322] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-06. [2025-10-28T17:12:27.494898] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-10-28T17:12:27.720688] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-28T17:12:27.959340] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-02. [2025-10-28T17:12:28.245684] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-28T17:12:28.759336] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-07. [2025-10-28T17:12:29.454366] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-28T17:12:29.559362] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-04. [2025-10-28T17:12:29.641169] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-28T17:12:30.359344] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-08. [2025-10-28T17:12:30.600996] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-28T17:12:31.159339] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-06. [2025-10-28T17:12:31.469106] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-28T17:12:31.959376] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-05. [2025-10-28T17:12:32.714198] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-28T17:12:32.759313] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-07. [2025-10-28T17:12:33.001986] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-28T17:12:33.559330] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-06. [2025-10-28T17:12:34.323718] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-28T17:12:34.359294] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-07. [2025-10-28T17:12:35.003698] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-10-28T17:12:35.159339] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-09. [2025-10-28T17:12:35.476055] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-28T17:12:35.959381] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-03. [2025-10-28T17:12:36.401264] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-28T17:12:36.759332] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-08. [2025-10-28T17:12:37.496451] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-28T17:12:37.559297] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-04. [2025-10-28T17:12:38.359334] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-10. [2025-10-28T17:12:38.772855] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-10-28T17:12:39.011872] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-28T17:12:39.159358] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-05. [2025-10-28T17:12:39.777057] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-28T17:12:39.785249] [INFO ] [REMOTE ] AMRC: Full fetch complete (54692 records). [2025-10-28T17:12:39.785390] [DEBUG] [VALIDATOR ] AMRC: Validating primary data. [2025-10-28T17:12:39.964967] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-09. [2025-10-28T17:12:40.177784] [DEBUG] [VALIDATOR ] AMRC: All expected trading days are present. [2025-10-28T17:12:40.177869] [DEBUG] [VALIDATOR ] AMRC: Primary data validation passed. [2025-10-28T17:12:40.178504] [INFO ] [MAIN ] AMRC: Fetched primary data is valid. [2025-10-28T17:12:40.178547] [DEBUG] [LOCAL ] AMRC: Saving primary data. [2025-10-28T17:12:40.179849] [DEBUG] [LOCAL ] AMRC: Trimmed 54692 records to 38167 (keeping 200 days of data) [2025-10-28T17:12:40.395055] [DEBUG] [LOCAL ] AMRC: Primary data saved (38167 records). [2025-10-28T17:12:40.395181] [INFO ] [MAIN ] AMRC: Full history saved. [2025-10-28T17:12:40.396471] [INFO ] [MAIN ] Update Progress: 107/2366 symbols completed. AMRC took 26.7s. Estimated remaining: 4h 26m 30s. Rate: 8.5 symbols/min [2025-10-28T17:12:40.570479] [INFO ] [MAIN ] AMTB: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:12:40.595056] [DEBUG] [LOCAL ] AMTB: Loaded 20491 existing records from primary storage. [2025-10-28T17:12:40.595321] [INFO ] [MAIN ] AMTB: Loaded 20491 existing records. [2025-10-28T17:12:40.772255] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-08. [2025-10-28T17:12:40.816993] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-28T17:12:40.815207] [WARN ] [MAIN ] AMTB: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:12:40.817219] [INFO ] [MAIN ] AMTB: Wiping existing primary data before full refresh. [2025-10-28T17:12:40.827607] [INFO ] [LOCAL ] AMTB: Starting deletion of primary data. [2025-10-28T17:12:40.828458] [DEBUG] [LOCAL ] AMTB: Deleted primary data file. [2025-10-28T17:12:40.828518] [INFO ] [MAIN ] AMTB: Starting full primary refresh. [2025-10-28T17:12:41.197841] [INFO ] [REMOTE ] AMTB: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:12:41.559327] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-06. [2025-10-28T17:12:41.859079] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-10-28T17:12:41.860248] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-28T17:12:42.359352] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-01. [2025-10-28T17:12:42.918907] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-28T17:12:43.159319] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-10. [2025-10-28T17:12:43.219865] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-28T17:12:43.959336] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-02. [2025-10-28T17:12:44.728489] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-28T17:12:44.759312] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-03. [2025-10-28T17:12:45.296145] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-10 (2.14 seconds). [2025-10-28T17:12:45.306805] [INFO ] [REMOTE ] AMPX: Full fetch complete (74879 records). [2025-10-28T17:12:45.306994] [DEBUG] [VALIDATOR ] AMPX: Validating primary data. [2025-10-28T17:12:45.307867] [FATAL] [VALIDATOR ] AMPX: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T17:12:45.307958] [FATAL] [MAIN ] AMPX: Fetched primary data is invalid. Refusing to save it. [2025-10-28T17:12:45.308020] [WARN ] [MAIN ] AMPX: Deleting existing primary and derivative data due to validation failure. [2025-10-28T17:12:45.308089] [INFO ] [LOCAL ] AMPX: Starting deletion of primary data. [2025-10-28T17:12:45.308156] [DEBUG] [LOCAL ] AMPX: No primary data file found to delete. [2025-10-28T17:12:45.308194] [INFO ] [LOCAL ] AMPX: Starting deletion of derivative data. [2025-10-28T17:12:45.308234] [DEBUG] [LOCAL ] AMPX: No derivative data file found to delete. [2025-10-28T17:12:45.308320] [INFO ] [MAIN ] Update Progress: 108/2366 symbols completed. AMPX took 47.5s. Estimated remaining: 4h 25m 38s. Rate: 8.5 symbols/min [2025-10-28T17:12:45.506324] [INFO ] [MAIN ] AMTD: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:12:45.520917] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-28T17:12:45.528306] [DEBUG] [LOCAL ] AMTD: Loaded 3794 existing records from primary storage. [2025-10-28T17:12:45.528869] [INFO ] [MAIN ] AMTD: Loaded 3794 existing records. [2025-10-28T17:12:45.564448] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-07. [2025-10-28T17:12:45.744079] [WARN ] [MAIN ] AMTD: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:12:45.744357] [INFO ] [MAIN ] AMTD: Wiping existing primary data before full refresh. [2025-10-28T17:12:45.744415] [INFO ] [LOCAL ] AMTD: Starting deletion of primary data. [2025-10-28T17:12:45.744619] [DEBUG] [LOCAL ] AMTD: Deleted primary data file. [2025-10-28T17:12:45.744723] [INFO ] [MAIN ] AMTD: Starting full primary refresh. [2025-10-28T17:12:46.154864] [INFO ] [REMOTE ] AMTD: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:12:46.359332] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-04. [2025-10-28T17:12:47.159311] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-01. [2025-10-28T17:12:47.194415] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-28T17:12:47.220370] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-28T17:12:47.647722] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-28T17:12:47.959341] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-08. [2025-10-28T17:12:48.759404] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-09. [2025-10-28T17:12:49.559375] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-02. [2025-10-28T17:12:49.639564] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-28T17:12:49.776575] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-28T17:12:49.951853] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-10-28T17:12:50.359318] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-09. [2025-10-28T17:12:51.159341] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-10. [2025-10-28T17:12:51.964822] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-03. [2025-10-28T17:12:51.970174] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-28T17:12:52.293972] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-10-28T17:12:52.581026] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-28T17:12:52.586731] [INFO ] [REMOTE ] AMR: Full fetch complete (40569 records). [2025-10-28T17:12:52.586827] [DEBUG] [VALIDATOR ] AMR: Validating primary data. [2025-10-28T17:12:52.770856] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-04. [2025-10-28T17:12:52.985677] [DEBUG] [VALIDATOR ] AMR: All expected trading days are present. [2025-10-28T17:12:52.985766] [DEBUG] [VALIDATOR ] AMR: Primary data validation passed. [2025-10-28T17:12:52.986256] [INFO ] [MAIN ] AMR: Fetched primary data is valid. [2025-10-28T17:12:52.986299] [DEBUG] [LOCAL ] AMR: Saving primary data. [2025-10-28T17:12:52.987219] [DEBUG] [LOCAL ] AMR: Trimmed 40569 records to 28338 (keeping 200 days of data) [2025-10-28T17:12:53.157424] [DEBUG] [LOCAL ] AMR: Primary data saved (28338 records). [2025-10-28T17:12:53.157739] [INFO ] [MAIN ] AMR: Full history saved. [2025-10-28T17:12:53.157829] [INFO ] [MAIN ] Update Progress: 109/2366 symbols completed. AMR took 40.9s. Estimated remaining: 4h 25m 47s. Rate: 8.5 symbols/min [2025-10-28T17:12:53.250534] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-28T17:12:53.350204] [INFO ] [MAIN ] AMTM: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:12:53.393294] [DEBUG] [LOCAL ] AMTM: Loaded 50131 existing records from primary storage. [2025-10-28T17:12:53.393594] [INFO ] [MAIN ] AMTM: Loaded 50131 existing records. [2025-10-28T17:12:53.563340] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-10. [2025-10-28T17:12:53.582932] [WARN ] [MAIN ] AMTM: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:12:53.584280] [INFO ] [MAIN ] AMTM: Wiping existing primary data before full refresh. [2025-10-28T17:12:53.584350] [INFO ] [LOCAL ] AMTM: Starting deletion of primary data. [2025-10-28T17:12:53.585087] [DEBUG] [LOCAL ] AMTM: Deleted primary data file. [2025-10-28T17:12:53.585147] [INFO ] [MAIN ] AMTM: Starting full primary refresh. [2025-10-28T17:12:53.937159] [INFO ] [REMOTE ] AMTM: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:12:54.359408] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-05. [2025-10-28T17:12:55.159400] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-01. [2025-10-28T17:12:55.218172] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-28T17:12:55.267969] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-28T17:12:55.278824] [INFO ] [REMOTE ] AMT: Full fetch complete (76158 records). [2025-10-28T17:12:55.278980] [DEBUG] [VALIDATOR ] AMT: Validating primary data. [2025-10-28T17:12:55.687343] [DEBUG] [VALIDATOR ] AMT: All expected trading days are present. [2025-10-28T17:12:55.687420] [DEBUG] [VALIDATOR ] AMT: Primary data validation passed. [2025-10-28T17:12:55.688142] [INFO ] [MAIN ] AMT: Fetched primary data is valid. [2025-10-28T17:12:55.688203] [DEBUG] [LOCAL ] AMT: Saving primary data. [2025-10-28T17:12:55.689540] [DEBUG] [LOCAL ] AMT: Trimmed 76158 records to 52408 (keeping 200 days of data) [2025-10-28T17:12:55.972069] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-06. [2025-10-28T17:12:56.016446] [DEBUG] [LOCAL ] AMT: Primary data saved (52408 records). [2025-10-28T17:12:56.017052] [INFO ] [MAIN ] AMT: Full history saved. [2025-10-28T17:12:56.018136] [INFO ] [MAIN ] Update Progress: 110/2366 symbols completed. AMT took 31.8s. Estimated remaining: 4h 24m 14s. Rate: 8.5 symbols/min [2025-10-28T17:12:56.183489] [INFO ] [MAIN ] AMWL: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:12:56.183635] [DEBUG] [LOCAL ] AMWL: No existing data file found in primary storage. [2025-10-28T17:12:56.183708] [WARN ] [MAIN ] AMWL: No existing data found, performing full refresh instead. [2025-10-28T17:12:56.183815] [INFO ] [MAIN ] AMWL: Wiping existing primary data before full refresh. [2025-10-28T17:12:56.183856] [INFO ] [LOCAL ] AMWL: Starting deletion of primary data. [2025-10-28T17:12:56.183896] [DEBUG] [LOCAL ] AMWL: No primary data file found to delete. [2025-10-28T17:12:56.183928] [INFO ] [MAIN ] AMWL: Starting full primary refresh. [2025-10-28T17:12:56.536253] [INFO ] [REMOTE ] AMWL: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:12:56.549190] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-28T17:12:56.580466] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-28T17:12:56.759342] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-02. [2025-10-28T17:12:57.559360] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-01. [2025-10-28T17:12:57.994996] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-28T17:12:58.201078] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-28T17:12:58.359344] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-02. [2025-10-28T17:12:58.930262] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-28T17:12:59.159327] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-05. [2025-10-28T17:12:59.799999] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-28T17:12:59.959365] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-07. [2025-10-28T17:13:00.759317] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-03. [2025-10-28T17:13:00.912492] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-28T17:13:01.559319] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-06. [2025-10-28T17:13:02.039381] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-28T17:13:02.359329] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-03. [2025-10-28T17:13:02.846012] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-28T17:13:03.159335] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-04. [2025-10-28T17:13:03.345878] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-03 (2.59 seconds). [2025-10-28T17:13:03.959394] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-07. [2025-10-28T17:13:04.011921] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-28T17:13:04.353338] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-10-28T17:13:04.759378] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-08. [2025-10-28T17:13:05.559356] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-04. [2025-10-28T17:13:05.707509] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-28T17:13:06.359388] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-09. [2025-10-28T17:13:07.073876] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-28T17:13:07.159315] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-10. [2025-10-28T17:13:07.242215] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-28T17:13:07.959360] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-05. [2025-10-28T17:13:07.976764] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-28T17:13:07.981512] [INFO ] [REMOTE ] AMTB: Full fetch complete (29855 records). [2025-10-28T17:13:07.981589] [DEBUG] [VALIDATOR ] AMTB: Validating primary data. [2025-10-28T17:13:08.345511] [DEBUG] [VALIDATOR ] AMTB: All expected trading days are present. [2025-10-28T17:13:08.345582] [DEBUG] [VALIDATOR ] AMTB: Primary data validation passed. [2025-10-28T17:13:08.345958] [INFO ] [MAIN ] AMTB: Fetched primary data is valid. [2025-10-28T17:13:08.346022] [DEBUG] [LOCAL ] AMTB: Saving primary data. [2025-10-28T17:13:08.346723] [DEBUG] [LOCAL ] AMTB: Trimmed 29855 records to 20507 (keeping 200 days of data) [2025-10-28T17:13:08.473908] [DEBUG] [LOCAL ] AMTB: Primary data saved (20507 records). [2025-10-28T17:13:08.474042] [INFO ] [MAIN ] AMTB: Full history saved. [2025-10-28T17:13:08.474121] [INFO ] [MAIN ] Update Progress: 111/2366 symbols completed. AMTB took 28.1s. Estimated remaining: 4h 25m 57s. Rate: 8.5 symbols/min [2025-10-28T17:13:08.650194] [INFO ] [MAIN ] AMX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:13:08.693738] [DEBUG] [LOCAL ] AMX: Loaded 49065 existing records from primary storage. [2025-10-28T17:13:08.694028] [INFO ] [MAIN ] AMX: Loaded 49065 existing records. [2025-10-28T17:13:08.768625] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-08. [2025-10-28T17:13:08.873633] [WARN ] [MAIN ] AMX: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:13:08.873825] [INFO ] [MAIN ] AMX: Wiping existing primary data before full refresh. [2025-10-28T17:13:08.873871] [INFO ] [LOCAL ] AMX: Starting deletion of primary data. [2025-10-28T17:13:08.874590] [DEBUG] [LOCAL ] AMX: Deleted primary data file. [2025-10-28T17:13:08.874676] [INFO ] [MAIN ] AMX: Starting full primary refresh. [2025-10-28T17:13:09.246247] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-28T17:13:09.251040] [INFO ] [REMOTE ] AMX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:13:09.559351] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-01. [2025-10-28T17:13:09.715563] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-28T17:13:10.359316] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-06. [2025-10-28T17:13:10.816857] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-28T17:13:11.159395] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-09. [2025-10-28T17:13:11.645502] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-28T17:13:11.704665] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-28T17:13:11.959328] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-10. [2025-10-28T17:13:12.607349] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-28T17:13:12.608722] [INFO ] [REMOTE ] AMTD: Full fetch complete (5368 records). [2025-10-28T17:13:12.608792] [DEBUG] [VALIDATOR ] AMTD: Validating primary data. [2025-10-28T17:13:12.764550] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-05. [2025-10-28T17:13:12.981412] [DEBUG] [VALIDATOR ] AMTD: All expected trading days are present. [2025-10-28T17:13:12.981488] [DEBUG] [VALIDATOR ] AMTD: Primary data validation passed. [2025-10-28T17:13:12.981705] [INFO ] [MAIN ] AMTD: Fetched primary data is valid. [2025-10-28T17:13:12.981766] [DEBUG] [LOCAL ] AMTD: Saving primary data. [2025-10-28T17:13:12.982201] [DEBUG] [LOCAL ] AMTD: Trimmed 5368 records to 3803 (keeping 200 days of data) [2025-10-28T17:13:13.004036] [DEBUG] [LOCAL ] AMTD: Primary data saved (3803 records). [2025-10-28T17:13:13.004160] [INFO ] [MAIN ] AMTD: Full history saved. [2025-10-28T17:13:13.004256] [INFO ] [MAIN ] Update Progress: 112/2366 symbols completed. AMTD took 27.7s. Estimated remaining: 4h 24m 59s. Rate: 8.5 symbols/min [2025-10-28T17:13:13.182867] [INFO ] [MAIN ] AN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:13:13.211665] [DEBUG] [LOCAL ] AN: Loaded 30923 existing records from primary storage. [2025-10-28T17:13:13.211925] [INFO ] [MAIN ] AN: Loaded 30923 existing records. [2025-10-28T17:13:13.384366] [WARN ] [MAIN ] AN: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:13:13.384575] [INFO ] [MAIN ] AN: Wiping existing primary data before full refresh. [2025-10-28T17:13:13.384621] [INFO ] [LOCAL ] AN: Starting deletion of primary data. [2025-10-28T17:13:13.385241] [DEBUG] [LOCAL ] AN: Deleted primary data file. [2025-10-28T17:13:13.385310] [INFO ] [MAIN ] AN: Starting full primary refresh. [2025-10-28T17:13:13.566693] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-07. [2025-10-28T17:13:13.607730] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-28T17:13:13.760284] [INFO ] [REMOTE ] AN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:13:14.359340] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-02. [2025-10-28T17:13:15.112276] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-28T17:13:15.159294] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-08. [2025-10-28T17:13:15.516012] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-28T17:13:15.959338] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-01. [2025-10-28T17:13:16.335329] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-28T17:13:16.759325] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-09. [2025-10-28T17:13:17.128891] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-28T17:13:17.559310] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-03. [2025-10-28T17:13:18.359381] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-06. [2025-10-28T17:13:18.565876] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-28T17:13:18.819940] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-28T17:13:18.986359] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-28T17:13:19.159328] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-07. [2025-10-28T17:13:19.648133] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-28T17:13:19.959323] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-02. [2025-10-28T17:13:20.759326] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-04. [2025-10-28T17:13:20.975573] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-28T17:13:21.559332] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-10. [2025-10-28T17:13:22.309169] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-28T17:13:22.359326] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-08. [2025-10-28T17:13:22.916546] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-28T17:13:23.084864] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-28T17:13:23.098185] [INFO ] [REMOTE ] AMTM: Full fetch complete (73441 records). [2025-10-28T17:13:23.098394] [DEBUG] [VALIDATOR ] AMTM: Validating primary data. [2025-10-28T17:13:23.159393] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-03. [2025-10-28T17:13:23.551266] [DEBUG] [VALIDATOR ] AMTM: All expected trading days are present. [2025-10-28T17:13:23.551348] [DEBUG] [VALIDATOR ] AMTM: Primary data validation passed. [2025-10-28T17:13:23.552143] [INFO ] [MAIN ] AMTM: Fetched primary data is valid. [2025-10-28T17:13:23.552208] [DEBUG] [LOCAL ] AMTM: Saving primary data. [2025-10-28T17:13:23.553605] [DEBUG] [LOCAL ] AMTM: Trimmed 73441 records to 50074 (keeping 200 days of data) [2025-10-28T17:13:23.842020] [DEBUG] [LOCAL ] AMTM: Primary data saved (50074 records). [2025-10-28T17:13:23.842153] [INFO ] [MAIN ] AMTM: Full history saved. [2025-10-28T17:13:23.842255] [INFO ] [MAIN ] Update Progress: 113/2366 symbols completed. AMTM took 30.7s. Estimated remaining: 4h 26m 7s. Rate: 8.5 symbols/min [2025-10-28T17:13:23.964554] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-05. [2025-10-28T17:13:24.038087] [INFO ] [MAIN ] ANET: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:13:24.089271] [DEBUG] [LOCAL ] ANET: Loaded 53766 existing records from primary storage. [2025-10-28T17:13:24.089762] [INFO ] [MAIN ] ANET: Loaded 53766 existing records. [2025-10-28T17:13:24.285395] [WARN ] [MAIN ] ANET: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:13:24.286021] [INFO ] [MAIN ] ANET: Wiping existing primary data before full refresh. [2025-10-28T17:13:24.286088] [INFO ] [LOCAL ] ANET: Starting deletion of primary data. [2025-10-28T17:13:24.286903] [DEBUG] [LOCAL ] ANET: Deleted primary data file. [2025-10-28T17:13:24.286959] [INFO ] [MAIN ] ANET: Starting full primary refresh. [2025-10-28T17:13:24.649807] [INFO ] [REMOTE ] ANET: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:13:24.707187] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-28T17:13:24.759309] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-04. [2025-10-28T17:13:25.149041] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-28T17:13:25.559329] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-06. [2025-10-28T17:13:25.923914] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-28T17:13:26.359406] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-01. [2025-10-28T17:13:27.064306] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-28T17:13:27.159319] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-05. [2025-10-28T17:13:27.959385] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-09. [2025-10-28T17:13:28.310550] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-28T17:13:28.592457] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-28T17:13:28.734300] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-28T17:13:28.759293] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-06. [2025-10-28T17:13:29.559338] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-02. [2025-10-28T17:13:29.699767] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-28T17:13:30.359356] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-10. [2025-10-28T17:13:31.070327] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-28T17:13:31.074090] [INFO ] [REMOTE ] AMWL: Full fetch complete (14877 records). [2025-10-28T17:13:31.074174] [DEBUG] [VALIDATOR ] AMWL: Validating primary data. [2025-10-28T17:13:31.164425] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-07. [2025-10-28T17:13:31.437606] [DEBUG] [VALIDATOR ] AMWL: All expected trading days are present. [2025-10-28T17:13:31.437708] [DEBUG] [VALIDATOR ] AMWL: Primary data validation passed. [2025-10-28T17:13:31.437990] [INFO ] [MAIN ] AMWL: Fetched primary data is valid. [2025-10-28T17:13:31.438030] [DEBUG] [LOCAL ] AMWL: Saving primary data. [2025-10-28T17:13:31.438497] [DEBUG] [LOCAL ] AMWL: Trimmed 14877 records to 9959 (keeping 200 days of data) [2025-10-28T17:13:31.496977] [DEBUG] [LOCAL ] AMWL: Primary data saved (9959 records). [2025-10-28T17:13:31.497085] [INFO ] [MAIN ] AMWL: Full history saved. [2025-10-28T17:13:31.497151] [INFO ] [MAIN ] Update Progress: 114/2366 symbols completed. AMWL took 35.5s. Estimated remaining: 4h 26m 11s. Rate: 8.5 symbols/min [2025-10-28T17:13:31.681089] [INFO ] [MAIN ] ANF: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:13:31.772722] [DEBUG] [LOCAL ] ANF: Loaded 51990 existing records from primary storage. [2025-10-28T17:13:31.773522] [INFO ] [MAIN ] ANF: Loaded 51990 existing records. [2025-10-28T17:13:31.977819] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-02 (2.42 seconds). [2025-10-28T17:13:31.978073] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-07. [2025-10-28T17:13:32.021486] [WARN ] [MAIN ] ANF: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:13:32.021900] [INFO ] [MAIN ] ANF: Wiping existing primary data before full refresh. [2025-10-28T17:13:32.021962] [INFO ] [LOCAL ] ANF: Starting deletion of primary data. [2025-10-28T17:13:32.022912] [DEBUG] [LOCAL ] ANF: Deleted primary data file. [2025-10-28T17:13:32.022975] [INFO ] [MAIN ] ANF: Starting full primary refresh. [2025-10-28T17:13:32.408805] [INFO ] [REMOTE ] ANF: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:13:32.435791] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-28T17:13:32.759318] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-08. [2025-10-28T17:13:33.333439] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-28T17:13:33.421760] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-28T17:13:33.559331] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-03. [2025-10-28T17:13:34.359346] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-09. [2025-10-28T17:13:35.159354] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-08. [2025-10-28T17:13:35.480422] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-28T17:13:35.599801] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-28T17:13:35.959324] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-10. [2025-10-28T17:13:36.743096] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-28T17:13:36.759297] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-09. [2025-10-28T17:13:37.282252] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-28T17:13:37.289313] [INFO ] [REMOTE ] AN: Full fetch complete (47236 records). [2025-10-28T17:13:37.289509] [DEBUG] [VALIDATOR ] AN: Validating primary data. [2025-10-28T17:13:37.567707] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-01. [2025-10-28T17:13:37.689455] [DEBUG] [VALIDATOR ] AN: All expected trading days are present. [2025-10-28T17:13:37.689576] [DEBUG] [VALIDATOR ] AN: Primary data validation passed. [2025-10-28T17:13:37.690287] [INFO ] [MAIN ] AN: Fetched primary data is valid. [2025-10-28T17:13:37.690356] [DEBUG] [LOCAL ] AN: Saving primary data. [2025-10-28T17:13:37.691845] [DEBUG] [LOCAL ] AN: Trimmed 47236 records to 30898 (keeping 200 days of data) [2025-10-28T17:13:37.876590] [DEBUG] [LOCAL ] AN: Primary data saved (30898 records). [2025-10-28T17:13:37.876750] [INFO ] [MAIN ] AN: Full history saved. [2025-10-28T17:13:37.876835] [INFO ] [MAIN ] Update Progress: 115/2366 symbols completed. AN took 24.9s. Estimated remaining: 4h 25m 50s. Rate: 8.5 symbols/min [2025-10-28T17:13:38.054963] [INFO ] [MAIN ] ANGX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:13:38.055259] [DEBUG] [LOCAL ] ANGX: No existing data file found in primary storage. [2025-10-28T17:13:38.055414] [WARN ] [MAIN ] ANGX: No existing data found, performing full refresh instead. [2025-10-28T17:13:38.055563] [INFO ] [MAIN ] ANGX: Wiping existing primary data before full refresh. [2025-10-28T17:13:38.055816] [INFO ] [LOCAL ] ANGX: Starting deletion of primary data. [2025-10-28T17:13:38.056021] [DEBUG] [LOCAL ] ANGX: No primary data file found to delete. [2025-10-28T17:13:38.056095] [INFO ] [MAIN ] ANGX: Starting full primary refresh. [2025-10-28T17:13:38.250550] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-28T17:13:38.369305] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-10. [2025-10-28T17:13:38.475588] [INFO ] [REMOTE ] ANGX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:13:39.159366] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-04. [2025-10-28T17:13:39.300791] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-28T17:13:39.836049] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-28T17:13:39.846081] [INFO ] [REMOTE ] AMX: Full fetch complete (71010 records). [2025-10-28T17:13:39.846223] [DEBUG] [VALIDATOR ] AMX: Validating primary data. [2025-10-28T17:13:39.965847] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-01. [2025-10-28T17:13:40.214525] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-28T17:13:40.231430] [WARN ] [REMOTE ] ANGX: No data returned for month 2025-01 [2025-10-28T17:13:40.235126] [FATAL] [REMOTE ] ANGX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-28T17:13:40.252417] [DEBUG] [VALIDATOR ] AMX: All expected trading days are present. [2025-10-28T17:13:40.252532] [FATAL] [MAIN ] ANGX: Failed to fetch primary data. [2025-10-28T17:13:40.252608] [DEBUG] [VALIDATOR ] AMX: Primary data validation passed. [2025-10-28T17:13:40.253439] [INFO ] [MAIN ] AMX: Fetched primary data is valid. [2025-10-28T17:13:40.253541] [WARN ] [MAIN ] ANGX: Deleting existing primary and derivative data due to fetch failure. [2025-10-28T17:13:40.253613] [DEBUG] [LOCAL ] AMX: Saving primary data. [2025-10-28T17:13:40.253926] [INFO ] [LOCAL ] ANGX: Starting deletion of primary data. [2025-10-28T17:13:40.254014] [DEBUG] [LOCAL ] ANGX: No primary data file found to delete. [2025-10-28T17:13:40.254054] [INFO ] [LOCAL ] ANGX: Starting deletion of derivative data. [2025-10-28T17:13:40.254095] [DEBUG] [LOCAL ] ANGX: No derivative data file found to delete. [2025-10-28T17:13:40.254144] [INFO ] [MAIN ] Update Progress: 116/2366 symbols completed. ANGX took 2.4s. Estimated remaining: 4h 24m 12s. Rate: 8.5 symbols/min [2025-10-28T17:13:40.361359] [DEBUG] [LOCAL ] AMX: Trimmed 71010 records to 49047 (keeping 200 days of data) [2025-10-28T17:13:40.526638] [INFO ] [MAIN ] ANRO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:13:40.528137] [DEBUG] [LOCAL ] ANRO: No existing data file found in primary storage. [2025-10-28T17:13:40.529179] [WARN ] [MAIN ] ANRO: No existing data found, performing full refresh instead. [2025-10-28T17:13:40.530363] [INFO ] [MAIN ] ANRO: Wiping existing primary data before full refresh. [2025-10-28T17:13:40.531717] [INFO ] [LOCAL ] ANRO: Starting deletion of primary data. [2025-10-28T17:13:40.532377] [DEBUG] [LOCAL ] ANRO: No primary data file found to delete. [2025-10-28T17:13:40.532690] [INFO ] [MAIN ] ANRO: Starting full primary refresh. [2025-10-28T17:13:40.789240] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-02. [2025-10-28T17:13:41.137963] [INFO ] [REMOTE ] ANRO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:13:41.144912] [DEBUG] [LOCAL ] AMX: Primary data saved (49047 records). [2025-10-28T17:13:41.144987] [INFO ] [MAIN ] AMX: Full history saved. [2025-10-28T17:13:41.145876] [INFO ] [MAIN ] Update Progress: 117/2366 symbols completed. AMX took 32.7s. Estimated remaining: 4h 22m 7s. Rate: 8.6 symbols/min [2025-10-28T17:13:41.283573] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-10-28T17:13:41.559352] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-01. [2025-10-28T17:13:42.246252] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-28T17:13:42.359304] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-03. [2025-10-28T17:13:42.475254] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-28T17:13:43.159394] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-05. [2025-10-28T17:13:43.730058] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-28T17:13:43.959406] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-02. [2025-10-28T17:13:44.648353] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-28T17:13:44.767316] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-03. [2025-10-28T17:13:44.790458] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-28T17:13:45.559366] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-06. [2025-10-28T17:13:45.608370] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-28T17:13:46.359402] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-04. [2025-10-28T17:13:47.159388] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-04. [2025-10-28T17:13:47.197724] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-28T17:13:47.889810] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-28T17:13:47.959410] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-05. [2025-10-28T17:13:48.267831] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-28T17:13:48.759333] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-07. [2025-10-28T17:13:49.559337] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-05. [2025-10-28T17:13:49.725398] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-28T17:13:50.226405] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-28T17:13:50.359372] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-06. [2025-10-28T17:13:50.428558] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-28T17:13:51.159344] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-08. [2025-10-28T17:13:51.959396] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-06. [2025-10-28T17:13:52.324757] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-10-28T17:13:52.759382] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-07. [2025-10-28T17:13:52.794474] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-28T17:13:53.285677] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-10-28T17:13:53.559390] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-09. [2025-10-28T17:13:54.326639] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-28T17:13:54.359296] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-08. [2025-10-28T17:13:55.159341] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-07. [2025-10-28T17:13:55.664839] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-10-28T17:13:55.876638] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-28T17:13:55.959353] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-10. [2025-10-28T17:13:56.107819] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-28T17:13:56.508961] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-28T17:13:56.521147] [INFO ] [REMOTE ] ANET: Full fetch complete (77945 records). [2025-10-28T17:13:56.521332] [DEBUG] [VALIDATOR ] ANET: Validating primary data. [2025-10-28T17:13:56.761847] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-08. [2025-10-28T17:13:57.101309] [DEBUG] [VALIDATOR ] ANET: All expected trading days are present. [2025-10-28T17:13:57.101438] [DEBUG] [VALIDATOR ] ANET: Primary data validation passed. [2025-10-28T17:13:57.102569] [INFO ] [MAIN ] ANET: Fetched primary data is valid. [2025-10-28T17:13:57.102696] [DEBUG] [LOCAL ] ANET: Saving primary data. [2025-10-28T17:13:57.104610] [DEBUG] [LOCAL ] ANET: Trimmed 77945 records to 53766 (keeping 200 days of data) [2025-10-28T17:13:57.459215] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-28T17:13:57.495097] [DEBUG] [LOCAL ] ANET: Primary data saved (53766 records). [2025-10-28T17:13:57.495259] [INFO ] [MAIN ] ANET: Full history saved. [2025-10-28T17:13:57.495353] [INFO ] [MAIN ] Update Progress: 118/2366 symbols completed. ANET took 33.7s. Estimated remaining: 4h 24m 58s. Rate: 8.5 symbols/min [2025-10-28T17:13:57.559386] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-09. [2025-10-28T17:13:58.359364] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-09. [2025-10-28T17:13:58.845183] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-28T17:13:58.864354] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-28T17:13:59.159334] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-10. [2025-10-28T17:13:59.959384] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-10. [2025-10-28T17:14:00.258755] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-28T17:14:00.265959] [INFO ] [REMOTE ] ANRO: Full fetch complete (30769 records). [2025-10-28T17:14:00.266066] [DEBUG] [VALIDATOR ] ANRO: Validating primary data. [2025-10-28T17:14:00.658100] [DEBUG] [VALIDATOR ] ANRO: All expected trading days are present. [2025-10-28T17:14:00.658240] [DEBUG] [VALIDATOR ] ANRO: Primary data validation passed. [2025-10-28T17:14:00.659065] [INFO ] [MAIN ] ANRO: Fetched primary data is valid. [2025-10-28T17:14:00.659145] [DEBUG] [LOCAL ] ANRO: Saving primary data. [2025-10-28T17:14:00.660405] [DEBUG] [LOCAL ] ANRO: Trimmed 30769 records to 19705 (keeping 200 days of data) [2025-10-28T17:14:00.775261] [DEBUG] [LOCAL ] ANRO: Primary data saved (19705 records). [2025-10-28T17:14:00.775501] [INFO ] [MAIN ] ANRO: Full history saved. [2025-10-28T17:14:00.775597] [INFO ] [MAIN ] Update Progress: 119/2366 symbols completed. ANRO took 20.5s. Estimated remaining: 4h 23m 39s. Rate: 8.5 symbols/min [2025-10-28T17:14:01.748734] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-28T17:14:01.760857] [INFO ] [REMOTE ] ANF: Full fetch complete (75800 records). [2025-10-28T17:14:01.761040] [DEBUG] [VALIDATOR ] ANF: Validating primary data. [2025-10-28T17:14:02.184385] [DEBUG] [VALIDATOR ] ANF: All expected trading days are present. [2025-10-28T17:14:02.184477] [DEBUG] [VALIDATOR ] ANF: Primary data validation passed. [2025-10-28T17:14:02.185252] [INFO ] [MAIN ] ANF: Fetched primary data is valid. [2025-10-28T17:14:02.185324] [DEBUG] [LOCAL ] ANF: Saving primary data. [2025-10-28T17:14:02.186863] [DEBUG] [LOCAL ] ANF: Trimmed 75800 records to 51983 (keeping 200 days of data) [2025-10-28T17:14:02.486052] [DEBUG] [LOCAL ] ANF: Primary data saved (51983 records). [2025-10-28T17:14:02.486187] [INFO ] [MAIN ] ANF: Full history saved. [2025-10-28T17:14:02.488355] [INFO ] [MAIN ] Update Progress: 120/2366 symbols completed. ANF took 31.0s. Estimated remaining: 4h 21m 53s. Rate: 8.6 symbols/min [2025-10-28T17:14:03.196371] [INFO ] [MAIN ] AOMD: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:14:03.221073] [INFO ] [MAIN ] ANVS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:14:03.277126] [INFO ] [MAIN ] AOMR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:14:03.267833] [DEBUG] [LOCAL ] AOMD: No existing data file found in primary storage. [2025-10-28T17:14:03.320026] [INFO ] [MAIN ] AOD: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:14:03.320211] [WARN ] [MAIN ] AOMD: No existing data found, performing full refresh instead. [2025-10-28T17:14:03.321417] [INFO ] [MAIN ] AOMD: Wiping existing primary data before full refresh. [2025-10-28T17:14:03.321481] [INFO ] [LOCAL ] AOMD: Starting deletion of primary data. [2025-10-28T17:14:03.321535] [DEBUG] [LOCAL ] AOMD: No primary data file found to delete. [2025-10-28T17:14:03.321572] [INFO ] [MAIN ] AOMD: Starting full primary refresh. [2025-10-28T17:14:03.461318] [DEBUG] [LOCAL ] AOMR: Loaded 16054 existing records from primary storage. [2025-10-28T17:14:03.479749] [INFO ] [MAIN ] AOMR: Loaded 16054 existing records. [2025-10-28T17:14:03.534109] [DEBUG] [LOCAL ] ANVS: Loaded 23987 existing records from primary storage. [2025-10-28T17:14:03.580093] [INFO ] [MAIN ] ANVS: Loaded 23987 existing records. [2025-10-28T17:14:03.666062] [DEBUG] [LOCAL ] AOD: Loaded 30589 existing records from primary storage. [2025-10-28T17:14:03.776576] [INFO ] [MAIN ] AOD: Loaded 30589 existing records. [2025-10-28T17:14:04.250121] [WARN ] [MAIN ] AOMR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:14:04.272814] [INFO ] [MAIN ] AOMR: Wiping existing primary data before full refresh. [2025-10-28T17:14:04.246112] [WARN ] [MAIN ] ANVS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:14:04.276245] [INFO ] [MAIN ] ANVS: Wiping existing primary data before full refresh. [2025-10-28T17:14:04.281475] [INFO ] [LOCAL ] AOMR: Starting deletion of primary data. [2025-10-28T17:14:04.341785] [DEBUG] [LOCAL ] AOMR: Deleted primary data file. [2025-10-28T17:14:04.342037] [INFO ] [MAIN ] AOMR: Starting full primary refresh. [2025-10-28T17:14:04.362338] [INFO ] [LOCAL ] ANVS: Starting deletion of primary data. [2025-10-28T17:14:04.362257] [INFO ] [REMOTE ] AOMD: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:14:04.408782] [WARN ] [MAIN ] AOD: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:14:04.420080] [DEBUG] [LOCAL ] ANVS: Deleted primary data file. [2025-10-28T17:14:04.431024] [INFO ] [MAIN ] AOD: Wiping existing primary data before full refresh. [2025-10-28T17:14:04.425670] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-01. [2025-10-28T17:14:04.448050] [INFO ] [LOCAL ] AOD: Starting deletion of primary data. [2025-10-28T17:14:04.448147] [INFO ] [MAIN ] ANVS: Starting full primary refresh. [2025-10-28T17:14:04.468408] [DEBUG] [LOCAL ] AOD: Deleted primary data file. [2025-10-28T17:14:04.542945] [INFO ] [MAIN ] AOD: Starting full primary refresh. [2025-10-28T17:14:04.719969] [DEBUG] [REMOTE ] AOMD: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-28T17:14:04.725681] [WARN ] [REMOTE ] AOMD: No data returned for month 2025-01 [2025-10-28T17:14:04.787057] [FATAL] [REMOTE ] AOMD: API call failed - aborting fetch to avoid wasting further API calls [2025-10-28T17:14:04.830489] [FATAL] [MAIN ] AOMD: Failed to fetch primary data. [2025-10-28T17:14:04.841094] [WARN ] [MAIN ] AOMD: Deleting existing primary and derivative data due to fetch failure. [2025-10-28T17:14:04.891258] [INFO ] [LOCAL ] AOMD: Starting deletion of primary data. [2025-10-28T17:14:04.911993] [DEBUG] [LOCAL ] AOMD: No primary data file found to delete. [2025-10-28T17:14:04.922412] [INFO ] [LOCAL ] AOMD: Starting deletion of derivative data. [2025-10-28T17:14:04.958217] [DEBUG] [LOCAL ] AOMD: No derivative data file found to delete. [2025-10-28T17:14:05.084486] [INFO ] [MAIN ] Update Progress: 121/2366 symbols completed. AOMD took 2.6s. Estimated remaining: 4h 20m 24s. Rate: 8.6 symbols/min [2025-10-28T17:14:05.447623] [INFO ] [REMOTE ] AOMR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:14:05.495570] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-01. [2025-10-28T17:14:05.750078] [INFO ] [REMOTE ] AOD: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:14:05.777061] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-01. [2025-10-28T17:14:05.770728] [INFO ] [MAIN ] AON: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:14:05.799519] [INFO ] [REMOTE ] ANVS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:14:05.800968] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-01. [2025-10-28T17:14:05.841355] [DEBUG] [LOCAL ] AON: Loaded 44854 existing records from primary storage. [2025-10-28T17:14:05.841635] [INFO ] [MAIN ] AON: Loaded 44854 existing records. [2025-10-28T17:14:06.023822] [WARN ] [MAIN ] AON: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:14:06.024015] [INFO ] [MAIN ] AON: Wiping existing primary data before full refresh. [2025-10-28T17:14:06.024062] [INFO ] [LOCAL ] AON: Starting deletion of primary data. [2025-10-28T17:14:06.024565] [DEBUG] [LOCAL ] AON: Deleted primary data file. [2025-10-28T17:14:06.024679] [INFO ] [MAIN ] AON: Starting full primary refresh. [2025-10-28T17:14:06.385269] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-28T17:14:06.391700] [INFO ] [REMOTE ] AON: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:14:06.394722] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-02. [2025-10-28T17:14:06.395037] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-01. [2025-10-28T17:14:06.746003] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-28T17:14:06.751633] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-02. [2025-10-28T17:14:06.937476] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-28T17:14:06.944571] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-02. [2025-10-28T17:14:07.068286] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-28T17:14:07.159343] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-03. [2025-10-28T17:14:07.719290] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-28T17:14:07.743733] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-28T17:14:07.791061] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-28T17:14:07.959331] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-02. [2025-10-28T17:14:08.167677] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-28T17:14:08.759351] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-03. [2025-10-28T17:14:09.204214] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-28T17:14:09.485879] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-28T17:14:09.559338] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-04. [2025-10-28T17:14:10.359299] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-03. [2025-10-28T17:14:10.428342] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-28T17:14:11.159323] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-03. [2025-10-28T17:14:11.761548] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-28T17:14:11.959304] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-05. [2025-10-28T17:14:11.988247] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-28T17:14:12.759328] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-04. [2025-10-28T17:14:12.816448] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-28T17:14:13.559332] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-04. [2025-10-28T17:14:14.228441] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-28T17:14:14.359325] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-05. [2025-10-28T17:14:14.849349] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-28T17:14:15.159327] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-05. [2025-10-28T17:14:15.609491] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-28T17:14:15.959330] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-04. [2025-10-28T17:14:16.074543] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-28T17:14:16.759326] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-06. [2025-10-28T17:14:17.010015] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-28T17:14:17.559337] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-05. [2025-10-28T17:14:18.248098] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-28T17:14:18.359295] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-07. [2025-10-28T17:14:18.750469] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-28T17:14:19.159317] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-06. [2025-10-28T17:14:19.275692] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-28T17:14:19.799632] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-28T17:14:19.959325] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-07. [2025-10-28T17:14:20.566354] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-28T17:14:20.759329] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-08. [2025-10-28T17:14:21.494689] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-28T17:14:21.559301] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-09. [2025-10-28T17:14:22.157919] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-28T17:14:22.359341] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-06. [2025-10-28T17:14:23.159406] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-08. [2025-10-28T17:14:23.524237] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-28T17:14:23.959321] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-06. [2025-10-28T17:14:24.098154] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-28T17:14:24.759336] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-07. [2025-10-28T17:14:25.559306] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-09. [2025-10-28T17:14:25.615679] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-28T17:14:25.849490] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-28T17:14:26.188681] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-28T17:14:26.359365] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-07. [2025-10-28T17:14:27.159323] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-08. [2025-10-28T17:14:27.895456] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-28T17:14:27.959297] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-08. [2025-10-28T17:14:28.100734] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-28T17:14:28.759384] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-09. [2025-10-28T17:14:29.191737] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-28T17:14:29.559304] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-10. [2025-10-28T17:14:29.880222] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-28T17:14:30.359394] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-10. [2025-10-28T17:14:30.801623] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-28T17:14:30.807964] [INFO ] [REMOTE ] ANVS: Full fetch complete (36708 records). [2025-10-28T17:14:30.808084] [DEBUG] [VALIDATOR ] ANVS: Validating primary data. [2025-10-28T17:14:31.165499] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-10. [2025-10-28T17:14:31.182080] [DEBUG] [VALIDATOR ] ANVS: All expected trading days are present. [2025-10-28T17:14:31.182158] [DEBUG] [VALIDATOR ] ANVS: Primary data validation passed. [2025-10-28T17:14:31.182876] [INFO ] [MAIN ] ANVS: Fetched primary data is valid. [2025-10-28T17:14:31.182940] [DEBUG] [LOCAL ] ANVS: Saving primary data. [2025-10-28T17:14:31.183950] [DEBUG] [LOCAL ] ANVS: Trimmed 36708 records to 24020 (keeping 200 days of data) [2025-10-28T17:14:31.315616] [DEBUG] [LOCAL ] ANVS: Primary data saved (24020 records). [2025-10-28T17:14:31.315775] [INFO ] [MAIN ] ANVS: Full history saved. [2025-10-28T17:14:31.315885] [INFO ] [MAIN ] Update Progress: 122/2366 symbols completed. ANVS took 28.8s. Estimated remaining: 4h 26m 11s. Rate: 8.4 symbols/min [2025-10-28T17:14:31.488782] [INFO ] [MAIN ] AORT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:14:31.508404] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-28T17:14:31.515559] [INFO ] [REMOTE ] AOD: Full fetch complete (44858 records). [2025-10-28T17:14:31.515730] [DEBUG] [VALIDATOR ] AOD: Validating primary data. [2025-10-28T17:14:31.710005] [DEBUG] [LOCAL ] AORT: Loaded 28591 existing records from primary storage. [2025-10-28T17:14:31.756094] [INFO ] [MAIN ] AORT: Loaded 28591 existing records. [2025-10-28T17:14:31.959613] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-09. [2025-10-28T17:14:32.107545] [WARN ] [MAIN ] AORT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:14:32.108961] [DEBUG] [VALIDATOR ] AOD: All expected trading days are present. [2025-10-28T17:14:32.108592] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-28T17:14:32.108856] [INFO ] [MAIN ] AORT: Wiping existing primary data before full refresh. [2025-10-28T17:14:32.111860] [INFO ] [LOCAL ] AORT: Starting deletion of primary data. [2025-10-28T17:14:32.112079] [DEBUG] [VALIDATOR ] AOD: Primary data validation passed. [2025-10-28T17:14:32.112685] [INFO ] [MAIN ] AOD: Fetched primary data is valid. [2025-10-28T17:14:32.113304] [DEBUG] [LOCAL ] AOD: Saving primary data. [2025-10-28T17:14:32.113253] [INFO ] [REMOTE ] AOMR: Full fetch complete (23136 records). [2025-10-28T17:14:32.113587] [DEBUG] [VALIDATOR ] AOMR: Validating primary data. [2025-10-28T17:14:32.113507] [DEBUG] [LOCAL ] AORT: Deleted primary data file. [2025-10-28T17:14:32.113953] [INFO ] [MAIN ] AORT: Starting full primary refresh. [2025-10-28T17:14:32.235778] [DEBUG] [LOCAL ] AOD: Trimmed 44858 records to 30529 (keeping 200 days of data) [2025-10-28T17:14:32.993611] [INFO ] [REMOTE ] AORT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:14:32.994978] [DEBUG] [VALIDATOR ] AOMR: All expected trading days are present. [2025-10-28T17:14:32.996376] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-01. [2025-10-28T17:14:32.996432] [DEBUG] [VALIDATOR ] AOMR: Primary data validation passed. [2025-10-28T17:14:33.004505] [INFO ] [MAIN ] AOMR: Fetched primary data is valid. [2025-10-28T17:14:33.004605] [DEBUG] [LOCAL ] AOMR: Saving primary data. [2025-10-28T17:14:33.055891] [DEBUG] [LOCAL ] AOMR: Trimmed 23136 records to 16020 (keeping 200 days of data) [2025-10-28T17:14:33.146373] [DEBUG] [LOCAL ] AOD: Primary data saved (30529 records). [2025-10-28T17:14:33.152942] [INFO ] [MAIN ] AOD: Full history saved. [2025-10-28T17:14:33.163374] [INFO ] [MAIN ] Update Progress: 123/2366 symbols completed. AOD took 30.7s. Estimated remaining: 4h 24m 28s. Rate: 8.5 symbols/min [2025-10-28T17:14:33.228691] [DEBUG] [LOCAL ] AOMR: Primary data saved (16020 records). [2025-10-28T17:14:33.243246] [INFO ] [MAIN ] AOMR: Full history saved. [2025-10-28T17:14:33.243420] [INFO ] [MAIN ] Update Progress: 124/2366 symbols completed. AOMR took 30.7s. Estimated remaining: 4h 22m 15s. Rate: 8.5 symbols/min [2025-10-28T17:14:33.440490] [INFO ] [MAIN ] AOS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:14:33.530120] [INFO ] [MAIN ] AP: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:14:33.564404] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-28T17:14:33.595288] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-10. [2025-10-28T17:14:33.595603] [DEBUG] [LOCAL ] AP: Loaded 7468 existing records from primary storage. [2025-10-28T17:14:33.596394] [INFO ] [MAIN ] AP: Loaded 7468 existing records. [2025-10-28T17:14:33.728548] [DEBUG] [LOCAL ] AOS: Loaded 48566 existing records from primary storage. [2025-10-28T17:14:33.749891] [INFO ] [MAIN ] AOS: Loaded 48566 existing records. [2025-10-28T17:14:33.871744] [WARN ] [MAIN ] AP: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:14:33.888492] [INFO ] [MAIN ] AP: Wiping existing primary data before full refresh. [2025-10-28T17:14:33.900541] [INFO ] [LOCAL ] AP: Starting deletion of primary data. [2025-10-28T17:14:33.914987] [DEBUG] [LOCAL ] AP: Deleted primary data file. [2025-10-28T17:14:33.924783] [INFO ] [MAIN ] AP: Starting full primary refresh. [2025-10-28T17:14:34.128082] [WARN ] [MAIN ] AOS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:14:34.175659] [INFO ] [MAIN ] AOS: Wiping existing primary data before full refresh. [2025-10-28T17:14:34.231217] [INFO ] [LOCAL ] AOS: Starting deletion of primary data. [2025-10-28T17:14:34.243032] [DEBUG] [LOCAL ] AOS: Deleted primary data file. [2025-10-28T17:14:34.255880] [INFO ] [MAIN ] AOS: Starting full primary refresh. [2025-10-28T17:14:34.545508] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-28T17:14:34.601035] [INFO ] [REMOTE ] AP: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:14:34.612731] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-02. [2025-10-28T17:14:34.851742] [INFO ] [REMOTE ] AOS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:14:34.985120] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-28T17:14:34.997741] [INFO ] [REMOTE ] AON: Full fetch complete (65234 records). [2025-10-28T17:14:34.997940] [DEBUG] [VALIDATOR ] AON: Validating primary data. [2025-10-28T17:14:35.162323] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-01. [2025-10-28T17:14:35.398055] [DEBUG] [VALIDATOR ] AON: All expected trading days are present. [2025-10-28T17:14:35.398147] [DEBUG] [VALIDATOR ] AON: Primary data validation passed. [2025-10-28T17:14:35.398834] [INFO ] [MAIN ] AON: Fetched primary data is valid. [2025-10-28T17:14:35.398924] [DEBUG] [LOCAL ] AON: Saving primary data. [2025-10-28T17:14:35.400125] [DEBUG] [LOCAL ] AON: Trimmed 65234 records to 44821 (keeping 200 days of data) [2025-10-28T17:14:35.664854] [DEBUG] [LOCAL ] AON: Primary data saved (44821 records). [2025-10-28T17:14:35.665077] [INFO ] [MAIN ] AON: Full history saved. [2025-10-28T17:14:35.665172] [INFO ] [MAIN ] Update Progress: 125/2366 symbols completed. AON took 30.5s. Estimated remaining: 4h 20m 45s. Rate: 8.6 symbols/min [2025-10-28T17:14:35.834681] [INFO ] [MAIN ] APAM: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:14:35.856397] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-28T17:14:35.893161] [DEBUG] [LOCAL ] APAM: Loaded 35313 existing records from primary storage. [2025-10-28T17:14:35.893512] [INFO ] [MAIN ] APAM: Loaded 35313 existing records. [2025-10-28T17:14:35.965805] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-03. [2025-10-28T17:14:36.071115] [WARN ] [MAIN ] APAM: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:14:36.071343] [INFO ] [MAIN ] APAM: Wiping existing primary data before full refresh. [2025-10-28T17:14:36.071391] [INFO ] [LOCAL ] APAM: Starting deletion of primary data. [2025-10-28T17:14:36.071875] [DEBUG] [LOCAL ] APAM: Deleted primary data file. [2025-10-28T17:14:36.071935] [INFO ] [MAIN ] APAM: Starting full primary refresh. [2025-10-28T17:14:36.418250] [INFO ] [REMOTE ] APAM: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:14:36.593160] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-28T17:14:36.759335] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-01. [2025-10-28T17:14:37.052395] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-28T17:14:37.168629] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-10-28T17:14:37.559335] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-02. [2025-10-28T17:14:37.950017] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-10-28T17:14:38.359363] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-03. [2025-10-28T17:14:38.856290] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-28T17:14:39.159314] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-04. [2025-10-28T17:14:39.630492] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-28T17:14:39.959365] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-01. [2025-10-28T17:14:40.759357] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-04. [2025-10-28T17:14:41.171443] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-28T17:14:41.559337] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-05. [2025-10-28T17:14:42.049668] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-28T17:14:42.202464] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-28T17:14:42.359371] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-05. [2025-10-28T17:14:43.159362] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-02. [2025-10-28T17:14:43.310504] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-28T17:14:43.959394] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-06. [2025-10-28T17:14:44.389983] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-28T17:14:44.464810] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-28T17:14:44.759342] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-07. [2025-10-28T17:14:45.286394] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-28T17:14:45.559366] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-06. [2025-10-28T17:14:46.359416] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-08. [2025-10-28T17:14:46.687425] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-28T17:14:46.807472] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-28T17:14:47.159371] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-09. [2025-10-28T17:14:47.780319] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-28T17:14:47.959378] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-03. [2025-10-28T17:14:48.759336] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-07. [2025-10-28T17:14:49.371945] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-28T17:14:49.559326] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-10. [2025-10-28T17:14:49.676085] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-28T17:14:50.098889] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-28T17:14:50.100636] [INFO ] [REMOTE ] AP: Full fetch complete (9218 records). [2025-10-28T17:14:50.100730] [DEBUG] [VALIDATOR ] AP: Validating primary data. [2025-10-28T17:14:50.364505] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-04. [2025-10-28T17:14:50.462916] [DEBUG] [VALIDATOR ] AP: All expected trading days are present. [2025-10-28T17:14:50.462991] [DEBUG] [VALIDATOR ] AP: Primary data validation passed. [2025-10-28T17:14:50.463251] [INFO ] [MAIN ] AP: Fetched primary data is valid. [2025-10-28T17:14:50.463291] [DEBUG] [LOCAL ] AP: Saving primary data. [2025-10-28T17:14:50.463784] [DEBUG] [LOCAL ] AP: Trimmed 9218 records to 7489 (keeping 200 days of data) [2025-10-28T17:14:50.504113] [DEBUG] [LOCAL ] AP: Primary data saved (7489 records). [2025-10-28T17:14:50.504227] [INFO ] [MAIN ] AP: Full history saved. [2025-10-28T17:14:50.504302] [INFO ] [MAIN ] Update Progress: 126/2366 symbols completed. AP took 17.3s. Estimated remaining: 4h 22m 58s. Rate: 8.5 symbols/min [2025-10-28T17:14:50.670397] [INFO ] [MAIN ] APD: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:14:50.712566] [DEBUG] [LOCAL ] APD: Loaded 45282 existing records from primary storage. [2025-10-28T17:14:50.712903] [INFO ] [MAIN ] APD: Loaded 45282 existing records. [2025-10-28T17:14:50.890013] [WARN ] [MAIN ] APD: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:14:50.890220] [INFO ] [MAIN ] APD: Wiping existing primary data before full refresh. [2025-10-28T17:14:50.890286] [INFO ] [LOCAL ] APD: Starting deletion of primary data. [2025-10-28T17:14:50.890991] [DEBUG] [LOCAL ] APD: Deleted primary data file. [2025-10-28T17:14:50.891052] [INFO ] [MAIN ] APD: Starting full primary refresh. [2025-10-28T17:14:51.163603] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-02. [2025-10-28T17:14:51.243258] [INFO ] [REMOTE ] APD: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:14:51.696245] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-28T17:14:51.959345] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-08. [2025-10-28T17:14:52.224938] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-28T17:14:52.759429] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-05. [2025-10-28T17:14:52.942993] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-28T17:14:53.559340] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-09. [2025-10-28T17:14:54.062963] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-28T17:14:54.359343] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-01. [2025-10-28T17:14:54.479626] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-28T17:14:55.159369] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-06. [2025-10-28T17:14:55.708117] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-28T17:14:55.959353] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-02. [2025-10-28T17:14:56.665534] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-28T17:14:56.759348] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-10. [2025-10-28T17:14:57.393007] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-28T17:14:57.559332] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-07. [2025-10-28T17:14:57.847730] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-28T17:14:57.853216] [INFO ] [REMOTE ] AORT: Full fetch complete (42330 records). [2025-10-28T17:14:57.853321] [DEBUG] [VALIDATOR ] AORT: Validating primary data. [2025-10-28T17:14:58.243982] [DEBUG] [VALIDATOR ] AORT: All expected trading days are present. [2025-10-28T17:14:58.244058] [DEBUG] [VALIDATOR ] AORT: Primary data validation passed. [2025-10-28T17:14:58.244511] [INFO ] [MAIN ] AORT: Fetched primary data is valid. [2025-10-28T17:14:58.244551] [DEBUG] [LOCAL ] AORT: Saving primary data. [2025-10-28T17:14:58.245434] [DEBUG] [LOCAL ] AORT: Trimmed 42330 records to 28553 (keeping 200 days of data) [2025-10-28T17:14:58.374587] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-03. [2025-10-28T17:14:58.403290] [DEBUG] [LOCAL ] AORT: Primary data saved (28553 records). [2025-10-28T17:14:58.403419] [INFO ] [MAIN ] AORT: Full history saved. [2025-10-28T17:14:58.403515] [INFO ] [MAIN ] Update Progress: 127/2366 symbols completed. AORT took 27.1s. Estimated remaining: 4h 23m 6s. Rate: 8.5 symbols/min [2025-10-28T17:14:58.569602] [INFO ] [MAIN ] APG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:14:58.569778] [DEBUG] [LOCAL ] APG: No existing data file found in primary storage. [2025-10-28T17:14:58.569820] [WARN ] [MAIN ] APG: No existing data found, performing full refresh instead. [2025-10-28T17:14:58.569941] [INFO ] [MAIN ] APG: Wiping existing primary data before full refresh. [2025-10-28T17:14:58.569986] [INFO ] [LOCAL ] APG: Starting deletion of primary data. [2025-10-28T17:14:58.570029] [DEBUG] [LOCAL ] APG: No primary data file found to delete. [2025-10-28T17:14:58.570060] [INFO ] [MAIN ] APG: Starting full primary refresh. [2025-10-28T17:14:58.927033] [INFO ] [REMOTE ] APG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:14:58.977550] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-28T17:14:59.159328] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-01. [2025-10-28T17:14:59.489188] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-28T17:14:59.959348] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-04. [2025-10-28T17:15:00.426315] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-28T17:15:00.759341] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-08. [2025-10-28T17:15:01.369432] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-28T17:15:01.559336] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-03. [2025-10-28T17:15:02.155529] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-28T17:15:02.359356] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-09. [2025-10-28T17:15:02.955972] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-28T17:15:03.159341] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-02. [2025-10-28T17:15:03.475881] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-28T17:15:03.959338] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-04. [2025-10-28T17:15:04.346125] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-28T17:15:04.759332] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-05. [2025-10-28T17:15:05.341717] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-28T17:15:05.559319] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-10. [2025-10-28T17:15:06.140362] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-28T17:15:06.359317] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-03. [2025-10-28T17:15:07.141192] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-28T17:15:07.151137] [INFO ] [REMOTE ] AOS: Full fetch complete (71106 records). [2025-10-28T17:15:07.151287] [DEBUG] [VALIDATOR ] AOS: Validating primary data. [2025-10-28T17:15:07.164914] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-06. [2025-10-28T17:15:07.556421] [DEBUG] [VALIDATOR ] AOS: All expected trading days are present. [2025-10-28T17:15:07.556518] [DEBUG] [VALIDATOR ] AOS: Primary data validation passed. [2025-10-28T17:15:07.557341] [INFO ] [MAIN ] AOS: Fetched primary data is valid. [2025-10-28T17:15:07.557405] [DEBUG] [LOCAL ] AOS: Saving primary data. [2025-10-28T17:15:07.558767] [DEBUG] [LOCAL ] AOS: Trimmed 71106 records to 48563 (keeping 200 days of data) [2025-10-28T17:15:07.850237] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-28T17:15:07.890446] [DEBUG] [LOCAL ] AOS: Primary data saved (48563 records). [2025-10-28T17:15:07.890558] [INFO ] [MAIN ] AOS: Full history saved. [2025-10-28T17:15:07.890631] [INFO ] [MAIN ] Update Progress: 128/2366 symbols completed. AOS took 34.7s. Estimated remaining: 4h 23m 42s. Rate: 8.5 symbols/min [2025-10-28T17:15:07.965258] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-05. [2025-10-28T17:15:08.061534] [INFO ] [MAIN ] APH: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:15:08.112595] [DEBUG] [LOCAL ] APH: Loaded 53691 existing records from primary storage. [2025-10-28T17:15:08.112912] [INFO ] [MAIN ] APH: Loaded 53691 existing records. [2025-10-28T17:15:08.296002] [WARN ] [MAIN ] APH: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:15:08.296246] [INFO ] [MAIN ] APH: Wiping existing primary data before full refresh. [2025-10-28T17:15:08.296375] [INFO ] [LOCAL ] APH: Starting deletion of primary data. [2025-10-28T17:15:08.303205] [DEBUG] [LOCAL ] APH: Deleted primary data file. [2025-10-28T17:15:08.314221] [INFO ] [MAIN ] APH: Starting full primary refresh. [2025-10-28T17:15:08.379466] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-28T17:15:08.675905] [INFO ] [REMOTE ] APH: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:15:08.759321] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-07. [2025-10-28T17:15:09.564446] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-04. [2025-10-28T17:15:09.578783] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-28T17:15:09.862437] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-28T17:15:10.359354] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-06. [2025-10-28T17:15:11.159309] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-08. [2025-10-28T17:15:11.324465] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-28T17:15:11.719853] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-28T17:15:11.959331] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-05. [2025-10-28T17:15:12.187388] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-28T17:15:12.759374] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-07. [2025-10-28T17:15:13.506850] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-28T17:15:13.559305] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-06. [2025-10-28T17:15:14.366323] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-01. [2025-10-28T17:15:14.384404] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-28T17:15:15.123624] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-28T17:15:15.159341] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-08. [2025-10-28T17:15:15.959305] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-09. [2025-10-28T17:15:16.099556] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-28T17:15:16.452612] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-28T17:15:16.759302] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-09. [2025-10-28T17:15:16.963546] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-28T17:15:17.559309] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-10. [2025-10-28T17:15:18.103638] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-28T17:15:18.359357] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-10. [2025-10-28T17:15:18.608200] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-28T17:15:18.615388] [INFO ] [REMOTE ] APAM: Full fetch complete (51938 records). [2025-10-28T17:15:18.615542] [DEBUG] [VALIDATOR ] APAM: Validating primary data. [2025-10-28T17:15:19.030448] [DEBUG] [VALIDATOR ] APAM: All expected trading days are present. [2025-10-28T17:15:19.030678] [DEBUG] [VALIDATOR ] APAM: Primary data validation passed. [2025-10-28T17:15:19.031910] [INFO ] [MAIN ] APAM: Fetched primary data is valid. [2025-10-28T17:15:19.032007] [DEBUG] [LOCAL ] APAM: Saving primary data. [2025-10-28T17:15:19.034329] [DEBUG] [LOCAL ] APAM: Trimmed 51938 records to 35260 (keeping 200 days of data) [2025-10-28T17:15:19.161704] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-02. [2025-10-28T17:15:19.271486] [DEBUG] [LOCAL ] APAM: Primary data saved (35260 records). [2025-10-28T17:15:19.271739] [INFO ] [MAIN ] APAM: Full history saved. [2025-10-28T17:15:19.271858] [INFO ] [MAIN ] Update Progress: 129/2366 symbols completed. APAM took 43.6s. Estimated remaining: 4h 24m 49s. Rate: 8.4 symbols/min [2025-10-28T17:15:19.452754] [INFO ] [MAIN ] APLE: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:15:19.505455] [DEBUG] [LOCAL ] APLE: Loaded 51909 existing records from primary storage. [2025-10-28T17:15:19.505894] [INFO ] [MAIN ] APLE: Loaded 51909 existing records. [2025-10-28T17:15:19.701717] [WARN ] [MAIN ] APLE: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:15:19.702162] [INFO ] [MAIN ] APLE: Wiping existing primary data before full refresh. [2025-10-28T17:15:19.702241] [INFO ] [LOCAL ] APLE: Starting deletion of primary data. [2025-10-28T17:15:19.703329] [DEBUG] [LOCAL ] APLE: Deleted primary data file. [2025-10-28T17:15:19.703391] [INFO ] [MAIN ] APLE: Starting full primary refresh. [2025-10-28T17:15:19.967066] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-07. [2025-10-28T17:15:20.099291] [INFO ] [REMOTE ] APLE: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:15:20.131619] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-28T17:15:20.141445] [INFO ] [REMOTE ] APD: Full fetch complete (67227 records). [2025-10-28T17:15:20.141626] [DEBUG] [VALIDATOR ] APD: Validating primary data. [2025-10-28T17:15:20.538190] [DEBUG] [VALIDATOR ] APD: All expected trading days are present. [2025-10-28T17:15:20.538301] [DEBUG] [VALIDATOR ] APD: Primary data validation passed. [2025-10-28T17:15:20.539094] [INFO ] [MAIN ] APD: Fetched primary data is valid. [2025-10-28T17:15:20.539178] [DEBUG] [LOCAL ] APD: Saving primary data. [2025-10-28T17:15:20.540973] [DEBUG] [LOCAL ] APD: Trimmed 67227 records to 45249 (keeping 200 days of data) [2025-10-28T17:15:20.783692] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-01. [2025-10-28T17:15:20.789256] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-28T17:15:20.867849] [DEBUG] [LOCAL ] APD: Primary data saved (45249 records). [2025-10-28T17:15:20.868004] [INFO ] [MAIN ] APD: Full history saved. [2025-10-28T17:15:20.869055] [INFO ] [MAIN ] Update Progress: 130/2366 symbols completed. APD took 30.4s. Estimated remaining: 4h 23m 7s. Rate: 8.5 symbols/min [2025-10-28T17:15:21.051976] [INFO ] [MAIN ] APO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:15:21.108538] [DEBUG] [LOCAL ] APO: Loaded 53373 existing records from primary storage. [2025-10-28T17:15:21.108952] [INFO ] [MAIN ] APO: Loaded 53373 existing records. [2025-10-28T17:15:21.294587] [WARN ] [MAIN ] APO: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:15:21.294840] [INFO ] [MAIN ] APO: Wiping existing primary data before full refresh. [2025-10-28T17:15:21.294921] [INFO ] [LOCAL ] APO: Starting deletion of primary data. [2025-10-28T17:15:21.296264] [DEBUG] [LOCAL ] APO: Deleted primary data file. [2025-10-28T17:15:21.296325] [INFO ] [MAIN ] APO: Starting full primary refresh. [2025-10-28T17:15:21.562122] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-03. [2025-10-28T17:15:21.683593] [INFO ] [REMOTE ] APO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:15:21.712081] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-28T17:15:22.359327] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-08. [2025-10-28T17:15:22.897006] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-10-28T17:15:22.935672] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-28T17:15:23.159369] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-02. [2025-10-28T17:15:23.674799] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-28T17:15:23.959351] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-09. [2025-10-28T17:15:24.599320] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-28T17:15:24.759331] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-04. [2025-10-28T17:15:25.231128] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-28T17:15:25.559332] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-03. [2025-10-28T17:15:26.359303] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-10. [2025-10-28T17:15:26.548189] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-28T17:15:26.870570] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-28T17:15:27.159327] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-05. [2025-10-28T17:15:27.673694] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-28T17:15:27.685086] [INFO ] [REMOTE ] APG: Full fetch complete (72266 records). [2025-10-28T17:15:27.685402] [DEBUG] [VALIDATOR ] APG: Validating primary data. [2025-10-28T17:15:27.969637] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-01. [2025-10-28T17:15:28.110475] [DEBUG] [VALIDATOR ] APG: All expected trading days are present. [2025-10-28T17:15:28.110572] [DEBUG] [VALIDATOR ] APG: Primary data validation passed. [2025-10-28T17:15:28.111398] [INFO ] [MAIN ] APG: Fetched primary data is valid. [2025-10-28T17:15:28.111466] [DEBUG] [LOCAL ] APG: Saving primary data. [2025-10-28T17:15:28.112992] [DEBUG] [LOCAL ] APG: Trimmed 72266 records to 50596 (keeping 200 days of data) [2025-10-28T17:15:28.421309] [DEBUG] [LOCAL ] APG: Primary data saved (50596 records). [2025-10-28T17:15:28.421481] [INFO ] [MAIN ] APG: Full history saved. [2025-10-28T17:15:28.421572] [INFO ] [MAIN ] Update Progress: 131/2366 symbols completed. APG took 30.0s. Estimated remaining: 4h 23m 9s. Rate: 8.5 symbols/min [2025-10-28T17:15:28.603991] [INFO ] [MAIN ] APOS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:15:28.612389] [DEBUG] [LOCAL ] APOS: Loaded 6830 existing records from primary storage. [2025-10-28T17:15:28.612627] [INFO ] [MAIN ] APOS: Loaded 6830 existing records. [2025-10-28T17:15:28.760022] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-04. [2025-10-28T17:15:28.800814] [WARN ] [MAIN ] APOS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:15:28.802026] [INFO ] [MAIN ] APOS: Wiping existing primary data before full refresh. [2025-10-28T17:15:28.802103] [INFO ] [LOCAL ] APOS: Starting deletion of primary data. [2025-10-28T17:15:28.802356] [DEBUG] [LOCAL ] APOS: Deleted primary data file. [2025-10-28T17:15:28.802419] [INFO ] [MAIN ] APOS: Starting full primary refresh. [2025-10-28T17:15:29.166846] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-28T17:15:29.206168] [INFO ] [REMOTE ] APOS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:15:29.559374] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-01. [2025-10-28T17:15:30.087717] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-10-28T17:15:30.110131] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-28T17:15:30.338524] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-28T17:15:30.359289] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-05. [2025-10-28T17:15:31.159333] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-02. [2025-10-28T17:15:31.666540] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-28T17:15:31.959334] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-02. [2025-10-28T17:15:32.349689] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-10-28T17:15:32.409101] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-28T17:15:32.759337] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-03. [2025-10-28T17:15:33.559316] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-03. [2025-10-28T17:15:33.641158] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-28T17:15:34.359340] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-04. [2025-10-28T17:15:35.086204] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-28T17:15:35.122683] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-28T17:15:35.159333] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-05. [2025-10-28T17:15:35.656049] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-28T17:15:35.959354] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-06. [2025-10-28T17:15:36.759402] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-06. [2025-10-28T17:15:37.559323] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-04. [2025-10-28T17:15:37.931045] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-10-28T17:15:38.196677] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-28T17:15:38.359347] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-07. [2025-10-28T17:15:38.995343] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-28T17:15:39.159328] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-06. [2025-10-28T17:15:39.755662] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-28T17:15:39.959363] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-05. [2025-10-28T17:15:40.046002] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-28T17:15:40.759340] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-07. [2025-10-28T17:15:41.493434] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-28T17:15:41.559344] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-06. [2025-10-28T17:15:42.229152] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-28T17:15:42.359354] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-08. [2025-10-28T17:15:42.885303] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-28T17:15:43.159336] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-07. [2025-10-28T17:15:43.658402] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-10-28T17:15:43.967302] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-08. [2025-10-28T17:15:43.972823] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-28T17:15:44.759354] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-07. [2025-10-28T17:15:45.559383] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-08. [2025-10-28T17:15:45.678175] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-28T17:15:46.000904] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-28T17:15:46.359314] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-09. [2025-10-28T17:15:46.403713] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-28T17:15:47.159319] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-09. [2025-10-28T17:15:47.838593] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-28T17:15:47.959329] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-10. [2025-10-28T17:15:48.764373] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-09. [2025-10-28T17:15:48.770212] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-28T17:15:49.246943] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-28T17:15:49.559329] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-08. [2025-10-28T17:15:49.780685] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-28T17:15:49.793360] [INFO ] [REMOTE ] APH: Full fetch complete (77871 records). [2025-10-28T17:15:49.793517] [DEBUG] [VALIDATOR ] APH: Validating primary data. [2025-10-28T17:15:50.200432] [DEBUG] [VALIDATOR ] APH: All expected trading days are present. [2025-10-28T17:15:50.200548] [DEBUG] [VALIDATOR ] APH: Primary data validation passed. [2025-10-28T17:15:50.201387] [INFO ] [MAIN ] APH: Fetched primary data is valid. [2025-10-28T17:15:50.201452] [DEBUG] [LOCAL ] APH: Saving primary data. [2025-10-28T17:15:50.202941] [DEBUG] [LOCAL ] APH: Trimmed 77871 records to 53691 (keeping 200 days of data) [2025-10-28T17:15:50.382316] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-10. [2025-10-28T17:15:50.538879] [DEBUG] [LOCAL ] APH: Primary data saved (53691 records). [2025-10-28T17:15:50.539021] [INFO ] [MAIN ] APH: Full history saved. [2025-10-28T17:15:50.539097] [INFO ] [MAIN ] Update Progress: 132/2366 symbols completed. APH took 42.6s. Estimated remaining: 4h 27m 16s. Rate: 8.4 symbols/min [2025-10-28T17:15:50.709948] [INFO ] [MAIN ] APTV: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:15:50.759368] [DEBUG] [LOCAL ] APTV: Loaded 51758 existing records from primary storage. [2025-10-28T17:15:50.759799] [INFO ] [MAIN ] APTV: Loaded 51758 existing records. [2025-10-28T17:15:50.943615] [WARN ] [MAIN ] APTV: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:15:50.943963] [INFO ] [MAIN ] APTV: Wiping existing primary data before full refresh. [2025-10-28T17:15:50.944068] [INFO ] [LOCAL ] APTV: Starting deletion of primary data. [2025-10-28T17:15:50.944781] [DEBUG] [LOCAL ] APTV: Deleted primary data file. [2025-10-28T17:15:50.944914] [INFO ] [MAIN ] APTV: Starting full primary refresh. [2025-10-28T17:15:51.149130] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-28T17:15:51.164473] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-10. [2025-10-28T17:15:51.396766] [INFO ] [REMOTE ] APTV: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:15:51.743346] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-28T17:15:51.745029] [INFO ] [REMOTE ] APOS: Full fetch complete (10198 records). [2025-10-28T17:15:51.745101] [DEBUG] [VALIDATOR ] APOS: Validating primary data. [2025-10-28T17:15:51.964488] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-09. [2025-10-28T17:15:52.119087] [DEBUG] [VALIDATOR ] APOS: All expected trading days are present. [2025-10-28T17:15:52.119201] [DEBUG] [VALIDATOR ] APOS: Primary data validation passed. [2025-10-28T17:15:52.119446] [INFO ] [MAIN ] APOS: Fetched primary data is valid. [2025-10-28T17:15:52.119521] [DEBUG] [LOCAL ] APOS: Saving primary data. [2025-10-28T17:15:52.146050] [DEBUG] [LOCAL ] APOS: Trimmed 10198 records to 6792 (keeping 200 days of data) [2025-10-28T17:15:52.148988] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-28T17:15:52.188051] [INFO ] [REMOTE ] APLE: Full fetch complete (74777 records). [2025-10-28T17:15:52.192859] [DEBUG] [VALIDATOR ] APLE: Validating primary data. [2025-10-28T17:15:52.206185] [DEBUG] [LOCAL ] APOS: Primary data saved (6792 records). [2025-10-28T17:15:52.244355] [INFO ] [MAIN ] APOS: Full history saved. [2025-10-28T17:15:52.270130] [INFO ] [MAIN ] Update Progress: 133/2366 symbols completed. APOS took 23.8s. Estimated remaining: 4h 25m 38s. Rate: 8.4 symbols/min [2025-10-28T17:15:52.598434] [INFO ] [MAIN ] AQN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:15:52.652453] [DEBUG] [LOCAL ] AQN: No existing data file found in primary storage. [2025-10-28T17:15:52.691081] [WARN ] [MAIN ] AQN: No existing data found, performing full refresh instead. [2025-10-28T17:15:52.731760] [INFO ] [MAIN ] AQN: Wiping existing primary data before full refresh. [2025-10-28T17:15:52.731946] [INFO ] [LOCAL ] AQN: Starting deletion of primary data. [2025-10-28T17:15:52.732298] [DEBUG] [LOCAL ] AQN: No primary data file found to delete. [2025-10-28T17:15:52.732367] [INFO ] [MAIN ] AQN: Starting full primary refresh. [2025-10-28T17:15:52.770160] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-01. [2025-10-28T17:15:52.949066] [DEBUG] [VALIDATOR ] APLE: All expected trading days are present. [2025-10-28T17:15:52.949181] [DEBUG] [VALIDATOR ] APLE: Primary data validation passed. [2025-10-28T17:15:52.949968] [INFO ] [MAIN ] APLE: Fetched primary data is valid. [2025-10-28T17:15:52.950052] [DEBUG] [LOCAL ] APLE: Saving primary data. [2025-10-28T17:15:53.009898] [DEBUG] [LOCAL ] APLE: Trimmed 74777 records to 51897 (keeping 200 days of data) [2025-10-28T17:15:53.422761] [INFO ] [REMOTE ] AQN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:15:53.534015] [DEBUG] [LOCAL ] APLE: Primary data saved (51897 records). [2025-10-28T17:15:53.534140] [INFO ] [MAIN ] APLE: Full history saved. [2025-10-28T17:15:53.534218] [INFO ] [MAIN ] Update Progress: 134/2366 symbols completed. APLE took 34.3s. Estimated remaining: 4h 23m 53s. Rate: 8.5 symbols/min [2025-10-28T17:15:53.565321] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-01. [2025-10-28T17:15:53.708278] [INFO ] [MAIN ] AQNB: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:15:53.732829] [DEBUG] [LOCAL ] AQNB: Loaded 3764 existing records from primary storage. [2025-10-28T17:15:53.743827] [INFO ] [MAIN ] AQNB: Loaded 3764 existing records. [2025-10-28T17:15:53.802900] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-28T17:15:53.938188] [WARN ] [MAIN ] AQNB: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:15:53.938378] [INFO ] [MAIN ] AQNB: Wiping existing primary data before full refresh. [2025-10-28T17:15:53.938425] [INFO ] [LOCAL ] AQNB: Starting deletion of primary data. [2025-10-28T17:15:53.938597] [DEBUG] [LOCAL ] AQNB: Deleted primary data file. [2025-10-28T17:15:53.938690] [INFO ] [MAIN ] AQNB: Starting full primary refresh. [2025-10-28T17:15:54.308237] [INFO ] [REMOTE ] AQNB: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:15:54.341076] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-28T17:15:54.359301] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-01. [2025-10-28T17:15:54.730343] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-10-28T17:15:55.164610] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-02. [2025-10-28T17:15:55.180916] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-28T17:15:55.478746] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-10-28T17:15:55.959331] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-03. [2025-10-28T17:15:56.349616] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-10-28T17:15:56.759394] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-10. [2025-10-28T17:15:57.559340] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-02. [2025-10-28T17:15:58.207999] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-28T17:15:58.219061] [INFO ] [REMOTE ] APO: Full fetch complete (77451 records). [2025-10-28T17:15:58.219210] [DEBUG] [VALIDATOR ] APO: Validating primary data. [2025-10-28T17:15:58.364432] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-02. [2025-10-28T17:15:58.615923] [DEBUG] [VALIDATOR ] APO: All expected trading days are present. [2025-10-28T17:15:58.616141] [DEBUG] [VALIDATOR ] APO: Primary data validation passed. [2025-10-28T17:15:58.616967] [INFO ] [MAIN ] APO: Fetched primary data is valid. [2025-10-28T17:15:58.617035] [DEBUG] [LOCAL ] APO: Saving primary data. [2025-10-28T17:15:58.618517] [DEBUG] [LOCAL ] APO: Trimmed 77451 records to 53369 (keeping 200 days of data) [2025-10-28T17:15:58.858093] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-28T17:15:58.977965] [DEBUG] [LOCAL ] APO: Primary data saved (53369 records). [2025-10-28T17:15:58.978081] [INFO ] [MAIN ] APO: Full history saved. [2025-10-28T17:15:58.978572] [INFO ] [MAIN ] Update Progress: 135/2366 symbols completed. APO took 38.1s. Estimated remaining: 4h 23m 19s. Rate: 8.5 symbols/min [2025-10-28T17:15:59.146397] [INFO ] [MAIN ] AR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:15:59.146533] [DEBUG] [LOCAL ] AR: No existing data file found in primary storage. [2025-10-28T17:15:59.146569] [WARN ] [MAIN ] AR: No existing data found, performing full refresh instead. [2025-10-28T17:15:59.146699] [INFO ] [MAIN ] AR: Wiping existing primary data before full refresh. [2025-10-28T17:15:59.146751] [INFO ] [LOCAL ] AR: Starting deletion of primary data. [2025-10-28T17:15:59.146794] [DEBUG] [LOCAL ] AR: No primary data file found to delete. [2025-10-28T17:15:59.146828] [INFO ] [MAIN ] AR: Starting full primary refresh. [2025-10-28T17:15:59.167164] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-03. [2025-10-28T17:15:59.509129] [INFO ] [REMOTE ] AR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:15:59.934087] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-28T17:15:59.959309] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-04. [2025-10-28T17:16:00.312193] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-10-28T17:16:00.759326] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-01. [2025-10-28T17:16:00.818805] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-28T17:16:01.559341] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-04. [2025-10-28T17:16:02.286322] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-28T17:16:02.359335] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-05. [2025-10-28T17:16:02.768838] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-10-28T17:16:03.011512] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-28T17:16:03.159360] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-02. [2025-10-28T17:16:03.959402] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-06. [2025-10-28T17:16:04.379496] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-28T17:16:04.543477] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-28T17:16:04.759357] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-05. [2025-10-28T17:16:05.559320] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-03. [2025-10-28T17:16:06.359353] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-03. [2025-10-28T17:16:06.765672] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-28T17:16:07.057041] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-28T17:16:07.159329] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-04. [2025-10-28T17:16:07.959343] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-06. [2025-10-28T17:16:08.375427] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-28T17:16:08.759340] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-04. [2025-10-28T17:16:08.794876] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-28T17:16:09.270906] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-28T17:16:09.559372] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-05. [2025-10-28T17:16:10.063997] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-28T17:16:10.359344] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-07. [2025-10-28T17:16:10.791327] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-28T17:16:11.078096] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-28T17:16:11.159320] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-08. [2025-10-28T17:16:11.756887] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-28T17:16:11.959324] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-06. [2025-10-28T17:16:12.759343] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-07. [2025-10-28T17:16:13.490138] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-28T17:16:13.559339] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-07. [2025-10-28T17:16:13.936290] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-28T17:16:14.359359] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-08. [2025-10-28T17:16:15.017892] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-28T17:16:15.159353] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-05. [2025-10-28T17:16:15.700464] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-28T17:16:15.959332] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-08. [2025-10-28T17:16:16.736067] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-28T17:16:16.759329] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-06. [2025-10-28T17:16:17.295725] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-28T17:16:17.559338] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-09. [2025-10-28T17:16:18.254898] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-28T17:16:18.359336] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-09. [2025-10-28T17:16:18.955991] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-28T17:16:19.159313] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-07. [2025-10-28T17:16:19.757380] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-28T17:16:19.959342] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-10. [2025-10-28T17:16:20.503010] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-28T17:16:20.759345] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-08. [2025-10-28T17:16:21.541542] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-28T17:16:21.552137] [INFO ] [REMOTE ] AR: Full fetch complete (77346 records). [2025-10-28T17:16:21.552310] [DEBUG] [VALIDATOR ] AR: Validating primary data. [2025-10-28T17:16:21.553098] [FATAL] [VALIDATOR ] AR: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T17:16:21.553188] [FATAL] [MAIN ] AR: Fetched primary data is invalid. Refusing to save it. [2025-10-28T17:16:21.553256] [WARN ] [MAIN ] AR: Deleting existing primary and derivative data due to validation failure. [2025-10-28T17:16:21.553304] [INFO ] [LOCAL ] AR: Starting deletion of primary data. [2025-10-28T17:16:21.553363] [DEBUG] [LOCAL ] AR: No primary data file found to delete. [2025-10-28T17:16:21.553438] [INFO ] [LOCAL ] AR: Starting deletion of derivative data. [2025-10-28T17:16:21.553488] [DEBUG] [LOCAL ] AR: No derivative data file found to delete. [2025-10-28T17:16:21.553546] [INFO ] [MAIN ] Update Progress: 136/2366 symbols completed. AR took 22.6s. Estimated remaining: 4h 27m 25s. Rate: 8.3 symbols/min [2025-10-28T17:16:21.565556] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-09. [2025-10-28T17:16:21.751478] [INFO ] [MAIN ] ARCO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:16:21.814265] [DEBUG] [LOCAL ] ARCO: Loaded 44014 existing records from primary storage. [2025-10-28T17:16:21.814575] [INFO ] [MAIN ] ARCO: Loaded 44014 existing records. [2025-10-28T17:16:22.010985] [WARN ] [MAIN ] ARCO: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:16:22.011338] [INFO ] [MAIN ] ARCO: Wiping existing primary data before full refresh. [2025-10-28T17:16:22.011446] [INFO ] [LOCAL ] ARCO: Starting deletion of primary data. [2025-10-28T17:16:22.012226] [DEBUG] [LOCAL ] ARCO: Deleted primary data file. [2025-10-28T17:16:22.012337] [INFO ] [MAIN ] ARCO: Starting full primary refresh. [2025-10-28T17:16:22.144883] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-28T17:16:22.209971] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-28T17:16:22.364417] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-10. [2025-10-28T17:16:22.435762] [INFO ] [REMOTE ] ARCO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:16:23.159379] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-10. [2025-10-28T17:16:23.610865] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-28T17:16:23.612273] [INFO ] [REMOTE ] AQNB: Full fetch complete (5344 records). [2025-10-28T17:16:23.612367] [DEBUG] [VALIDATOR ] AQNB: Validating primary data. [2025-10-28T17:16:23.964552] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-01. [2025-10-28T17:16:24.136042] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-28T17:16:24.204543] [INFO ] [REMOTE ] AQN: Full fetch complete (75289 records). [2025-10-28T17:16:24.234893] [DEBUG] [VALIDATOR ] AQN: Validating primary data. [2025-10-28T17:16:24.269237] [DEBUG] [VALIDATOR ] AQNB: All expected trading days are present. [2025-10-28T17:16:24.269360] [DEBUG] [VALIDATOR ] AQNB: Primary data validation passed. [2025-10-28T17:16:24.269698] [INFO ] [MAIN ] AQNB: Fetched primary data is valid. [2025-10-28T17:16:24.275416] [DEBUG] [LOCAL ] AQNB: Saving primary data. [2025-10-28T17:16:24.323442] [DEBUG] [LOCAL ] AQNB: Trimmed 5344 records to 3742 (keeping 200 days of data) [2025-10-28T17:16:24.514687] [DEBUG] [LOCAL ] AQNB: Primary data saved (3742 records). [2025-10-28T17:16:24.521146] [INFO ] [MAIN ] AQNB: Full history saved. [2025-10-28T17:16:24.542482] [INFO ] [MAIN ] Update Progress: 137/2366 symbols completed. AQNB took 31.0s. Estimated remaining: 4h 26m 10s. Rate: 8.4 symbols/min [2025-10-28T17:16:24.781480] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-09. [2025-10-28T17:16:24.933063] [DEBUG] [VALIDATOR ] AQN: All expected trading days are present. [2025-10-28T17:16:24.943177] [DEBUG] [VALIDATOR ] AQN: Primary data validation passed. [2025-10-28T17:16:24.946533] [INFO ] [MAIN ] AQN: Fetched primary data is valid. [2025-10-28T17:16:24.962634] [DEBUG] [LOCAL ] AQN: Saving primary data. [2025-10-28T17:16:24.964199] [INFO ] [MAIN ] ARDC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:16:24.966271] [DEBUG] [LOCAL ] AQN: Trimmed 75289 records to 51564 (keeping 200 days of data) [2025-10-28T17:16:25.040567] [DEBUG] [LOCAL ] ARDC: Loaded 14965 existing records from primary storage. [2025-10-28T17:16:25.041212] [INFO ] [MAIN ] ARDC: Loaded 14965 existing records. [2025-10-28T17:16:25.288339] [WARN ] [MAIN ] ARDC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:16:25.299412] [INFO ] [MAIN ] ARDC: Wiping existing primary data before full refresh. [2025-10-28T17:16:25.299549] [INFO ] [LOCAL ] ARDC: Starting deletion of primary data. [2025-10-28T17:16:25.299937] [DEBUG] [LOCAL ] ARDC: Deleted primary data file. [2025-10-28T17:16:25.299997] [INFO ] [MAIN ] ARDC: Starting full primary refresh. [2025-10-28T17:16:25.742771] [DEBUG] [LOCAL ] AQN: Primary data saved (51564 records). [2025-10-28T17:16:25.760426] [INFO ] [MAIN ] AQN: Full history saved. [2025-10-28T17:16:25.779491] [INFO ] [MAIN ] Update Progress: 138/2366 symbols completed. AQN took 33.5s. Estimated remaining: 4h 24m 27s. Rate: 8.4 symbols/min [2025-10-28T17:16:25.922998] [INFO ] [REMOTE ] ARDC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:16:25.976940] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-10-28T17:16:25.975277] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-01. [2025-10-28T17:16:26.082559] [INFO ] [MAIN ] ARDT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:16:26.115354] [DEBUG] [LOCAL ] ARDT: Loaded 27328 existing records from primary storage. [2025-10-28T17:16:26.115604] [INFO ] [MAIN ] ARDT: Loaded 27328 existing records. [2025-10-28T17:16:26.322906] [WARN ] [MAIN ] ARDT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:16:26.323265] [INFO ] [MAIN ] ARDT: Wiping existing primary data before full refresh. [2025-10-28T17:16:26.323358] [INFO ] [LOCAL ] ARDT: Starting deletion of primary data. [2025-10-28T17:16:26.323870] [DEBUG] [LOCAL ] ARDT: Deleted primary data file. [2025-10-28T17:16:26.323933] [INFO ] [MAIN ] ARDT: Starting full primary refresh. [2025-10-28T17:16:26.364820] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-02. [2025-10-28T17:16:26.443915] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-28T17:16:26.758101] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-28T17:16:26.797293] [INFO ] [REMOTE ] ARDT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:16:27.159387] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-01. [2025-10-28T17:16:27.355319] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-28T17:16:27.959310] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-02. [2025-10-28T17:16:28.135716] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-28T17:16:28.716420] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-28T17:16:28.759357] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-02. [2025-10-28T17:16:29.510482] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-28T17:16:29.559342] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-03. [2025-10-28T17:16:30.359340] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-03. [2025-10-28T17:16:30.587471] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-28T17:16:31.159337] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-10. [2025-10-28T17:16:31.303035] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-28T17:16:31.768473] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-28T17:16:31.781095] [INFO ] [REMOTE ] APTV: Full fetch complete (75713 records). [2025-10-28T17:16:31.781285] [DEBUG] [VALIDATOR ] APTV: Validating primary data. [2025-10-28T17:16:31.963264] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-04. [2025-10-28T17:16:32.186109] [DEBUG] [VALIDATOR ] APTV: All expected trading days are present. [2025-10-28T17:16:32.186205] [DEBUG] [VALIDATOR ] APTV: Primary data validation passed. [2025-10-28T17:16:32.186966] [INFO ] [MAIN ] APTV: Fetched primary data is valid. [2025-10-28T17:16:32.187029] [DEBUG] [LOCAL ] APTV: Saving primary data. [2025-10-28T17:16:32.188414] [DEBUG] [LOCAL ] APTV: Trimmed 75713 records to 51726 (keeping 200 days of data) [2025-10-28T17:16:32.485530] [DEBUG] [LOCAL ] APTV: Primary data saved (51726 records). [2025-10-28T17:16:32.485692] [INFO ] [MAIN ] APTV: Full history saved. [2025-10-28T17:16:32.485788] [INFO ] [MAIN ] Update Progress: 139/2366 symbols completed. APTV took 41.9s. Estimated remaining: 4h 24m 13s. Rate: 8.4 symbols/min [2025-10-28T17:16:32.659191] [INFO ] [MAIN ] ARE: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:16:32.659421] [DEBUG] [LOCAL ] ARE: No existing data file found in primary storage. [2025-10-28T17:16:32.659492] [WARN ] [MAIN ] ARE: No existing data found, performing full refresh instead. [2025-10-28T17:16:32.659639] [INFO ] [MAIN ] ARE: Wiping existing primary data before full refresh. [2025-10-28T17:16:32.659734] [INFO ] [LOCAL ] ARE: Starting deletion of primary data. [2025-10-28T17:16:32.659821] [DEBUG] [LOCAL ] ARE: No primary data file found to delete. [2025-10-28T17:16:32.659891] [INFO ] [MAIN ] ARE: Starting full primary refresh. [2025-10-28T17:16:32.767706] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-04. [2025-10-28T17:16:33.025922] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-28T17:16:33.072263] [INFO ] [REMOTE ] ARE: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:16:33.559400] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-01. [2025-10-28T17:16:34.117290] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-28T17:16:34.359399] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-03. [2025-10-28T17:16:34.952035] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-28T17:16:35.125290] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-28T17:16:35.159328] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-02. [2025-10-28T17:16:35.959338] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-05. [2025-10-28T17:16:36.465032] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-28T17:16:36.759371] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-05. [2025-10-28T17:16:37.349759] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-28T17:16:37.559323] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-04. [2025-10-28T17:16:37.707430] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-28T17:16:38.286389] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-28T17:16:38.359370] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-03. [2025-10-28T17:16:39.159338] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-06. [2025-10-28T17:16:39.715560] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-28T17:16:39.959356] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-05. [2025-10-28T17:16:40.464607] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-28T17:16:40.569857] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-28T17:16:40.759345] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-06. [2025-10-28T17:16:41.559351] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-07. [2025-10-28T17:16:41.940500] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-28T17:16:42.359349] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-04. [2025-10-28T17:16:42.714019] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-28T17:16:43.159362] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-06. [2025-10-28T17:16:43.884249] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-28T17:16:43.959348] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-08. [2025-10-28T17:16:44.081111] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-28T17:16:44.759360] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-07. [2025-10-28T17:16:45.084896] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-28T17:16:45.559385] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-07. [2025-10-28T17:16:45.892385] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-28T17:16:46.356204] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-28T17:16:46.360877] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-05. [2025-10-28T17:16:47.159383] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-09. [2025-10-28T17:16:47.959357] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-08. [2025-10-28T17:16:48.155132] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-28T17:16:48.395535] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-28T17:16:48.759362] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-10. [2025-10-28T17:16:48.918297] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-28T17:16:49.559330] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-08. [2025-10-28T17:16:50.231995] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-28T17:16:50.283236] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-28T17:16:50.293188] [INFO ] [REMOTE ] ARCO: Full fetch complete (64678 records). [2025-10-28T17:16:50.293346] [DEBUG] [VALIDATOR ] ARCO: Validating primary data. [2025-10-28T17:16:50.364468] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-06. [2025-10-28T17:16:50.682604] [DEBUG] [VALIDATOR ] ARCO: All expected trading days are present. [2025-10-28T17:16:50.682711] [DEBUG] [VALIDATOR ] ARCO: Primary data validation passed. [2025-10-28T17:16:50.683845] [INFO ] [MAIN ] ARCO: Fetched primary data is valid. [2025-10-28T17:16:50.683909] [DEBUG] [LOCAL ] ARCO: Saving primary data. [2025-10-28T17:16:50.685381] [DEBUG] [LOCAL ] ARCO: Trimmed 64678 records to 43944 (keeping 200 days of data) [2025-10-28T17:16:50.957067] [DEBUG] [LOCAL ] ARCO: Primary data saved (43944 records). [2025-10-28T17:16:50.957189] [INFO ] [MAIN ] ARCO: Full history saved. [2025-10-28T17:16:50.959294] [INFO ] [MAIN ] Update Progress: 140/2366 symbols completed. ARCO took 29.4s. Estimated remaining: 4h 27m 7s. Rate: 8.3 symbols/min [2025-10-28T17:16:51.134420] [INFO ] [MAIN ] ARES: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:16:51.159348] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-09. [2025-10-28T17:16:51.208623] [DEBUG] [LOCAL ] ARES: Loaded 49601 existing records from primary storage. [2025-10-28T17:16:51.208948] [INFO ] [MAIN ] ARES: Loaded 49601 existing records. [2025-10-28T17:16:51.390167] [WARN ] [MAIN ] ARES: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:16:51.390387] [INFO ] [MAIN ] ARES: Wiping existing primary data before full refresh. [2025-10-28T17:16:51.390434] [INFO ] [LOCAL ] ARES: Starting deletion of primary data. [2025-10-28T17:16:51.391301] [DEBUG] [LOCAL ] ARES: Deleted primary data file. [2025-10-28T17:16:51.391359] [INFO ] [MAIN ] ARES: Starting full primary refresh. [2025-10-28T17:16:51.747381] [INFO ] [REMOTE ] ARES: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:16:51.947606] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-28T17:16:51.959299] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-07. [2025-10-28T17:16:52.135263] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-28T17:16:52.759335] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-09. [2025-10-28T17:16:53.184400] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-28T17:16:53.559331] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-08. [2025-10-28T17:16:53.641363] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-28T17:16:54.359326] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-10. [2025-10-28T17:16:54.978689] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-28T17:16:55.142005] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-28T17:16:55.146112] [INFO ] [REMOTE ] ARDC: Full fetch complete (21652 records). [2025-10-28T17:16:55.146222] [DEBUG] [VALIDATOR ] ARDC: Validating primary data. [2025-10-28T17:16:55.167412] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-09. [2025-10-28T17:16:55.513523] [DEBUG] [VALIDATOR ] ARDC: All expected trading days are present. [2025-10-28T17:16:55.513599] [DEBUG] [VALIDATOR ] ARDC: Primary data validation passed. [2025-10-28T17:16:55.513915] [INFO ] [MAIN ] ARDC: Fetched primary data is valid. [2025-10-28T17:16:55.513974] [DEBUG] [LOCAL ] ARDC: Saving primary data. [2025-10-28T17:16:55.514506] [DEBUG] [LOCAL ] ARDC: Trimmed 21652 records to 14875 (keeping 200 days of data) [2025-10-28T17:16:55.602430] [DEBUG] [LOCAL ] ARDC: Primary data saved (14875 records). [2025-10-28T17:16:55.602553] [INFO ] [MAIN ] ARDC: Full history saved. [2025-10-28T17:16:55.602630] [INFO ] [MAIN ] Update Progress: 141/2366 symbols completed. ARDC took 31.0s. Estimated remaining: 4h 26m 19s. Rate: 8.4 symbols/min [2025-10-28T17:16:55.771491] [INFO ] [MAIN ] ARI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:16:55.807413] [DEBUG] [LOCAL ] ARI: Loaded 43209 existing records from primary storage. [2025-10-28T17:16:55.807727] [INFO ] [MAIN ] ARI: Loaded 43209 existing records. [2025-10-28T17:16:55.967423] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-01. [2025-10-28T17:16:55.987813] [WARN ] [MAIN ] ARI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:16:55.988616] [INFO ] [MAIN ] ARI: Wiping existing primary data before full refresh. [2025-10-28T17:16:55.988700] [INFO ] [LOCAL ] ARI: Starting deletion of primary data. [2025-10-28T17:16:55.989405] [DEBUG] [LOCAL ] ARI: Deleted primary data file. [2025-10-28T17:16:55.989464] [INFO ] [MAIN ] ARI: Starting full primary refresh. [2025-10-28T17:16:56.350697] [INFO ] [REMOTE ] ARI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:16:56.491972] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-28T17:16:56.759349] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-10. [2025-10-28T17:16:57.118727] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-28T17:16:57.559340] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-02. [2025-10-28T17:16:57.763790] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-28T17:16:57.769702] [INFO ] [REMOTE ] ARDT: Full fetch complete (41627 records). [2025-10-28T17:16:57.769793] [DEBUG] [VALIDATOR ] ARDT: Validating primary data. [2025-10-28T17:16:57.770294] [FATAL] [VALIDATOR ] ARDT: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T17:16:57.770378] [FATAL] [MAIN ] ARDT: Fetched primary data is invalid. Refusing to save it. [2025-10-28T17:16:57.770425] [WARN ] [MAIN ] ARDT: Deleting existing primary and derivative data due to validation failure. [2025-10-28T17:16:57.770463] [INFO ] [LOCAL ] ARDT: Starting deletion of primary data. [2025-10-28T17:16:57.770539] [DEBUG] [LOCAL ] ARDT: No primary data file found to delete. [2025-10-28T17:16:57.770583] [INFO ] [LOCAL ] ARDT: Starting deletion of derivative data. [2025-10-28T17:16:57.771494] [DEBUG] [LOCAL ] ARDT: Deleted derivative data file. [2025-10-28T17:16:57.771582] [INFO ] [MAIN ] Update Progress: 142/2366 symbols completed. ARDT took 31.9s. Estimated remaining: 4h 24m 53s. Rate: 8.4 symbols/min [2025-10-28T17:16:57.942083] [INFO ] [MAIN ] ARLO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:16:57.942245] [DEBUG] [LOCAL ] ARLO: No existing data file found in primary storage. [2025-10-28T17:16:57.942281] [WARN ] [MAIN ] ARLO: No existing data found, performing full refresh instead. [2025-10-28T17:16:57.942385] [INFO ] [MAIN ] ARLO: Wiping existing primary data before full refresh. [2025-10-28T17:16:57.942425] [INFO ] [LOCAL ] ARLO: Starting deletion of primary data. [2025-10-28T17:16:57.942468] [DEBUG] [LOCAL ] ARLO: No primary data file found to delete. [2025-10-28T17:16:57.942527] [INFO ] [MAIN ] ARLO: Starting full primary refresh. [2025-10-28T17:16:58.294439] [INFO ] [REMOTE ] ARLO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:16:58.359335] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-01. [2025-10-28T17:16:58.666221] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-28T17:16:59.159326] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-03. [2025-10-28T17:16:59.418801] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-28T17:16:59.959332] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-10. [2025-10-28T17:17:00.759311] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-02. [2025-10-28T17:17:00.810368] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-28T17:17:01.559329] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-01. [2025-10-28T17:17:01.942637] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-28T17:17:01.953342] [INFO ] [REMOTE ] ARE: Full fetch complete (72670 records). [2025-10-28T17:17:01.953491] [DEBUG] [VALIDATOR ] ARE: Validating primary data. [2025-10-28T17:17:01.954150] [FATAL] [VALIDATOR ] ARE: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T17:17:01.954233] [FATAL] [MAIN ] ARE: Fetched primary data is invalid. Refusing to save it. [2025-10-28T17:17:01.954274] [WARN ] [MAIN ] ARE: Deleting existing primary and derivative data due to validation failure. [2025-10-28T17:17:01.954338] [INFO ] [LOCAL ] ARE: Starting deletion of primary data. [2025-10-28T17:17:01.954401] [DEBUG] [LOCAL ] ARE: No primary data file found to delete. [2025-10-28T17:17:01.954436] [INFO ] [LOCAL ] ARE: Starting deletion of derivative data. [2025-10-28T17:17:01.954475] [DEBUG] [LOCAL ] ARE: No derivative data file found to delete. [2025-10-28T17:17:01.954530] [INFO ] [MAIN ] Update Progress: 143/2366 symbols completed. ARE took 29.5s. Estimated remaining: 4h 24m 0s. Rate: 8.4 symbols/min [2025-10-28T17:17:02.076378] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-28T17:17:02.152099] [INFO ] [MAIN ] ARMK: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:17:02.193140] [DEBUG] [LOCAL ] ARMK: Loaded 50218 existing records from primary storage. [2025-10-28T17:17:02.193462] [INFO ] [MAIN ] ARMK: Loaded 50218 existing records. [2025-10-28T17:17:02.364694] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-03. [2025-10-28T17:17:02.369686] [WARN ] [MAIN ] ARMK: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:17:02.370581] [INFO ] [MAIN ] ARMK: Wiping existing primary data before full refresh. [2025-10-28T17:17:02.370674] [INFO ] [LOCAL ] ARMK: Starting deletion of primary data. [2025-10-28T17:17:02.371437] [DEBUG] [LOCAL ] ARMK: Deleted primary data file. [2025-10-28T17:17:02.371507] [INFO ] [MAIN ] ARMK: Starting full primary refresh. [2025-10-28T17:17:02.739846] [INFO ] [REMOTE ] ARMK: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:17:02.763155] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-28T17:17:03.159334] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-01. [2025-10-28T17:17:03.550565] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-28T17:17:03.959336] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-04. [2025-10-28T17:17:04.272813] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-28T17:17:04.759374] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-02. [2025-10-28T17:17:05.032321] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-28T17:17:05.559333] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-04. [2025-10-28T17:17:05.959746] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-28T17:17:06.359339] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-02. [2025-10-28T17:17:07.159375] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-03. [2025-10-28T17:17:07.237025] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-28T17:17:07.531230] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-28T17:17:07.959350] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-05. [2025-10-28T17:17:08.621437] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-28T17:17:08.759334] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-04. [2025-10-28T17:17:09.559369] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-03. [2025-10-28T17:17:09.651958] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-28T17:17:10.369070] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-05. [2025-10-28T17:17:10.391173] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-28T17:17:10.741952] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-28T17:17:11.159384] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-06. [2025-10-28T17:17:11.762617] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-28T17:17:11.959309] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-04. [2025-10-28T17:17:12.566985] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-28T17:17:12.759329] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-07. [2025-10-28T17:17:13.180600] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-28T17:17:13.559335] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-06. [2025-10-28T17:17:14.157339] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-28T17:17:14.359330] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-05. [2025-10-28T17:17:14.522936] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-28T17:17:15.159319] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-07. [2025-10-28T17:17:15.686759] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-28T17:17:15.959327] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-08. [2025-10-28T17:17:16.250475] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-28T17:17:16.759333] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-06. [2025-10-28T17:17:17.276088] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-28T17:17:17.559343] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-05. [2025-10-28T17:17:17.819504] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-28T17:17:18.359326] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-08. [2025-10-28T17:17:18.735510] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-28T17:17:19.159338] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-06. [2025-10-28T17:17:19.443540] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-28T17:17:19.959374] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-09. [2025-10-28T17:17:20.514513] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-28T17:17:20.759344] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-09. [2025-10-28T17:17:21.172582] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-28T17:17:21.559447] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-07. [2025-10-28T17:17:22.099846] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-28T17:17:22.359317] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-07. [2025-10-28T17:17:22.685760] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-28T17:17:23.159404] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-08. [2025-10-28T17:17:23.691479] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-28T17:17:23.959374] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-10. [2025-10-28T17:17:24.260427] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-28T17:17:24.759396] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-10. [2025-10-28T17:17:25.559320] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-08. [2025-10-28T17:17:25.842395] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-28T17:17:25.852905] [INFO ] [REMOTE ] ARES: Full fetch complete (71802 records). [2025-10-28T17:17:25.853064] [DEBUG] [VALIDATOR ] ARES: Validating primary data. [2025-10-28T17:17:26.243398] [DEBUG] [VALIDATOR ] ARES: All expected trading days are present. [2025-10-28T17:17:26.243504] [DEBUG] [VALIDATOR ] ARES: Primary data validation passed. [2025-10-28T17:17:26.244300] [INFO ] [MAIN ] ARES: Fetched primary data is valid. [2025-10-28T17:17:26.244380] [DEBUG] [LOCAL ] ARES: Saving primary data. [2025-10-28T17:17:26.253614] [DEBUG] [LOCAL ] ARES: Trimmed 71802 records to 49590 (keeping 200 days of data) [2025-10-28T17:17:26.270841] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-28T17:17:26.367781] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-09. [2025-10-28T17:17:26.373751] [INFO ] [REMOTE ] ARLO: Full fetch complete (63245 records). [2025-10-28T17:17:26.380328] [DEBUG] [VALIDATOR ] ARLO: Validating primary data. [2025-10-28T17:17:27.057862] [DEBUG] [VALIDATOR ] ARLO: All expected trading days are present. [2025-10-28T17:17:27.064540] [DEBUG] [VALIDATOR ] ARLO: Primary data validation passed. [2025-10-28T17:17:27.068727] [INFO ] [MAIN ] ARLO: Fetched primary data is valid. [2025-10-28T17:17:27.068823] [DEBUG] [LOCAL ] ARLO: Saving primary data. [2025-10-28T17:17:27.079254] [DEBUG] [LOCAL ] ARES: Primary data saved (49590 records). [2025-10-28T17:17:27.079699] [INFO ] [MAIN ] ARES: Full history saved. [2025-10-28T17:17:27.080841] [INFO ] [MAIN ] Update Progress: 144/2366 symbols completed. ARES took 36.1s. Estimated remaining: 4h 28m 31s. Rate: 8.3 symbols/min [2025-10-28T17:17:27.126860] [DEBUG] [LOCAL ] ARLO: Trimmed 63245 records to 43466 (keeping 200 days of data) [2025-10-28T17:17:27.370406] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-28T17:17:27.398832] [INFO ] [MAIN ] AROC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:17:27.446023] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-09. [2025-10-28T17:17:27.619013] [DEBUG] [LOCAL ] ARLO: Primary data saved (43466 records). [2025-10-28T17:17:27.619542] [INFO ] [MAIN ] ARLO: Full history saved. [2025-10-28T17:17:27.633075] [INFO ] [MAIN ] Update Progress: 145/2366 symbols completed. ARLO took 29.9s. Estimated remaining: 4h 26m 41s. Rate: 8.3 symbols/min [2025-10-28T17:17:27.657084] [DEBUG] [LOCAL ] AROC: Loaded 49007 existing records from primary storage. [2025-10-28T17:17:27.675375] [INFO ] [MAIN ] AROC: Loaded 49007 existing records. [2025-10-28T17:17:27.950167] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-28T17:17:28.017616] [INFO ] [MAIN ] ARR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:17:28.037329] [WARN ] [MAIN ] AROC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:17:28.037843] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-10. [2025-10-28T17:17:28.038381] [INFO ] [MAIN ] AROC: Wiping existing primary data before full refresh. [2025-10-28T17:17:28.038307] [DEBUG] [LOCAL ] ARR: No existing data file found in primary storage. [2025-10-28T17:17:28.038541] [WARN ] [MAIN ] ARR: No existing data found, performing full refresh instead. [2025-10-28T17:17:28.038714] [INFO ] [LOCAL ] AROC: Starting deletion of primary data. [2025-10-28T17:17:28.038900] [INFO ] [MAIN ] ARR: Wiping existing primary data before full refresh. [2025-10-28T17:17:28.040007] [INFO ] [LOCAL ] ARR: Starting deletion of primary data. [2025-10-28T17:17:28.040101] [DEBUG] [LOCAL ] ARR: No primary data file found to delete. [2025-10-28T17:17:28.040153] [INFO ] [MAIN ] ARR: Starting full primary refresh. [2025-10-28T17:17:28.045800] [DEBUG] [LOCAL ] AROC: Deleted primary data file. [2025-10-28T17:17:28.087391] [INFO ] [MAIN ] AROC: Starting full primary refresh. [2025-10-28T17:17:28.732495] [INFO ] [REMOTE ] ARR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:17:28.771364] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-01. [2025-10-28T17:17:28.811700] [INFO ] [REMOTE ] AROC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:17:28.859579] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-28T17:17:29.369420] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-28T17:17:29.377719] [INFO ] [REMOTE ] ARI: Full fetch complete (62136 records). [2025-10-28T17:17:29.377843] [DEBUG] [VALIDATOR ] ARI: Validating primary data. [2025-10-28T17:17:29.567608] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-01. [2025-10-28T17:17:29.759208] [DEBUG] [VALIDATOR ] ARI: All expected trading days are present. [2025-10-28T17:17:29.759279] [DEBUG] [VALIDATOR ] ARI: Primary data validation passed. [2025-10-28T17:17:29.759904] [INFO ] [MAIN ] ARI: Fetched primary data is valid. [2025-10-28T17:17:29.759964] [DEBUG] [LOCAL ] ARI: Saving primary data. [2025-10-28T17:17:29.761121] [DEBUG] [LOCAL ] ARI: Trimmed 62136 records to 43095 (keeping 200 days of data) [2025-10-28T17:17:30.004732] [DEBUG] [LOCAL ] ARI: Primary data saved (43095 records). [2025-10-28T17:17:30.004851] [INFO ] [MAIN ] ARI: Full history saved. [2025-10-28T17:17:30.004924] [INFO ] [MAIN ] Update Progress: 146/2366 symbols completed. ARI took 34.4s. Estimated remaining: 4h 25m 20s. Rate: 8.4 symbols/min [2025-10-28T17:17:30.171034] [INFO ] [MAIN ] ARW: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:17:30.171209] [DEBUG] [LOCAL ] ARW: No existing data file found in primary storage. [2025-10-28T17:17:30.171246] [WARN ] [MAIN ] ARW: No existing data found, performing full refresh instead. [2025-10-28T17:17:30.171351] [INFO ] [MAIN ] ARW: Wiping existing primary data before full refresh. [2025-10-28T17:17:30.171391] [INFO ] [LOCAL ] ARW: Starting deletion of primary data. [2025-10-28T17:17:30.171430] [DEBUG] [LOCAL ] ARW: No primary data file found to delete. [2025-10-28T17:17:30.171461] [INFO ] [MAIN ] ARW: Starting full primary refresh. [2025-10-28T17:17:30.376898] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-10. [2025-10-28T17:17:30.526827] [INFO ] [REMOTE ] ARW: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:17:30.585141] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-28T17:17:30.938031] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-28T17:17:31.159394] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-02. [2025-10-28T17:17:31.836669] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-28T17:17:31.852433] [INFO ] [REMOTE ] ARMK: Full fetch complete (72919 records). [2025-10-28T17:17:31.852684] [DEBUG] [VALIDATOR ] ARMK: Validating primary data. [2025-10-28T17:17:31.964627] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-02. [2025-10-28T17:17:32.446242] [DEBUG] [VALIDATOR ] ARMK: All expected trading days are present. [2025-10-28T17:17:32.446392] [DEBUG] [VALIDATOR ] ARMK: Primary data validation passed. [2025-10-28T17:17:32.447777] [INFO ] [MAIN ] ARMK: Fetched primary data is valid. [2025-10-28T17:17:32.447865] [DEBUG] [LOCAL ] ARMK: Saving primary data. [2025-10-28T17:17:32.449874] [DEBUG] [LOCAL ] ARMK: Trimmed 72919 records to 50219 (keeping 200 days of data) [2025-10-28T17:17:32.741890] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-28T17:17:32.760792] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-03. [2025-10-28T17:17:32.819262] [DEBUG] [LOCAL ] ARMK: Primary data saved (50219 records). [2025-10-28T17:17:32.819369] [INFO ] [MAIN ] ARMK: Full history saved. [2025-10-28T17:17:32.819444] [INFO ] [MAIN ] Update Progress: 147/2366 symbols completed. ARMK took 30.9s. Estimated remaining: 4h 24m 7s. Rate: 8.4 symbols/min [2025-10-28T17:17:32.986806] [INFO ] [MAIN ] ARX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:17:32.986980] [DEBUG] [LOCAL ] ARX: No existing data file found in primary storage. [2025-10-28T17:17:32.987060] [WARN ] [MAIN ] ARX: No existing data found, performing full refresh instead. [2025-10-28T17:17:32.987140] [INFO ] [MAIN ] ARX: Wiping existing primary data before full refresh. [2025-10-28T17:17:32.987176] [INFO ] [LOCAL ] ARX: Starting deletion of primary data. [2025-10-28T17:17:32.987243] [DEBUG] [LOCAL ] ARX: No primary data file found to delete. [2025-10-28T17:17:32.987298] [INFO ] [MAIN ] ARX: Starting full primary refresh. [2025-10-28T17:17:33.366113] [INFO ] [REMOTE ] ARX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:17:33.392992] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-28T17:17:33.559334] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-01. [2025-10-28T17:17:33.788031] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-28T17:17:33.788314] [WARN ] [REMOTE ] ARX: No data returned for month 2025-01 [2025-10-28T17:17:33.788397] [FATAL] [REMOTE ] ARX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-28T17:17:33.788451] [FATAL] [MAIN ] ARX: Failed to fetch primary data. [2025-10-28T17:17:33.788525] [WARN ] [MAIN ] ARX: Deleting existing primary and derivative data due to fetch failure. [2025-10-28T17:17:33.788595] [INFO ] [LOCAL ] ARX: Starting deletion of primary data. [2025-10-28T17:17:33.788681] [DEBUG] [LOCAL ] ARX: No primary data file found to delete. [2025-10-28T17:17:33.788738] [INFO ] [LOCAL ] ARX: Starting deletion of derivative data. [2025-10-28T17:17:33.788781] [DEBUG] [LOCAL ] ARX: No derivative data file found to delete. [2025-10-28T17:17:33.788827] [INFO ] [MAIN ] Update Progress: 148/2366 symbols completed. ARX took 1.0s. Estimated remaining: 4h 22m 28s. Rate: 8.5 symbols/min [2025-10-28T17:17:33.962941] [INFO ] [MAIN ] AS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:17:34.010638] [DEBUG] [LOCAL ] AS: Loaded 53194 existing records from primary storage. [2025-10-28T17:17:34.011003] [INFO ] [MAIN ] AS: Loaded 53194 existing records. [2025-10-28T17:17:34.193230] [WARN ] [MAIN ] AS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:17:34.221473] [INFO ] [MAIN ] AS: Wiping existing primary data before full refresh. [2025-10-28T17:17:34.222141] [INFO ] [LOCAL ] AS: Starting deletion of primary data. [2025-10-28T17:17:34.223319] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-28T17:17:34.233350] [DEBUG] [LOCAL ] AS: Deleted primary data file. [2025-10-28T17:17:34.233824] [INFO ] [MAIN ] AS: Starting full primary refresh. [2025-10-28T17:17:34.373028] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-01. [2025-10-28T17:17:34.590022] [INFO ] [REMOTE ] AS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:17:35.159351] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-01. [2025-10-28T17:17:35.959369] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-03. [2025-10-28T17:17:36.542568] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-28T17:17:36.727630] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-01 (2.35 seconds). [2025-10-28T17:17:36.759292] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-02. [2025-10-28T17:17:37.393670] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-28T17:17:37.559334] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-04. [2025-10-28T17:17:37.785806] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-28T17:17:38.359350] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-02. [2025-10-28T17:17:39.159325] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-04. [2025-10-28T17:17:39.514287] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-28T17:17:39.959363] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-03. [2025-10-28T17:17:40.645787] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-04 (3.09 seconds). [2025-10-28T17:17:40.736196] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-28T17:17:40.759296] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-05. [2025-10-28T17:17:41.181807] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-28T17:17:41.559331] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-04. [2025-10-28T17:17:42.359325] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-05. [2025-10-28T17:17:42.514468] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-28T17:17:43.159331] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-06. [2025-10-28T17:17:43.320741] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-28T17:17:43.691152] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-28T17:17:43.959395] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-05. [2025-10-28T17:17:44.706028] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-28T17:17:44.759381] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-06. [2025-10-28T17:17:44.976631] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-28T17:17:45.559344] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-03. [2025-10-28T17:17:46.068556] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-28T17:17:46.359342] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-06. [2025-10-28T17:17:47.152902] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-28T17:17:47.163098] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-07. [2025-10-28T17:17:47.408565] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-28T17:17:47.959349] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-07. [2025-10-28T17:17:48.769611] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-04. [2025-10-28T17:17:48.772987] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-28T17:17:48.836169] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-28T17:17:49.559334] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-07. [2025-10-28T17:17:50.249588] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-28T17:17:50.359384] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-08. [2025-10-28T17:17:51.159332] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-08. [2025-10-28T17:17:51.279219] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-28T17:17:51.959301] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-08. [2025-10-28T17:17:52.037912] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-28T17:17:52.226558] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-28T17:17:52.759351] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-09. [2025-10-28T17:17:53.058701] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-28T17:17:53.559390] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-05. [2025-10-28T17:17:54.106857] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-28T17:17:54.359408] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-10. [2025-10-28T17:17:54.996583] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-28T17:17:55.159355] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-09. [2025-10-28T17:17:55.943438] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-28T17:17:55.953745] [INFO ] [REMOTE ] ARR: Full fetch complete (75152 records). [2025-10-28T17:17:55.953875] [DEBUG] [VALIDATOR ] ARR: Validating primary data. [2025-10-28T17:17:55.954500] [FATAL] [VALIDATOR ] ARR: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T17:17:55.954579] [FATAL] [MAIN ] ARR: Fetched primary data is invalid. Refusing to save it. [2025-10-28T17:17:55.954623] [WARN ] [MAIN ] ARR: Deleting existing primary and derivative data due to validation failure. [2025-10-28T17:17:55.954726] [INFO ] [LOCAL ] ARR: Starting deletion of primary data. [2025-10-28T17:17:55.954803] [DEBUG] [LOCAL ] ARR: No primary data file found to delete. [2025-10-28T17:17:55.954851] [INFO ] [LOCAL ] ARR: Starting deletion of derivative data. [2025-10-28T17:17:55.954912] [DEBUG] [LOCAL ] ARR: No derivative data file found to delete. [2025-10-28T17:17:55.954991] [INFO ] [MAIN ] Update Progress: 149/2366 symbols completed. ARR took 28.3s. Estimated remaining: 4h 26m 5s. Rate: 8.3 symbols/min [2025-10-28T17:17:55.966126] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-06. [2025-10-28T17:17:56.135774] [INFO ] [MAIN ] ASA: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:17:56.136015] [DEBUG] [LOCAL ] ASA: No existing data file found in primary storage. [2025-10-28T17:17:56.136101] [WARN ] [MAIN ] ASA: No existing data found, performing full refresh instead. [2025-10-28T17:17:56.136435] [INFO ] [MAIN ] ASA: Wiping existing primary data before full refresh. [2025-10-28T17:17:56.136612] [INFO ] [LOCAL ] ASA: Starting deletion of primary data. [2025-10-28T17:17:56.136745] [DEBUG] [LOCAL ] ASA: No primary data file found to delete. [2025-10-28T17:17:56.136969] [INFO ] [MAIN ] ASA: Starting full primary refresh. [2025-10-28T17:17:56.263256] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-28T17:17:56.521897] [INFO ] [REMOTE ] ASA: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:17:56.759350] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-09. [2025-10-28T17:17:57.396453] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-28T17:17:57.559318] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-07. [2025-10-28T17:17:58.165812] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-28T17:17:58.359361] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-10. [2025-10-28T17:17:58.884612] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-28T17:17:59.159327] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-10. [2025-10-28T17:17:59.959318] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-08. [2025-10-28T17:18:00.027027] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-28T17:18:00.037424] [INFO ] [REMOTE ] AROC: Full fetch complete (71457 records). [2025-10-28T17:18:00.037569] [DEBUG] [VALIDATOR ] AROC: Validating primary data. [2025-10-28T17:18:00.439047] [DEBUG] [VALIDATOR ] AROC: All expected trading days are present. [2025-10-28T17:18:00.439206] [DEBUG] [VALIDATOR ] AROC: Primary data validation passed. [2025-10-28T17:18:00.440013] [INFO ] [MAIN ] AROC: Fetched primary data is valid. [2025-10-28T17:18:00.440093] [DEBUG] [LOCAL ] AROC: Saving primary data. [2025-10-28T17:18:00.458532] [DEBUG] [LOCAL ] AROC: Trimmed 71457 records to 48992 (keeping 200 days of data) [2025-10-28T17:18:00.472382] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-28T17:18:00.541861] [INFO ] [REMOTE ] ARW: Full fetch complete (48704 records). [2025-10-28T17:18:00.569284] [DEBUG] [VALIDATOR ] ARW: Validating primary data. [2025-10-28T17:18:00.766505] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-01. [2025-10-28T17:18:01.088099] [DEBUG] [VALIDATOR ] ARW: All expected trading days are present. [2025-10-28T17:18:01.088674] [DEBUG] [VALIDATOR ] ARW: Primary data validation passed. [2025-10-28T17:18:01.089254] [INFO ] [MAIN ] ARW: Fetched primary data is valid. [2025-10-28T17:18:01.089330] [DEBUG] [LOCAL ] ARW: Saving primary data. [2025-10-28T17:18:01.122848] [DEBUG] [LOCAL ] ARW: Trimmed 48704 records to 32848 (keeping 200 days of data) [2025-10-28T17:18:01.282186] [DEBUG] [LOCAL ] AROC: Primary data saved (48992 records). [2025-10-28T17:18:01.282924] [INFO ] [MAIN ] AROC: Full history saved. [2025-10-28T17:18:01.283686] [INFO ] [MAIN ] Update Progress: 150/2366 symbols completed. AROC took 34.2s. Estimated remaining: 4h 25m 30s. Rate: 8.3 symbols/min [2025-10-28T17:18:01.545071] [INFO ] [MAIN ] ASAN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:18:01.554531] [DEBUG] [LOCAL ] ASAN: No existing data file found in primary storage. [2025-10-28T17:18:01.556456] [WARN ] [MAIN ] ASAN: No existing data found, performing full refresh instead. [2025-10-28T17:18:01.557054] [INFO ] [MAIN ] ASAN: Wiping existing primary data before full refresh. [2025-10-28T17:18:01.557192] [INFO ] [LOCAL ] ASAN: Starting deletion of primary data. [2025-10-28T17:18:01.556593] [DEBUG] [LOCAL ] ARW: Primary data saved (32848 records). [2025-10-28T17:18:01.557927] [DEBUG] [LOCAL ] ASAN: No primary data file found to delete. [2025-10-28T17:18:01.557837] [INFO ] [MAIN ] ARW: Full history saved. [2025-10-28T17:18:01.558226] [INFO ] [MAIN ] ASAN: Starting full primary refresh. [2025-10-28T17:18:01.563724] [INFO ] [MAIN ] Update Progress: 151/2366 symbols completed. ARW took 31.6s. Estimated remaining: 4h 23m 41s. Rate: 8.4 symbols/min [2025-10-28T17:18:01.631790] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-28T17:18:01.701020] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-02. [2025-10-28T17:18:01.996636] [INFO ] [MAIN ] ASB: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:18:02.029520] [DEBUG] [LOCAL ] ASB: No existing data file found in primary storage. [2025-10-28T17:18:02.072240] [WARN ] [MAIN ] ASB: No existing data found, performing full refresh instead. [2025-10-28T17:18:02.102434] [INFO ] [MAIN ] ASB: Wiping existing primary data before full refresh. [2025-10-28T17:18:02.102768] [INFO ] [LOCAL ] ASB: Starting deletion of primary data. [2025-10-28T17:18:02.127331] [DEBUG] [LOCAL ] ASB: No primary data file found to delete. [2025-10-28T17:18:02.114798] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-10-28T17:18:02.127485] [INFO ] [MAIN ] ASB: Starting full primary refresh. [2025-10-28T17:18:02.190663] [INFO ] [REMOTE ] ASAN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:18:02.362603] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-01. [2025-10-28T17:18:02.545121] [INFO ] [REMOTE ] ASB: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:18:02.553709] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-28T17:18:03.159378] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-03. [2025-10-28T17:18:03.772143] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-28T17:18:03.959347] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-09. [2025-10-28T17:18:04.145850] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-28T17:18:04.759380] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-01. [2025-10-28T17:18:05.445103] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-28T17:18:05.559344] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-02. [2025-10-28T17:18:06.367624] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-10. [2025-10-28T17:18:06.385478] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-28T17:18:07.159436] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-04. [2025-10-28T17:18:07.389102] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-10-28T17:18:07.914321] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-28T17:18:07.959337] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-03. [2025-10-28T17:18:08.025276] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-28T17:18:08.036919] [INFO ] [REMOTE ] AS: Full fetch complete (76944 records). [2025-10-28T17:18:08.037110] [DEBUG] [VALIDATOR ] AS: Validating primary data. [2025-10-28T17:18:08.431809] [DEBUG] [VALIDATOR ] AS: All expected trading days are present. [2025-10-28T17:18:08.431899] [DEBUG] [VALIDATOR ] AS: Primary data validation passed. [2025-10-28T17:18:08.432778] [INFO ] [MAIN ] AS: Fetched primary data is valid. [2025-10-28T17:18:08.432874] [DEBUG] [LOCAL ] AS: Saving primary data. [2025-10-28T17:18:08.434413] [DEBUG] [LOCAL ] AS: Trimmed 76944 records to 53194 (keeping 200 days of data) [2025-10-28T17:18:08.738791] [DEBUG] [LOCAL ] AS: Primary data saved (53194 records). [2025-10-28T17:18:08.738939] [INFO ] [MAIN ] AS: Full history saved. [2025-10-28T17:18:08.739061] [INFO ] [MAIN ] Update Progress: 152/2366 symbols completed. AS took 35.0s. Estimated remaining: 4h 23m 35s. Rate: 8.4 symbols/min [2025-10-28T17:18:08.769334] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-02. [2025-10-28T17:18:08.906015] [INFO ] [MAIN ] ASBA: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:18:08.911288] [DEBUG] [LOCAL ] ASBA: Loaded 3407 existing records from primary storage. [2025-10-28T17:18:08.911440] [INFO ] [MAIN ] ASBA: Loaded 3407 existing records. [2025-10-28T17:18:09.085043] [WARN ] [MAIN ] ASBA: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:18:09.085271] [INFO ] [MAIN ] ASBA: Wiping existing primary data before full refresh. [2025-10-28T17:18:09.085318] [INFO ] [LOCAL ] ASBA: Starting deletion of primary data. [2025-10-28T17:18:09.085469] [DEBUG] [LOCAL ] ASBA: Deleted primary data file. [2025-10-28T17:18:09.085508] [INFO ] [MAIN ] ASBA: Starting full primary refresh. [2025-10-28T17:18:09.446147] [INFO ] [REMOTE ] ASBA: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:18:09.533552] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-28T17:18:09.559313] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-01. [2025-10-28T17:18:10.067676] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-28T17:18:10.364137] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-02. [2025-10-28T17:18:10.365743] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-28T17:18:10.789961] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-28T17:18:11.159339] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-05. [2025-10-28T17:18:11.778156] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-28T17:18:11.959345] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-04. [2025-10-28T17:18:12.759352] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-06. [2025-10-28T17:18:13.559333] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-03. [2025-10-28T17:18:13.595076] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-28T17:18:13.635892] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-28T17:18:14.035560] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-28T17:18:14.359329] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-03. [2025-10-28T17:18:15.159346] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-04. [2025-10-28T17:18:15.537325] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-10-28T17:18:15.741363] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-28T17:18:15.959349] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-04. [2025-10-28T17:18:16.759315] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-05. [2025-10-28T17:18:17.086383] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-10-28T17:18:17.553999] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-28T17:18:17.564258] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-06. [2025-10-28T17:18:18.009562] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-28T17:18:18.359267] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-05. [2025-10-28T17:18:19.159394] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-05. [2025-10-28T17:18:19.964775] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-07. [2025-10-28T17:18:19.970962] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-28T17:18:20.271383] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-28T17:18:20.407535] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-28T17:18:20.759364] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-06. [2025-10-28T17:18:21.559337] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-06. [2025-10-28T17:18:22.228740] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-28T17:18:22.359308] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-07. [2025-10-28T17:18:22.660960] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-28T17:18:23.159336] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-07. [2025-10-28T17:18:23.860332] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-28T17:18:23.959397] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-07. [2025-10-28T17:18:24.317385] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-28T17:18:24.655053] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-28T17:18:24.759329] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-08. [2025-10-28T17:18:25.419989] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-28T17:18:25.559334] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-08. [2025-10-28T17:18:26.359363] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-08. [2025-10-28T17:18:26.694075] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-28T17:18:27.159352] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-08. [2025-10-28T17:18:27.527693] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-10-28T17:18:27.959347] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-09. [2025-10-28T17:18:28.759403] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-09. [2025-10-28T17:18:29.384348] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-28T17:18:29.534619] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-28T17:18:29.559324] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-10. [2025-10-28T17:18:30.359360] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-10. [2025-10-28T17:18:30.672264] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-28T17:18:30.677595] [INFO ] [REMOTE ] ASA: Full fetch complete (21057 records). [2025-10-28T17:18:30.677728] [DEBUG] [VALIDATOR ] ASA: Validating primary data. [2025-10-28T17:18:31.035351] [DEBUG] [VALIDATOR ] ASA: All expected trading days are present. [2025-10-28T17:18:31.035442] [DEBUG] [VALIDATOR ] ASA: Primary data validation passed. [2025-10-28T17:18:31.035777] [INFO ] [MAIN ] ASA: Fetched primary data is valid. [2025-10-28T17:18:31.035838] [DEBUG] [LOCAL ] ASA: Saving primary data. [2025-10-28T17:18:31.036419] [DEBUG] [LOCAL ] ASA: Trimmed 21057 records to 15914 (keeping 200 days of data) [2025-10-28T17:18:31.126252] [DEBUG] [LOCAL ] ASA: Primary data saved (15914 records). [2025-10-28T17:18:31.126369] [INFO ] [MAIN ] ASA: Full history saved. [2025-10-28T17:18:31.126453] [INFO ] [MAIN ] Update Progress: 153/2366 symbols completed. ASA took 35.2s. Estimated remaining: 4h 27m 8s. Rate: 8.3 symbols/min [2025-10-28T17:18:31.169112] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-09. [2025-10-28T17:18:31.301397] [INFO ] [MAIN ] ASC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:18:31.301531] [DEBUG] [LOCAL ] ASC: No existing data file found in primary storage. [2025-10-28T17:18:31.301567] [WARN ] [MAIN ] ASC: No existing data found, performing full refresh instead. [2025-10-28T17:18:31.301699] [INFO ] [MAIN ] ASC: Wiping existing primary data before full refresh. [2025-10-28T17:18:31.301753] [INFO ] [LOCAL ] ASC: Starting deletion of primary data. [2025-10-28T17:18:31.301796] [DEBUG] [LOCAL ] ASC: No primary data file found to delete. [2025-10-28T17:18:31.301830] [INFO ] [MAIN ] ASC: Starting full primary refresh. [2025-10-28T17:18:31.658616] [INFO ] [REMOTE ] ASC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:18:31.663027] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-28T17:18:31.796258] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-28T17:18:31.808177] [INFO ] [REMOTE ] ASB: Full fetch complete (72327 records). [2025-10-28T17:18:31.808375] [DEBUG] [VALIDATOR ] ASB: Validating primary data. [2025-10-28T17:18:31.973530] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-10. [2025-10-28T17:18:32.254110] [DEBUG] [VALIDATOR ] ASB: All expected trading days are present. [2025-10-28T17:18:32.254188] [DEBUG] [VALIDATOR ] ASB: Primary data validation passed. [2025-10-28T17:18:32.254885] [INFO ] [MAIN ] ASB: Fetched primary data is valid. [2025-10-28T17:18:32.254947] [DEBUG] [LOCAL ] ASB: Saving primary data. [2025-10-28T17:18:32.256277] [DEBUG] [LOCAL ] ASB: Trimmed 72327 records to 49640 (keeping 200 days of data) [2025-10-28T17:18:32.537986] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-28T17:18:32.541113] [INFO ] [REMOTE ] ASBA: Full fetch complete (5125 records). [2025-10-28T17:18:32.542012] [DEBUG] [VALIDATOR ] ASBA: Validating primary data. [2025-10-28T17:18:32.683947] [DEBUG] [LOCAL ] ASB: Primary data saved (49640 records). [2025-10-28T17:18:32.706994] [INFO ] [MAIN ] ASB: Full history saved. [2025-10-28T17:18:32.723677] [INFO ] [MAIN ] Update Progress: 154/2366 symbols completed. ASB took 31.2s. Estimated remaining: 4h 25m 40s. Rate: 8.3 symbols/min [2025-10-28T17:18:32.770815] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-01. [2025-10-28T17:18:33.100697] [INFO ] [MAIN ] ASG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:18:33.108091] [DEBUG] [VALIDATOR ] ASBA: All expected trading days are present. [2025-10-28T17:18:33.108164] [DEBUG] [VALIDATOR ] ASBA: Primary data validation passed. [2025-10-28T17:18:33.108355] [INFO ] [MAIN ] ASBA: Fetched primary data is valid. [2025-10-28T17:18:33.108393] [DEBUG] [LOCAL ] ASBA: Saving primary data. [2025-10-28T17:18:33.108800] [DEBUG] [LOCAL ] ASBA: Trimmed 5125 records to 3412 (keeping 200 days of data) [2025-10-28T17:18:33.131136] [DEBUG] [LOCAL ] ASBA: Primary data saved (3412 records). [2025-10-28T17:18:33.136171] [INFO ] [MAIN ] ASBA: Full history saved. [2025-10-28T17:18:33.136298] [INFO ] [MAIN ] Update Progress: 155/2366 symbols completed. ASBA took 24.4s. Estimated remaining: 4h 23m 56s. Rate: 8.4 symbols/min [2025-10-28T17:18:33.249104] [DEBUG] [LOCAL ] ASG: Loaded 19127 existing records from primary storage. [2025-10-28T17:18:33.260100] [INFO ] [MAIN ] ASG: Loaded 19127 existing records. [2025-10-28T17:18:33.431304] [INFO ] [MAIN ] ASGI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:18:33.441740] [DEBUG] [LOCAL ] ASGI: No existing data file found in primary storage. [2025-10-28T17:18:33.459274] [WARN ] [MAIN ] ASGI: No existing data found, performing full refresh instead. [2025-10-28T17:18:33.459417] [INFO ] [MAIN ] ASGI: Wiping existing primary data before full refresh. [2025-10-28T17:18:33.469533] [INFO ] [LOCAL ] ASGI: Starting deletion of primary data. [2025-10-28T17:18:33.478390] [DEBUG] [LOCAL ] ASGI: No primary data file found to delete. [2025-10-28T17:18:33.493752] [INFO ] [MAIN ] ASGI: Starting full primary refresh. [2025-10-28T17:18:33.531619] [WARN ] [MAIN ] ASG: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:18:33.570539] [INFO ] [MAIN ] ASG: Wiping existing primary data before full refresh. [2025-10-28T17:18:33.581737] [INFO ] [LOCAL ] ASG: Starting deletion of primary data. [2025-10-28T17:18:33.601412] [DEBUG] [LOCAL ] ASG: Deleted primary data file. [2025-10-28T17:18:33.604144] [INFO ] [MAIN ] ASG: Starting full primary refresh. [2025-10-28T17:18:34.129536] [INFO ] [REMOTE ] ASGI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:18:34.141451] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-01. [2025-10-28T17:18:34.235730] [INFO ] [REMOTE ] ASG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:18:34.258560] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-28T17:18:34.359318] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-01. [2025-10-28T17:18:35.130322] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-28T17:18:35.159299] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-02. [2025-10-28T17:18:35.356882] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-28T17:18:35.783255] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-28T17:18:35.959359] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-02. [2025-10-28T17:18:36.759337] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-02. [2025-10-28T17:18:37.531527] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-28T17:18:37.559311] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-03. [2025-10-28T17:18:38.359337] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-03. [2025-10-28T17:18:38.462161] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-28T17:18:39.009449] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-28T17:18:39.159317] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-04. [2025-10-28T17:18:39.959371] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-04. [2025-10-28T17:18:40.178109] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-28T17:18:40.657668] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-28T17:18:40.759312] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-05. [2025-10-28T17:18:41.463140] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-28T17:18:41.559348] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-06. [2025-10-28T17:18:42.359327] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-05. [2025-10-28T17:18:42.425515] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-28T17:18:42.628891] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-08 (16.27 seconds). [2025-10-28T17:18:43.038064] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-28T17:18:43.159325] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-06. [2025-10-28T17:18:43.767904] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-28T17:18:43.959322] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-09. [2025-10-28T17:18:44.759382] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-07. [2025-10-28T17:18:45.415245] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-28T17:18:45.559363] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-10. [2025-10-28T17:18:46.359413] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-07. [2025-10-28T17:18:47.368904] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-28T17:18:47.380097] [INFO ] [REMOTE ] ASAN: Full fetch complete (76615 records). [2025-10-28T17:18:47.380271] [DEBUG] [VALIDATOR ] ASAN: Validating primary data. [2025-10-28T17:18:47.776846] [DEBUG] [VALIDATOR ] ASAN: All expected trading days are present. [2025-10-28T17:18:47.776927] [DEBUG] [VALIDATOR ] ASAN: Primary data validation passed. [2025-10-28T17:18:47.777673] [INFO ] [MAIN ] ASAN: Fetched primary data is valid. [2025-10-28T17:18:47.777739] [DEBUG] [LOCAL ] ASAN: Saving primary data. [2025-10-28T17:18:47.779325] [DEBUG] [LOCAL ] ASAN: Trimmed 76615 records to 52705 (keeping 200 days of data) [2025-10-28T17:18:48.086480] [DEBUG] [LOCAL ] ASAN: Primary data saved (52705 records). [2025-10-28T17:18:48.086612] [INFO ] [MAIN ] ASAN: Full history saved. [2025-10-28T17:18:48.086715] [INFO ] [MAIN ] Update Progress: 156/2366 symbols completed. ASAN took 46.8s. Estimated remaining: 4h 25m 39s. Rate: 8.3 symbols/min [2025-10-28T17:18:48.250230] [INFO ] [MAIN ] ASGN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:18:48.283254] [DEBUG] [LOCAL ] ASGN: Loaded 36722 existing records from primary storage. [2025-10-28T17:18:48.283555] [INFO ] [MAIN ] ASGN: Loaded 36722 existing records. [2025-10-28T17:18:48.453944] [WARN ] [MAIN ] ASGN: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:18:48.454156] [INFO ] [MAIN ] ASGN: Wiping existing primary data before full refresh. [2025-10-28T17:18:48.454203] [INFO ] [LOCAL ] ASGN: Starting deletion of primary data. [2025-10-28T17:18:48.454487] [DEBUG] [LOCAL ] ASGN: Deleted primary data file. [2025-10-28T17:18:48.454528] [INFO ] [MAIN ] ASGN: Starting full primary refresh. [2025-10-28T17:18:48.800003] [INFO ] [REMOTE ] ASGN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:18:48.800303] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-01. [2025-10-28T17:18:49.305704] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-02 (13.35 seconds). [2025-10-28T17:18:49.314240] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-03. [2025-10-28T17:18:49.645271] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-28T17:18:49.651947] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-02. [2025-10-28T17:18:50.305264] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-28T17:18:50.318558] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-04. [2025-10-28T17:18:50.622153] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-28T17:18:50.630358] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-03. [2025-10-28T17:18:51.217203] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-28T17:18:51.225454] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-05. [2025-10-28T17:18:51.647253] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-28T17:18:51.959347] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-04. [2025-10-28T17:18:52.241971] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-28T17:18:52.759372] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-06. [2025-10-28T17:18:52.862439] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-28T17:18:53.559352] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-05. [2025-10-28T17:18:54.402325] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-28T17:18:54.409348] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-06. [2025-10-28T17:18:55.271981] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-28T17:18:55.279241] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-07. [2025-10-28T17:18:56.242008] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-28T17:18:56.250512] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-08. [2025-10-28T17:18:57.192431] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-28T17:18:57.205414] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-09. [2025-10-28T17:19:00.820746] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-07 (16.06 seconds). [2025-10-28T17:19:00.826128] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-08. [2025-10-28T17:19:01.499315] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-07 (15.14 seconds). [2025-10-28T17:19:01.504127] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-08. [2025-10-28T17:19:01.732279] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-28T17:19:01.737884] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-09. [2025-10-28T17:19:02.442780] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-28T17:19:02.448768] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-10. [2025-10-28T17:19:02.560561] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-28T17:19:02.564928] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-09. [2025-10-28T17:19:03.382993] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-28T17:19:03.388290] [INFO ] [REMOTE ] ASGI: Full fetch complete (32672 records). [2025-10-28T17:19:03.388459] [DEBUG] [VALIDATOR ] ASGI: Validating primary data. [2025-10-28T17:19:03.589616] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-28T17:19:03.683188] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-10. [2025-10-28T17:19:03.808730] [DEBUG] [VALIDATOR ] ASGI: All expected trading days are present. [2025-10-28T17:19:03.808830] [DEBUG] [VALIDATOR ] ASGI: Primary data validation passed. [2025-10-28T17:19:03.809284] [INFO ] [MAIN ] ASGI: Fetched primary data is valid. [2025-10-28T17:19:03.809351] [DEBUG] [LOCAL ] ASGI: Saving primary data. [2025-10-28T17:19:03.810402] [DEBUG] [LOCAL ] ASGI: Trimmed 32672 records to 22642 (keeping 200 days of data) [2025-10-28T17:19:03.944474] [DEBUG] [LOCAL ] ASGI: Primary data saved (22642 records). [2025-10-28T17:19:03.944596] [INFO ] [MAIN ] ASGI: Full history saved. [2025-10-28T17:19:03.944685] [INFO ] [MAIN ] Update Progress: 157/2366 symbols completed. ASGI took 30.8s. Estimated remaining: 4h 27m 33s. Rate: 8.3 symbols/min [2025-10-28T17:19:04.502636] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-28T17:19:04.506694] [INFO ] [REMOTE ] ASG: Full fetch complete (30809 records). [2025-10-28T17:19:04.506774] [DEBUG] [VALIDATOR ] ASG: Validating primary data. [2025-10-28T17:19:04.863507] [DEBUG] [VALIDATOR ] ASG: All expected trading days are present. [2025-10-28T17:19:04.863586] [DEBUG] [VALIDATOR ] ASG: Primary data validation passed. [2025-10-28T17:19:04.863981] [INFO ] [MAIN ] ASG: Fetched primary data is valid. [2025-10-28T17:19:04.864042] [DEBUG] [LOCAL ] ASG: Saving primary data. [2025-10-28T17:19:04.864736] [DEBUG] [LOCAL ] ASG: Trimmed 30809 records to 19022 (keeping 200 days of data) [2025-10-28T17:19:04.969747] [DEBUG] [LOCAL ] ASG: Primary data saved (19022 records). [2025-10-28T17:19:04.969894] [INFO ] [MAIN ] ASG: Full history saved. [2025-10-28T17:19:04.969973] [INFO ] [MAIN ] Update Progress: 158/2366 symbols completed. ASG took 32.2s. Estimated remaining: 4h 25m 59s. Rate: 8.3 symbols/min [2025-10-28T17:19:06.191249] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-06 (13.43 seconds). [2025-10-28T17:19:06.199433] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-07. [2025-10-28T17:19:07.650969] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-28T17:19:07.682603] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-08. [2025-10-28T17:19:07.683327] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-09 (10.48 seconds). [2025-10-28T17:19:07.692628] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-10. [2025-10-28T17:19:08.627761] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-28T17:19:08.635754] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-09. [2025-10-28T17:19:09.139909] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-28T17:19:09.148282] [INFO ] [REMOTE ] ASGN: Full fetch complete (53937 records). [2025-10-28T17:19:09.148373] [DEBUG] [VALIDATOR ] ASGN: Validating primary data. [2025-10-28T17:19:09.526143] [DEBUG] [VALIDATOR ] ASGN: All expected trading days are present. [2025-10-28T17:19:09.526217] [DEBUG] [VALIDATOR ] ASGN: Primary data validation passed. [2025-10-28T17:19:09.526774] [INFO ] [MAIN ] ASGN: Fetched primary data is valid. [2025-10-28T17:19:09.526835] [DEBUG] [LOCAL ] ASGN: Saving primary data. [2025-10-28T17:19:09.527971] [DEBUG] [LOCAL ] ASGN: Trimmed 53937 records to 36761 (keeping 200 days of data) [2025-10-28T17:19:09.738954] [DEBUG] [LOCAL ] ASGN: Primary data saved (36761 records). [2025-10-28T17:19:09.739101] [INFO ] [MAIN ] ASGN: Full history saved. [2025-10-28T17:19:09.739267] [INFO ] [MAIN ] Update Progress: 159/2366 symbols completed. ASGN took 21.7s. Estimated remaining: 4h 25m 17s. Rate: 8.3 symbols/min [2025-10-28T17:19:09.759858] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-28T17:19:09.767562] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-10. [2025-10-28T17:19:11.053217] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-28T17:19:11.060797] [INFO ] [REMOTE ] ASC: Full fetch complete (55843 records). [2025-10-28T17:19:11.060920] [DEBUG] [VALIDATOR ] ASC: Validating primary data. [2025-10-28T17:19:11.529337] [DEBUG] [VALIDATOR ] ASC: All expected trading days are present. [2025-10-28T17:19:11.529457] [DEBUG] [VALIDATOR ] ASC: Primary data validation passed. [2025-10-28T17:19:11.530534] [INFO ] [MAIN ] ASC: Fetched primary data is valid. [2025-10-28T17:19:11.530619] [DEBUG] [LOCAL ] ASC: Saving primary data. [2025-10-28T17:19:11.532382] [DEBUG] [LOCAL ] ASC: Trimmed 55843 records to 36901 (keeping 200 days of data) [2025-10-28T17:19:11.877996] [DEBUG] [LOCAL ] ASC: Primary data saved (36901 records). [2025-10-28T17:19:11.878190] [INFO ] [MAIN ] ASC: Full history saved. [2025-10-28T17:19:11.878301] [INFO ] [MAIN ] Update Progress: 160/2366 symbols completed. ASC took 40.8s. Estimated remaining: 4h 24m 0s. Rate: 8.4 symbols/min [2025-10-28T17:19:12.546206] [INFO ] [MAIN ] ASPN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:19:12.563052] [INFO ] [MAIN ] ASIX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:19:12.648421] [INFO ] [MAIN ] ASH: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:19:12.680813] [INFO ] [MAIN ] ASR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:19:12.707972] [DEBUG] [LOCAL ] ASR: Loaded 9374 existing records from primary storage. [2025-10-28T17:19:12.717096] [DEBUG] [LOCAL ] ASIX: Loaded 22673 existing records from primary storage. [2025-10-28T17:19:12.715875] [INFO ] [MAIN ] ASR: Loaded 9374 existing records. [2025-10-28T17:19:12.717572] [INFO ] [MAIN ] ASIX: Loaded 22673 existing records. [2025-10-28T17:19:12.919215] [DEBUG] [LOCAL ] ASH: Loaded 37142 existing records from primary storage. [2025-10-28T17:19:12.983387] [INFO ] [MAIN ] ASH: Loaded 37142 existing records. [2025-10-28T17:19:13.004864] [DEBUG] [LOCAL ] ASPN: Loaded 49804 existing records from primary storage. [2025-10-28T17:19:13.005801] [INFO ] [MAIN ] ASPN: Loaded 49804 existing records. [2025-10-28T17:19:13.316190] [WARN ] [MAIN ] ASIX: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:19:13.369277] [WARN ] [MAIN ] ASR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:19:13.398635] [INFO ] [MAIN ] ASIX: Wiping existing primary data before full refresh. [2025-10-28T17:19:13.404170] [INFO ] [LOCAL ] ASIX: Starting deletion of primary data. [2025-10-28T17:19:13.409808] [INFO ] [MAIN ] ASR: Wiping existing primary data before full refresh. [2025-10-28T17:19:13.420540] [INFO ] [LOCAL ] ASR: Starting deletion of primary data. [2025-10-28T17:19:13.431161] [DEBUG] [LOCAL ] ASIX: Deleted primary data file. [2025-10-28T17:19:13.455116] [INFO ] [MAIN ] ASIX: Starting full primary refresh. [2025-10-28T17:19:13.465681] [DEBUG] [LOCAL ] ASR: Deleted primary data file. [2025-10-28T17:19:13.542751] [INFO ] [MAIN ] ASR: Starting full primary refresh. [2025-10-28T17:19:13.595385] [WARN ] [MAIN ] ASPN: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:19:13.662178] [WARN ] [MAIN ] ASH: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:19:13.682728] [INFO ] [MAIN ] ASPN: Wiping existing primary data before full refresh. [2025-10-28T17:19:13.694330] [INFO ] [MAIN ] ASH: Wiping existing primary data before full refresh. [2025-10-28T17:19:13.699601] [INFO ] [LOCAL ] ASPN: Starting deletion of primary data. [2025-10-28T17:19:13.755019] [INFO ] [LOCAL ] ASH: Starting deletion of primary data. [2025-10-28T17:19:13.760801] [DEBUG] [LOCAL ] ASPN: Deleted primary data file. [2025-10-28T17:19:13.766149] [DEBUG] [LOCAL ] ASH: Deleted primary data file. [2025-10-28T17:19:13.776041] [INFO ] [MAIN ] ASPN: Starting full primary refresh. [2025-10-28T17:19:13.792889] [INFO ] [MAIN ] ASH: Starting full primary refresh. [2025-10-28T17:19:14.683196] [INFO ] [REMOTE ] ASR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:19:14.732700] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-01. [2025-10-28T17:19:14.893285] [INFO ] [REMOTE ] ASIX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:19:14.931970] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-01. [2025-10-28T17:19:15.018766] [INFO ] [REMOTE ] ASPN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:19:15.025296] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-01. [2025-10-28T17:19:15.098463] [INFO ] [REMOTE ] ASH: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:19:15.098820] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-01. [2025-10-28T17:19:15.482721] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-28T17:19:15.484561] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-02. [2025-10-28T17:19:15.784012] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-28T17:19:15.788006] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-02. [2025-10-28T17:19:16.310684] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-28T17:19:16.312685] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-03. [2025-10-28T17:19:16.432548] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-28T17:19:16.442921] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-02. [2025-10-28T17:19:16.503303] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-28T17:19:16.511277] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-02. [2025-10-28T17:19:16.537938] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-28T17:19:16.541530] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-03. [2025-10-28T17:19:17.098385] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-28T17:19:17.101436] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-04. [2025-10-28T17:19:17.177999] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-28T17:19:17.182437] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-04. [2025-10-28T17:19:17.513496] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-28T17:19:17.521202] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-03. [2025-10-28T17:19:17.705553] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-28T17:19:17.708941] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-05. [2025-10-28T17:19:18.022229] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-28T17:19:18.032947] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-03. [2025-10-28T17:19:18.048370] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-28T17:19:18.197972] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-28T17:19:18.359324] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-06. [2025-10-28T17:19:18.732096] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-28T17:19:18.930563] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-28T17:19:19.159349] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-04. [2025-10-28T17:19:19.425738] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-28T17:19:19.959458] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-04. [2025-10-28T17:19:20.239328] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-28T17:19:20.759353] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-05. [2025-10-28T17:19:21.186944] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-28T17:19:21.484333] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-28T17:19:21.559329] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-06. [2025-10-28T17:19:22.200777] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-28T17:19:22.359350] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-07. [2025-10-28T17:19:23.120261] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-28T17:19:23.159342] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-05. [2025-10-28T17:19:23.959340] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-08. [2025-10-28T17:19:24.234036] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-28T17:19:24.707941] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-28T17:19:24.759299] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-09. [2025-10-28T17:19:25.430233] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-28T17:19:25.559330] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-05. [2025-10-28T17:19:26.359371] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-06. [2025-10-28T17:19:26.989387] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-28T17:19:27.159322] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-10. [2025-10-28T17:19:27.684240] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-28T17:19:27.959417] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-07. [2025-10-28T17:19:28.147276] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-28T17:19:28.152122] [INFO ] [REMOTE ] ASIX: Full fetch complete (31110 records). [2025-10-28T17:19:28.152217] [DEBUG] [VALIDATOR ] ASIX: Validating primary data. [2025-10-28T17:19:28.542124] [DEBUG] [VALIDATOR ] ASIX: All expected trading days are present. [2025-10-28T17:19:28.542241] [DEBUG] [VALIDATOR ] ASIX: Primary data validation passed. [2025-10-28T17:19:28.542773] [INFO ] [MAIN ] ASIX: Fetched primary data is valid. [2025-10-28T17:19:28.542920] [DEBUG] [LOCAL ] ASIX: Saving primary data. [2025-10-28T17:19:28.551985] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-28T17:19:28.552144] [DEBUG] [LOCAL ] ASIX: Trimmed 31110 records to 22656 (keeping 200 days of data) [2025-10-28T17:19:28.693462] [DEBUG] [LOCAL ] ASIX: Primary data saved (22656 records). [2025-10-28T17:19:28.693595] [INFO ] [MAIN ] ASIX: Full history saved. [2025-10-28T17:19:28.693696] [INFO ] [MAIN ] Update Progress: 161/2366 symbols completed. ASIX took 16.8s. Estimated remaining: 4h 26m 5s. Rate: 8.3 symbols/min [2025-10-28T17:19:28.764522] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-08. [2025-10-28T17:19:28.871266] [INFO ] [MAIN ] ASX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:19:28.920167] [DEBUG] [LOCAL ] ASX: Loaded 52859 existing records from primary storage. [2025-10-28T17:19:28.920481] [INFO ] [MAIN ] ASX: Loaded 52859 existing records. [2025-10-28T17:19:29.096620] [WARN ] [MAIN ] ASX: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:19:29.096866] [INFO ] [MAIN ] ASX: Wiping existing primary data before full refresh. [2025-10-28T17:19:29.096942] [INFO ] [LOCAL ] ASX: Starting deletion of primary data. [2025-10-28T17:19:29.097537] [DEBUG] [LOCAL ] ASX: Deleted primary data file. [2025-10-28T17:19:29.097595] [INFO ] [MAIN ] ASX: Starting full primary refresh. [2025-10-28T17:19:29.451407] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-28T17:19:29.456264] [INFO ] [REMOTE ] ASX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:19:29.559306] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-09. [2025-10-28T17:19:30.274131] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-28T17:19:30.359343] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-10. [2025-10-28T17:19:31.002176] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-28T17:19:31.004272] [INFO ] [REMOTE ] ASR: Full fetch complete (12542 records). [2025-10-28T17:19:31.004342] [DEBUG] [VALIDATOR ] ASR: Validating primary data. [2025-10-28T17:19:31.004745] [FATAL] [VALIDATOR ] ASR: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T17:19:31.004826] [FATAL] [MAIN ] ASR: Fetched primary data is invalid. Refusing to save it. [2025-10-28T17:19:31.004888] [WARN ] [MAIN ] ASR: Deleting existing primary and derivative data due to validation failure. [2025-10-28T17:19:31.004973] [INFO ] [LOCAL ] ASR: Starting deletion of primary data. [2025-10-28T17:19:31.005061] [DEBUG] [LOCAL ] ASR: No primary data file found to delete. [2025-10-28T17:19:31.005111] [INFO ] [LOCAL ] ASR: Starting deletion of derivative data. [2025-10-28T17:19:31.005304] [DEBUG] [LOCAL ] ASR: Deleted derivative data file. [2025-10-28T17:19:31.005402] [INFO ] [MAIN ] Update Progress: 162/2366 symbols completed. ASR took 19.1s. Estimated remaining: 4h 24m 51s. Rate: 8.3 symbols/min [2025-10-28T17:19:31.173575] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-01. [2025-10-28T17:19:31.177722] [INFO ] [MAIN ] ATEN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:19:31.216771] [DEBUG] [LOCAL ] ATEN: Loaded 37301 existing records from primary storage. [2025-10-28T17:19:31.217090] [INFO ] [MAIN ] ATEN: Loaded 37301 existing records. [2025-10-28T17:19:31.398412] [WARN ] [MAIN ] ATEN: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:19:31.398610] [INFO ] [MAIN ] ATEN: Wiping existing primary data before full refresh. [2025-10-28T17:19:31.398684] [INFO ] [LOCAL ] ATEN: Starting deletion of primary data. [2025-10-28T17:19:31.399123] [DEBUG] [LOCAL ] ATEN: Deleted primary data file. [2025-10-28T17:19:31.399183] [INFO ] [MAIN ] ATEN: Starting full primary refresh. [2025-10-28T17:19:31.780892] [INFO ] [REMOTE ] ATEN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:19:31.959310] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-01. [2025-10-28T17:19:32.637248] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-28T17:19:32.759402] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-06. [2025-10-28T17:19:33.030030] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-28T17:19:33.559374] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-07. [2025-10-28T17:19:33.983186] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-28T17:19:34.359389] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-02. [2025-10-28T17:19:34.452986] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-28T17:19:35.159340] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-02. [2025-10-28T17:19:35.622679] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-28T17:19:35.959367] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-03. [2025-10-28T17:19:36.235030] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-28T17:19:36.759344] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-08. [2025-10-28T17:19:37.420737] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-28T17:19:37.559330] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-04. [2025-10-28T17:19:37.915565] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-28T17:19:38.359340] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-03. [2025-10-28T17:19:39.159395] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-07. [2025-10-28T17:19:39.253340] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-28T17:19:39.515384] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-28T17:19:39.959328] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-09. [2025-10-28T17:19:40.740921] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-28T17:19:40.759310] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-08. [2025-10-28T17:19:41.236456] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-28T17:19:41.559389] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-05. [2025-10-28T17:19:42.226009] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-28T17:19:42.359306] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-09. [2025-10-28T17:19:42.956769] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-28T17:19:43.159321] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-10. [2025-10-28T17:19:43.780342] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-28T17:19:43.959390] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-04. [2025-10-28T17:19:44.205175] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-28T17:19:44.213297] [INFO ] [REMOTE ] ASH: Full fetch complete (55605 records). [2025-10-28T17:19:44.213460] [DEBUG] [VALIDATOR ] ASH: Validating primary data. [2025-10-28T17:19:44.608323] [DEBUG] [VALIDATOR ] ASH: All expected trading days are present. [2025-10-28T17:19:44.608396] [DEBUG] [VALIDATOR ] ASH: Primary data validation passed. [2025-10-28T17:19:44.608965] [INFO ] [MAIN ] ASH: Fetched primary data is valid. [2025-10-28T17:19:44.609025] [DEBUG] [LOCAL ] ASH: Saving primary data. [2025-10-28T17:19:44.610075] [DEBUG] [LOCAL ] ASH: Trimmed 55605 records to 37028 (keeping 200 days of data) [2025-10-28T17:19:44.770405] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-10. [2025-10-28T17:19:44.827890] [DEBUG] [LOCAL ] ASH: Primary data saved (37028 records). [2025-10-28T17:19:44.828001] [INFO ] [MAIN ] ASH: Full history saved. [2025-10-28T17:19:44.828141] [INFO ] [MAIN ] Update Progress: 163/2366 symbols completed. ASH took 32.9s. Estimated remaining: 4h 26m 13s. Rate: 8.3 symbols/min [2025-10-28T17:19:45.002034] [INFO ] [MAIN ] ATGE: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:19:45.054514] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-28T17:19:45.053500] [DEBUG] [LOCAL ] ATGE: Loaded 29886 existing records from primary storage. [2025-10-28T17:19:45.063191] [INFO ] [MAIN ] ATGE: Loaded 29886 existing records. [2025-10-28T17:19:45.238353] [WARN ] [MAIN ] ATGE: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:19:45.238548] [INFO ] [MAIN ] ATGE: Wiping existing primary data before full refresh. [2025-10-28T17:19:45.238592] [INFO ] [LOCAL ] ATGE: Starting deletion of primary data. [2025-10-28T17:19:45.238932] [DEBUG] [LOCAL ] ATGE: Deleted primary data file. [2025-10-28T17:19:45.238987] [INFO ] [MAIN ] ATGE: Starting full primary refresh. [2025-10-28T17:19:45.563541] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-05. [2025-10-28T17:19:45.584422] [INFO ] [REMOTE ] ATGE: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:19:46.297353] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-28T17:19:46.307707] [INFO ] [REMOTE ] ASPN: Full fetch complete (72564 records). [2025-10-28T17:19:46.307851] [DEBUG] [VALIDATOR ] ASPN: Validating primary data. [2025-10-28T17:19:46.371323] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-06. [2025-10-28T17:19:46.707003] [DEBUG] [VALIDATOR ] ASPN: All expected trading days are present. [2025-10-28T17:19:46.707106] [DEBUG] [VALIDATOR ] ASPN: Primary data validation passed. [2025-10-28T17:19:46.707855] [INFO ] [MAIN ] ASPN: Fetched primary data is valid. [2025-10-28T17:19:46.708029] [DEBUG] [LOCAL ] ASPN: Saving primary data. [2025-10-28T17:19:46.738514] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-28T17:19:46.737484] [DEBUG] [LOCAL ] ASPN: Trimmed 72564 records to 49760 (keeping 200 days of data) [2025-10-28T17:19:47.020726] [DEBUG] [LOCAL ] ASPN: Primary data saved (49760 records). [2025-10-28T17:19:47.020902] [INFO ] [MAIN ] ASPN: Full history saved. [2025-10-28T17:19:47.021010] [INFO ] [MAIN ] Update Progress: 164/2366 symbols completed. ASPN took 35.1s. Estimated remaining: 4h 24m 58s. Rate: 8.3 symbols/min [2025-10-28T17:19:47.165987] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-06. [2025-10-28T17:19:47.192831] [INFO ] [MAIN ] ATHM: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:19:47.192997] [DEBUG] [LOCAL ] ATHM: No existing data file found in primary storage. [2025-10-28T17:19:47.193051] [WARN ] [MAIN ] ATHM: No existing data found, performing full refresh instead. [2025-10-28T17:19:47.193157] [INFO ] [MAIN ] ATHM: Wiping existing primary data before full refresh. [2025-10-28T17:19:47.193198] [INFO ] [LOCAL ] ATHM: Starting deletion of primary data. [2025-10-28T17:19:47.193238] [DEBUG] [LOCAL ] ATHM: No primary data file found to delete. [2025-10-28T17:19:47.193269] [INFO ] [MAIN ] ATHM: Starting full primary refresh. [2025-10-28T17:19:47.549718] [INFO ] [REMOTE ] ATHM: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:19:47.608878] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-28T17:19:47.959340] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-07. [2025-10-28T17:19:48.180109] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-28T17:19:48.759349] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-07. [2025-10-28T17:19:49.498889] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-28T17:19:49.559300] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-08. [2025-10-28T17:19:49.815472] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-28T17:19:50.359307] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-08. [2025-10-28T17:19:51.032772] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-28T17:19:51.159320] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-01. [2025-10-28T17:19:51.495181] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-28T17:19:51.959384] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-01. [2025-10-28T17:19:52.071095] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-28T17:19:52.759351] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-02. [2025-10-28T17:19:53.088307] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-28T17:19:53.559349] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-09. [2025-10-28T17:19:54.160341] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-28T17:19:54.359318] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-02. [2025-10-28T17:19:54.437428] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-28T17:19:55.159310] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-09. [2025-10-28T17:19:55.508370] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-28T17:19:55.959345] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-03. [2025-10-28T17:19:56.668169] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-28T17:19:56.759373] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-10. [2025-10-28T17:19:56.995889] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-28T17:19:57.559358] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-03. [2025-10-28T17:19:58.179175] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-28T17:19:58.191317] [INFO ] [REMOTE ] ASX: Full fetch complete (76777 records). [2025-10-28T17:19:58.191491] [DEBUG] [VALIDATOR ] ASX: Validating primary data. [2025-10-28T17:19:58.364452] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-10. [2025-10-28T17:19:58.653695] [DEBUG] [VALIDATOR ] ASX: All expected trading days are present. [2025-10-28T17:19:58.653873] [DEBUG] [VALIDATOR ] ASX: Primary data validation passed. [2025-10-28T17:19:58.654961] [INFO ] [MAIN ] ASX: Fetched primary data is valid. [2025-10-28T17:19:58.655113] [DEBUG] [LOCAL ] ASX: Saving primary data. [2025-10-28T17:19:58.657345] [DEBUG] [LOCAL ] ASX: Trimmed 76777 records to 52851 (keeping 200 days of data) [2025-10-28T17:19:58.800776] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-28T17:19:59.109040] [DEBUG] [LOCAL ] ASX: Primary data saved (52851 records). [2025-10-28T17:19:59.109226] [INFO ] [MAIN ] ASX: Full history saved. [2025-10-28T17:19:59.109344] [INFO ] [MAIN ] Update Progress: 165/2366 symbols completed. ASX took 30.4s. Estimated remaining: 4h 25m 55s. Rate: 8.3 symbols/min [2025-10-28T17:19:59.167143] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-04. [2025-10-28T17:19:59.389269] [INFO ] [MAIN ] ATHS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:19:59.389478] [DEBUG] [LOCAL ] ATHS: No existing data file found in primary storage. [2025-10-28T17:19:59.389589] [WARN ] [MAIN ] ATHS: No existing data found, performing full refresh instead. [2025-10-28T17:19:59.389743] [INFO ] [MAIN ] ATHS: Wiping existing primary data before full refresh. [2025-10-28T17:19:59.389807] [INFO ] [LOCAL ] ATHS: Starting deletion of primary data. [2025-10-28T17:19:59.389876] [DEBUG] [LOCAL ] ATHS: No primary data file found to delete. [2025-10-28T17:19:59.389930] [INFO ] [MAIN ] ATHS: Starting full primary refresh. [2025-10-28T17:19:59.871203] [INFO ] [REMOTE ] ATHS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:19:59.874110] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-28T17:19:59.881815] [INFO ] [REMOTE ] ATEN: Full fetch complete (56506 records). [2025-10-28T17:19:59.881965] [DEBUG] [VALIDATOR ] ATEN: Validating primary data. [2025-10-28T17:19:59.964518] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-01. [2025-10-28T17:20:00.330713] [DEBUG] [VALIDATOR ] ATEN: All expected trading days are present. [2025-10-28T17:20:00.330815] [DEBUG] [VALIDATOR ] ATEN: Primary data validation passed. [2025-10-28T17:20:00.331621] [INFO ] [MAIN ] ATEN: Fetched primary data is valid. [2025-10-28T17:20:00.331739] [DEBUG] [LOCAL ] ATEN: Saving primary data. [2025-10-28T17:20:00.333219] [DEBUG] [LOCAL ] ATEN: Trimmed 56506 records to 37208 (keeping 200 days of data) [2025-10-28T17:20:00.619927] [DEBUG] [LOCAL ] ATEN: Primary data saved (37208 records). [2025-10-28T17:20:00.623390] [INFO ] [MAIN ] ATEN: Full history saved. [2025-10-28T17:20:00.633128] [INFO ] [MAIN ] Update Progress: 166/2366 symbols completed. ATEN took 29.6s. Estimated remaining: 4h 24m 32s. Rate: 8.3 symbols/min [2025-10-28T17:20:00.632936] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-28T17:20:00.634137] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-28T17:20:00.765970] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-05. [2025-10-28T17:20:00.851871] [INFO ] [MAIN ] ATI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:20:00.900419] [DEBUG] [LOCAL ] ATI: Loaded 51272 existing records from primary storage. [2025-10-28T17:20:00.900843] [INFO ] [MAIN ] ATI: Loaded 51272 existing records. [2025-10-28T17:20:01.109041] [WARN ] [MAIN ] ATI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:20:01.109255] [INFO ] [MAIN ] ATI: Wiping existing primary data before full refresh. [2025-10-28T17:20:01.109304] [INFO ] [LOCAL ] ATI: Starting deletion of primary data. [2025-10-28T17:20:01.110083] [DEBUG] [LOCAL ] ATI: Deleted primary data file. [2025-10-28T17:20:01.110143] [INFO ] [MAIN ] ATI: Starting full primary refresh. [2025-10-28T17:20:01.516885] [INFO ] [REMOTE ] ATI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:20:01.559307] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-01. [2025-10-28T17:20:02.015430] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-28T17:20:02.359395] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-06. [2025-10-28T17:20:03.159349] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-02. [2025-10-28T17:20:03.274629] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-28T17:20:03.486667] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-10-28T17:20:03.711270] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-28T17:20:03.959368] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-07. [2025-10-28T17:20:04.759313] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-04. [2025-10-28T17:20:04.812229] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-28T17:20:05.559339] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-08. [2025-10-28T17:20:06.359379] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-02. [2025-10-28T17:20:06.420378] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-28T17:20:06.963380] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-28T17:20:07.159341] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-03. [2025-10-28T17:20:07.616845] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-28T17:20:07.652177] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-28T17:20:07.959362] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-05. [2025-10-28T17:20:08.759372] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-03. [2025-10-28T17:20:08.877484] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-28T17:20:09.559346] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-06. [2025-10-28T17:20:10.108669] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-28T17:20:10.359308] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-04. [2025-10-28T17:20:10.462147] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-28T17:20:11.159349] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-04. [2025-10-28T17:20:11.959347] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-07. [2025-10-28T17:20:12.349361] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-28T17:20:12.759331] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-09. [2025-10-28T17:20:13.059639] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-28T17:20:13.072538] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-04 (2.71 seconds). [2025-10-28T17:20:13.559357] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-08. [2025-10-28T17:20:14.366429] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-05. [2025-10-28T17:20:14.369674] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-28T17:20:14.644952] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-28T17:20:14.760393] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-10-28T17:20:15.159330] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-06. [2025-10-28T17:20:15.747233] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-28T17:20:15.959319] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-05. [2025-10-28T17:20:16.759328] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-09. [2025-10-28T17:20:17.558384] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-28T17:20:17.568889] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-07. [2025-10-28T17:20:17.974818] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-28T17:20:17.985739] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-10-28T17:20:18.359334] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-10. [2025-10-28T17:20:19.159347] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-08. [2025-10-28T17:20:19.366638] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-28T17:20:19.372475] [INFO ] [REMOTE ] ATGE: Full fetch complete (45305 records). [2025-10-28T17:20:19.372780] [DEBUG] [VALIDATOR ] ATGE: Validating primary data. [2025-10-28T17:20:19.685885] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-28T17:20:19.784003] [DEBUG] [VALIDATOR ] ATGE: All expected trading days are present. [2025-10-28T17:20:19.784114] [DEBUG] [VALIDATOR ] ATGE: Primary data validation passed. [2025-10-28T17:20:19.784825] [INFO ] [MAIN ] ATGE: Fetched primary data is valid. [2025-10-28T17:20:19.784922] [DEBUG] [LOCAL ] ATGE: Saving primary data. [2025-10-28T17:20:19.786320] [DEBUG] [LOCAL ] ATGE: Trimmed 45305 records to 29751 (keeping 200 days of data) [2025-10-28T17:20:19.959517] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-09. [2025-10-28T17:20:19.980695] [DEBUG] [LOCAL ] ATGE: Primary data saved (29751 records). [2025-10-28T17:20:19.980962] [INFO ] [MAIN ] ATGE: Full history saved. [2025-10-28T17:20:19.981097] [INFO ] [MAIN ] Update Progress: 167/2366 symbols completed. ATGE took 35.2s. Estimated remaining: 4h 27m 5s. Rate: 8.2 symbols/min [2025-10-28T17:20:20.169090] [INFO ] [MAIN ] ATKR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:20:20.204518] [DEBUG] [LOCAL ] ATKR: Loaded 34497 existing records from primary storage. [2025-10-28T17:20:20.204964] [INFO ] [MAIN ] ATKR: Loaded 34497 existing records. [2025-10-28T17:20:20.396756] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-28T17:20:20.401778] [WARN ] [MAIN ] ATKR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:20:20.405227] [INFO ] [MAIN ] ATKR: Wiping existing primary data before full refresh. [2025-10-28T17:20:20.405288] [INFO ] [LOCAL ] ATKR: Starting deletion of primary data. [2025-10-28T17:20:20.405916] [DEBUG] [LOCAL ] ATKR: Deleted primary data file. [2025-10-28T17:20:20.405974] [INFO ] [MAIN ] ATKR: Starting full primary refresh. [2025-10-28T17:20:20.759041] [INFO ] [REMOTE ] ATKR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:20:20.759360] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-01. [2025-10-28T17:20:21.559369] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-10. [2025-10-28T17:20:22.070776] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-28T17:20:22.087704] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-28T17:20:22.089608] [INFO ] [REMOTE ] ATHS: Full fetch complete (9520 records). [2025-10-28T17:20:22.089729] [DEBUG] [VALIDATOR ] ATHS: Validating primary data. [2025-10-28T17:20:22.364525] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-06. [2025-10-28T17:20:22.514824] [DEBUG] [VALIDATOR ] ATHS: All expected trading days are present. [2025-10-28T17:20:22.514925] [DEBUG] [VALIDATOR ] ATHS: Primary data validation passed. [2025-10-28T17:20:22.515254] [INFO ] [MAIN ] ATHS: Fetched primary data is valid. [2025-10-28T17:20:22.515297] [DEBUG] [LOCAL ] ATHS: Saving primary data. [2025-10-28T17:20:22.515874] [DEBUG] [LOCAL ] ATHS: Trimmed 9520 records to 6279 (keeping 200 days of data) [2025-10-28T17:20:22.556325] [DEBUG] [LOCAL ] ATHS: Primary data saved (6279 records). [2025-10-28T17:20:22.556496] [INFO ] [MAIN ] ATHS: Full history saved. [2025-10-28T17:20:22.556583] [INFO ] [MAIN ] Update Progress: 168/2366 symbols completed. ATHS took 23.4s. Estimated remaining: 4h 25m 56s. Rate: 8.3 symbols/min [2025-10-28T17:20:22.741741] [INFO ] [MAIN ] ATMU: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:20:22.780865] [DEBUG] [LOCAL ] ATMU: Loaded 38247 existing records from primary storage. [2025-10-28T17:20:22.781234] [INFO ] [MAIN ] ATMU: Loaded 38247 existing records. [2025-10-28T17:20:23.031046] [WARN ] [MAIN ] ATMU: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:20:23.031375] [INFO ] [MAIN ] ATMU: Wiping existing primary data before full refresh. [2025-10-28T17:20:23.031444] [INFO ] [LOCAL ] ATMU: Starting deletion of primary data. [2025-10-28T17:20:23.032260] [DEBUG] [LOCAL ] ATMU: Deleted primary data file. [2025-10-28T17:20:23.032321] [INFO ] [MAIN ] ATMU: Starting full primary refresh. [2025-10-28T17:20:23.164520] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-10. [2025-10-28T17:20:23.430275] [INFO ] [REMOTE ] ATMU: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:20:23.959329] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-02. [2025-10-28T17:20:24.187759] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-28T17:20:24.197339] [INFO ] [REMOTE ] ATHM: Full fetch complete (48984 records). [2025-10-28T17:20:24.197496] [DEBUG] [VALIDATOR ] ATHM: Validating primary data. [2025-10-28T17:20:24.496568] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-10-28T17:20:24.658227] [DEBUG] [VALIDATOR ] ATHM: All expected trading days are present. [2025-10-28T17:20:24.658314] [DEBUG] [VALIDATOR ] ATHM: Primary data validation passed. [2025-10-28T17:20:24.658918] [INFO ] [MAIN ] ATHM: Fetched primary data is valid. [2025-10-28T17:20:24.658982] [DEBUG] [LOCAL ] ATHM: Saving primary data. [2025-10-28T17:20:24.660114] [DEBUG] [LOCAL ] ATHM: Trimmed 48984 records to 30483 (keeping 200 days of data) [2025-10-28T17:20:24.765436] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-07. [2025-10-28T17:20:24.846514] [DEBUG] [LOCAL ] ATHM: Primary data saved (30483 records). [2025-10-28T17:20:24.846690] [INFO ] [MAIN ] ATHM: Full history saved. [2025-10-28T17:20:24.846780] [INFO ] [MAIN ] Update Progress: 169/2366 symbols completed. ATHM took 37.8s. Estimated remaining: 4h 24m 44s. Rate: 8.3 symbols/min [2025-10-28T17:20:25.033405] [INFO ] [MAIN ] ATO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:20:25.072561] [DEBUG] [LOCAL ] ATO: Loaded 41245 existing records from primary storage. [2025-10-28T17:20:25.072873] [INFO ] [MAIN ] ATO: Loaded 41245 existing records. [2025-10-28T17:20:25.283890] [WARN ] [MAIN ] ATO: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:20:25.289501] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-28T17:20:25.298156] [INFO ] [MAIN ] ATO: Wiping existing primary data before full refresh. [2025-10-28T17:20:25.298612] [INFO ] [LOCAL ] ATO: Starting deletion of primary data. [2025-10-28T17:20:25.299608] [DEBUG] [LOCAL ] ATO: Deleted primary data file. [2025-10-28T17:20:25.299697] [INFO ] [MAIN ] ATO: Starting full primary refresh. [2025-10-28T17:20:25.564569] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-01. [2025-10-28T17:20:25.674924] [INFO ] [REMOTE ] ATO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:20:26.060832] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-28T17:20:26.359394] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-03. [2025-10-28T17:20:26.682022] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-28T17:20:27.159362] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-01. [2025-10-28T17:20:27.416017] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-28T17:20:27.959338] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-02. [2025-10-28T17:20:28.426928] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-28T17:20:28.759345] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-08. [2025-10-28T17:20:28.806550] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-28T17:20:29.559350] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-03. [2025-10-28T17:20:30.330943] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-28T17:20:30.359308] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-09. [2025-10-28T17:20:30.570150] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-28T17:20:31.159363] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-04. [2025-10-28T17:20:31.809497] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-28T17:20:31.959349] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-04. [2025-10-28T17:20:32.306750] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-28T17:20:32.759330] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-05. [2025-10-28T17:20:33.120867] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-28T17:20:33.559297] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-10. [2025-10-28T17:20:33.594902] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-28T17:20:34.359319] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-02. [2025-10-28T17:20:34.947505] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-28T17:20:34.957692] [INFO ] [REMOTE ] ATI: Full fetch complete (74231 records). [2025-10-28T17:20:34.957856] [DEBUG] [VALIDATOR ] ATI: Validating primary data. [2025-10-28T17:20:35.164484] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-06. [2025-10-28T17:20:35.365323] [DEBUG] [VALIDATOR ] ATI: All expected trading days are present. [2025-10-28T17:20:35.365438] [DEBUG] [VALIDATOR ] ATI: Primary data validation passed. [2025-10-28T17:20:35.366353] [INFO ] [MAIN ] ATI: Fetched primary data is valid. [2025-10-28T17:20:35.366436] [DEBUG] [LOCAL ] ATI: Saving primary data. [2025-10-28T17:20:35.368050] [DEBUG] [LOCAL ] ATI: Trimmed 74231 records to 51276 (keeping 200 days of data) [2025-10-28T17:20:35.601119] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-28T17:20:35.706988] [DEBUG] [LOCAL ] ATI: Primary data saved (51276 records). [2025-10-28T17:20:35.707118] [INFO ] [MAIN ] ATI: Full history saved. [2025-10-28T17:20:35.707217] [INFO ] [MAIN ] Update Progress: 170/2366 symbols completed. ATI took 35.1s. Estimated remaining: 4h 25m 24s. Rate: 8.3 symbols/min [2025-10-28T17:20:35.875352] [INFO ] [MAIN ] ATR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:20:35.907707] [DEBUG] [LOCAL ] ATR: Loaded 30289 existing records from primary storage. [2025-10-28T17:20:35.907973] [INFO ] [MAIN ] ATR: Loaded 30289 existing records. [2025-10-28T17:20:35.969711] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-03. [2025-10-28T17:20:36.090308] [WARN ] [MAIN ] ATR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:20:36.090598] [INFO ] [MAIN ] ATR: Wiping existing primary data before full refresh. [2025-10-28T17:20:36.090804] [INFO ] [LOCAL ] ATR: Starting deletion of primary data. [2025-10-28T17:20:36.091273] [DEBUG] [LOCAL ] ATR: Deleted primary data file. [2025-10-28T17:20:36.091334] [INFO ] [MAIN ] ATR: Starting full primary refresh. [2025-10-28T17:20:36.437002] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-28T17:20:36.481458] [INFO ] [REMOTE ] ATR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:20:36.759346] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-01. [2025-10-28T17:20:37.189681] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-28T17:20:37.559346] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-07. [2025-10-28T17:20:37.806322] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-28T17:20:38.359377] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-05. [2025-10-28T17:20:38.933721] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-28T17:20:39.159315] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-04. [2025-10-28T17:20:39.208169] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-28T17:20:39.959373] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-06. [2025-10-28T17:20:40.270594] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-28T17:20:40.759315] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-02. [2025-10-28T17:20:41.044938] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-28T17:20:41.559327] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-08. [2025-10-28T17:20:41.659283] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-28T17:20:42.359342] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-03. [2025-10-28T17:20:42.598808] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-28T17:20:43.164511] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-07. [2025-10-28T17:20:43.175610] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-28T17:20:43.959362] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-04. [2025-10-28T17:20:44.250900] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-28T17:20:44.759300] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-05. [2025-10-28T17:20:44.900621] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-28T17:20:45.559337] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-08. [2025-10-28T17:20:46.081329] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-28T17:20:46.359329] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-09. [2025-10-28T17:20:46.653536] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-28T17:20:47.159339] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-06. [2025-10-28T17:20:47.446728] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-28T17:20:47.959360] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-10. [2025-10-28T17:20:48.591041] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-28T17:20:48.759337] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-07. [2025-10-28T17:20:49.082435] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-28T17:20:49.097766] [INFO ] [REMOTE ] ATMU: Full fetch complete (56582 records). [2025-10-28T17:20:49.097933] [DEBUG] [VALIDATOR ] ATMU: Validating primary data. [2025-10-28T17:20:49.488245] [DEBUG] [VALIDATOR ] ATMU: All expected trading days are present. [2025-10-28T17:20:49.488337] [DEBUG] [VALIDATOR ] ATMU: Primary data validation passed. [2025-10-28T17:20:49.488945] [INFO ] [MAIN ] ATMU: Fetched primary data is valid. [2025-10-28T17:20:49.489012] [DEBUG] [LOCAL ] ATMU: Saving primary data. [2025-10-28T17:20:49.490275] [DEBUG] [LOCAL ] ATMU: Trimmed 56582 records to 38125 (keeping 200 days of data) [2025-10-28T17:20:49.575199] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-09. [2025-10-28T17:20:49.718054] [DEBUG] [LOCAL ] ATMU: Primary data saved (38125 records). [2025-10-28T17:20:49.718195] [INFO ] [MAIN ] ATMU: Full history saved. [2025-10-28T17:20:49.718279] [INFO ] [MAIN ] Update Progress: 171/2366 symbols completed. ATMU took 27.2s. Estimated remaining: 4h 26m 43s. Rate: 8.2 symbols/min [2025-10-28T17:20:49.909943] [INFO ] [MAIN ] ATS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:20:49.933380] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-28T17:20:49.957131] [DEBUG] [LOCAL ] ATS: Loaded 16610 existing records from primary storage. [2025-10-28T17:20:49.957456] [INFO ] [MAIN ] ATS: Loaded 16610 existing records. [2025-10-28T17:20:50.155106] [WARN ] [MAIN ] ATS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:20:50.155331] [INFO ] [MAIN ] ATS: Wiping existing primary data before full refresh. [2025-10-28T17:20:50.155377] [INFO ] [LOCAL ] ATS: Starting deletion of primary data. [2025-10-28T17:20:50.155638] [DEBUG] [LOCAL ] ATS: Deleted primary data file. [2025-10-28T17:20:50.155730] [INFO ] [MAIN ] ATS: Starting full primary refresh. [2025-10-28T17:20:50.364770] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-08. [2025-10-28T17:20:50.524053] [INFO ] [REMOTE ] ATS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:20:50.617832] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-28T17:20:51.159401] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-01. [2025-10-28T17:20:51.879504] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-28T17:20:51.964432] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-05. [2025-10-28T17:20:51.981524] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-28T17:20:52.759348] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-02. [2025-10-28T17:20:53.172082] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-28T17:20:53.374949] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-28T17:20:53.559356] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-06. [2025-10-28T17:20:54.359330] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-09. [2025-10-28T17:20:54.473222] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-28T17:20:55.159337] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-03. [2025-10-28T17:20:55.542988] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-28T17:20:55.767038] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-28T17:20:55.959393] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-10. [2025-10-28T17:20:56.759364] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-10. [2025-10-28T17:20:57.069092] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-28T17:20:57.076097] [INFO ] [REMOTE ] ATKR: Full fetch complete (52905 records). [2025-10-28T17:20:57.076298] [DEBUG] [VALIDATOR ] ATKR: Validating primary data. [2025-10-28T17:20:57.461389] [DEBUG] [VALIDATOR ] ATKR: All expected trading days are present. [2025-10-28T17:20:57.461495] [DEBUG] [VALIDATOR ] ATKR: Primary data validation passed. [2025-10-28T17:20:57.462055] [INFO ] [MAIN ] ATKR: Fetched primary data is valid. [2025-10-28T17:20:57.462117] [DEBUG] [LOCAL ] ATKR: Saving primary data. [2025-10-28T17:20:57.463237] [DEBUG] [LOCAL ] ATKR: Trimmed 52905 records to 34337 (keeping 200 days of data) [2025-10-28T17:20:57.568784] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-07. [2025-10-28T17:20:57.669817] [DEBUG] [LOCAL ] ATKR: Primary data saved (34337 records). [2025-10-28T17:20:57.670032] [INFO ] [MAIN ] ATKR: Full history saved. [2025-10-28T17:20:57.670120] [INFO ] [MAIN ] Update Progress: 172/2366 symbols completed. ATKR took 37.7s. Estimated remaining: 4h 26m 44s. Rate: 8.2 symbols/min [2025-10-28T17:20:57.844274] [INFO ] [MAIN ] ATUS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:20:57.884667] [DEBUG] [LOCAL ] ATUS: Loaded 49931 existing records from primary storage. [2025-10-28T17:20:57.884960] [INFO ] [MAIN ] ATUS: Loaded 49931 existing records. [2025-10-28T17:20:58.070534] [WARN ] [MAIN ] ATUS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:20:58.070849] [INFO ] [MAIN ] ATUS: Wiping existing primary data before full refresh. [2025-10-28T17:20:58.071014] [INFO ] [LOCAL ] ATUS: Starting deletion of primary data. [2025-10-28T17:20:58.071908] [DEBUG] [LOCAL ] ATUS: Deleted primary data file. [2025-10-28T17:20:58.071967] [INFO ] [MAIN ] ATUS: Starting full primary refresh. [2025-10-28T17:20:58.267684] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-28T17:20:58.360132] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-04. [2025-10-28T17:20:58.382929] [INFO ] [REMOTE ] ATO: Full fetch complete (60549 records). [2025-10-28T17:20:58.391838] [DEBUG] [VALIDATOR ] ATO: Validating primary data. [2025-10-28T17:20:58.572531] [INFO ] [REMOTE ] ATUS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:20:58.880215] [DEBUG] [VALIDATOR ] ATO: All expected trading days are present. [2025-10-28T17:20:58.880321] [DEBUG] [VALIDATOR ] ATO: Primary data validation passed. [2025-10-28T17:20:58.881167] [INFO ] [MAIN ] ATO: Fetched primary data is valid. [2025-10-28T17:20:58.881315] [DEBUG] [LOCAL ] ATO: Saving primary data. [2025-10-28T17:20:58.899839] [DEBUG] [LOCAL ] ATO: Trimmed 60549 records to 41194 (keeping 200 days of data) [2025-10-28T17:20:58.899720] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-28T17:20:59.160972] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-08. [2025-10-28T17:20:59.166711] [DEBUG] [LOCAL ] ATO: Primary data saved (41194 records). [2025-10-28T17:20:59.166804] [INFO ] [MAIN ] ATO: Full history saved. [2025-10-28T17:20:59.167403] [INFO ] [MAIN ] Update Progress: 173/2366 symbols completed. ATO took 34.3s. Estimated remaining: 4h 25m 24s. Rate: 8.3 symbols/min [2025-10-28T17:20:59.351206] [INFO ] [MAIN ] AU: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:20:59.364575] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-28T17:20:59.414264] [DEBUG] [LOCAL ] AU: Loaded 53079 existing records from primary storage. [2025-10-28T17:20:59.414599] [INFO ] [MAIN ] AU: Loaded 53079 existing records. [2025-10-28T17:20:59.587336] [WARN ] [MAIN ] AU: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:20:59.587535] [INFO ] [MAIN ] AU: Wiping existing primary data before full refresh. [2025-10-28T17:20:59.587581] [INFO ] [LOCAL ] AU: Starting deletion of primary data. [2025-10-28T17:20:59.588104] [DEBUG] [LOCAL ] AU: Deleted primary data file. [2025-10-28T17:20:59.588161] [INFO ] [MAIN ] AU: Starting full primary refresh. [2025-10-28T17:20:59.933504] [INFO ] [REMOTE ] AU: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:20:59.959291] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-01. [2025-10-28T17:21:00.208588] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-28T17:21:00.759375] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-05. [2025-10-28T17:21:01.559338] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-01. [2025-10-28T17:21:01.733055] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-10-28T17:21:02.127585] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-28T17:21:02.359346] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-06. [2025-10-28T17:21:02.741299] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-28T17:21:03.031789] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-28T17:21:03.159335] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-07. [2025-10-28T17:21:03.841747] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-28T17:21:03.959360] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-09. [2025-10-28T17:21:04.759354] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-02. [2025-10-28T17:21:04.940836] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-28T17:21:05.559335] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-10. [2025-10-28T17:21:06.245416] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-28T17:21:06.359315] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-03. [2025-10-28T17:21:06.545566] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-28T17:21:06.551970] [INFO ] [REMOTE ] ATR: Full fetch complete (43983 records). [2025-10-28T17:21:06.552131] [DEBUG] [VALIDATOR ] ATR: Validating primary data. [2025-10-28T17:21:06.940953] [DEBUG] [VALIDATOR ] ATR: All expected trading days are present. [2025-10-28T17:21:06.941054] [DEBUG] [VALIDATOR ] ATR: Primary data validation passed. [2025-10-28T17:21:06.941633] [INFO ] [MAIN ] ATR: Fetched primary data is valid. [2025-10-28T17:21:06.941719] [DEBUG] [LOCAL ] ATR: Saving primary data. [2025-10-28T17:21:06.942886] [DEBUG] [LOCAL ] ATR: Trimmed 43983 records to 30316 (keeping 200 days of data) [2025-10-28T17:21:07.178239] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-08. [2025-10-28T17:21:07.238884] [DEBUG] [LOCAL ] ATR: Primary data saved (30316 records). [2025-10-28T17:21:07.239076] [INFO ] [MAIN ] ATR: Full history saved. [2025-10-28T17:21:07.240754] [INFO ] [MAIN ] Update Progress: 174/2366 symbols completed. ATR took 31.5s. Estimated remaining: 4h 25m 27s. Rate: 8.3 symbols/min [2025-10-28T17:21:07.514444] [INFO ] [MAIN ] AUB: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:21:07.585021] [DEBUG] [LOCAL ] AUB: Loaded 45688 existing records from primary storage. [2025-10-28T17:21:07.585476] [INFO ] [MAIN ] AUB: Loaded 45688 existing records. [2025-10-28T17:21:07.817027] [WARN ] [MAIN ] AUB: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:21:07.818519] [INFO ] [MAIN ] AUB: Wiping existing primary data before full refresh. [2025-10-28T17:21:07.818820] [INFO ] [LOCAL ] AUB: Starting deletion of primary data. [2025-10-28T17:21:07.820087] [DEBUG] [LOCAL ] AUB: Deleted primary data file. [2025-10-28T17:21:07.820362] [INFO ] [MAIN ] AUB: Starting full primary refresh. [2025-10-28T17:21:07.972697] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-02. [2025-10-28T17:21:07.985089] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-28T17:21:08.278236] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-10-28T17:21:08.364189] [INFO ] [REMOTE ] AUB: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:21:08.759327] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-09. [2025-10-28T17:21:09.348670] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-28T17:21:09.559333] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-01. [2025-10-28T17:21:09.701461] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-28T17:21:10.359338] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-10. [2025-10-28T17:21:10.757307] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-28T17:21:11.045476] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-28T17:21:11.048465] [INFO ] [REMOTE ] ATS: Full fetch complete (25157 records). [2025-10-28T17:21:11.048561] [DEBUG] [VALIDATOR ] ATS: Validating primary data. [2025-10-28T17:21:11.164526] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-02. [2025-10-28T17:21:11.432475] [DEBUG] [VALIDATOR ] ATS: All expected trading days are present. [2025-10-28T17:21:11.432554] [DEBUG] [VALIDATOR ] ATS: Primary data validation passed. [2025-10-28T17:21:11.432985] [INFO ] [MAIN ] ATS: Fetched primary data is valid. [2025-10-28T17:21:11.433055] [DEBUG] [LOCAL ] ATS: Saving primary data. [2025-10-28T17:21:11.433778] [DEBUG] [LOCAL ] ATS: Trimmed 25157 records to 16453 (keeping 200 days of data) [2025-10-28T17:21:11.525602] [DEBUG] [LOCAL ] ATS: Primary data saved (16453 records). [2025-10-28T17:21:11.525754] [INFO ] [MAIN ] ATS: Full history saved. [2025-10-28T17:21:11.525838] [INFO ] [MAIN ] Update Progress: 175/2366 symbols completed. ATS took 21.8s. Estimated remaining: 4h 24m 42s. Rate: 8.3 symbols/min [2025-10-28T17:21:11.696463] [INFO ] [MAIN ] AUNA: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:21:11.696620] [DEBUG] [LOCAL ] AUNA: No existing data file found in primary storage. [2025-10-28T17:21:11.696685] [WARN ] [MAIN ] AUNA: No existing data found, performing full refresh instead. [2025-10-28T17:21:11.696799] [INFO ] [MAIN ] AUNA: Wiping existing primary data before full refresh. [2025-10-28T17:21:11.696841] [INFO ] [LOCAL ] AUNA: Starting deletion of primary data. [2025-10-28T17:21:11.696883] [DEBUG] [LOCAL ] AUNA: No primary data file found to delete. [2025-10-28T17:21:11.696915] [INFO ] [MAIN ] AUNA: Starting full primary refresh. [2025-10-28T17:21:11.964690] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-03. [2025-10-28T17:21:12.059072] [INFO ] [REMOTE ] AUNA: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:21:12.279173] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-28T17:21:12.759333] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-04. [2025-10-28T17:21:13.119609] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-28T17:21:13.559330] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-04. [2025-10-28T17:21:14.359304] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-03. [2025-10-28T17:21:14.473994] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-28T17:21:14.872104] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-28T17:21:15.159332] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-05. [2025-10-28T17:21:15.509933] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-28T17:21:15.959334] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-04. [2025-10-28T17:21:16.725039] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-28T17:21:16.759319] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-01. [2025-10-28T17:21:17.125072] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-28T17:21:17.240026] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-28T17:21:17.559355] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-02. [2025-10-28T17:21:17.926144] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-10-28T17:21:18.359339] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-03. [2025-10-28T17:21:18.698445] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-10-28T17:21:19.159365] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-04. [2025-10-28T17:21:19.592238] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-28T17:21:19.959334] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-05. [2025-10-28T17:21:20.328697] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-10-28T17:21:20.759352] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-06. [2025-10-28T17:21:21.213692] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-28T17:21:21.559351] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-06. [2025-10-28T17:21:22.359391] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-07. [2025-10-28T17:21:22.700248] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-10-28T17:21:22.972103] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-28T17:21:23.159337] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-05. [2025-10-28T17:21:23.959380] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-07. [2025-10-28T17:21:24.489015] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-28T17:21:24.759397] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-05. [2025-10-28T17:21:25.559337] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-08. [2025-10-28T17:21:25.913594] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-10-28T17:21:26.037182] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-28T17:21:26.099556] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-10-28T17:21:26.359327] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-09. [2025-10-28T17:21:26.858005] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-28T17:21:27.159333] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-06. [2025-10-28T17:21:27.959360] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-10. [2025-10-28T17:21:28.232597] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-28T17:21:28.625420] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-28T17:21:28.627687] [INFO ] [REMOTE ] AUNA: Full fetch complete (7854 records). [2025-10-28T17:21:28.627789] [DEBUG] [VALIDATOR ] AUNA: Validating primary data. [2025-10-28T17:21:28.628425] [FATAL] [VALIDATOR ] AUNA: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T17:21:28.628506] [FATAL] [MAIN ] AUNA: Fetched primary data is invalid. Refusing to save it. [2025-10-28T17:21:28.628574] [WARN ] [MAIN ] AUNA: Deleting existing primary and derivative data due to validation failure. [2025-10-28T17:21:28.628666] [INFO ] [LOCAL ] AUNA: Starting deletion of primary data. [2025-10-28T17:21:28.628753] [DEBUG] [LOCAL ] AUNA: No primary data file found to delete. [2025-10-28T17:21:28.628797] [INFO ] [LOCAL ] AUNA: Starting deletion of derivative data. [2025-10-28T17:21:28.628837] [DEBUG] [LOCAL ] AUNA: No derivative data file found to delete. [2025-10-28T17:21:28.628903] [INFO ] [MAIN ] Update Progress: 176/2366 symbols completed. AUNA took 17.1s. Estimated remaining: 4h 26m 37s. Rate: 8.2 symbols/min [2025-10-28T17:21:28.764419] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-07. [2025-10-28T17:21:28.840346] [INFO ] [MAIN ] AVA: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:21:28.891243] [DEBUG] [LOCAL ] AVA: Loaded 37994 existing records from primary storage. [2025-10-28T17:21:28.891531] [INFO ] [MAIN ] AVA: Loaded 37994 existing records. [2025-10-28T17:21:29.121501] [WARN ] [MAIN ] AVA: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:21:29.121769] [INFO ] [MAIN ] AVA: Wiping existing primary data before full refresh. [2025-10-28T17:21:29.121822] [INFO ] [LOCAL ] AVA: Starting deletion of primary data. [2025-10-28T17:21:29.122178] [DEBUG] [LOCAL ] AVA: Deleted primary data file. [2025-10-28T17:21:29.122238] [INFO ] [MAIN ] AVA: Starting full primary refresh. [2025-10-28T17:21:29.548597] [INFO ] [REMOTE ] AVA: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:21:29.559296] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-01. [2025-10-28T17:21:29.992732] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-28T17:21:30.359392] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-08. [2025-10-28T17:21:30.876914] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-28T17:21:31.159338] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-02. [2025-10-28T17:21:31.924346] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-28T17:21:31.959297] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-09. [2025-10-28T17:21:32.052323] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-28T17:21:32.759335] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-03. [2025-10-28T17:21:33.450303] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-28T17:21:33.559351] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-06. [2025-10-28T17:21:33.996341] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-28T17:21:34.359343] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-10. [2025-10-28T17:21:34.790902] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-28T17:21:35.159374] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-07. [2025-10-28T17:21:35.959407] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-04. [2025-10-28T17:21:36.517069] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-10 (2.16 seconds). [2025-10-28T17:21:36.566570] [INFO ] [REMOTE ] AU: Full fetch complete (76650 records). [2025-10-28T17:21:36.566791] [DEBUG] [VALIDATOR ] AU: Validating primary data. [2025-10-28T17:21:36.602297] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-28T17:21:36.759534] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-08. [2025-10-28T17:21:37.008667] [DEBUG] [VALIDATOR ] AU: All expected trading days are present. [2025-10-28T17:21:37.008768] [DEBUG] [VALIDATOR ] AU: Primary data validation passed. [2025-10-28T17:21:37.009571] [INFO ] [MAIN ] AU: Fetched primary data is valid. [2025-10-28T17:21:37.009634] [DEBUG] [LOCAL ] AU: Saving primary data. [2025-10-28T17:21:37.011103] [DEBUG] [LOCAL ] AU: Trimmed 76650 records to 53074 (keeping 200 days of data) [2025-10-28T17:21:37.334865] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-28T17:21:37.360274] [DEBUG] [LOCAL ] AU: Primary data saved (53074 records). [2025-10-28T17:21:37.360425] [INFO ] [MAIN ] AU: Full history saved. [2025-10-28T17:21:37.360512] [INFO ] [MAIN ] Update Progress: 177/2366 symbols completed. AU took 38.2s. Estimated remaining: 4h 26m 48s. Rate: 8.2 symbols/min [2025-10-28T17:21:37.525283] [INFO ] [MAIN ] AVAL: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:21:37.535080] [DEBUG] [LOCAL ] AVAL: Loaded 8321 existing records from primary storage. [2025-10-28T17:21:37.535299] [INFO ] [MAIN ] AVAL: Loaded 8321 existing records. [2025-10-28T17:21:37.565447] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-05. [2025-10-28T17:21:37.712143] [WARN ] [MAIN ] AVAL: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:21:37.712350] [INFO ] [MAIN ] AVAL: Wiping existing primary data before full refresh. [2025-10-28T17:21:37.712395] [INFO ] [LOCAL ] AVAL: Starting deletion of primary data. [2025-10-28T17:21:37.712581] [DEBUG] [LOCAL ] AVAL: Deleted primary data file. [2025-10-28T17:21:37.712620] [INFO ] [MAIN ] AVAL: Starting full primary refresh. [2025-10-28T17:21:38.074820] [INFO ] [REMOTE ] AVAL: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:21:38.101180] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-28T17:21:38.359343] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-09. [2025-10-28T17:21:38.700183] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-28T17:21:39.159509] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-08. [2025-10-28T17:21:39.391105] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-28T17:21:39.959443] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-01. [2025-10-28T17:21:40.332276] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-28T17:21:40.626079] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-28T17:21:40.759379] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-02. [2025-10-28T17:21:41.531188] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-28T17:21:41.559297] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-03. [2025-10-28T17:21:42.101528] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-28T17:21:42.359391] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-10. [2025-10-28T17:21:43.159404] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-04. [2025-10-28T17:21:43.572531] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-28T17:21:43.583179] [INFO ] [REMOTE ] AUB: Full fetch complete (66494 records). [2025-10-28T17:21:43.583371] [DEBUG] [VALIDATOR ] AUB: Validating primary data. [2025-10-28T17:21:43.924199] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-28T17:21:43.964477] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-06. [2025-10-28T17:21:44.036539] [DEBUG] [VALIDATOR ] AUB: All expected trading days are present. [2025-10-28T17:21:44.036698] [DEBUG] [VALIDATOR ] AUB: Primary data validation passed. [2025-10-28T17:21:44.037421] [INFO ] [MAIN ] AUB: Fetched primary data is valid. [2025-10-28T17:21:44.037484] [DEBUG] [LOCAL ] AUB: Saving primary data. [2025-10-28T17:21:44.038769] [DEBUG] [LOCAL ] AUB: Trimmed 66494 records to 45626 (keeping 200 days of data) [2025-10-28T17:21:44.312878] [DEBUG] [LOCAL ] AUB: Primary data saved (45626 records). [2025-10-28T17:21:44.313002] [INFO ] [MAIN ] AUB: Full history saved. [2025-10-28T17:21:44.313078] [INFO ] [MAIN ] Update Progress: 178/2366 symbols completed. AUB took 37.1s. Estimated remaining: 4h 26m 36s. Rate: 8.2 symbols/min [2025-10-28T17:21:44.500696] [INFO ] [MAIN ] AVB: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:21:44.539422] [DEBUG] [LOCAL ] AVB: Loaded 41943 existing records from primary storage. [2025-10-28T17:21:44.539754] [INFO ] [MAIN ] AVB: Loaded 41943 existing records. [2025-10-28T17:21:44.730036] [WARN ] [MAIN ] AVB: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:21:44.730255] [INFO ] [MAIN ] AVB: Wiping existing primary data before full refresh. [2025-10-28T17:21:44.730305] [INFO ] [LOCAL ] AVB: Starting deletion of primary data. [2025-10-28T17:21:44.731087] [DEBUG] [LOCAL ] AVB: Deleted primary data file. [2025-10-28T17:21:44.731152] [INFO ] [MAIN ] AVB: Starting full primary refresh. [2025-10-28T17:21:44.766063] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-09. [2025-10-28T17:21:45.144843] [INFO ] [REMOTE ] AVB: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:21:45.166256] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-28T17:21:45.559379] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-05. [2025-10-28T17:21:46.015480] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-28T17:21:46.099117] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-28T17:21:46.359331] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-06. [2025-10-28T17:21:46.755997] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-10-28T17:21:47.159334] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-07. [2025-10-28T17:21:47.959372] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-10. [2025-10-28T17:21:48.340384] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-28T17:21:48.759360] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-08. [2025-10-28T17:21:49.310556] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-28T17:21:49.321539] [INFO ] [REMOTE ] ATUS: Full fetch complete (71464 records). [2025-10-28T17:21:49.321733] [DEBUG] [VALIDATOR ] ATUS: Validating primary data. [2025-10-28T17:21:49.564783] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-07. [2025-10-28T17:21:49.849722] [DEBUG] [VALIDATOR ] ATUS: All expected trading days are present. [2025-10-28T17:21:49.849921] [DEBUG] [VALIDATOR ] ATUS: Primary data validation passed. [2025-10-28T17:21:49.850794] [INFO ] [MAIN ] ATUS: Fetched primary data is valid. [2025-10-28T17:21:49.850875] [DEBUG] [LOCAL ] ATUS: Saving primary data. [2025-10-28T17:21:49.876121] [DEBUG] [LOCAL ] ATUS: Trimmed 71464 records to 49952 (keeping 200 days of data) [2025-10-28T17:21:49.877034] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-28T17:21:50.145575] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-28T17:21:50.219062] [DEBUG] [LOCAL ] ATUS: Primary data saved (49952 records). [2025-10-28T17:21:50.219210] [INFO ] [MAIN ] ATUS: Full history saved. [2025-10-28T17:21:50.219293] [INFO ] [MAIN ] Update Progress: 179/2366 symbols completed. ATUS took 52.5s. Estimated remaining: 4h 26m 12s. Rate: 8.2 symbols/min [2025-10-28T17:21:50.364575] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-01. [2025-10-28T17:21:50.427409] [INFO ] [MAIN ] AVBC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:21:50.427582] [DEBUG] [LOCAL ] AVBC: No existing data file found in primary storage. [2025-10-28T17:21:50.427620] [WARN ] [MAIN ] AVBC: No existing data found, performing full refresh instead. [2025-10-28T17:21:50.427752] [INFO ] [MAIN ] AVBC: Wiping existing primary data before full refresh. [2025-10-28T17:21:50.427835] [INFO ] [LOCAL ] AVBC: Starting deletion of primary data. [2025-10-28T17:21:50.427886] [DEBUG] [LOCAL ] AVBC: No primary data file found to delete. [2025-10-28T17:21:50.427935] [INFO ] [MAIN ] AVBC: Starting full primary refresh. [2025-10-28T17:21:50.797350] [INFO ] [REMOTE ] AVBC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:21:51.159366] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-09. [2025-10-28T17:21:51.558362] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-28T17:21:51.959352] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-08. [2025-10-28T17:21:52.107852] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-28T17:21:52.481959] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-28T17:21:52.759359] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-01. [2025-10-28T17:21:52.903812] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-28T17:21:52.904106] [WARN ] [REMOTE ] AVBC: No data returned for month 2025-01 [2025-10-28T17:21:52.904194] [FATAL] [REMOTE ] AVBC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-28T17:21:52.904265] [FATAL] [MAIN ] AVBC: Failed to fetch primary data. [2025-10-28T17:21:52.904336] [WARN ] [MAIN ] AVBC: Deleting existing primary and derivative data due to fetch failure. [2025-10-28T17:21:52.904408] [INFO ] [LOCAL ] AVBC: Starting deletion of primary data. [2025-10-28T17:21:52.904504] [DEBUG] [LOCAL ] AVBC: No primary data file found to delete. [2025-10-28T17:21:52.904557] [INFO ] [LOCAL ] AVBC: Starting deletion of derivative data. [2025-10-28T17:21:52.904602] [DEBUG] [LOCAL ] AVBC: No derivative data file found to delete. [2025-10-28T17:21:52.904673] [INFO ] [MAIN ] Update Progress: 180/2366 symbols completed. AVBC took 2.7s. Estimated remaining: 4h 25m 8s. Rate: 8.2 symbols/min [2025-10-28T17:21:53.077558] [INFO ] [MAIN ] AVD: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:21:53.096324] [DEBUG] [LOCAL ] AVD: Loaded 20940 existing records from primary storage. [2025-10-28T17:21:53.096556] [INFO ] [MAIN ] AVD: Loaded 20940 existing records. [2025-10-28T17:21:53.279218] [WARN ] [MAIN ] AVD: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:21:53.279417] [INFO ] [MAIN ] AVD: Wiping existing primary data before full refresh. [2025-10-28T17:21:53.279462] [INFO ] [LOCAL ] AVD: Starting deletion of primary data. [2025-10-28T17:21:53.279859] [DEBUG] [LOCAL ] AVD: Deleted primary data file. [2025-10-28T17:21:53.279916] [INFO ] [MAIN ] AVD: Starting full primary refresh. [2025-10-28T17:21:53.564446] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-09. [2025-10-28T17:21:53.652714] [INFO ] [REMOTE ] AVD: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:21:54.049813] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-28T17:21:54.359416] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-10. [2025-10-28T17:21:55.159350] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-01. [2025-10-28T17:21:55.414396] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-28T17:21:55.421630] [INFO ] [REMOTE ] AVA: Full fetch complete (55404 records). [2025-10-28T17:21:55.421789] [DEBUG] [VALIDATOR ] AVA: Validating primary data. [2025-10-28T17:21:55.810616] [DEBUG] [VALIDATOR ] AVA: All expected trading days are present. [2025-10-28T17:21:55.810722] [DEBUG] [VALIDATOR ] AVA: Primary data validation passed. [2025-10-28T17:21:55.811281] [INFO ] [MAIN ] AVA: Fetched primary data is valid. [2025-10-28T17:21:55.811341] [DEBUG] [LOCAL ] AVA: Saving primary data. [2025-10-28T17:21:55.812403] [DEBUG] [LOCAL ] AVA: Trimmed 55404 records to 37896 (keeping 200 days of data) [2025-10-28T17:21:55.976689] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-02. [2025-10-28T17:21:56.038279] [DEBUG] [LOCAL ] AVA: Primary data saved (37896 records). [2025-10-28T17:21:56.038394] [INFO ] [MAIN ] AVA: Full history saved. [2025-10-28T17:21:56.038469] [INFO ] [MAIN ] Update Progress: 181/2366 symbols completed. AVA took 27.4s. Estimated remaining: 4h 24m 11s. Rate: 8.3 symbols/min [2025-10-28T17:21:56.231373] [INFO ] [MAIN ] AVK: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:21:56.228239] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-28T17:21:56.254770] [DEBUG] [LOCAL ] AVK: Loaded 18417 existing records from primary storage. [2025-10-28T17:21:56.255016] [INFO ] [MAIN ] AVK: Loaded 18417 existing records. [2025-10-28T17:21:56.436892] [WARN ] [MAIN ] AVK: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:21:56.437130] [INFO ] [MAIN ] AVK: Wiping existing primary data before full refresh. [2025-10-28T17:21:56.437183] [INFO ] [LOCAL ] AVK: Starting deletion of primary data. [2025-10-28T17:21:56.437606] [DEBUG] [LOCAL ] AVK: Deleted primary data file. [2025-10-28T17:21:56.437705] [INFO ] [MAIN ] AVK: Starting full primary refresh. [2025-10-28T17:21:56.769462] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-10. [2025-10-28T17:21:56.803838] [INFO ] [REMOTE ] AVK: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:21:57.082153] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-28T17:21:57.504223] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-28T17:21:57.506712] [INFO ] [REMOTE ] AVAL: Full fetch complete (15170 records). [2025-10-28T17:21:57.506781] [DEBUG] [VALIDATOR ] AVAL: Validating primary data. [2025-10-28T17:21:57.568603] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-03. [2025-10-28T17:21:57.869498] [DEBUG] [VALIDATOR ] AVAL: All expected trading days are present. [2025-10-28T17:21:57.869563] [DEBUG] [VALIDATOR ] AVAL: Primary data validation passed. [2025-10-28T17:21:57.870047] [INFO ] [MAIN ] AVAL: Fetched primary data is valid. [2025-10-28T17:21:57.870087] [DEBUG] [LOCAL ] AVAL: Saving primary data. [2025-10-28T17:21:57.870532] [DEBUG] [LOCAL ] AVAL: Trimmed 15170 records to 8308 (keeping 200 days of data) [2025-10-28T17:21:57.916866] [DEBUG] [LOCAL ] AVAL: Primary data saved (8308 records). [2025-10-28T17:21:57.916968] [INFO ] [MAIN ] AVAL: Full history saved. [2025-10-28T17:21:57.917041] [INFO ] [MAIN ] Update Progress: 182/2366 symbols completed. AVAL took 20.6s. Estimated remaining: 4h 22m 59s. Rate: 8.3 symbols/min [2025-10-28T17:21:58.090342] [INFO ] [MAIN ] AVNS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:21:58.122046] [DEBUG] [LOCAL ] AVNS: Loaded 33316 existing records from primary storage. [2025-10-28T17:21:58.122297] [INFO ] [MAIN ] AVNS: Loaded 33316 existing records. [2025-10-28T17:21:58.296361] [WARN ] [MAIN ] AVNS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:21:58.296579] [INFO ] [MAIN ] AVNS: Wiping existing primary data before full refresh. [2025-10-28T17:21:58.296626] [INFO ] [LOCAL ] AVNS: Starting deletion of primary data. [2025-10-28T17:21:58.296991] [DEBUG] [LOCAL ] AVNS: Deleted primary data file. [2025-10-28T17:21:58.297037] [INFO ] [MAIN ] AVNS: Starting full primary refresh. [2025-10-28T17:21:58.364499] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-02. [2025-10-28T17:21:58.656350] [INFO ] [REMOTE ] AVNS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:21:58.782998] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-28T17:21:59.060438] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-28T17:21:59.159336] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-03. [2025-10-28T17:21:59.959352] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-01. [2025-10-28T17:22:00.532678] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-28T17:22:00.759326] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-04. [2025-10-28T17:22:01.075724] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-28T17:22:01.559353] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-04. [2025-10-28T17:22:02.086800] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-28T17:22:02.359378] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-02. [2025-10-28T17:22:02.418367] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-28T17:22:02.936201] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-28T17:22:03.159355] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-05. [2025-10-28T17:22:03.959330] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-01. [2025-10-28T17:22:04.189998] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-28T17:22:04.759335] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-06. [2025-10-28T17:22:05.144454] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-28T17:22:05.559331] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-03. [2025-10-28T17:22:05.924761] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-28T17:22:06.140900] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-28T17:22:06.359338] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-05. [2025-10-28T17:22:07.159344] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-07. [2025-10-28T17:22:07.541469] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-28T17:22:07.939114] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-28T17:22:07.959312] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-02. [2025-10-28T17:22:08.759310] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-06. [2025-10-28T17:22:08.786465] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-28T17:22:09.559332] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-08. [2025-10-28T17:22:10.174750] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-28T17:22:10.359343] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-03. [2025-10-28T17:22:10.376762] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-28T17:22:11.159305] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-04. [2025-10-28T17:22:11.189060] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-28T17:22:11.959336] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-04. [2025-10-28T17:22:12.005125] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-28T17:22:12.759376] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-07. [2025-10-28T17:22:12.896225] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-28T17:22:13.559340] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-05. [2025-10-28T17:22:14.193883] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-28T17:22:14.359371] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-09. [2025-10-28T17:22:15.090298] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-28T17:22:15.166522] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-05. [2025-10-28T17:22:15.169850] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-28T17:22:15.928817] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-28T17:22:15.959291] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-06. [2025-10-28T17:22:16.635964] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-28T17:22:16.759335] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-10. [2025-10-28T17:22:17.461903] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-28T17:22:17.465489] [INFO ] [REMOTE ] AVD: Full fetch complete (32265 records). [2025-10-28T17:22:17.465569] [DEBUG] [VALIDATOR ] AVD: Validating primary data. [2025-10-28T17:22:17.564409] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-07. [2025-10-28T17:22:17.839854] [DEBUG] [VALIDATOR ] AVD: All expected trading days are present. [2025-10-28T17:22:17.839964] [DEBUG] [VALIDATOR ] AVD: Primary data validation passed. [2025-10-28T17:22:17.840394] [INFO ] [MAIN ] AVD: Fetched primary data is valid. [2025-10-28T17:22:17.840438] [DEBUG] [LOCAL ] AVD: Saving primary data. [2025-10-28T17:22:17.841208] [DEBUG] [LOCAL ] AVD: Trimmed 32265 records to 20832 (keeping 200 days of data) [2025-10-28T17:22:17.953845] [DEBUG] [LOCAL ] AVD: Primary data saved (20832 records). [2025-10-28T17:22:17.953975] [INFO ] [MAIN ] AVD: Full history saved. [2025-10-28T17:22:17.954080] [INFO ] [MAIN ] Update Progress: 183/2366 symbols completed. AVD took 25.0s. Estimated remaining: 4h 25m 25s. Rate: 8.2 symbols/min [2025-10-28T17:22:18.136012] [INFO ] [MAIN ] AVNT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:22:18.174998] [DEBUG] [LOCAL ] AVNT: Loaded 38236 existing records from primary storage. [2025-10-28T17:22:18.175265] [INFO ] [MAIN ] AVNT: Loaded 38236 existing records. [2025-10-28T17:22:18.360243] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-06. [2025-10-28T17:22:18.360175] [WARN ] [MAIN ] AVNT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:22:18.373566] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-28T17:22:18.374260] [INFO ] [MAIN ] AVNT: Wiping existing primary data before full refresh. [2025-10-28T17:22:18.379616] [INFO ] [LOCAL ] AVNT: Starting deletion of primary data. [2025-10-28T17:22:18.380359] [DEBUG] [LOCAL ] AVNT: Deleted primary data file. [2025-10-28T17:22:18.380418] [INFO ] [MAIN ] AVNT: Starting full primary refresh. [2025-10-28T17:22:18.731582] [INFO ] [REMOTE ] AVNT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:22:19.159318] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-01. [2025-10-28T17:22:19.418153] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-28T17:22:19.959318] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-08. [2025-10-28T17:22:20.169618] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-28T17:22:20.506069] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-28T17:22:20.759406] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-07. [2025-10-28T17:22:21.559345] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-09. [2025-10-28T17:22:21.700103] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-28T17:22:22.325221] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-28T17:22:22.359361] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-10. [2025-10-28T17:22:23.159394] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-08. [2025-10-28T17:22:23.279939] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-28T17:22:23.284777] [INFO ] [REMOTE ] AVK: Full fetch complete (26771 records). [2025-10-28T17:22:23.284891] [DEBUG] [VALIDATOR ] AVK: Validating primary data. [2025-10-28T17:22:23.688731] [DEBUG] [VALIDATOR ] AVK: All expected trading days are present. [2025-10-28T17:22:23.688823] [DEBUG] [VALIDATOR ] AVK: Primary data validation passed. [2025-10-28T17:22:23.689182] [INFO ] [MAIN ] AVK: Fetched primary data is valid. [2025-10-28T17:22:23.689229] [DEBUG] [LOCAL ] AVK: Saving primary data. [2025-10-28T17:22:23.690276] [DEBUG] [LOCAL ] AVK: Trimmed 26771 records to 18344 (keeping 200 days of data) [2025-10-28T17:22:23.815635] [DEBUG] [LOCAL ] AVK: Primary data saved (18344 records). [2025-10-28T17:22:23.815808] [INFO ] [MAIN ] AVK: Full history saved. [2025-10-28T17:22:23.815891] [INFO ] [MAIN ] Update Progress: 184/2366 symbols completed. AVK took 27.8s. Estimated remaining: 4h 25m 0s. Rate: 8.2 symbols/min [2025-10-28T17:22:23.964559] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-02. [2025-10-28T17:22:23.999781] [INFO ] [MAIN ] AVTR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:22:24.057934] [DEBUG] [LOCAL ] AVTR: Loaded 53570 existing records from primary storage. [2025-10-28T17:22:24.058317] [INFO ] [MAIN ] AVTR: Loaded 53570 existing records. [2025-10-28T17:22:24.256596] [WARN ] [MAIN ] AVTR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:22:24.257054] [INFO ] [MAIN ] AVTR: Wiping existing primary data before full refresh. [2025-10-28T17:22:24.257139] [INFO ] [LOCAL ] AVTR: Starting deletion of primary data. [2025-10-28T17:22:24.267170] [DEBUG] [LOCAL ] AVTR: Deleted primary data file. [2025-10-28T17:22:24.273271] [INFO ] [MAIN ] AVTR: Starting full primary refresh. [2025-10-28T17:22:24.316956] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-28T17:22:24.661956] [INFO ] [REMOTE ] AVTR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:22:24.759313] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-08. [2025-10-28T17:22:25.091751] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-28T17:22:25.559351] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-03. [2025-10-28T17:22:26.086325] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-28T17:22:26.359369] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-01. [2025-10-28T17:22:26.700081] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-28T17:22:27.159379] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-04. [2025-10-28T17:22:27.776890] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-28T17:22:27.959410] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-09. [2025-10-28T17:22:28.286384] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-28T17:22:28.759393] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-09. [2025-10-28T17:22:29.002297] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-28T17:22:29.559366] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-02. [2025-10-28T17:22:30.363939] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-05. [2025-10-28T17:22:30.369852] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-28T17:22:30.958291] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-28T17:22:31.159413] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-10. [2025-10-28T17:22:31.420768] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-28T17:22:31.959381] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-10. [2025-10-28T17:22:32.135476] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-28T17:22:32.142763] [INFO ] [REMOTE ] AVNS: Full fetch complete (48161 records). [2025-10-28T17:22:32.142910] [DEBUG] [VALIDATOR ] AVNS: Validating primary data. [2025-10-28T17:22:32.540378] [DEBUG] [VALIDATOR ] AVNS: All expected trading days are present. [2025-10-28T17:22:32.540459] [DEBUG] [VALIDATOR ] AVNS: Primary data validation passed. [2025-10-28T17:22:32.540978] [INFO ] [MAIN ] AVNS: Fetched primary data is valid. [2025-10-28T17:22:32.541040] [DEBUG] [LOCAL ] AVNS: Saving primary data. [2025-10-28T17:22:32.542119] [DEBUG] [LOCAL ] AVNS: Trimmed 48161 records to 33233 (keeping 200 days of data) [2025-10-28T17:22:32.727979] [DEBUG] [LOCAL ] AVNS: Primary data saved (33233 records). [2025-10-28T17:22:32.728103] [INFO ] [MAIN ] AVNS: Full history saved. [2025-10-28T17:22:32.728180] [INFO ] [MAIN ] Update Progress: 185/2366 symbols completed. AVNS took 34.8s. Estimated remaining: 4h 25m 12s. Rate: 8.2 symbols/min [2025-10-28T17:22:32.764509] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-03. [2025-10-28T17:22:32.901477] [INFO ] [MAIN ] AVY: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:22:32.935834] [DEBUG] [LOCAL ] AVY: Loaded 37987 existing records from primary storage. [2025-10-28T17:22:32.936098] [INFO ] [MAIN ] AVY: Loaded 37987 existing records. [2025-10-28T17:22:33.111620] [WARN ] [MAIN ] AVY: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:22:33.111827] [INFO ] [MAIN ] AVY: Wiping existing primary data before full refresh. [2025-10-28T17:22:33.111875] [INFO ] [LOCAL ] AVY: Starting deletion of primary data. [2025-10-28T17:22:33.112891] [DEBUG] [LOCAL ] AVY: Deleted primary data file. [2025-10-28T17:22:33.112952] [INFO ] [MAIN ] AVY: Starting full primary refresh. [2025-10-28T17:22:33.474203] [INFO ] [REMOTE ] AVY: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:22:33.497910] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-28T17:22:33.506392] [INFO ] [REMOTE ] AVB: Full fetch complete (59505 records). [2025-10-28T17:22:33.506561] [DEBUG] [VALIDATOR ] AVB: Validating primary data. [2025-10-28T17:22:33.569949] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-01. [2025-10-28T17:22:33.906824] [DEBUG] [VALIDATOR ] AVB: All expected trading days are present. [2025-10-28T17:22:33.906900] [DEBUG] [VALIDATOR ] AVB: Primary data validation passed. [2025-10-28T17:22:33.907548] [INFO ] [MAIN ] AVB: Fetched primary data is valid. [2025-10-28T17:22:33.907612] [DEBUG] [LOCAL ] AVB: Saving primary data. [2025-10-28T17:22:33.908870] [DEBUG] [LOCAL ] AVB: Trimmed 59505 records to 41829 (keeping 200 days of data) [2025-10-28T17:22:34.203464] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-28T17:22:34.232615] [DEBUG] [LOCAL ] AVB: Primary data saved (41829 records). [2025-10-28T17:22:34.233190] [INFO ] [MAIN ] AVB: Full history saved. [2025-10-28T17:22:34.234283] [INFO ] [MAIN ] Update Progress: 186/2366 symbols completed. AVB took 49.9s. Estimated remaining: 4h 23m 57s. Rate: 8.3 symbols/min [2025-10-28T17:22:34.364543] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-04. [2025-10-28T17:22:34.426621] [INFO ] [MAIN ] AWF: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:22:34.454054] [DEBUG] [LOCAL ] AWF: Loaded 23920 existing records from primary storage. [2025-10-28T17:22:34.454371] [INFO ] [MAIN ] AWF: Loaded 23920 existing records. [2025-10-28T17:22:34.635052] [WARN ] [MAIN ] AWF: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:22:34.635297] [INFO ] [MAIN ] AWF: Wiping existing primary data before full refresh. [2025-10-28T17:22:34.635344] [INFO ] [LOCAL ] AWF: Starting deletion of primary data. [2025-10-28T17:22:34.635855] [DEBUG] [LOCAL ] AWF: Deleted primary data file. [2025-10-28T17:22:34.635914] [INFO ] [MAIN ] AWF: Starting full primary refresh. [2025-10-28T17:22:34.999205] [INFO ] [REMOTE ] AWF: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:22:35.107163] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-28T17:22:35.159313] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-02. [2025-10-28T17:22:35.959392] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-01. [2025-10-28T17:22:36.356253] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-28T17:22:36.759323] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-03. [2025-10-28T17:22:36.804379] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-28T17:22:37.193569] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-04 (2.83 seconds). [2025-10-28T17:22:37.559332] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-02. [2025-10-28T17:22:38.048222] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-28T17:22:38.359309] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-05. [2025-10-28T17:22:38.395499] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-28T17:22:39.159347] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-03. [2025-10-28T17:22:39.926517] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-28T17:22:39.955354] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-28T17:22:39.961350] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-06. [2025-10-28T17:22:40.759394] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-04. [2025-10-28T17:22:40.988416] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-28T17:22:41.559343] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-07. [2025-10-28T17:22:41.629458] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-28T17:22:42.359336] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-05. [2025-10-28T17:22:42.813506] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-28T17:22:43.156420] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-28T17:22:43.161184] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-06. [2025-10-28T17:22:43.959322] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-04. [2025-10-28T17:22:44.507482] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-28T17:22:44.759370] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-06. [2025-10-28T17:22:45.334178] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-28T17:22:45.435980] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-28T17:22:45.559315] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-07. [2025-10-28T17:22:46.359430] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-05. [2025-10-28T17:22:47.033419] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-28T17:22:47.159364] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-08. [2025-10-28T17:22:47.635511] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-28T17:22:47.959335] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-06. [2025-10-28T17:22:48.355595] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-28T17:22:48.759323] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-07. [2025-10-28T17:22:48.934002] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-28T17:22:49.559347] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-09. [2025-10-28T17:22:50.075073] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-28T17:22:50.359384] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-07. [2025-10-28T17:22:50.673697] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-28T17:22:51.159391] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-10. [2025-10-28T17:22:51.482837] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-28T17:22:51.959416] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-08. [2025-10-28T17:22:52.086869] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-28T17:22:52.094253] [INFO ] [REMOTE ] AVNT: Full fetch complete (55889 records). [2025-10-28T17:22:52.094377] [DEBUG] [VALIDATOR ] AVNT: Validating primary data. [2025-10-28T17:22:52.478048] [DEBUG] [VALIDATOR ] AVNT: All expected trading days are present. [2025-10-28T17:22:52.478127] [DEBUG] [VALIDATOR ] AVNT: Primary data validation passed. [2025-10-28T17:22:52.478766] [INFO ] [MAIN ] AVNT: Fetched primary data is valid. [2025-10-28T17:22:52.478829] [DEBUG] [LOCAL ] AVNT: Saving primary data. [2025-10-28T17:22:52.480000] [DEBUG] [LOCAL ] AVNT: Trimmed 55889 records to 38109 (keeping 200 days of data) [2025-10-28T17:22:52.717260] [DEBUG] [LOCAL ] AVNT: Primary data saved (38109 records). [2025-10-28T17:22:52.717403] [INFO ] [MAIN ] AVNT: Full history saved. [2025-10-28T17:22:52.717492] [INFO ] [MAIN ] Update Progress: 187/2366 symbols completed. AVNT took 34.8s. Estimated remaining: 4h 26m 1s. Rate: 8.2 symbols/min [2025-10-28T17:22:52.764615] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-08. [2025-10-28T17:22:52.929500] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-28T17:22:52.956369] [INFO ] [MAIN ] AWI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:22:52.981485] [DEBUG] [LOCAL ] AWI: Loaded 24899 existing records from primary storage. [2025-10-28T17:22:52.981809] [INFO ] [MAIN ] AWI: Loaded 24899 existing records. [2025-10-28T17:22:53.154878] [WARN ] [MAIN ] AWI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:22:53.155097] [INFO ] [MAIN ] AWI: Wiping existing primary data before full refresh. [2025-10-28T17:22:53.155143] [INFO ] [LOCAL ] AWI: Starting deletion of primary data. [2025-10-28T17:22:53.155629] [DEBUG] [LOCAL ] AWI: Deleted primary data file. [2025-10-28T17:22:53.155719] [INFO ] [MAIN ] AWI: Starting full primary refresh. [2025-10-28T17:22:53.498822] [INFO ] [REMOTE ] AWI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:22:53.559307] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-01. [2025-10-28T17:22:54.327746] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-28T17:22:54.359288] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-09. [2025-10-28T17:22:54.422944] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-28T17:22:55.159306] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-08. [2025-10-28T17:22:55.303492] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-28T17:22:55.959390] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-02. [2025-10-28T17:22:56.279002] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-28T17:22:56.759405] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-10. [2025-10-28T17:22:56.777454] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-28T17:22:57.559363] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-09. [2025-10-28T17:22:57.720071] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-28T17:22:57.725437] [INFO ] [REMOTE ] AWF: Full fetch complete (35845 records). [2025-10-28T17:22:57.725518] [DEBUG] [VALIDATOR ] AWF: Validating primary data. [2025-10-28T17:22:58.093743] [DEBUG] [VALIDATOR ] AWF: All expected trading days are present. [2025-10-28T17:22:58.093824] [DEBUG] [VALIDATOR ] AWF: Primary data validation passed. [2025-10-28T17:22:58.094260] [INFO ] [MAIN ] AWF: Fetched primary data is valid. [2025-10-28T17:22:58.094320] [DEBUG] [LOCAL ] AWF: Saving primary data. [2025-10-28T17:22:58.095140] [DEBUG] [LOCAL ] AWF: Trimmed 35845 records to 23902 (keeping 200 days of data) [2025-10-28T17:22:58.231875] [DEBUG] [LOCAL ] AWF: Primary data saved (23902 records). [2025-10-28T17:22:58.231991] [INFO ] [MAIN ] AWF: Full history saved. [2025-10-28T17:22:58.232065] [INFO ] [MAIN ] Update Progress: 188/2366 symbols completed. AWF took 24.0s. Estimated remaining: 4h 25m 32s. Rate: 8.2 symbols/min [2025-10-28T17:22:58.371256] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-03. [2025-10-28T17:22:58.401875] [INFO ] [MAIN ] AWK: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:22:58.451277] [DEBUG] [LOCAL ] AWK: Loaded 48248 existing records from primary storage. [2025-10-28T17:22:58.451920] [INFO ] [MAIN ] AWK: Loaded 48248 existing records. [2025-10-28T17:22:58.629183] [WARN ] [MAIN ] AWK: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:22:58.629356] [INFO ] [MAIN ] AWK: Wiping existing primary data before full refresh. [2025-10-28T17:22:58.629401] [INFO ] [LOCAL ] AWK: Starting deletion of primary data. [2025-10-28T17:22:58.629946] [DEBUG] [LOCAL ] AWK: Deleted primary data file. [2025-10-28T17:22:58.630003] [INFO ] [MAIN ] AWK: Starting full primary refresh. [2025-10-28T17:22:58.992841] [INFO ] [REMOTE ] AWK: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:22:59.023563] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-28T17:22:59.159299] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-01. [2025-10-28T17:22:59.959352] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-10. [2025-10-28T17:23:00.759311] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-09. [2025-10-28T17:23:04.979988] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-09 (4.22 seconds). [2025-10-28T17:23:04.988192] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-10. [2025-10-28T17:23:05.325467] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-03 (6.95 seconds). [2025-10-28T17:23:05.331782] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-04. [2025-10-28T17:23:05.949428] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-01 (6.79 seconds). [2025-10-28T17:23:05.960041] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-02. [2025-10-28T17:23:06.101126] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-28T17:23:06.109553] [INFO ] [REMOTE ] AVY: Full fetch complete (56501 records). [2025-10-28T17:23:06.109753] [DEBUG] [VALIDATOR ] AVY: Validating primary data. [2025-10-28T17:23:06.110384] [FATAL] [VALIDATOR ] AVY: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T17:23:06.110480] [FATAL] [MAIN ] AVY: Fetched primary data is invalid. Refusing to save it. [2025-10-28T17:23:06.110542] [WARN ] [MAIN ] AVY: Deleting existing primary and derivative data due to validation failure. [2025-10-28T17:23:06.110584] [INFO ] [LOCAL ] AVY: Starting deletion of primary data. [2025-10-28T17:23:06.110639] [DEBUG] [LOCAL ] AVY: No primary data file found to delete. [2025-10-28T17:23:06.110723] [INFO ] [LOCAL ] AVY: Starting deletion of derivative data. [2025-10-28T17:23:06.110872] [DEBUG] [LOCAL ] AVY: Deleted derivative data file. [2025-10-28T17:23:06.111605] [INFO ] [MAIN ] Update Progress: 189/2366 symbols completed. AVY took 33.4s. Estimated remaining: 4h 25m 31s. Rate: 8.2 symbols/min [2025-10-28T17:23:06.280164] [INFO ] [MAIN ] AWP: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:23:06.280320] [DEBUG] [LOCAL ] AWP: No existing data file found in primary storage. [2025-10-28T17:23:06.280355] [WARN ] [MAIN ] AWP: No existing data found, performing full refresh instead. [2025-10-28T17:23:06.280467] [INFO ] [MAIN ] AWP: Wiping existing primary data before full refresh. [2025-10-28T17:23:06.280514] [INFO ] [LOCAL ] AWP: Starting deletion of primary data. [2025-10-28T17:23:06.280553] [DEBUG] [LOCAL ] AWP: No primary data file found to delete. [2025-10-28T17:23:06.280587] [INFO ] [MAIN ] AWP: Starting full primary refresh. [2025-10-28T17:23:06.660042] [INFO ] [REMOTE ] AWP: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:23:06.660353] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-01. [2025-10-28T17:23:06.695466] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-10 (6.74 seconds). [2025-10-28T17:23:06.705540] [INFO ] [REMOTE ] AVTR: Full fetch complete (77286 records). [2025-10-28T17:23:06.705734] [DEBUG] [VALIDATOR ] AVTR: Validating primary data. [2025-10-28T17:23:06.706527] [FATAL] [VALIDATOR ] AVTR: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T17:23:06.706609] [FATAL] [MAIN ] AVTR: Fetched primary data is invalid. Refusing to save it. [2025-10-28T17:23:06.706681] [WARN ] [MAIN ] AVTR: Deleting existing primary and derivative data due to validation failure. [2025-10-28T17:23:06.706736] [INFO ] [LOCAL ] AVTR: Starting deletion of primary data. [2025-10-28T17:23:06.706794] [DEBUG] [LOCAL ] AVTR: No primary data file found to delete. [2025-10-28T17:23:06.706828] [INFO ] [LOCAL ] AVTR: Starting deletion of derivative data. [2025-10-28T17:23:06.707000] [DEBUG] [LOCAL ] AVTR: Deleted derivative data file. [2025-10-28T17:23:06.707098] [INFO ] [MAIN ] Update Progress: 190/2366 symbols completed. AVTR took 42.9s. Estimated remaining: 4h 24m 7s. Rate: 8.2 symbols/min [2025-10-28T17:23:06.878789] [INFO ] [MAIN ] AWR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:23:06.899125] [DEBUG] [LOCAL ] AWR: Loaded 22460 existing records from primary storage. [2025-10-28T17:23:06.899368] [INFO ] [MAIN ] AWR: Loaded 22460 existing records. [2025-10-28T17:23:07.032055] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-28T17:23:07.085769] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-05. [2025-10-28T17:23:07.108393] [WARN ] [MAIN ] AWR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:23:07.109553] [INFO ] [MAIN ] AWR: Wiping existing primary data before full refresh. [2025-10-28T17:23:07.109781] [INFO ] [LOCAL ] AWR: Starting deletion of primary data. [2025-10-28T17:23:07.110466] [DEBUG] [LOCAL ] AWR: Deleted primary data file. [2025-10-28T17:23:07.110540] [INFO ] [MAIN ] AWR: Starting full primary refresh. [2025-10-28T17:23:07.497711] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-28T17:23:07.541589] [INFO ] [REMOTE ] AWR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:23:07.542227] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-01. [2025-10-28T17:23:07.543923] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-03. [2025-10-28T17:23:07.585911] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-28T17:23:07.594394] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-02. [2025-10-28T17:23:08.144702] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-28T17:23:08.150758] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-06. [2025-10-28T17:23:08.256431] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-28T17:23:08.385765] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-28T17:23:08.759524] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-02. [2025-10-28T17:23:08.894035] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-28T17:23:09.051284] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-28T17:23:09.538920] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-28T17:23:09.559310] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-07. [2025-10-28T17:23:10.359307] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-04. [2025-10-28T17:23:10.441065] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-28T17:23:11.159344] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-08. [2025-10-28T17:23:11.671362] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-28T17:23:11.959330] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-03. [2025-10-28T17:23:12.115206] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-28T17:23:12.759363] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-03. [2025-10-28T17:23:12.847593] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-28T17:23:13.440513] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-28T17:23:13.559336] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-04. [2025-10-28T17:23:14.359344] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-05. [2025-10-28T17:23:14.790526] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-28T17:23:15.159389] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-05. [2025-10-28T17:23:15.705878] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-28T17:23:15.959423] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-09. [2025-10-28T17:23:16.060076] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-28T17:23:16.759346] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-04. [2025-10-28T17:23:16.906302] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-28T17:23:17.384956] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-28T17:23:17.559333] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-06. [2025-10-28T17:23:18.359359] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-05. [2025-10-28T17:23:18.897701] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-28T17:23:19.159306] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-07. [2025-10-28T17:23:19.439633] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-28T17:23:19.959363] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-06. [2025-10-28T17:23:20.474844] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-28T17:23:20.707811] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-28T17:23:20.759335] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-07. [2025-10-28T17:23:21.550092] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-28T17:23:21.559289] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-08. [2025-10-28T17:23:22.353219] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-28T17:23:22.359285] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-06. [2025-10-28T17:23:22.956618] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-28T17:23:23.159344] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-10. [2025-10-28T17:23:23.959308] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-08. [2025-10-28T17:23:24.124460] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-28T17:23:24.133130] [INFO ] [REMOTE ] AWI: Full fetch complete (36322 records). [2025-10-28T17:23:24.133242] [DEBUG] [VALIDATOR ] AWI: Validating primary data. [2025-10-28T17:23:24.513859] [DEBUG] [VALIDATOR ] AWI: All expected trading days are present. [2025-10-28T17:23:24.513926] [DEBUG] [VALIDATOR ] AWI: Primary data validation passed. [2025-10-28T17:23:24.514336] [INFO ] [MAIN ] AWI: Fetched primary data is valid. [2025-10-28T17:23:24.514374] [DEBUG] [LOCAL ] AWI: Saving primary data. [2025-10-28T17:23:24.515129] [DEBUG] [LOCAL ] AWI: Trimmed 36322 records to 24954 (keeping 200 days of data) [2025-10-28T17:23:24.661119] [DEBUG] [LOCAL ] AWI: Primary data saved (24954 records). [2025-10-28T17:23:24.661236] [INFO ] [MAIN ] AWI: Full history saved. [2025-10-28T17:23:24.661309] [INFO ] [MAIN ] Update Progress: 191/2366 symbols completed. AWI took 31.9s. Estimated remaining: 4h 26m 1s. Rate: 8.2 symbols/min [2025-10-28T17:23:24.762590] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-07. [2025-10-28T17:23:24.830839] [INFO ] [MAIN ] AX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:23:24.854279] [DEBUG] [LOCAL ] AX: Loaded 27347 existing records from primary storage. [2025-10-28T17:23:24.854534] [INFO ] [MAIN ] AX: Loaded 27347 existing records. [2025-10-28T17:23:25.063462] [WARN ] [MAIN ] AX: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:23:25.063702] [INFO ] [MAIN ] AX: Wiping existing primary data before full refresh. [2025-10-28T17:23:25.063762] [INFO ] [LOCAL ] AX: Starting deletion of primary data. [2025-10-28T17:23:25.064259] [DEBUG] [LOCAL ] AX: Deleted primary data file. [2025-10-28T17:23:25.065119] [INFO ] [MAIN ] AX: Starting full primary refresh. [2025-10-28T17:23:25.454034] [INFO ] [REMOTE ] AX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:23:25.482592] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-28T17:23:25.559315] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-01. [2025-10-28T17:23:25.700246] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-28T17:23:26.359356] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-08. [2025-10-28T17:23:26.695795] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-28T17:23:27.159387] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-02. [2025-10-28T17:23:27.184542] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-28T17:23:27.959306] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-09. [2025-10-28T17:23:28.047369] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-28T17:23:28.759353] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-09. [2025-10-28T17:23:29.334099] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-28T17:23:29.481920] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-28T17:23:29.559341] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-09. [2025-10-28T17:23:30.359363] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-03. [2025-10-28T17:23:30.799207] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-28T17:23:31.159379] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-10. [2025-10-28T17:23:31.218715] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-28T17:23:31.941784] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-28T17:23:31.945916] [INFO ] [REMOTE ] AWP: Full fetch complete (31414 records). [2025-10-28T17:23:31.945997] [DEBUG] [VALIDATOR ] AWP: Validating primary data. [2025-10-28T17:23:31.966677] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-10. [2025-10-28T17:23:32.312343] [DEBUG] [VALIDATOR ] AWP: All expected trading days are present. [2025-10-28T17:23:32.312438] [DEBUG] [VALIDATOR ] AWP: Primary data validation passed. [2025-10-28T17:23:32.312860] [INFO ] [MAIN ] AWP: Fetched primary data is valid. [2025-10-28T17:23:32.312919] [DEBUG] [LOCAL ] AWP: Saving primary data. [2025-10-28T17:23:32.313605] [DEBUG] [LOCAL ] AWP: Trimmed 31414 records to 21301 (keeping 200 days of data) [2025-10-28T17:23:32.432076] [DEBUG] [LOCAL ] AWP: Primary data saved (21301 records). [2025-10-28T17:23:32.432191] [INFO ] [MAIN ] AWP: Full history saved. [2025-10-28T17:23:32.432267] [INFO ] [MAIN ] Update Progress: 192/2366 symbols completed. AWP took 26.3s. Estimated remaining: 4h 25m 59s. Rate: 8.2 symbols/min [2025-10-28T17:23:32.603811] [INFO ] [MAIN ] AXL: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:23:32.647392] [DEBUG] [LOCAL ] AXL: Loaded 50492 existing records from primary storage. [2025-10-28T17:23:32.647702] [INFO ] [MAIN ] AXL: Loaded 50492 existing records. [2025-10-28T17:23:32.764436] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-04. [2025-10-28T17:23:32.824807] [WARN ] [MAIN ] AXL: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:23:32.825120] [INFO ] [MAIN ] AXL: Wiping existing primary data before full refresh. [2025-10-28T17:23:32.825181] [INFO ] [LOCAL ] AXL: Starting deletion of primary data. [2025-10-28T17:23:32.825994] [DEBUG] [LOCAL ] AXL: Deleted primary data file. [2025-10-28T17:23:32.826051] [INFO ] [MAIN ] AXL: Starting full primary refresh. [2025-10-28T17:23:33.183691] [INFO ] [REMOTE ] AXL: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:23:33.197844] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-28T17:23:33.202895] [INFO ] [REMOTE ] AWR: Full fetch complete (32585 records). [2025-10-28T17:23:33.203004] [DEBUG] [VALIDATOR ] AWR: Validating primary data. [2025-10-28T17:23:33.564549] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-01. [2025-10-28T17:23:33.660277] [DEBUG] [VALIDATOR ] AWR: All expected trading days are present. [2025-10-28T17:23:33.660394] [DEBUG] [VALIDATOR ] AWR: Primary data validation passed. [2025-10-28T17:23:33.661168] [INFO ] [MAIN ] AWR: Fetched primary data is valid. [2025-10-28T17:23:33.661251] [DEBUG] [LOCAL ] AWR: Saving primary data. [2025-10-28T17:23:33.662458] [DEBUG] [LOCAL ] AWR: Trimmed 32585 records to 22474 (keeping 200 days of data) [2025-10-28T17:23:33.870245] [DEBUG] [LOCAL ] AWR: Primary data saved (22474 records). [2025-10-28T17:23:33.870701] [INFO ] [MAIN ] AWR: Full history saved. [2025-10-28T17:23:33.870837] [INFO ] [MAIN ] Update Progress: 193/2366 symbols completed. AWR took 27.2s. Estimated remaining: 4h 24m 45s. Rate: 8.2 symbols/min [2025-10-28T17:23:33.962317] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-28T17:23:34.193580] [INFO ] [MAIN ] AXP: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:23:34.268782] [DEBUG] [LOCAL ] AXP: Loaded 53134 existing records from primary storage. [2025-10-28T17:23:34.269214] [INFO ] [MAIN ] AXP: Loaded 53134 existing records. [2025-10-28T17:23:34.364562] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-10. [2025-10-28T17:23:34.470442] [WARN ] [MAIN ] AXP: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:23:34.470677] [INFO ] [MAIN ] AXP: Wiping existing primary data before full refresh. [2025-10-28T17:23:34.470737] [INFO ] [LOCAL ] AXP: Starting deletion of primary data. [2025-10-28T17:23:34.471767] [DEBUG] [LOCAL ] AXP: Deleted primary data file. [2025-10-28T17:23:34.471826] [INFO ] [MAIN ] AXP: Starting full primary refresh. [2025-10-28T17:23:34.854508] [INFO ] [REMOTE ] AXP: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:23:34.958071] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-28T17:23:35.159332] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-02. [2025-10-28T17:23:35.881071] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-28T17:23:35.890664] [INFO ] [REMOTE ] AWK: Full fetch complete (70899 records). [2025-10-28T17:23:35.890786] [DEBUG] [VALIDATOR ] AWK: Validating primary data. [2025-10-28T17:23:35.964634] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-01. [2025-10-28T17:23:36.289374] [DEBUG] [VALIDATOR ] AWK: All expected trading days are present. [2025-10-28T17:23:36.289550] [DEBUG] [VALIDATOR ] AWK: Primary data validation passed. [2025-10-28T17:23:36.290299] [INFO ] [MAIN ] AWK: Fetched primary data is valid. [2025-10-28T17:23:36.290384] [DEBUG] [LOCAL ] AWK: Saving primary data. [2025-10-28T17:23:36.292209] [DEBUG] [LOCAL ] AWK: Trimmed 70899 records to 48235 (keeping 200 days of data) [2025-10-28T17:23:36.531238] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-28T17:23:36.625267] [DEBUG] [LOCAL ] AWK: Primary data saved (48235 records). [2025-10-28T17:23:36.625401] [INFO ] [MAIN ] AWK: Full history saved. [2025-10-28T17:23:36.626224] [INFO ] [MAIN ] Update Progress: 194/2366 symbols completed. AWK took 38.4s. Estimated remaining: 4h 23m 47s. Rate: 8.2 symbols/min [2025-10-28T17:23:36.768494] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-05. [2025-10-28T17:23:36.793259] [INFO ] [MAIN ] AXR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:23:36.798000] [DEBUG] [LOCAL ] AXR: Loaded 2799 existing records from primary storage. [2025-10-28T17:23:36.798171] [INFO ] [MAIN ] AXR: Loaded 2799 existing records. [2025-10-28T17:23:36.973881] [WARN ] [MAIN ] AXR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:23:36.974121] [INFO ] [MAIN ] AXR: Wiping existing primary data before full refresh. [2025-10-28T17:23:36.974169] [INFO ] [LOCAL ] AXR: Starting deletion of primary data. [2025-10-28T17:23:36.974341] [DEBUG] [LOCAL ] AXR: Deleted primary data file. [2025-10-28T17:23:36.974423] [INFO ] [MAIN ] AXR: Starting full primary refresh. [2025-10-28T17:23:37.325393] [INFO ] [REMOTE ] AXR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:23:37.559298] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-01. [2025-10-28T17:23:37.637369] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-28T17:23:38.043331] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-28T17:23:38.113802] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-28T17:23:38.359330] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-02. [2025-10-28T17:23:38.703841] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-10-28T17:23:39.159336] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-02. [2025-10-28T17:23:39.959418] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-06. [2025-10-28T17:23:40.617743] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-28T17:23:40.641303] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-28T17:23:40.759322] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-03. [2025-10-28T17:23:41.175259] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-28T17:23:41.559336] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-04. [2025-10-28T17:23:41.927332] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-10-28T17:23:42.359396] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-03. [2025-10-28T17:23:43.159400] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-03. [2025-10-28T17:23:43.719942] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-28T17:23:43.959338] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-04. [2025-10-28T17:23:44.759306] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-05. [2025-10-28T17:23:44.878059] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-28T17:23:45.055997] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-05 (0.30 seconds). [2025-10-28T17:23:45.339320] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-28T17:23:45.559335] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-06. [2025-10-28T17:23:45.937728] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-10-28T17:23:46.359334] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-07. [2025-10-28T17:23:47.159337] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-05. [2025-10-28T17:23:47.266847] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-28T17:23:47.959384] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-08. [2025-10-28T17:23:48.546568] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-28T17:23:48.759391] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-06. [2025-10-28T17:23:49.132950] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-28T17:23:49.559344] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-04. [2025-10-28T17:23:49.916068] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-28T17:23:50.359337] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-07. [2025-10-28T17:23:51.159323] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-07. [2025-10-28T17:23:51.478591] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-28T17:23:51.591741] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-28T17:23:51.633331] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-28T17:23:51.959338] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-09. [2025-10-28T17:23:52.759345] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-08. [2025-10-28T17:23:52.954403] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-28T17:23:53.559380] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-05. [2025-10-28T17:23:54.132828] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-28T17:23:54.359351] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-09. [2025-10-28T17:23:55.156763] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-28T17:23:55.167709] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-08. [2025-10-28T17:23:55.642726] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-28T17:23:55.778911] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-28T17:23:55.959333] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-10. [2025-10-28T17:23:56.759335] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-06. [2025-10-28T17:23:57.559363] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-09. [2025-10-28T17:23:57.736378] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-28T17:23:57.746726] [INFO ] [REMOTE ] AXL: Full fetch complete (73217 records). [2025-10-28T17:23:57.746866] [DEBUG] [VALIDATOR ] AXL: Validating primary data. [2025-10-28T17:23:58.018266] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-28T17:23:58.151344] [DEBUG] [VALIDATOR ] AXL: All expected trading days are present. [2025-10-28T17:23:58.151715] [DEBUG] [VALIDATOR ] AXL: Primary data validation passed. [2025-10-28T17:23:58.152552] [INFO ] [MAIN ] AXL: Fetched primary data is valid. [2025-10-28T17:23:58.152812] [DEBUG] [LOCAL ] AXL: Saving primary data. [2025-10-28T17:23:58.154526] [DEBUG] [LOCAL ] AXL: Trimmed 73217 records to 50491 (keeping 200 days of data) [2025-10-28T17:23:58.365730] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-10. [2025-10-28T17:23:58.419320] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-28T17:23:58.488855] [DEBUG] [LOCAL ] AXL: Primary data saved (50491 records). [2025-10-28T17:23:58.489142] [INFO ] [MAIN ] AXL: Full history saved. [2025-10-28T17:23:58.489557] [INFO ] [MAIN ] Update Progress: 195/2366 symbols completed. AXL took 26.1s. Estimated remaining: 4h 26m 22s. Rate: 8.2 symbols/min [2025-10-28T17:23:58.654540] [INFO ] [MAIN ] AXS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:23:58.689977] [DEBUG] [LOCAL ] AXS: Loaded 38703 existing records from primary storage. [2025-10-28T17:23:58.690279] [INFO ] [MAIN ] AXS: Loaded 38703 existing records. [2025-10-28T17:23:58.861981] [WARN ] [MAIN ] AXS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:23:58.862213] [INFO ] [MAIN ] AXS: Wiping existing primary data before full refresh. [2025-10-28T17:23:58.862259] [INFO ] [LOCAL ] AXS: Starting deletion of primary data. [2025-10-28T17:23:58.862953] [DEBUG] [LOCAL ] AXS: Deleted primary data file. [2025-10-28T17:23:58.863010] [INFO ] [MAIN ] AXS: Starting full primary refresh. [2025-10-28T17:23:59.164536] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-10. [2025-10-28T17:23:59.217357] [INFO ] [REMOTE ] AXS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:23:59.352371] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-28T17:23:59.358109] [INFO ] [REMOTE ] AX: Full fetch complete (41762 records). [2025-10-28T17:23:59.358282] [DEBUG] [VALIDATOR ] AX: Validating primary data. [2025-10-28T17:23:59.747759] [DEBUG] [VALIDATOR ] AX: All expected trading days are present. [2025-10-28T17:23:59.747877] [DEBUG] [VALIDATOR ] AX: Primary data validation passed. [2025-10-28T17:23:59.748528] [INFO ] [MAIN ] AX: Fetched primary data is valid. [2025-10-28T17:23:59.748594] [DEBUG] [LOCAL ] AX: Saving primary data. [2025-10-28T17:23:59.750004] [DEBUG] [LOCAL ] AX: Trimmed 41762 records to 27197 (keeping 200 days of data) [2025-10-28T17:23:59.838755] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-28T17:23:59.844768] [INFO ] [REMOTE ] AXR: Full fetch complete (4253 records). [2025-10-28T17:23:59.850692] [DEBUG] [VALIDATOR ] AXR: Validating primary data. [2025-10-28T17:23:59.961141] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-01. [2025-10-28T17:24:00.095997] [DEBUG] [LOCAL ] AX: Primary data saved (27197 records). [2025-10-28T17:24:00.118178] [INFO ] [MAIN ] AX: Full history saved. [2025-10-28T17:24:00.138182] [INFO ] [MAIN ] Update Progress: 196/2366 symbols completed. AX took 35.5s. Estimated remaining: 4h 25m 11s. Rate: 8.2 symbols/min [2025-10-28T17:24:00.483477] [DEBUG] [VALIDATOR ] AXR: All expected trading days are present. [2025-10-28T17:24:00.496464] [DEBUG] [VALIDATOR ] AXR: Primary data validation passed. [2025-10-28T17:24:00.496767] [INFO ] [MAIN ] AXR: Fetched primary data is valid. [2025-10-28T17:24:00.496853] [DEBUG] [LOCAL ] AXR: Saving primary data. [2025-10-28T17:24:00.504572] [DEBUG] [LOCAL ] AXR: Trimmed 4253 records to 2773 (keeping 200 days of data) [2025-10-28T17:24:00.538537] [INFO ] [MAIN ] AXTA: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:24:00.558265] [DEBUG] [LOCAL ] AXR: Primary data saved (2773 records). [2025-10-28T17:24:00.558545] [INFO ] [MAIN ] AXR: Full history saved. [2025-10-28T17:24:00.558859] [INFO ] [MAIN ] Update Progress: 197/2366 symbols completed. AXR took 23.9s. Estimated remaining: 4h 23m 48s. Rate: 8.2 symbols/min [2025-10-28T17:24:00.623914] [DEBUG] [LOCAL ] AXTA: Loaded 52292 existing records from primary storage. [2025-10-28T17:24:00.624605] [INFO ] [MAIN ] AXTA: Loaded 52292 existing records. [2025-10-28T17:24:00.765533] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-07. [2025-10-28T17:24:00.857564] [WARN ] [MAIN ] AXTA: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:24:00.857889] [INFO ] [MAIN ] AXTA: Wiping existing primary data before full refresh. [2025-10-28T17:24:00.857945] [INFO ] [LOCAL ] AXTA: Starting deletion of primary data. [2025-10-28T17:24:00.858989] [DEBUG] [LOCAL ] AXTA: Deleted primary data file. [2025-10-28T17:24:00.859051] [INFO ] [MAIN ] AXTA: Starting full primary refresh. [2025-10-28T17:24:01.296348] [INFO ] [REMOTE ] AXTA: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:24:01.320996] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-28T17:24:01.559403] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-02. [2025-10-28T17:24:02.327953] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-28T17:24:02.359318] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-03. [2025-10-28T17:24:02.743719] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-28T17:24:03.159361] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-08. [2025-10-28T17:24:03.587142] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-28T17:24:03.959353] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-01. [2025-10-28T17:24:04.639491] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-28T17:24:04.759361] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-09. [2025-10-28T17:24:05.241735] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-28T17:24:05.559340] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-04. [2025-10-28T17:24:06.222757] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-28T17:24:06.359333] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-10. [2025-10-28T17:24:06.557057] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-28T17:24:07.159370] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-02. [2025-10-28T17:24:07.959366] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-05. [2025-10-28T17:24:08.194965] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-28T17:24:08.206240] [INFO ] [REMOTE ] AXP: Full fetch complete (77077 records). [2025-10-28T17:24:08.206414] [DEBUG] [VALIDATOR ] AXP: Validating primary data. [2025-10-28T17:24:08.655629] [DEBUG] [VALIDATOR ] AXP: All expected trading days are present. [2025-10-28T17:24:08.655814] [DEBUG] [VALIDATOR ] AXP: Primary data validation passed. [2025-10-28T17:24:08.656639] [INFO ] [MAIN ] AXP: Fetched primary data is valid. [2025-10-28T17:24:08.656916] [DEBUG] [LOCAL ] AXP: Saving primary data. [2025-10-28T17:24:08.659125] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-28T17:24:08.670075] [DEBUG] [LOCAL ] AXP: Trimmed 77077 records to 53107 (keeping 200 days of data) [2025-10-28T17:24:08.761827] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-03. [2025-10-28T17:24:09.033692] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-28T17:24:09.047021] [DEBUG] [LOCAL ] AXP: Primary data saved (53107 records). [2025-10-28T17:24:09.047125] [INFO ] [MAIN ] AXP: Full history saved. [2025-10-28T17:24:09.047236] [INFO ] [MAIN ] Update Progress: 198/2366 symbols completed. AXP took 35.2s. Estimated remaining: 4h 23m 54s. Rate: 8.2 symbols/min [2025-10-28T17:24:09.559328] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-06. [2025-10-28T17:24:10.156001] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-28T17:24:10.359396] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-04. [2025-10-28T17:24:10.722073] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-28T17:24:11.159334] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-07. [2025-10-28T17:24:11.725099] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-28T17:24:11.959376] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-05. [2025-10-28T17:24:12.358689] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-28T17:24:12.759323] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-08. [2025-10-28T17:24:13.416885] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-28T17:24:13.559305] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-06. [2025-10-28T17:24:13.813248] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-28T17:24:14.359399] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-09. [2025-10-28T17:24:14.732660] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-28T17:24:15.159344] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-07. [2025-10-28T17:24:15.847341] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-28T17:24:15.959322] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-10. [2025-10-28T17:24:16.430609] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-28T17:24:16.759367] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-08. [2025-10-28T17:24:17.225340] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-28T17:24:17.233978] [INFO ] [REMOTE ] AXS: Full fetch complete (56328 records). [2025-10-28T17:24:17.234134] [DEBUG] [VALIDATOR ] AXS: Validating primary data. [2025-10-28T17:24:17.628541] [DEBUG] [VALIDATOR ] AXS: All expected trading days are present. [2025-10-28T17:24:17.628677] [DEBUG] [VALIDATOR ] AXS: Primary data validation passed. [2025-10-28T17:24:17.629328] [INFO ] [MAIN ] AXS: Fetched primary data is valid. [2025-10-28T17:24:17.629392] [DEBUG] [LOCAL ] AXS: Saving primary data. [2025-10-28T17:24:17.630681] [DEBUG] [LOCAL ] AXS: Trimmed 56328 records to 38711 (keeping 200 days of data) [2025-10-28T17:24:17.869707] [DEBUG] [LOCAL ] AXS: Primary data saved (38711 records). [2025-10-28T17:24:17.869899] [INFO ] [MAIN ] AXS: Full history saved. [2025-10-28T17:24:17.870440] [INFO ] [MAIN ] Update Progress: 199/2366 symbols completed. AXS took 19.4s. Estimated remaining: 4h 24m 3s. Rate: 8.2 symbols/min [2025-10-28T17:24:17.985517] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-28T17:24:17.996931] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-09. [2025-10-28T17:24:19.098115] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-28T17:24:19.109513] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-10. [2025-10-28T17:24:20.476869] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-28T17:24:20.487686] [INFO ] [REMOTE ] AXTA: Full fetch complete (75526 records). [2025-10-28T17:24:20.487848] [DEBUG] [VALIDATOR ] AXTA: Validating primary data. [2025-10-28T17:24:20.881531] [DEBUG] [VALIDATOR ] AXTA: All expected trading days are present. [2025-10-28T17:24:20.881625] [DEBUG] [VALIDATOR ] AXTA: Primary data validation passed. [2025-10-28T17:24:20.882419] [INFO ] [MAIN ] AXTA: Fetched primary data is valid. [2025-10-28T17:24:20.882473] [DEBUG] [LOCAL ] AXTA: Saving primary data. [2025-10-28T17:24:20.883994] [DEBUG] [LOCAL ] AXTA: Trimmed 75526 records to 52296 (keeping 200 days of data) [2025-10-28T17:24:21.183309] [DEBUG] [LOCAL ] AXTA: Primary data saved (52296 records). [2025-10-28T17:24:21.183683] [INFO ] [MAIN ] AXTA: Full history saved. [2025-10-28T17:24:21.183784] [INFO ] [MAIN ] Update Progress: 200/2366 symbols completed. AXTA took 21.0s. Estimated remaining: 4h 23m 12s. Rate: 8.2 symbols/min [2025-10-28T17:24:21.888257] [INFO ] [MAIN ] B: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:24:21.889139] [INFO ] [MAIN ] AZO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:24:21.908632] [INFO ] [MAIN ] AYI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:24:21.931410] [DEBUG] [LOCAL ] B: No existing data file found in primary storage. [2025-10-28T17:24:21.931310] [INFO ] [MAIN ] AZZ: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:24:21.932083] [WARN ] [MAIN ] B: No existing data found, performing full refresh instead. [2025-10-28T17:24:21.932207] [INFO ] [MAIN ] B: Wiping existing primary data before full refresh. [2025-10-28T17:24:21.932249] [INFO ] [LOCAL ] B: Starting deletion of primary data. [2025-10-28T17:24:21.932288] [DEBUG] [LOCAL ] B: No primary data file found to delete. [2025-10-28T17:24:21.932319] [INFO ] [MAIN ] B: Starting full primary refresh. [2025-10-28T17:24:22.041755] [DEBUG] [LOCAL ] AZO: Loaded 10621 existing records from primary storage. [2025-10-28T17:24:22.062823] [INFO ] [MAIN ] AZO: Loaded 10621 existing records. [2025-10-28T17:24:22.170588] [DEBUG] [LOCAL ] AYI: Loaded 23636 existing records from primary storage. [2025-10-28T17:24:22.178696] [DEBUG] [LOCAL ] AZZ: Loaded 22861 existing records from primary storage. [2025-10-28T17:24:22.201039] [INFO ] [MAIN ] AYI: Loaded 23636 existing records. [2025-10-28T17:24:22.245998] [INFO ] [MAIN ] AZZ: Loaded 22861 existing records. [2025-10-28T17:24:22.725341] [WARN ] [MAIN ] AZO: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:24:22.756702] [INFO ] [REMOTE ] B: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:24:22.736244] [INFO ] [MAIN ] AZO: Wiping existing primary data before full refresh. [2025-10-28T17:24:22.784702] [INFO ] [REMOTE ] B: Fetching primary data for 2025-01. [2025-10-28T17:24:22.789921] [INFO ] [LOCAL ] AZO: Starting deletion of primary data. [2025-10-28T17:24:22.863566] [WARN ] [MAIN ] AYI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:24:22.864424] [DEBUG] [LOCAL ] AZO: Deleted primary data file. [2025-10-28T17:24:22.868290] [INFO ] [MAIN ] AYI: Wiping existing primary data before full refresh. [2025-10-28T17:24:22.867938] [WARN ] [MAIN ] AZZ: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:24:22.868434] [INFO ] [MAIN ] AZO: Starting full primary refresh. [2025-10-28T17:24:22.868385] [INFO ] [LOCAL ] AYI: Starting deletion of primary data. [2025-10-28T17:24:22.888837] [INFO ] [MAIN ] AZZ: Wiping existing primary data before full refresh. [2025-10-28T17:24:22.910951] [INFO ] [LOCAL ] AZZ: Starting deletion of primary data. [2025-10-28T17:24:22.922668] [DEBUG] [LOCAL ] AYI: Deleted primary data file. [2025-10-28T17:24:22.936671] [DEBUG] [LOCAL ] AZZ: Deleted primary data file. [2025-10-28T17:24:22.936585] [INFO ] [MAIN ] AYI: Starting full primary refresh. [2025-10-28T17:24:22.948257] [INFO ] [MAIN ] AZZ: Starting full primary refresh. [2025-10-28T17:24:23.853583] [INFO ] [REMOTE ] AYI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:24:23.853969] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-01. [2025-10-28T17:24:23.848574] [INFO ] [REMOTE ] AZO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:24:23.891824] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-01. [2025-10-28T17:24:23.987947] [INFO ] [REMOTE ] AZZ: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:24:23.989071] [INFO ] [REMOTE ] B: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-28T17:24:23.989315] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-01. [2025-10-28T17:24:23.995704] [INFO ] [REMOTE ] B: Fetching primary data for 2025-02. [2025-10-28T17:24:24.209015] [DEBUG] [REMOTE ] B: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-28T17:24:24.209189] [WARN ] [REMOTE ] B: No data returned for month 2025-02 [2025-10-28T17:24:24.209268] [FATAL] [REMOTE ] B: API call failed - aborting fetch to avoid wasting further API calls [2025-10-28T17:24:24.209352] [FATAL] [MAIN ] B: Failed to fetch primary data. [2025-10-28T17:24:24.209416] [WARN ] [MAIN ] B: Deleting existing primary and derivative data due to fetch failure. [2025-10-28T17:24:24.209482] [INFO ] [LOCAL ] B: Starting deletion of primary data. [2025-10-28T17:24:24.209539] [DEBUG] [LOCAL ] B: No primary data file found to delete. [2025-10-28T17:24:24.209573] [INFO ] [LOCAL ] B: Starting deletion of derivative data. [2025-10-28T17:24:24.209613] [DEBUG] [LOCAL ] B: No derivative data file found to delete. [2025-10-28T17:24:24.209719] [INFO ] [MAIN ] Update Progress: 201/2366 symbols completed. B took 3.0s. Estimated remaining: 4h 22m 19s. Rate: 8.3 symbols/min [2025-10-28T17:24:24.375105] [INFO ] [MAIN ] BA: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:24:24.422795] [DEBUG] [LOCAL ] BA: Loaded 53790 existing records from primary storage. [2025-10-28T17:24:24.423086] [INFO ] [MAIN ] BA: Loaded 53790 existing records. [2025-10-28T17:24:24.599760] [WARN ] [MAIN ] BA: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:24:24.600076] [INFO ] [MAIN ] BA: Wiping existing primary data before full refresh. [2025-10-28T17:24:24.600165] [INFO ] [LOCAL ] BA: Starting deletion of primary data. [2025-10-28T17:24:24.606033] [DEBUG] [LOCAL ] BA: Deleted primary data file. [2025-10-28T17:24:24.606171] [INFO ] [MAIN ] BA: Starting full primary refresh. [2025-10-28T17:24:24.638091] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-28T17:24:24.699985] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-02. [2025-10-28T17:24:24.955276] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-28T17:24:24.988497] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-02. [2025-10-28T17:24:24.984419] [INFO ] [REMOTE ] BA: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:24:24.988812] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-01. [2025-10-28T17:24:25.012388] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-28T17:24:25.295850] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-28T17:24:25.559337] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-02. [2025-10-28T17:24:25.667504] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-28T17:24:26.359381] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-03. [2025-10-28T17:24:26.594811] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-28T17:24:26.730344] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-28T17:24:27.159331] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-03. [2025-10-28T17:24:27.458245] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-28T17:24:27.959319] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-02. [2025-10-28T17:24:28.098444] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-28T17:24:28.759381] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-04. [2025-10-28T17:24:29.559354] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-04. [2025-10-28T17:24:29.682091] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-28T17:24:29.761727] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-28T17:24:30.359339] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-03. [2025-10-28T17:24:30.580484] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-28T17:24:30.950382] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-28T17:24:31.159334] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-03. [2025-10-28T17:24:31.959328] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-05. [2025-10-28T17:24:32.712961] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-28T17:24:32.759295] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-06. [2025-10-28T17:24:32.898798] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-28T17:24:33.559333] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-05. [2025-10-28T17:24:33.878217] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-28T17:24:34.303675] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-28T17:24:34.359306] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-07. [2025-10-28T17:24:35.159317] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-04. [2025-10-28T17:24:35.268713] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-28T17:24:35.959315] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-08. [2025-10-28T17:24:36.759333] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-04. [2025-10-28T17:24:37.056211] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-28T17:24:37.345489] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-10-28T17:24:37.559310] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-05. [2025-10-28T17:24:37.684699] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-28T17:24:38.359338] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-05. [2025-10-28T17:24:38.970869] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-28T17:24:39.159389] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-06. [2025-10-28T17:24:39.449089] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-28T17:24:39.959380] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-06. [2025-10-28T17:24:40.179027] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-28T17:24:40.627412] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-28T17:24:40.759363] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-09. [2025-10-28T17:24:41.559348] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-07. [2025-10-28T17:24:41.583120] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-28T17:24:42.084155] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-28T17:24:42.359384] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-06. [2025-10-28T17:24:43.159402] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-07. [2025-10-28T17:24:43.959369] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-08. [2025-10-28T17:24:44.077834] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-28T17:24:44.443635] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-28T17:24:44.527491] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-06 (2.17 seconds). [2025-10-28T17:24:44.759346] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-08. [2025-10-28T17:24:45.559324] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-07. [2025-10-28T17:24:45.573741] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-28T17:24:46.359389] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-10. [2025-10-28T17:24:47.159333] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-09. [2025-10-28T17:24:47.438008] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-28T17:24:47.442613] [INFO ] [REMOTE ] AYI: Full fetch complete (36270 records). [2025-10-28T17:24:47.442719] [DEBUG] [VALIDATOR ] AYI: Validating primary data. [2025-10-28T17:24:47.844545] [DEBUG] [VALIDATOR ] AYI: All expected trading days are present. [2025-10-28T17:24:47.844732] [DEBUG] [VALIDATOR ] AYI: Primary data validation passed. [2025-10-28T17:24:47.845361] [INFO ] [MAIN ] AYI: Fetched primary data is valid. [2025-10-28T17:24:47.845611] [DEBUG] [LOCAL ] AYI: Saving primary data. [2025-10-28T17:24:47.853919] [DEBUG] [LOCAL ] AYI: Trimmed 36270 records to 23511 (keeping 200 days of data) [2025-10-28T17:24:47.854987] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-28T17:24:47.962668] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-10. [2025-10-28T17:24:47.999528] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-07 (2.44 seconds). [2025-10-28T17:24:48.057066] [DEBUG] [LOCAL ] AYI: Primary data saved (23511 records). [2025-10-28T17:24:48.057229] [INFO ] [MAIN ] AYI: Full history saved. [2025-10-28T17:24:48.057323] [INFO ] [MAIN ] Update Progress: 202/2366 symbols completed. AYI took 26.9s. Estimated remaining: 4h 25m 9s. Rate: 8.2 symbols/min [2025-10-28T17:24:48.224170] [INFO ] [MAIN ] BABA: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:24:48.224357] [DEBUG] [LOCAL ] BABA: No existing data file found in primary storage. [2025-10-28T17:24:48.224394] [WARN ] [MAIN ] BABA: No existing data found, performing full refresh instead. [2025-10-28T17:24:48.224524] [INFO ] [MAIN ] BABA: Wiping existing primary data before full refresh. [2025-10-28T17:24:48.224565] [INFO ] [LOCAL ] BABA: Starting deletion of primary data. [2025-10-28T17:24:48.224604] [DEBUG] [LOCAL ] BABA: No primary data file found to delete. [2025-10-28T17:24:48.224634] [INFO ] [MAIN ] BABA: Starting full primary refresh. [2025-10-28T17:24:48.576915] [INFO ] [REMOTE ] BABA: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:24:48.711133] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-28T17:24:48.713677] [INFO ] [REMOTE ] AZO: Full fetch complete (16057 records). [2025-10-28T17:24:48.713748] [DEBUG] [VALIDATOR ] AZO: Validating primary data. [2025-10-28T17:24:48.768899] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-09. [2025-10-28T17:24:49.097838] [DEBUG] [VALIDATOR ] AZO: All expected trading days are present. [2025-10-28T17:24:49.097911] [DEBUG] [VALIDATOR ] AZO: Primary data validation passed. [2025-10-28T17:24:49.098173] [INFO ] [MAIN ] AZO: Fetched primary data is valid. [2025-10-28T17:24:49.098209] [DEBUG] [LOCAL ] AZO: Saving primary data. [2025-10-28T17:24:49.098771] [DEBUG] [LOCAL ] AZO: Trimmed 16057 records to 10576 (keeping 200 days of data) [2025-10-28T17:24:49.162904] [DEBUG] [LOCAL ] AZO: Primary data saved (10576 records). [2025-10-28T17:24:49.163012] [INFO ] [MAIN ] AZO: Full history saved. [2025-10-28T17:24:49.163088] [INFO ] [MAIN ] Update Progress: 203/2366 symbols completed. AZO took 28.0s. Estimated remaining: 4h 23m 55s. Rate: 8.2 symbols/min [2025-10-28T17:24:49.330621] [INFO ] [MAIN ] BAC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:24:49.377776] [DEBUG] [LOCAL ] BAC: Loaded 53808 existing records from primary storage. [2025-10-28T17:24:49.378087] [INFO ] [MAIN ] BAC: Loaded 53808 existing records. [2025-10-28T17:24:49.562831] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-08. [2025-10-28T17:24:49.562724] [WARN ] [MAIN ] BAC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:24:49.564144] [INFO ] [MAIN ] BAC: Wiping existing primary data before full refresh. [2025-10-28T17:24:49.564294] [INFO ] [LOCAL ] BAC: Starting deletion of primary data. [2025-10-28T17:24:49.565113] [DEBUG] [LOCAL ] BAC: Deleted primary data file. [2025-10-28T17:24:49.565172] [INFO ] [MAIN ] BAC: Starting full primary refresh. [2025-10-28T17:24:49.764207] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-28T17:24:49.960067] [INFO ] [REMOTE ] BAC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:24:50.359345] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-10. [2025-10-28T17:24:51.159300] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-01. [2025-10-28T17:24:51.366696] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-28T17:24:51.512238] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-28T17:24:51.518135] [INFO ] [REMOTE ] AZZ: Full fetch complete (32094 records). [2025-10-28T17:24:51.518267] [DEBUG] [VALIDATOR ] AZZ: Validating primary data. [2025-10-28T17:24:51.880746] [DEBUG] [VALIDATOR ] AZZ: All expected trading days are present. [2025-10-28T17:24:51.880828] [DEBUG] [VALIDATOR ] AZZ: Primary data validation passed. [2025-10-28T17:24:51.881224] [INFO ] [MAIN ] AZZ: Fetched primary data is valid. [2025-10-28T17:24:51.881264] [DEBUG] [LOCAL ] AZZ: Saving primary data. [2025-10-28T17:24:51.882114] [DEBUG] [LOCAL ] AZZ: Trimmed 32094 records to 22835 (keeping 200 days of data) [2025-10-28T17:24:51.969501] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-01. [2025-10-28T17:24:52.021825] [DEBUG] [LOCAL ] AZZ: Primary data saved (22835 records). [2025-10-28T17:24:52.021935] [INFO ] [MAIN ] AZZ: Full history saved. [2025-10-28T17:24:52.022010] [INFO ] [MAIN ] Update Progress: 204/2366 symbols completed. AZZ took 30.8s. Estimated remaining: 4h 23m 1s. Rate: 8.2 symbols/min [2025-10-28T17:24:52.190282] [INFO ] [MAIN ] BAH: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:24:52.240566] [DEBUG] [LOCAL ] BAH: Loaded 51639 existing records from primary storage. [2025-10-28T17:24:52.240887] [INFO ] [MAIN ] BAH: Loaded 51639 existing records. [2025-10-28T17:24:52.414147] [WARN ] [MAIN ] BAH: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:24:52.414372] [INFO ] [MAIN ] BAH: Wiping existing primary data before full refresh. [2025-10-28T17:24:52.414419] [INFO ] [LOCAL ] BAH: Starting deletion of primary data. [2025-10-28T17:24:52.415197] [DEBUG] [LOCAL ] BAH: Deleted primary data file. [2025-10-28T17:24:52.415256] [INFO ] [MAIN ] BAH: Starting full primary refresh. [2025-10-28T17:24:52.756820] [INFO ] [REMOTE ] BAH: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:24:52.759298] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-01. [2025-10-28T17:24:52.906576] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-28T17:24:53.559352] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-02. [2025-10-28T17:24:53.984701] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-10-28T17:24:54.133629] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-28T17:24:54.359344] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-02. [2025-10-28T17:24:55.160114] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-02. [2025-10-28T17:24:55.162457] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-28T17:24:55.731039] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-28T17:24:55.959397] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-03. [2025-10-28T17:24:56.759338] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-09. [2025-10-28T17:24:57.176839] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-10-28T17:24:57.335744] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-28T17:24:57.559332] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-04. [2025-10-28T17:24:58.359391] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-03. [2025-10-28T17:24:58.659283] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-28T17:24:58.996698] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-28T17:24:59.159336] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-05. [2025-10-28T17:24:59.959421] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-10. [2025-10-28T17:25:00.374907] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-10-28T17:25:00.476471] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-28T17:25:00.599223] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-28T17:25:00.611149] [INFO ] [REMOTE ] BA: Full fetch complete (77969 records). [2025-10-28T17:25:00.611379] [DEBUG] [VALIDATOR ] BA: Validating primary data. [2025-10-28T17:25:00.768983] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-04. [2025-10-28T17:25:00.998292] [DEBUG] [VALIDATOR ] BA: All expected trading days are present. [2025-10-28T17:25:00.998373] [DEBUG] [VALIDATOR ] BA: Primary data validation passed. [2025-10-28T17:25:00.999158] [INFO ] [MAIN ] BA: Fetched primary data is valid. [2025-10-28T17:25:00.999241] [DEBUG] [LOCAL ] BA: Saving primary data. [2025-10-28T17:25:01.000791] [DEBUG] [LOCAL ] BA: Trimmed 77969 records to 53790 (keeping 200 days of data) [2025-10-28T17:25:01.322458] [DEBUG] [LOCAL ] BA: Primary data saved (53790 records). [2025-10-28T17:25:01.322586] [INFO ] [MAIN ] BA: Full history saved. [2025-10-28T17:25:01.322684] [INFO ] [MAIN ] Update Progress: 205/2366 symbols completed. BA took 37.1s. Estimated remaining: 4h 23m 15s. Rate: 8.2 symbols/min [2025-10-28T17:25:01.489533] [INFO ] [MAIN ] BAK: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:25:01.522754] [DEBUG] [LOCAL ] BAK: Loaded 39231 existing records from primary storage. [2025-10-28T17:25:01.523047] [INFO ] [MAIN ] BAK: Loaded 39231 existing records. [2025-10-28T17:25:01.564504] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-06. [2025-10-28T17:25:01.712192] [WARN ] [MAIN ] BAK: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:25:01.712448] [INFO ] [MAIN ] BAK: Wiping existing primary data before full refresh. [2025-10-28T17:25:01.712505] [INFO ] [LOCAL ] BAK: Starting deletion of primary data. [2025-10-28T17:25:01.713400] [DEBUG] [LOCAL ] BAK: Deleted primary data file. [2025-10-28T17:25:01.713459] [INFO ] [MAIN ] BAK: Starting full primary refresh. [2025-10-28T17:25:02.083059] [INFO ] [REMOTE ] BAK: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:25:02.359340] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-01. [2025-10-28T17:25:02.896565] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-10-28T17:25:03.159313] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-05. [2025-10-28T17:25:03.436007] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-28T17:25:03.474045] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-10-28T17:25:03.959349] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-02. [2025-10-28T17:25:04.759326] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-07. [2025-10-28T17:25:05.019724] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-28T17:25:05.474480] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-05 (2.32 seconds). [2025-10-28T17:25:05.559339] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-03. [2025-10-28T17:25:06.166243] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-28T17:25:06.359349] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-03. [2025-10-28T17:25:06.892809] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-28T17:25:07.159331] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-08. [2025-10-28T17:25:07.959345] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-04. [2025-10-28T17:25:08.536589] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-28T17:25:08.659628] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-03 (2.30 seconds). [2025-10-28T17:25:08.759340] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-04. [2025-10-28T17:25:09.123925] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-28T17:25:09.559341] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-06. [2025-10-28T17:25:10.359334] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-09. [2025-10-28T17:25:10.984084] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-10-28T17:25:11.159376] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-05. [2025-10-28T17:25:11.390491] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-28T17:25:11.603887] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-28T17:25:11.959331] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-10. [2025-10-28T17:25:12.216062] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-28T17:25:12.759393] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-05. [2025-10-28T17:25:13.559308] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-06. [2025-10-28T17:25:13.892600] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-10 (1.93 seconds). [2025-10-28T17:25:13.903040] [INFO ] [REMOTE ] BAH: Full fetch complete (75279 records). [2025-10-28T17:25:13.903184] [DEBUG] [VALIDATOR ] BAH: Validating primary data. [2025-10-28T17:25:14.293534] [DEBUG] [VALIDATOR ] BAH: All expected trading days are present. [2025-10-28T17:25:14.293607] [DEBUG] [VALIDATOR ] BAH: Primary data validation passed. [2025-10-28T17:25:14.294407] [INFO ] [MAIN ] BAH: Fetched primary data is valid. [2025-10-28T17:25:14.294473] [DEBUG] [LOCAL ] BAH: Saving primary data. [2025-10-28T17:25:14.295852] [DEBUG] [LOCAL ] BAH: Trimmed 75279 records to 51644 (keeping 200 days of data) [2025-10-28T17:25:14.359371] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-07. [2025-10-28T17:25:14.641418] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-28T17:25:14.640329] [DEBUG] [LOCAL ] BAH: Primary data saved (51644 records). [2025-10-28T17:25:14.652082] [INFO ] [MAIN ] BAH: Full history saved. [2025-10-28T17:25:14.652944] [INFO ] [MAIN ] Update Progress: 206/2366 symbols completed. BAH took 22.6s. Estimated remaining: 4h 24m 10s. Rate: 8.2 symbols/min [2025-10-28T17:25:14.827244] [INFO ] [MAIN ] BALL: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:25:14.849306] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-28T17:25:14.900205] [DEBUG] [LOCAL ] BALL: Loaded 51906 existing records from primary storage. [2025-10-28T17:25:14.900493] [INFO ] [MAIN ] BALL: Loaded 51906 existing records. [2025-10-28T17:25:15.074965] [WARN ] [MAIN ] BALL: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:25:15.075157] [INFO ] [MAIN ] BALL: Wiping existing primary data before full refresh. [2025-10-28T17:25:15.075237] [INFO ] [LOCAL ] BALL: Starting deletion of primary data. [2025-10-28T17:25:15.076069] [DEBUG] [LOCAL ] BALL: Deleted primary data file. [2025-10-28T17:25:15.076127] [INFO ] [MAIN ] BALL: Starting full primary refresh. [2025-10-28T17:25:15.164532] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-06. [2025-10-28T17:25:15.428889] [INFO ] [REMOTE ] BALL: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:25:15.959368] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-01. [2025-10-28T17:25:16.759334] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-07. [2025-10-28T17:25:16.796236] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-28T17:25:17.098857] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-07 (2.74 seconds). [2025-10-28T17:25:17.499735] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-28T17:25:17.559302] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-02. [2025-10-28T17:25:17.813397] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-28T17:25:18.359350] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-08. [2025-10-28T17:25:18.687969] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-28T17:25:19.159315] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-07. [2025-10-28T17:25:19.291250] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-28T17:25:19.959337] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-09. [2025-10-28T17:25:20.759389] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-08. [2025-10-28T17:25:20.849485] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-28T17:25:21.115817] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-28T17:25:21.559348] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-08. [2025-10-28T17:25:22.359362] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-03. [2025-10-28T17:25:23.159333] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-10. [2025-10-28T17:25:23.215128] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-08 (2.46 seconds). [2025-10-28T17:25:23.535064] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-10-28T17:25:23.730604] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-28T17:25:23.959394] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-04. [2025-10-28T17:25:24.312344] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-28T17:25:24.324425] [INFO ] [REMOTE ] BAK: Full fetch complete (56755 records). [2025-10-28T17:25:24.324749] [DEBUG] [VALIDATOR ] BAK: Validating primary data. [2025-10-28T17:25:24.715819] [DEBUG] [VALIDATOR ] BAK: All expected trading days are present. [2025-10-28T17:25:24.715889] [DEBUG] [VALIDATOR ] BAK: Primary data validation passed. [2025-10-28T17:25:24.716487] [INFO ] [MAIN ] BAK: Fetched primary data is valid. [2025-10-28T17:25:24.716526] [DEBUG] [LOCAL ] BAK: Saving primary data. [2025-10-28T17:25:24.717629] [DEBUG] [LOCAL ] BAK: Trimmed 56755 records to 39107 (keeping 200 days of data) [2025-10-28T17:25:24.760494] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-09. [2025-10-28T17:25:24.930179] [DEBUG] [LOCAL ] BAK: Primary data saved (39107 records). [2025-10-28T17:25:24.930292] [INFO ] [MAIN ] BAK: Full history saved. [2025-10-28T17:25:24.930368] [INFO ] [MAIN ] Update Progress: 207/2366 symbols completed. BAK took 23.6s. Estimated remaining: 4h 24m 34s. Rate: 8.2 symbols/min [2025-10-28T17:25:25.104787] [INFO ] [MAIN ] BALY: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:25:25.104955] [DEBUG] [LOCAL ] BALY: No existing data file found in primary storage. [2025-10-28T17:25:25.105004] [WARN ] [MAIN ] BALY: No existing data found, performing full refresh instead. [2025-10-28T17:25:25.105107] [INFO ] [MAIN ] BALY: Wiping existing primary data before full refresh. [2025-10-28T17:25:25.105147] [INFO ] [LOCAL ] BALY: Starting deletion of primary data. [2025-10-28T17:25:25.105205] [DEBUG] [LOCAL ] BALY: No primary data file found to delete. [2025-10-28T17:25:25.105282] [INFO ] [MAIN ] BALY: Starting full primary refresh. [2025-10-28T17:25:25.468687] [INFO ] [REMOTE ] BALY: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:25:25.526362] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-28T17:25:25.559308] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-05. [2025-10-28T17:25:26.359338] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-01. [2025-10-28T17:25:26.754369] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-28T17:25:26.910054] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-10-28T17:25:27.122504] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-28T17:25:27.159307] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-02. [2025-10-28T17:25:27.584710] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-28T17:25:27.959327] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-03. [2025-10-28T17:25:28.494406] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-28T17:25:28.759350] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-10. [2025-10-28T17:25:29.559361] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-06. [2025-10-28T17:25:30.359436] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-09. [2025-10-28T17:25:30.888062] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-10 (2.13 seconds). [2025-10-28T17:25:30.901373] [INFO ] [REMOTE ] BAC: Full fetch complete (77988 records). [2025-10-28T17:25:30.901547] [DEBUG] [VALIDATOR ] BAC: Validating primary data. [2025-10-28T17:25:31.164563] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-04. [2025-10-28T17:25:31.366480] [DEBUG] [VALIDATOR ] BAC: All expected trading days are present. [2025-10-28T17:25:31.366593] [DEBUG] [VALIDATOR ] BAC: Primary data validation passed. [2025-10-28T17:25:31.367522] [INFO ] [MAIN ] BAC: Fetched primary data is valid. [2025-10-28T17:25:31.367744] [DEBUG] [LOCAL ] BAC: Saving primary data. [2025-10-28T17:25:31.369217] [DEBUG] [LOCAL ] BAC: Trimmed 77988 records to 53808 (keeping 200 days of data) [2025-10-28T17:25:31.625691] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-10-28T17:25:31.746967] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-28T17:25:31.774389] [DEBUG] [LOCAL ] BAC: Primary data saved (53808 records). [2025-10-28T17:25:31.774548] [INFO ] [MAIN ] BAC: Full history saved. [2025-10-28T17:25:31.774874] [INFO ] [MAIN ] Update Progress: 208/2366 symbols completed. BAC took 42.6s. Estimated remaining: 4h 24m 21s. Rate: 8.2 symbols/min [2025-10-28T17:25:31.948053] [INFO ] [MAIN ] BAM: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:25:31.959342] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-07. [2025-10-28T17:25:32.000194] [DEBUG] [LOCAL ] BAM: Loaded 52063 existing records from primary storage. [2025-10-28T17:25:32.000581] [INFO ] [MAIN ] BAM: Loaded 52063 existing records. [2025-10-28T17:25:32.178377] [WARN ] [MAIN ] BAM: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:25:32.178593] [INFO ] [MAIN ] BAM: Wiping existing primary data before full refresh. [2025-10-28T17:25:32.178638] [INFO ] [LOCAL ] BAM: Starting deletion of primary data. [2025-10-28T17:25:32.179184] [DEBUG] [LOCAL ] BAM: Deleted primary data file. [2025-10-28T17:25:32.179242] [INFO ] [MAIN ] BAM: Starting full primary refresh. [2025-10-28T17:25:32.533492] [INFO ] [REMOTE ] BAM: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:25:32.566113] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-10-28T17:25:32.759333] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-01. [2025-10-28T17:25:33.210016] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-28T17:25:33.559335] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-05. [2025-10-28T17:25:33.945887] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-28T17:25:34.035707] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-28T17:25:34.359359] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-02. [2025-10-28T17:25:35.159353] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-06. [2025-10-28T17:25:35.566627] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-28T17:25:35.644119] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-28T17:25:35.959345] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-07. [2025-10-28T17:25:36.737208] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-28T17:25:36.759325] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-08. [2025-10-28T17:25:37.213759] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-28T17:25:37.559346] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-03. [2025-10-28T17:25:38.359382] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-10. [2025-10-28T17:25:38.867039] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-28T17:25:39.159345] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-08. [2025-10-28T17:25:39.959321] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-04. [2025-10-28T17:25:40.410811] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-28T17:25:40.600614] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-10 (2.24 seconds). [2025-10-28T17:25:40.611392] [INFO ] [REMOTE ] BABA: Full fetch complete (78000 records). [2025-10-28T17:25:40.611525] [DEBUG] [VALIDATOR ] BABA: Validating primary data. [2025-10-28T17:25:40.764145] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-09. [2025-10-28T17:25:40.995569] [DEBUG] [VALIDATOR ] BABA: All expected trading days are present. [2025-10-28T17:25:40.995662] [DEBUG] [VALIDATOR ] BABA: Primary data validation passed. [2025-10-28T17:25:40.996410] [INFO ] [MAIN ] BABA: Fetched primary data is valid. [2025-10-28T17:25:40.996452] [DEBUG] [LOCAL ] BABA: Saving primary data. [2025-10-28T17:25:40.997876] [DEBUG] [LOCAL ] BABA: Trimmed 78000 records to 53820 (keeping 200 days of data) [2025-10-28T17:25:41.362094] [DEBUG] [LOCAL ] BABA: Primary data saved (53820 records). [2025-10-28T17:25:41.365512] [INFO ] [MAIN ] BABA: Full history saved. [2025-10-28T17:25:41.365816] [INFO ] [MAIN ] Update Progress: 209/2366 symbols completed. BABA took 53.3s. Estimated remaining: 4h 24m 37s. Rate: 8.2 symbols/min [2025-10-28T17:25:41.378574] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-28T17:25:41.429018] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-28T17:25:41.559736] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-05. [2025-10-28T17:25:41.561192] [INFO ] [MAIN ] BANC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:25:41.610465] [DEBUG] [LOCAL ] BANC: Loaded 51382 existing records from primary storage. [2025-10-28T17:25:41.610882] [INFO ] [MAIN ] BANC: Loaded 51382 existing records. [2025-10-28T17:25:41.790794] [WARN ] [MAIN ] BANC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:25:41.790994] [INFO ] [MAIN ] BANC: Wiping existing primary data before full refresh. [2025-10-28T17:25:41.791041] [INFO ] [LOCAL ] BANC: Starting deletion of primary data. [2025-10-28T17:25:41.791942] [DEBUG] [LOCAL ] BANC: Deleted primary data file. [2025-10-28T17:25:41.791998] [INFO ] [MAIN ] BANC: Starting full primary refresh. [2025-10-28T17:25:42.151022] [INFO ] [REMOTE ] BANC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:25:42.359312] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-01. [2025-10-28T17:25:42.814004] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-28T17:25:43.159338] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-06. [2025-10-28T17:25:43.543143] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-28T17:25:43.959322] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-10. [2025-10-28T17:25:44.605852] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-28T17:25:44.714107] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-28T17:25:44.718417] [INFO ] [REMOTE ] BALY: Full fetch complete (16120 records). [2025-10-28T17:25:44.718496] [DEBUG] [VALIDATOR ] BALY: Validating primary data. [2025-10-28T17:25:44.764592] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-07. [2025-10-28T17:25:44.905667] [WARN ] [VALIDATOR ] BALY: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-28T17:25:44.905964] [FATAL] [MAIN ] BALY: Fetched primary data is invalid. Refusing to save it. [2025-10-28T17:25:44.906032] [WARN ] [MAIN ] BALY: Deleting existing primary and derivative data due to validation failure. [2025-10-28T17:25:44.906105] [INFO ] [LOCAL ] BALY: Starting deletion of primary data. [2025-10-28T17:25:44.906184] [DEBUG] [LOCAL ] BALY: No primary data file found to delete. [2025-10-28T17:25:44.906238] [INFO ] [LOCAL ] BALY: Starting deletion of derivative data. [2025-10-28T17:25:44.906310] [DEBUG] [LOCAL ] BALY: No derivative data file found to delete. [2025-10-28T17:25:44.906392] [INFO ] [MAIN ] Update Progress: 210/2366 symbols completed. BALY took 20.0s. Estimated remaining: 4h 23m 50s. Rate: 8.2 symbols/min [2025-10-28T17:25:45.082141] [INFO ] [MAIN ] BAP: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:25:45.103561] [DEBUG] [LOCAL ] BAP: Loaded 24970 existing records from primary storage. [2025-10-28T17:25:45.103846] [INFO ] [MAIN ] BAP: Loaded 24970 existing records. [2025-10-28T17:25:45.282772] [WARN ] [MAIN ] BAP: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:25:45.282966] [INFO ] [MAIN ] BAP: Wiping existing primary data before full refresh. [2025-10-28T17:25:45.283013] [INFO ] [LOCAL ] BAP: Starting deletion of primary data. [2025-10-28T17:25:45.283484] [DEBUG] [LOCAL ] BAP: Deleted primary data file. [2025-10-28T17:25:45.283540] [INFO ] [MAIN ] BAP: Starting full primary refresh. [2025-10-28T17:25:45.560504] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-02. [2025-10-28T17:25:45.638507] [INFO ] [REMOTE ] BAP: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:25:46.111565] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-28T17:25:46.359334] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-01. [2025-10-28T17:25:46.696598] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-28T17:25:47.159331] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-03. [2025-10-28T17:25:47.361943] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-28T17:25:47.959324] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-02. [2025-10-28T17:25:48.395220] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-28T17:25:48.759323] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-04. [2025-10-28T17:25:48.851513] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-28T17:25:49.559349] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-03. [2025-10-28T17:25:50.139963] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-28T17:25:50.361547] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-05. [2025-10-28T17:25:50.365781] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-28T17:25:51.159395] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-08. [2025-10-28T17:25:51.705154] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-28T17:25:51.959354] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-04. [2025-10-28T17:25:52.446622] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-28T17:25:52.759304] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-09. [2025-10-28T17:25:52.891481] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-28T17:25:53.559322] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-06. [2025-10-28T17:25:54.015566] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-28T17:25:54.359367] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-05. [2025-10-28T17:25:55.019271] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-28T17:25:55.159334] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-07. [2025-10-28T17:25:55.556820] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-28T17:25:55.959342] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-09. [2025-10-28T17:25:56.309506] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-28T17:25:56.759332] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-08. [2025-10-28T17:25:57.116186] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-28T17:25:57.559342] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-06. [2025-10-28T17:25:57.813130] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-28T17:25:58.359374] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-10. [2025-10-28T17:25:58.441710] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-28T17:25:59.159321] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-07. [2025-10-28T17:25:59.748026] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-28T17:25:59.760084] [INFO ] [REMOTE ] BALL: Full fetch complete (75614 records). [2025-10-28T17:25:59.760273] [DEBUG] [VALIDATOR ] BALL: Validating primary data. [2025-10-28T17:25:59.970515] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-09. [2025-10-28T17:26:00.182135] [DEBUG] [VALIDATOR ] BALL: All expected trading days are present. [2025-10-28T17:26:00.190176] [DEBUG] [VALIDATOR ] BALL: Primary data validation passed. [2025-10-28T17:26:00.191937] [INFO ] [MAIN ] BALL: Fetched primary data is valid. [2025-10-28T17:26:00.207936] [DEBUG] [LOCAL ] BALL: Saving primary data. [2025-10-28T17:26:00.209438] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-28T17:26:00.217738] [DEBUG] [LOCAL ] BALL: Trimmed 75614 records to 51894 (keeping 200 days of data) [2025-10-28T17:26:00.549453] [DEBUG] [LOCAL ] BALL: Primary data saved (51894 records). [2025-10-28T17:26:00.549598] [INFO ] [MAIN ] BALL: Full history saved. [2025-10-28T17:26:00.550068] [INFO ] [MAIN ] Update Progress: 211/2366 symbols completed. BALL took 45.9s. Estimated remaining: 4h 25m 8s. Rate: 8.1 symbols/min [2025-10-28T17:26:00.713915] [INFO ] [MAIN ] BARK: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:26:00.749161] [DEBUG] [LOCAL ] BARK: Loaded 37982 existing records from primary storage. [2025-10-28T17:26:00.749459] [INFO ] [MAIN ] BARK: Loaded 37982 existing records. [2025-10-28T17:26:00.769695] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-10. [2025-10-28T17:26:00.926587] [WARN ] [MAIN ] BARK: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:26:00.926804] [INFO ] [MAIN ] BARK: Wiping existing primary data before full refresh. [2025-10-28T17:26:00.926851] [INFO ] [LOCAL ] BARK: Starting deletion of primary data. [2025-10-28T17:26:00.927485] [DEBUG] [LOCAL ] BARK: Deleted primary data file. [2025-10-28T17:26:00.927542] [INFO ] [MAIN ] BARK: Starting full primary refresh. [2025-10-28T17:26:01.293262] [INFO ] [REMOTE ] BARK: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:26:01.348198] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-28T17:26:01.559328] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-01. [2025-10-28T17:26:02.173335] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-28T17:26:02.183427] [INFO ] [REMOTE ] BAM: Full fetch complete (74924 records). [2025-10-28T17:26:02.183589] [DEBUG] [VALIDATOR ] BAM: Validating primary data. [2025-10-28T17:26:02.184299] [FATAL] [VALIDATOR ] BAM: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T17:26:02.184411] [FATAL] [MAIN ] BAM: Fetched primary data is invalid. Refusing to save it. [2025-10-28T17:26:02.184476] [WARN ] [MAIN ] BAM: Deleting existing primary and derivative data due to validation failure. [2025-10-28T17:26:02.184525] [INFO ] [LOCAL ] BAM: Starting deletion of primary data. [2025-10-28T17:26:02.184596] [DEBUG] [LOCAL ] BAM: No primary data file found to delete. [2025-10-28T17:26:02.184678] [INFO ] [LOCAL ] BAM: Starting deletion of derivative data. [2025-10-28T17:26:02.185384] [DEBUG] [LOCAL ] BAM: Deleted derivative data file. [2025-10-28T17:26:02.185491] [INFO ] [MAIN ] Update Progress: 212/2366 symbols completed. BAM took 30.4s. Estimated remaining: 4h 24m 2s. Rate: 8.2 symbols/min [2025-10-28T17:26:02.357329] [INFO ] [MAIN ] BAX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:26:02.357498] [DEBUG] [LOCAL ] BAX: No existing data file found in primary storage. [2025-10-28T17:26:02.357535] [WARN ] [MAIN ] BAX: No existing data found, performing full refresh instead. [2025-10-28T17:26:02.357674] [INFO ] [MAIN ] BAX: Wiping existing primary data before full refresh. [2025-10-28T17:26:02.357728] [INFO ] [LOCAL ] BAX: Starting deletion of primary data. [2025-10-28T17:26:02.357772] [DEBUG] [LOCAL ] BAX: No primary data file found to delete. [2025-10-28T17:26:02.357805] [INFO ] [MAIN ] BAX: Starting full primary refresh. [2025-10-28T17:26:02.368946] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-08. [2025-10-28T17:26:02.760207] [INFO ] [REMOTE ] BAX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:26:02.765762] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-28T17:26:03.159392] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-01. [2025-10-28T17:26:03.518590] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-28T17:26:03.959402] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-09. [2025-10-28T17:26:04.759318] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-02. [2025-10-28T17:26:04.807458] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-28T17:26:04.882371] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-28T17:26:05.559371] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-10. [2025-10-28T17:26:05.787392] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-28T17:26:06.359343] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-03. [2025-10-28T17:26:06.469528] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-28T17:26:06.474304] [INFO ] [REMOTE ] BAP: Full fetch complete (37178 records). [2025-10-28T17:26:06.474405] [DEBUG] [VALIDATOR ] BAP: Validating primary data. [2025-10-28T17:26:06.847693] [DEBUG] [VALIDATOR ] BAP: All expected trading days are present. [2025-10-28T17:26:06.847778] [DEBUG] [VALIDATOR ] BAP: Primary data validation passed. [2025-10-28T17:26:06.848206] [INFO ] [MAIN ] BAP: Fetched primary data is valid. [2025-10-28T17:26:06.848243] [DEBUG] [LOCAL ] BAP: Saving primary data. [2025-10-28T17:26:06.849072] [DEBUG] [LOCAL ] BAP: Trimmed 37178 records to 24953 (keeping 200 days of data) [2025-10-28T17:26:06.995881] [DEBUG] [LOCAL ] BAP: Primary data saved (24953 records). [2025-10-28T17:26:06.996002] [INFO ] [MAIN ] BAP: Full history saved. [2025-10-28T17:26:06.996086] [INFO ] [MAIN ] Update Progress: 213/2366 symbols completed. BAP took 22.1s. Estimated remaining: 4h 23m 29s. Rate: 8.2 symbols/min [2025-10-28T17:26:07.169758] [INFO ] [MAIN ] BB: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:26:07.166503] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-02. [2025-10-28T17:26:07.218396] [DEBUG] [LOCAL ] BB: Loaded 52860 existing records from primary storage. [2025-10-28T17:26:07.218713] [INFO ] [MAIN ] BB: Loaded 52860 existing records. [2025-10-28T17:26:07.399824] [WARN ] [MAIN ] BB: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:26:07.400101] [INFO ] [MAIN ] BB: Wiping existing primary data before full refresh. [2025-10-28T17:26:07.400154] [INFO ] [LOCAL ] BB: Starting deletion of primary data. [2025-10-28T17:26:07.400562] [DEBUG] [LOCAL ] BB: Deleted primary data file. [2025-10-28T17:26:07.400617] [INFO ] [MAIN ] BB: Starting full primary refresh. [2025-10-28T17:26:07.758699] [INFO ] [REMOTE ] BB: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:26:07.780929] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-28T17:26:07.959318] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-01. [2025-10-28T17:26:08.389355] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-28T17:26:08.759339] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-03. [2025-10-28T17:26:09.358075] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-28T17:26:09.559332] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-02. [2025-10-28T17:26:10.051367] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-28T17:26:10.359333] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-04. [2025-10-28T17:26:11.091022] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-28T17:26:11.159308] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-03. [2025-10-28T17:26:11.707388] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-28T17:26:11.959339] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-04. [2025-10-28T17:26:12.533617] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-28T17:26:12.759313] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-05. [2025-10-28T17:26:12.898025] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-28T17:26:13.559350] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-04. [2025-10-28T17:26:14.206995] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-28T17:26:14.359332] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-06. [2025-10-28T17:26:14.999104] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-28T17:26:15.159341] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-05. [2025-10-28T17:26:15.559287] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-28T17:26:15.959329] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-10. [2025-10-28T17:26:16.424166] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-28T17:26:16.759351] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-06. [2025-10-28T17:26:17.532906] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-28T17:26:17.543699] [INFO ] [REMOTE ] BANC: Full fetch complete (74659 records). [2025-10-28T17:26:17.543854] [DEBUG] [VALIDATOR ] BANC: Validating primary data. [2025-10-28T17:26:17.564953] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-05. [2025-10-28T17:26:17.933934] [DEBUG] [VALIDATOR ] BANC: All expected trading days are present. [2025-10-28T17:26:17.934022] [DEBUG] [VALIDATOR ] BANC: Primary data validation passed. [2025-10-28T17:26:17.934782] [INFO ] [MAIN ] BANC: Fetched primary data is valid. [2025-10-28T17:26:17.934845] [DEBUG] [LOCAL ] BANC: Saving primary data. [2025-10-28T17:26:17.936354] [DEBUG] [LOCAL ] BANC: Trimmed 74659 records to 51376 (keeping 200 days of data) [2025-10-28T17:26:18.245270] [DEBUG] [LOCAL ] BANC: Primary data saved (51376 records). [2025-10-28T17:26:18.245409] [INFO ] [MAIN ] BANC: Full history saved. [2025-10-28T17:26:18.245520] [INFO ] [MAIN ] Update Progress: 214/2366 symbols completed. BANC took 36.9s. Estimated remaining: 4h 24m 1s. Rate: 8.2 symbols/min [2025-10-28T17:26:18.359515] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-07. [2025-10-28T17:26:18.422192] [INFO ] [MAIN ] BBAI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:26:18.451572] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-28T17:26:18.506108] [DEBUG] [LOCAL ] BBAI: Loaded 53820 existing records from primary storage. [2025-10-28T17:26:18.506499] [INFO ] [MAIN ] BBAI: Loaded 53820 existing records. [2025-10-28T17:26:18.702815] [WARN ] [MAIN ] BBAI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:26:18.725058] [INFO ] [MAIN ] BBAI: Wiping existing primary data before full refresh. [2025-10-28T17:26:18.725208] [INFO ] [LOCAL ] BBAI: Starting deletion of primary data. [2025-10-28T17:26:18.726635] [DEBUG] [LOCAL ] BBAI: Deleted primary data file. [2025-10-28T17:26:18.726571] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-28T17:26:18.726874] [INFO ] [MAIN ] BBAI: Starting full primary refresh. [2025-10-28T17:26:19.086396] [INFO ] [REMOTE ] BBAI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:26:19.159307] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-07. [2025-10-28T17:26:19.825757] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-28T17:26:19.959339] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-08. [2025-10-28T17:26:20.579659] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-28T17:26:20.759330] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-01. [2025-10-28T17:26:21.219624] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-28T17:26:21.559333] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-08. [2025-10-28T17:26:22.359392] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-09. [2025-10-28T17:26:22.664335] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-10-28T17:26:22.842420] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-28T17:26:23.159395] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-02. [2025-10-28T17:26:23.919965] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-28T17:26:23.959321] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-10. [2025-10-28T17:26:24.759380] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-09. [2025-10-28T17:26:25.116144] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-10-28T17:26:25.489527] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-28T17:26:25.500809] [INFO ] [REMOTE ] BAX: Full fetch complete (77622 records). [2025-10-28T17:26:25.500963] [DEBUG] [VALIDATOR ] BAX: Validating primary data. [2025-10-28T17:26:25.572957] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-03. [2025-10-28T17:26:25.927385] [DEBUG] [VALIDATOR ] BAX: All expected trading days are present. [2025-10-28T17:26:25.927489] [DEBUG] [VALIDATOR ] BAX: Primary data validation passed. [2025-10-28T17:26:25.928357] [INFO ] [MAIN ] BAX: Fetched primary data is valid. [2025-10-28T17:26:25.928422] [DEBUG] [LOCAL ] BAX: Saving primary data. [2025-10-28T17:26:25.929952] [DEBUG] [LOCAL ] BAX: Trimmed 77622 records to 53536 (keeping 200 days of data) [2025-10-28T17:26:26.264413] [DEBUG] [LOCAL ] BAX: Primary data saved (53536 records). [2025-10-28T17:26:26.264569] [INFO ] [MAIN ] BAX: Full history saved. [2025-10-28T17:26:26.264870] [INFO ] [MAIN ] Update Progress: 215/2366 symbols completed. BAX took 24.1s. Estimated remaining: 4h 24m 0s. Rate: 8.1 symbols/min [2025-10-28T17:26:26.365031] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-06. [2025-10-28T17:26:26.440790] [INFO ] [MAIN ] BBAR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:26:26.474556] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-28T17:26:26.518374] [DEBUG] [LOCAL ] BBAR: Loaded 42596 existing records from primary storage. [2025-10-28T17:26:26.518697] [INFO ] [MAIN ] BBAR: Loaded 42596 existing records. [2025-10-28T17:26:26.706565] [WARN ] [MAIN ] BBAR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:26:26.706907] [INFO ] [MAIN ] BBAR: Wiping existing primary data before full refresh. [2025-10-28T17:26:26.706976] [INFO ] [LOCAL ] BBAR: Starting deletion of primary data. [2025-10-28T17:26:26.707845] [DEBUG] [LOCAL ] BBAR: Deleted primary data file. [2025-10-28T17:26:26.707906] [INFO ] [MAIN ] BBAR: Starting full primary refresh. [2025-10-28T17:26:27.077714] [INFO ] [REMOTE ] BBAR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:26:27.159348] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-10. [2025-10-28T17:26:27.726585] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-10-28T17:26:27.764701] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-28T17:26:27.959325] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-07. [2025-10-28T17:26:28.759350] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-01. [2025-10-28T17:26:28.923630] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-10 (1.76 seconds). [2025-10-28T17:26:28.934450] [INFO ] [REMOTE ] BB: Full fetch complete (76955 records). [2025-10-28T17:26:28.934577] [DEBUG] [VALIDATOR ] BB: Validating primary data. [2025-10-28T17:26:29.305979] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-28T17:26:29.382142] [DEBUG] [VALIDATOR ] BB: All expected trading days are present. [2025-10-28T17:26:29.382225] [DEBUG] [VALIDATOR ] BB: Primary data validation passed. [2025-10-28T17:26:29.383062] [INFO ] [MAIN ] BB: Fetched primary data is valid. [2025-10-28T17:26:29.383129] [DEBUG] [LOCAL ] BB: Saving primary data. [2025-10-28T17:26:29.384708] [DEBUG] [LOCAL ] BB: Trimmed 76955 records to 52857 (keeping 200 days of data) [2025-10-28T17:26:29.560706] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-08. [2025-10-28T17:26:29.705841] [DEBUG] [LOCAL ] BB: Primary data saved (52857 records). [2025-10-28T17:26:29.705991] [INFO ] [MAIN ] BB: Full history saved. [2025-10-28T17:26:29.706102] [INFO ] [MAIN ] Update Progress: 216/2366 symbols completed. BB took 22.7s. Estimated remaining: 4h 23m 14s. Rate: 8.2 symbols/min [2025-10-28T17:26:29.899280] [INFO ] [MAIN ] BBD: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:26:29.950098] [DEBUG] [LOCAL ] BBD: Loaded 53275 existing records from primary storage. [2025-10-28T17:26:29.950406] [INFO ] [MAIN ] BBD: Loaded 53275 existing records. [2025-10-28T17:26:30.150949] [WARN ] [MAIN ] BBD: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:26:30.151294] [INFO ] [MAIN ] BBD: Wiping existing primary data before full refresh. [2025-10-28T17:26:30.151370] [INFO ] [LOCAL ] BBD: Starting deletion of primary data. [2025-10-28T17:26:30.151745] [DEBUG] [LOCAL ] BBD: Deleted primary data file. [2025-10-28T17:26:30.151857] [INFO ] [MAIN ] BBD: Starting full primary refresh. [2025-10-28T17:26:30.376305] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-04. [2025-10-28T17:26:30.407285] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-28T17:26:30.583903] [INFO ] [REMOTE ] BBD: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:26:30.604964] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-28T17:26:31.159341] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-02. [2025-10-28T17:26:31.959339] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-09. [2025-10-28T17:26:32.190081] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-28T17:26:32.248127] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-10-28T17:26:32.759312] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-01. [2025-10-28T17:26:32.833310] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-28T17:26:33.559338] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-05. [2025-10-28T17:26:34.370169] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-03. [2025-10-28T17:26:34.374473] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-28T17:26:35.159323] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-02. [2025-10-28T17:26:35.475218] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-28T17:26:35.697253] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-10-28T17:26:35.959328] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-04. [2025-10-28T17:26:36.382680] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-28T17:26:36.759324] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-10. [2025-10-28T17:26:36.921595] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-28T17:26:37.559339] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-06. [2025-10-28T17:26:37.977091] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-28T17:26:37.988108] [INFO ] [REMOTE ] BARK: Full fetch complete (55853 records). [2025-10-28T17:26:37.988229] [DEBUG] [VALIDATOR ] BARK: Validating primary data. [2025-10-28T17:26:38.357386] [DEBUG] [VALIDATOR ] BARK: All expected trading days are present. [2025-10-28T17:26:38.357469] [DEBUG] [VALIDATOR ] BARK: Primary data validation passed. [2025-10-28T17:26:38.358067] [INFO ] [MAIN ] BARK: Fetched primary data is valid. [2025-10-28T17:26:38.358129] [DEBUG] [LOCAL ] BARK: Saving primary data. [2025-10-28T17:26:38.359266] [DEBUG] [LOCAL ] BARK: Trimmed 55853 records to 38013 (keeping 200 days of data) [2025-10-28T17:26:38.359601] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-03. [2025-10-28T17:26:38.571135] [DEBUG] [LOCAL ] BARK: Primary data saved (38013 records). [2025-10-28T17:26:38.571267] [INFO ] [MAIN ] BARK: Full history saved. [2025-10-28T17:26:38.571817] [INFO ] [MAIN ] Update Progress: 217/2366 symbols completed. BARK took 38.0s. Estimated remaining: 4h 23m 21s. Rate: 8.2 symbols/min [2025-10-28T17:26:38.736930] [INFO ] [MAIN ] BBDC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:26:38.769971] [DEBUG] [LOCAL ] BBDC: Loaded 32408 existing records from primary storage. [2025-10-28T17:26:38.770308] [INFO ] [MAIN ] BBDC: Loaded 32408 existing records. [2025-10-28T17:26:38.942567] [WARN ] [MAIN ] BBDC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:26:38.942781] [INFO ] [MAIN ] BBDC: Wiping existing primary data before full refresh. [2025-10-28T17:26:38.942827] [INFO ] [LOCAL ] BBDC: Starting deletion of primary data. [2025-10-28T17:26:38.943466] [DEBUG] [LOCAL ] BBDC: Deleted primary data file. [2025-10-28T17:26:38.943523] [INFO ] [MAIN ] BBDC: Starting full primary refresh. [2025-10-28T17:26:39.176209] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-05. [2025-10-28T17:26:39.287661] [INFO ] [REMOTE ] BBDC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:26:39.566624] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-28T17:26:39.662874] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-10-28T17:26:39.959331] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-07. [2025-10-28T17:26:40.759303] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-01. [2025-10-28T17:26:40.912972] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-28T17:26:41.559317] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-06. [2025-10-28T17:26:41.745123] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-28T17:26:42.031598] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-28T17:26:42.359345] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-02. [2025-10-28T17:26:42.615600] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-28T17:26:43.160807] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-04. [2025-10-28T17:26:43.301597] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-28T17:26:43.959357] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-03. [2025-10-28T17:26:44.443320] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-28T17:26:44.759349] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-05. [2025-10-28T17:26:45.164196] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-28T17:26:45.559345] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-04. [2025-10-28T17:26:46.359327] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-07. [2025-10-28T17:26:46.483609] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-28T17:26:46.496054] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-28T17:26:47.159382] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-06. [2025-10-28T17:26:47.420878] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-28T17:26:47.959409] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-08. [2025-10-28T17:26:48.306405] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-28T17:26:48.759319] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-08. [2025-10-28T17:26:48.967795] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-28T17:26:49.559380] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-07. [2025-10-28T17:26:50.359381] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-09. [2025-10-28T17:26:50.822288] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-28T17:26:50.934081] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-10-28T17:26:51.159368] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-09. [2025-10-28T17:26:51.575323] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-28T17:26:51.959406] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-08. [2025-10-28T17:26:52.759335] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-10. [2025-10-28T17:26:53.060877] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-28T17:26:53.353967] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-28T17:26:53.559346] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-09. [2025-10-28T17:26:54.155396] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-28T17:26:54.165561] [INFO ] [REMOTE ] BBAR: Full fetch complete (61276 records). [2025-10-28T17:26:54.165728] [DEBUG] [VALIDATOR ] BBAR: Validating primary data. [2025-10-28T17:26:54.369025] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-10. [2025-10-28T17:26:54.564174] [DEBUG] [VALIDATOR ] BBAR: All expected trading days are present. [2025-10-28T17:26:54.564256] [DEBUG] [VALIDATOR ] BBAR: Primary data validation passed. [2025-10-28T17:26:54.564919] [INFO ] [MAIN ] BBAR: Fetched primary data is valid. [2025-10-28T17:26:54.564981] [DEBUG] [LOCAL ] BBAR: Saving primary data. [2025-10-28T17:26:54.566207] [DEBUG] [LOCAL ] BBAR: Trimmed 61276 records to 42680 (keeping 200 days of data) [2025-10-28T17:26:54.818694] [DEBUG] [LOCAL ] BBAR: Primary data saved (42680 records). [2025-10-28T17:26:54.818819] [INFO ] [MAIN ] BBAR: Full history saved. [2025-10-28T17:26:54.818936] [INFO ] [MAIN ] Update Progress: 218/2366 symbols completed. BBAR took 28.6s. Estimated remaining: 4h 24m 42s. Rate: 8.1 symbols/min [2025-10-28T17:26:54.987111] [INFO ] [MAIN ] BBDO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:26:54.987390] [DEBUG] [LOCAL ] BBDO: No existing data file found in primary storage. [2025-10-28T17:26:54.987548] [WARN ] [MAIN ] BBDO: No existing data found, performing full refresh instead. [2025-10-28T17:26:54.987770] [INFO ] [MAIN ] BBDO: Wiping existing primary data before full refresh. [2025-10-28T17:26:54.987868] [INFO ] [LOCAL ] BBDO: Starting deletion of primary data. [2025-10-28T17:26:54.987982] [DEBUG] [LOCAL ] BBDO: No primary data file found to delete. [2025-10-28T17:26:54.988049] [INFO ] [MAIN ] BBDO: Starting full primary refresh. [2025-10-28T17:26:55.161317] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-05. [2025-10-28T17:26:55.324061] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-28T17:26:55.401634] [INFO ] [REMOTE ] BBDO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:26:55.959391] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-01. [2025-10-28T17:26:56.251050] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-28T17:26:56.509541] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-28T17:26:56.759316] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-06. [2025-10-28T17:26:56.863153] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-10 (2.49 seconds). [2025-10-28T17:26:56.874163] [INFO ] [REMOTE ] BBAI: Full fetch complete (78000 records). [2025-10-28T17:26:56.874327] [DEBUG] [VALIDATOR ] BBAI: Validating primary data. [2025-10-28T17:26:57.259541] [DEBUG] [VALIDATOR ] BBAI: All expected trading days are present. [2025-10-28T17:26:57.259615] [DEBUG] [VALIDATOR ] BBAI: Primary data validation passed. [2025-10-28T17:26:57.260321] [INFO ] [MAIN ] BBAI: Fetched primary data is valid. [2025-10-28T17:26:57.260378] [DEBUG] [LOCAL ] BBAI: Saving primary data. [2025-10-28T17:26:57.261739] [DEBUG] [LOCAL ] BBAI: Trimmed 78000 records to 53820 (keeping 200 days of data) [2025-10-28T17:26:57.560541] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-02. [2025-10-28T17:26:57.570312] [DEBUG] [LOCAL ] BBAI: Primary data saved (53820 records). [2025-10-28T17:26:57.570413] [INFO ] [MAIN ] BBAI: Full history saved. [2025-10-28T17:26:57.570511] [INFO ] [MAIN ] Update Progress: 219/2366 symbols completed. BBAI took 39.3s. Estimated remaining: 4h 23m 49s. Rate: 8.1 symbols/min [2025-10-28T17:26:57.758350] [INFO ] [MAIN ] BBN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:26:57.758800] [DEBUG] [LOCAL ] BBN: No existing data file found in primary storage. [2025-10-28T17:26:57.758860] [WARN ] [MAIN ] BBN: No existing data found, performing full refresh instead. [2025-10-28T17:26:57.777786] [INFO ] [MAIN ] BBN: Wiping existing primary data before full refresh. [2025-10-28T17:26:57.777911] [INFO ] [LOCAL ] BBN: Starting deletion of primary data. [2025-10-28T17:26:57.777998] [DEBUG] [LOCAL ] BBN: No primary data file found to delete. [2025-10-28T17:26:57.778599] [INFO ] [MAIN ] BBN: Starting full primary refresh. [2025-10-28T17:26:57.779358] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-28T17:26:58.090572] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-28T17:26:58.172178] [INFO ] [REMOTE ] BBN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:26:58.359356] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-07. [2025-10-28T17:26:59.159324] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-10. [2025-10-28T17:26:59.409209] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-28T17:26:59.959325] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-08. [2025-10-28T17:27:00.470476] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-28T17:27:00.481114] [INFO ] [REMOTE ] BBD: Full fetch complete (77272 records). [2025-10-28T17:27:00.481230] [DEBUG] [VALIDATOR ] BBD: Validating primary data. [2025-10-28T17:27:00.765500] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-03. [2025-10-28T17:27:00.870421] [DEBUG] [VALIDATOR ] BBD: All expected trading days are present. [2025-10-28T17:27:00.870575] [DEBUG] [VALIDATOR ] BBD: Primary data validation passed. [2025-10-28T17:27:00.871351] [INFO ] [MAIN ] BBD: Fetched primary data is valid. [2025-10-28T17:27:00.871415] [DEBUG] [LOCAL ] BBD: Saving primary data. [2025-10-28T17:27:00.872786] [DEBUG] [LOCAL ] BBD: Trimmed 77272 records to 53278 (keeping 200 days of data) [2025-10-28T17:27:00.994105] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-28T17:27:01.202513] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-28T17:27:01.218089] [DEBUG] [LOCAL ] BBD: Primary data saved (53278 records). [2025-10-28T17:27:01.218231] [INFO ] [MAIN ] BBD: Full history saved. [2025-10-28T17:27:01.218310] [INFO ] [MAIN ] Update Progress: 220/2366 symbols completed. BBD took 31.5s. Estimated remaining: 4h 23m 5s. Rate: 8.2 symbols/min [2025-10-28T17:27:01.398382] [INFO ] [MAIN ] BBT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:27:01.398580] [DEBUG] [LOCAL ] BBT: No existing data file found in primary storage. [2025-10-28T17:27:01.398620] [WARN ] [MAIN ] BBT: No existing data found, performing full refresh instead. [2025-10-28T17:27:01.398753] [INFO ] [MAIN ] BBT: Wiping existing primary data before full refresh. [2025-10-28T17:27:01.398794] [INFO ] [LOCAL ] BBT: Starting deletion of primary data. [2025-10-28T17:27:01.398835] [DEBUG] [LOCAL ] BBT: No primary data file found to delete. [2025-10-28T17:27:01.398868] [INFO ] [MAIN ] BBT: Starting full primary refresh. [2025-10-28T17:27:01.573315] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-01. [2025-10-28T17:27:01.793437] [INFO ] [REMOTE ] BBT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:27:02.359332] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-09. [2025-10-28T17:27:02.450233] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-28T17:27:03.159348] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-04. [2025-10-28T17:27:03.448316] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-28T17:27:03.542560] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-10-28T17:27:03.959336] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-01. [2025-10-28T17:27:04.181344] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-28T17:27:04.181697] [WARN ] [REMOTE ] BBT: No data returned for month 2025-01 [2025-10-28T17:27:04.181799] [FATAL] [REMOTE ] BBT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-28T17:27:04.181890] [FATAL] [MAIN ] BBT: Failed to fetch primary data. [2025-10-28T17:27:04.181973] [WARN ] [MAIN ] BBT: Deleting existing primary and derivative data due to fetch failure. [2025-10-28T17:27:04.182063] [INFO ] [LOCAL ] BBT: Starting deletion of primary data. [2025-10-28T17:27:04.182147] [DEBUG] [LOCAL ] BBT: No primary data file found to delete. [2025-10-28T17:27:04.182185] [INFO ] [LOCAL ] BBT: Starting deletion of derivative data. [2025-10-28T17:27:04.182223] [DEBUG] [LOCAL ] BBT: No derivative data file found to delete. [2025-10-28T17:27:04.182268] [INFO ] [MAIN ] Update Progress: 221/2366 symbols completed. BBT took 3.0s. Estimated remaining: 4h 22m 15s. Rate: 8.2 symbols/min [2025-10-28T17:27:04.357599] [INFO ] [MAIN ] BBU: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:27:04.364726] [DEBUG] [LOCAL ] BBU: Loaded 5811 existing records from primary storage. [2025-10-28T17:27:04.364880] [INFO ] [MAIN ] BBU: Loaded 5811 existing records. [2025-10-28T17:27:04.536594] [WARN ] [MAIN ] BBU: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:27:04.536815] [INFO ] [MAIN ] BBU: Wiping existing primary data before full refresh. [2025-10-28T17:27:04.536875] [INFO ] [LOCAL ] BBU: Starting deletion of primary data. [2025-10-28T17:27:04.537014] [DEBUG] [LOCAL ] BBU: Deleted primary data file. [2025-10-28T17:27:04.537054] [INFO ] [MAIN ] BBU: Starting full primary refresh. [2025-10-28T17:27:04.766328] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-05. [2025-10-28T17:27:04.881753] [INFO ] [REMOTE ] BBU: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:27:05.223566] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-28T17:27:05.559341] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-10. [2025-10-28T17:27:06.359349] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-06. [2025-10-28T17:27:06.931479] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-28T17:27:06.932297] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-28T17:27:06.942085] [INFO ] [REMOTE ] BBDC: Full fetch complete (48844 records). [2025-10-28T17:27:06.942536] [DEBUG] [VALIDATOR ] BBDC: Validating primary data. [2025-10-28T17:27:07.164481] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-07. [2025-10-28T17:27:07.318575] [DEBUG] [VALIDATOR ] BBDC: All expected trading days are present. [2025-10-28T17:27:07.318671] [DEBUG] [VALIDATOR ] BBDC: Primary data validation passed. [2025-10-28T17:27:07.319193] [INFO ] [MAIN ] BBDC: Fetched primary data is valid. [2025-10-28T17:27:07.319233] [DEBUG] [LOCAL ] BBDC: Saving primary data. [2025-10-28T17:27:07.320142] [DEBUG] [LOCAL ] BBDC: Trimmed 48844 records to 32318 (keeping 200 days of data) [2025-10-28T17:27:07.502461] [DEBUG] [LOCAL ] BBDC: Primary data saved (32318 records). [2025-10-28T17:27:07.502587] [INFO ] [MAIN ] BBDC: Full history saved. [2025-10-28T17:27:07.503233] [INFO ] [MAIN ] Update Progress: 222/2366 symbols completed. BBDC took 28.9s. Estimated remaining: 4h 21m 29s. Rate: 8.2 symbols/min [2025-10-28T17:27:07.618375] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-28T17:27:07.675683] [INFO ] [MAIN ] BBUC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:27:07.691177] [DEBUG] [LOCAL ] BBUC: Loaded 13766 existing records from primary storage. [2025-10-28T17:27:07.691386] [INFO ] [MAIN ] BBUC: Loaded 13766 existing records. [2025-10-28T17:27:07.864240] [WARN ] [MAIN ] BBUC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:27:07.864406] [INFO ] [MAIN ] BBUC: Wiping existing primary data before full refresh. [2025-10-28T17:27:07.864454] [INFO ] [LOCAL ] BBUC: Starting deletion of primary data. [2025-10-28T17:27:07.864670] [DEBUG] [LOCAL ] BBUC: Deleted primary data file. [2025-10-28T17:27:07.864729] [INFO ] [MAIN ] BBUC: Starting full primary refresh. [2025-10-28T17:27:07.964537] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-08. [2025-10-28T17:27:08.216450] [INFO ] [REMOTE ] BBUC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:27:08.331763] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-10-28T17:27:08.759322] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-01. [2025-10-28T17:27:09.384964] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-28T17:27:09.559351] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-09. [2025-10-28T17:27:09.931819] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-10-28T17:27:10.359356] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-02. [2025-10-28T17:27:10.882674] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-28T17:27:11.159383] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-01. [2025-10-28T17:27:11.609289] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-28T17:27:11.959359] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-10. [2025-10-28T17:27:12.412354] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-28T17:27:12.414095] [INFO ] [REMOTE ] BBDO: Full fetch complete (7422 records). [2025-10-28T17:27:12.414169] [DEBUG] [VALIDATOR ] BBDO: Validating primary data. [2025-10-28T17:27:12.769389] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-02. [2025-10-28T17:27:12.801982] [DEBUG] [VALIDATOR ] BBDO: All expected trading days are present. [2025-10-28T17:27:12.802039] [DEBUG] [VALIDATOR ] BBDO: Primary data validation passed. [2025-10-28T17:27:12.802249] [INFO ] [MAIN ] BBDO: Fetched primary data is valid. [2025-10-28T17:27:12.802289] [DEBUG] [LOCAL ] BBDO: Saving primary data. [2025-10-28T17:27:12.802692] [DEBUG] [LOCAL ] BBDO: Trimmed 7422 records to 4822 (keeping 200 days of data) [2025-10-28T17:27:12.830043] [DEBUG] [LOCAL ] BBDO: Primary data saved (4822 records). [2025-10-28T17:27:12.830123] [INFO ] [MAIN ] BBDO: Full history saved. [2025-10-28T17:27:12.830186] [INFO ] [MAIN ] Update Progress: 223/2366 symbols completed. BBDO took 18.0s. Estimated remaining: 4h 21m 2s. Rate: 8.2 symbols/min [2025-10-28T17:27:13.033998] [INFO ] [MAIN ] BBVA: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:27:13.077113] [DEBUG] [LOCAL ] BBVA: Loaded 48999 existing records from primary storage. [2025-10-28T17:27:13.077444] [INFO ] [MAIN ] BBVA: Loaded 48999 existing records. [2025-10-28T17:27:13.265729] [WARN ] [MAIN ] BBVA: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:27:13.266072] [INFO ] [MAIN ] BBVA: Wiping existing primary data before full refresh. [2025-10-28T17:27:13.266153] [INFO ] [LOCAL ] BBVA: Starting deletion of primary data. [2025-10-28T17:27:13.267155] [DEBUG] [LOCAL ] BBVA: Deleted primary data file. [2025-10-28T17:27:13.267248] [INFO ] [MAIN ] BBVA: Starting full primary refresh. [2025-10-28T17:27:13.564000] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-02. [2025-10-28T17:27:13.645806] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-28T17:27:13.645472] [INFO ] [REMOTE ] BBVA: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:27:13.976495] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-28T17:27:14.359346] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-03. [2025-10-28T17:27:14.949769] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-28T17:27:15.159330] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-04. [2025-10-28T17:27:15.959352] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-01. [2025-10-28T17:27:16.238355] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-28T17:27:16.759381] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-03. [2025-10-28T17:27:17.214120] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-28T17:27:17.444225] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-28T17:27:17.559355] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-05. [2025-10-28T17:27:18.365361] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-03. [2025-10-28T17:27:18.368046] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-28T17:27:18.670940] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-03 (0.31 seconds). [2025-10-28T17:27:19.159383] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-04. [2025-10-28T17:27:19.463966] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-04 (0.30 seconds). [2025-10-28T17:27:19.959355] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-05. [2025-10-28T17:27:20.400825] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-28T17:27:20.759339] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-06. [2025-10-28T17:27:21.036635] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-06 (0.28 seconds). [2025-10-28T17:27:21.559365] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-02. [2025-10-28T17:27:22.359408] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-04. [2025-10-28T17:27:22.990716] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-28T17:27:23.159326] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-07. [2025-10-28T17:27:23.352773] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-28T17:27:23.640582] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-28T17:27:23.959355] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-06. [2025-10-28T17:27:24.641371] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-28T17:27:24.759383] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-05. [2025-10-28T17:27:25.312819] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-28T17:27:25.559353] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-03. [2025-10-28T17:27:26.359385] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-08. [2025-10-28T17:27:26.915733] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-28T17:27:26.917306] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-28T17:27:27.159347] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-04. [2025-10-28T17:27:27.959354] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-09. [2025-10-28T17:27:28.399397] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-28T17:27:28.417572] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-28T17:27:28.759375] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-05. [2025-10-28T17:27:29.559398] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-07. [2025-10-28T17:27:29.950390] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-28T17:27:30.216973] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-28T17:27:30.359387] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-08. [2025-10-28T17:27:31.054102] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-28T17:27:31.159341] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-06. [2025-10-28T17:27:31.959363] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-09. [2025-10-28T17:27:32.437990] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-28T17:27:32.651820] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-28T17:27:32.759345] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-06. [2025-10-28T17:27:33.454579] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-28T17:27:33.559313] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-07. [2025-10-28T17:27:34.359370] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-10. [2025-10-28T17:27:35.164406] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-07. [2025-10-28T17:27:35.184265] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-28T17:27:35.204104] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-28T17:27:35.207247] [INFO ] [REMOTE ] BBN: Full fetch complete (24922 records). [2025-10-28T17:27:35.207323] [DEBUG] [VALIDATOR ] BBN: Validating primary data. [2025-10-28T17:27:35.583507] [DEBUG] [VALIDATOR ] BBN: All expected trading days are present. [2025-10-28T17:27:35.583581] [DEBUG] [VALIDATOR ] BBN: Primary data validation passed. [2025-10-28T17:27:35.583943] [INFO ] [MAIN ] BBN: Fetched primary data is valid. [2025-10-28T17:27:35.584003] [DEBUG] [LOCAL ] BBN: Saving primary data. [2025-10-28T17:27:35.584585] [DEBUG] [LOCAL ] BBN: Trimmed 24922 records to 17318 (keeping 200 days of data) [2025-10-28T17:27:35.686176] [DEBUG] [LOCAL ] BBN: Primary data saved (17318 records). [2025-10-28T17:27:35.686309] [INFO ] [MAIN ] BBN: Full history saved. [2025-10-28T17:27:35.686380] [INFO ] [MAIN ] Update Progress: 224/2366 symbols completed. BBN took 38.1s. Estimated remaining: 4h 23m 24s. Rate: 8.1 symbols/min [2025-10-28T17:27:35.870901] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-28T17:27:35.870550] [INFO ] [MAIN ] BBW: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:27:35.899529] [DEBUG] [LOCAL ] BBW: Loaded 26942 existing records from primary storage. [2025-10-28T17:27:35.899794] [INFO ] [MAIN ] BBW: Loaded 26942 existing records. [2025-10-28T17:27:35.964404] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-10. [2025-10-28T17:27:36.076935] [WARN ] [MAIN ] BBW: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:27:36.077142] [INFO ] [MAIN ] BBW: Wiping existing primary data before full refresh. [2025-10-28T17:27:36.079697] [INFO ] [LOCAL ] BBW: Starting deletion of primary data. [2025-10-28T17:27:36.080100] [DEBUG] [LOCAL ] BBW: Deleted primary data file. [2025-10-28T17:27:36.080170] [INFO ] [MAIN ] BBW: Starting full primary refresh. [2025-10-28T17:27:36.432747] [INFO ] [REMOTE ] BBW: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:27:36.759326] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-08. [2025-10-28T17:27:36.788127] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-28T17:27:36.790975] [INFO ] [REMOTE ] BBU: Full fetch complete (7611 records). [2025-10-28T17:27:36.791056] [DEBUG] [VALIDATOR ] BBU: Validating primary data. [2025-10-28T17:27:37.156124] [DEBUG] [VALIDATOR ] BBU: All expected trading days are present. [2025-10-28T17:27:37.156198] [DEBUG] [VALIDATOR ] BBU: Primary data validation passed. [2025-10-28T17:27:37.156389] [INFO ] [MAIN ] BBU: Fetched primary data is valid. [2025-10-28T17:27:37.156427] [DEBUG] [LOCAL ] BBU: Saving primary data. [2025-10-28T17:27:37.156838] [DEBUG] [LOCAL ] BBU: Trimmed 7611 records to 5867 (keeping 200 days of data) [2025-10-28T17:27:37.190434] [DEBUG] [LOCAL ] BBU: Primary data saved (5867 records). [2025-10-28T17:27:37.190575] [INFO ] [MAIN ] BBU: Full history saved. [2025-10-28T17:27:37.190711] [INFO ] [MAIN ] Update Progress: 225/2366 symbols completed. BBU took 33.0s. Estimated remaining: 4h 22m 21s. Rate: 8.2 symbols/min [2025-10-28T17:27:37.360823] [INFO ] [MAIN ] BBWI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:27:37.408171] [DEBUG] [LOCAL ] BBWI: Loaded 53591 existing records from primary storage. [2025-10-28T17:27:37.408460] [INFO ] [MAIN ] BBWI: Loaded 53591 existing records. [2025-10-28T17:27:37.562277] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-08. [2025-10-28T17:27:37.586818] [WARN ] [MAIN ] BBWI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:27:37.587059] [INFO ] [MAIN ] BBWI: Wiping existing primary data before full refresh. [2025-10-28T17:27:37.587110] [INFO ] [LOCAL ] BBWI: Starting deletion of primary data. [2025-10-28T17:27:37.587550] [DEBUG] [LOCAL ] BBWI: Deleted primary data file. [2025-10-28T17:27:37.587608] [INFO ] [MAIN ] BBWI: Starting full primary refresh. [2025-10-28T17:27:37.944745] [INFO ] [REMOTE ] BBWI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:27:38.123284] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-28T17:27:38.167386] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-28T17:27:38.359341] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-01. [2025-10-28T17:27:39.159318] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-09. [2025-10-28T17:27:39.813497] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-28T17:27:39.833922] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-28T17:27:39.959329] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-02. [2025-10-28T17:27:40.759344] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-01. [2025-10-28T17:27:41.346064] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-28T17:27:41.559347] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-03. [2025-10-28T17:27:41.691344] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-28T17:27:42.359350] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-10. [2025-10-28T17:27:43.023129] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-28T17:27:43.159328] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-02. [2025-10-28T17:27:43.200333] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-28T17:27:43.204318] [INFO ] [REMOTE ] BBUC: Full fetch complete (19350 records). [2025-10-28T17:27:43.204389] [DEBUG] [VALIDATOR ] BBUC: Validating primary data. [2025-10-28T17:27:43.562720] [DEBUG] [VALIDATOR ] BBUC: All expected trading days are present. [2025-10-28T17:27:43.562829] [DEBUG] [VALIDATOR ] BBUC: Primary data validation passed. [2025-10-28T17:27:43.563149] [INFO ] [MAIN ] BBUC: Fetched primary data is valid. [2025-10-28T17:27:43.563226] [DEBUG] [LOCAL ] BBUC: Saving primary data. [2025-10-28T17:27:43.563930] [DEBUG] [LOCAL ] BBUC: Trimmed 19350 records to 13766 (keeping 200 days of data) [2025-10-28T17:27:43.644766] [DEBUG] [LOCAL ] BBUC: Primary data saved (13766 records). [2025-10-28T17:27:43.644895] [INFO ] [MAIN ] BBUC: Full history saved. [2025-10-28T17:27:43.644971] [INFO ] [MAIN ] Update Progress: 226/2366 symbols completed. BBUC took 36.1s. Estimated remaining: 4h 22m 5s. Rate: 8.2 symbols/min [2025-10-28T17:27:43.811884] [INFO ] [MAIN ] BBY: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:27:43.859733] [DEBUG] [LOCAL ] BBY: Loaded 53430 existing records from primary storage. [2025-10-28T17:27:43.860030] [INFO ] [MAIN ] BBY: Loaded 53430 existing records. [2025-10-28T17:27:43.959779] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-04. [2025-10-28T17:27:44.044113] [WARN ] [MAIN ] BBY: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:27:44.057224] [INFO ] [MAIN ] BBY: Wiping existing primary data before full refresh. [2025-10-28T17:27:44.057430] [INFO ] [LOCAL ] BBY: Starting deletion of primary data. [2025-10-28T17:27:44.058420] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-28T17:27:44.058450] [DEBUG] [LOCAL ] BBY: Deleted primary data file. [2025-10-28T17:27:44.058556] [INFO ] [MAIN ] BBY: Starting full primary refresh. [2025-10-28T17:27:44.422009] [INFO ] [REMOTE ] BBY: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:27:44.759303] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-01. [2025-10-28T17:27:45.236686] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-28T17:27:45.559327] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-03. [2025-10-28T17:27:46.100252] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-28T17:27:46.359326] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-05. [2025-10-28T17:27:46.401202] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-28T17:27:47.159344] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-04. [2025-10-28T17:27:47.828078] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-28T17:27:47.959305] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-06. [2025-10-28T17:27:48.105174] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-28T17:27:48.759346] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-02. [2025-10-28T17:27:49.057468] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-28T17:27:49.559409] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-09. [2025-10-28T17:27:50.019180] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-28T17:27:50.359349] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-05. [2025-10-28T17:27:50.972482] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-28T17:27:51.050910] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-28T17:27:51.159455] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-07. [2025-10-28T17:27:51.959350] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-06. [2025-10-28T17:27:52.738223] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-28T17:27:52.759320] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-07. [2025-10-28T17:27:52.956059] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-28T17:27:53.487453] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-28T17:27:53.559339] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-08. [2025-10-28T17:27:54.359339] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-10. [2025-10-28T17:27:54.795385] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-28T17:27:55.159402] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-08. [2025-10-28T17:27:55.875445] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-28T17:27:55.888924] [INFO ] [REMOTE ] BBVA: Full fetch complete (71547 records). [2025-10-28T17:27:55.889110] [DEBUG] [VALIDATOR ] BBVA: Validating primary data. [2025-10-28T17:27:55.889867] [FATAL] [VALIDATOR ] BBVA: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T17:27:55.889953] [FATAL] [MAIN ] BBVA: Fetched primary data is invalid. Refusing to save it. [2025-10-28T17:27:55.890017] [WARN ] [MAIN ] BBVA: Deleting existing primary and derivative data due to validation failure. [2025-10-28T17:27:55.890065] [INFO ] [LOCAL ] BBVA: Starting deletion of primary data. [2025-10-28T17:27:55.890122] [DEBUG] [LOCAL ] BBVA: No primary data file found to delete. [2025-10-28T17:27:55.890157] [INFO ] [LOCAL ] BBVA: Starting deletion of derivative data. [2025-10-28T17:27:55.890315] [DEBUG] [LOCAL ] BBVA: Deleted derivative data file. [2025-10-28T17:27:55.890391] [INFO ] [MAIN ] Update Progress: 227/2366 symbols completed. BBVA took 43.1s. Estimated remaining: 4h 22m 44s. Rate: 8.1 symbols/min [2025-10-28T17:27:55.964601] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-09. [2025-10-28T17:27:56.078768] [INFO ] [MAIN ] BC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:27:56.097094] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-28T17:27:56.138097] [DEBUG] [LOCAL ] BC: Loaded 43867 existing records from primary storage. [2025-10-28T17:27:56.138418] [INFO ] [MAIN ] BC: Loaded 43867 existing records. [2025-10-28T17:27:56.321765] [WARN ] [MAIN ] BC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:27:56.321970] [INFO ] [MAIN ] BC: Wiping existing primary data before full refresh. [2025-10-28T17:27:56.322016] [INFO ] [LOCAL ] BC: Starting deletion of primary data. [2025-10-28T17:27:56.322486] [DEBUG] [LOCAL ] BC: Deleted primary data file. [2025-10-28T17:27:56.322544] [INFO ] [MAIN ] BC: Starting full primary refresh. [2025-10-28T17:27:56.681504] [INFO ] [REMOTE ] BC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:27:56.759351] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-03. [2025-10-28T17:27:57.306438] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-28T17:27:57.559397] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-09. [2025-10-28T17:27:58.124778] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-28T17:27:58.359488] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-04. [2025-10-28T17:27:58.633883] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-28T17:27:59.159335] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-01. [2025-10-28T17:27:59.959388] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-10. [2025-10-28T17:28:00.034177] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-28T17:28:00.309883] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-28T17:28:00.759407] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-05. [2025-10-28T17:28:01.559332] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-02. [2025-10-28T17:28:01.682318] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-28T17:28:01.693506] [INFO ] [REMOTE ] BBWI: Full fetch complete (77636 records). [2025-10-28T17:28:01.693717] [DEBUG] [VALIDATOR ] BBWI: Validating primary data. [2025-10-28T17:28:02.106980] [DEBUG] [VALIDATOR ] BBWI: All expected trading days are present. [2025-10-28T17:28:02.107157] [DEBUG] [VALIDATOR ] BBWI: Primary data validation passed. [2025-10-28T17:28:02.108067] [INFO ] [MAIN ] BBWI: Fetched primary data is valid. [2025-10-28T17:28:02.108151] [DEBUG] [LOCAL ] BBWI: Saving primary data. [2025-10-28T17:28:02.109817] [DEBUG] [LOCAL ] BBWI: Trimmed 77636 records to 53591 (keeping 200 days of data) [2025-10-28T17:28:02.349771] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-28T17:28:02.364679] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-10. [2025-10-28T17:28:02.478242] [DEBUG] [LOCAL ] BBWI: Primary data saved (53591 records). [2025-10-28T17:28:02.478392] [INFO ] [MAIN ] BBWI: Full history saved. [2025-10-28T17:28:02.478494] [INFO ] [MAIN ] Update Progress: 228/2366 symbols completed. BBWI took 25.3s. Estimated remaining: 4h 22m 29s. Rate: 8.1 symbols/min [2025-10-28T17:28:02.669547] [INFO ] [MAIN ] BCAT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:28:02.695685] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-28T17:28:02.731122] [DEBUG] [LOCAL ] BCAT: Loaded 34005 existing records from primary storage. [2025-10-28T17:28:02.731404] [INFO ] [MAIN ] BCAT: Loaded 34005 existing records. [2025-10-28T17:28:02.910992] [WARN ] [MAIN ] BCAT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:28:02.911137] [INFO ] [MAIN ] BCAT: Wiping existing primary data before full refresh. [2025-10-28T17:28:02.911183] [INFO ] [LOCAL ] BCAT: Starting deletion of primary data. [2025-10-28T17:28:02.911778] [DEBUG] [LOCAL ] BCAT: Deleted primary data file. [2025-10-28T17:28:02.911834] [INFO ] [MAIN ] BCAT: Starting full primary refresh. [2025-10-28T17:28:03.164405] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-06. [2025-10-28T17:28:03.267525] [INFO ] [REMOTE ] BCAT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:28:03.461626] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-28T17:28:03.467880] [INFO ] [REMOTE ] BBW: Full fetch complete (39274 records). [2025-10-28T17:28:03.467962] [DEBUG] [VALIDATOR ] BBW: Validating primary data. [2025-10-28T17:28:03.831478] [DEBUG] [VALIDATOR ] BBW: All expected trading days are present. [2025-10-28T17:28:03.831548] [DEBUG] [VALIDATOR ] BBW: Primary data validation passed. [2025-10-28T17:28:03.831999] [INFO ] [MAIN ] BBW: Fetched primary data is valid. [2025-10-28T17:28:03.832065] [DEBUG] [LOCAL ] BBW: Saving primary data. [2025-10-28T17:28:03.832873] [DEBUG] [LOCAL ] BBW: Trimmed 39274 records to 26874 (keeping 200 days of data) [2025-10-28T17:28:03.966596] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-03. [2025-10-28T17:28:03.991892] [DEBUG] [LOCAL ] BBW: Primary data saved (26874 records). [2025-10-28T17:28:03.991978] [INFO ] [MAIN ] BBW: Full history saved. [2025-10-28T17:28:03.992050] [INFO ] [MAIN ] Update Progress: 229/2366 symbols completed. BBW took 28.3s. Estimated remaining: 4h 21m 27s. Rate: 8.2 symbols/min [2025-10-28T17:28:04.164173] [INFO ] [MAIN ] BCC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:28:04.190572] [DEBUG] [LOCAL ] BCC: Loaded 28474 existing records from primary storage. [2025-10-28T17:28:04.190895] [INFO ] [MAIN ] BCC: Loaded 28474 existing records. [2025-10-28T17:28:04.369260] [WARN ] [MAIN ] BCC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:28:04.369533] [INFO ] [MAIN ] BCC: Wiping existing primary data before full refresh. [2025-10-28T17:28:04.369615] [INFO ] [LOCAL ] BCC: Starting deletion of primary data. [2025-10-28T17:28:04.370329] [DEBUG] [LOCAL ] BCC: Deleted primary data file. [2025-10-28T17:28:04.370390] [INFO ] [MAIN ] BCC: Starting full primary refresh. [2025-10-28T17:28:04.742192] [INFO ] [REMOTE ] BCC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:28:04.771722] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-01. [2025-10-28T17:28:04.777992] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-28T17:28:05.359385] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-28T17:28:05.559402] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-07. [2025-10-28T17:28:05.821373] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-28T17:28:06.359325] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-02. [2025-10-28T17:28:06.951681] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-28T17:28:07.145903] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-28T17:28:07.159299] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-08. [2025-10-28T17:28:07.959390] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-03. [2025-10-28T17:28:08.386132] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-28T17:28:08.759305] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-09. [2025-10-28T17:28:08.884435] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-28T17:28:09.559379] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-01. [2025-10-28T17:28:10.018867] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-28T17:28:10.359323] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-04. [2025-10-28T17:28:10.687286] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-28T17:28:11.159350] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-02. [2025-10-28T17:28:11.593334] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-28T17:28:11.959298] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-04. [2025-10-28T17:28:11.993933] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-28T17:28:12.759494] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-03. [2025-10-28T17:28:12.959776] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-28T17:28:13.559377] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-05. [2025-10-28T17:28:14.082767] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-28T17:28:14.359328] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-10. [2025-10-28T17:28:14.589188] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-28T17:28:15.159329] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-06. [2025-10-28T17:28:15.959340] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-05. [2025-10-28T17:28:16.018905] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-28T17:28:16.030077] [INFO ] [REMOTE ] BBY: Full fetch complete (77412 records). [2025-10-28T17:28:16.030254] [DEBUG] [VALIDATOR ] BBY: Validating primary data. [2025-10-28T17:28:16.440781] [DEBUG] [VALIDATOR ] BBY: All expected trading days are present. [2025-10-28T17:28:16.440937] [DEBUG] [VALIDATOR ] BBY: Primary data validation passed. [2025-10-28T17:28:16.441782] [INFO ] [MAIN ] BBY: Fetched primary data is valid. [2025-10-28T17:28:16.441863] [DEBUG] [LOCAL ] BBY: Saving primary data. [2025-10-28T17:28:16.466424] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-28T17:28:16.475164] [DEBUG] [LOCAL ] BBY: Trimmed 77412 records to 53427 (keeping 200 days of data) [2025-10-28T17:28:16.773281] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-04. [2025-10-28T17:28:16.797435] [DEBUG] [LOCAL ] BBY: Primary data saved (53427 records). [2025-10-28T17:28:16.797715] [INFO ] [MAIN ] BBY: Full history saved. [2025-10-28T17:28:16.798248] [INFO ] [MAIN ] Update Progress: 230/2366 symbols completed. BBY took 33.2s. Estimated remaining: 4h 22m 10s. Rate: 8.1 symbols/min [2025-10-28T17:28:16.975487] [INFO ] [MAIN ] BCE: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:28:16.992229] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-28T17:28:17.039924] [DEBUG] [LOCAL ] BCE: Loaded 52235 existing records from primary storage. [2025-10-28T17:28:17.040214] [INFO ] [MAIN ] BCE: Loaded 52235 existing records. [2025-10-28T17:28:17.221381] [WARN ] [MAIN ] BCE: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:28:17.221563] [INFO ] [MAIN ] BCE: Wiping existing primary data before full refresh. [2025-10-28T17:28:17.221611] [INFO ] [LOCAL ] BCE: Starting deletion of primary data. [2025-10-28T17:28:17.222464] [DEBUG] [LOCAL ] BCE: Deleted primary data file. [2025-10-28T17:28:17.222522] [INFO ] [MAIN ] BCE: Starting full primary refresh. [2025-10-28T17:28:17.570276] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-07. [2025-10-28T17:28:17.574674] [INFO ] [REMOTE ] BCE: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:28:17.744324] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-28T17:28:18.359419] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-06. [2025-10-28T17:28:18.681467] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-28T17:28:19.155497] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-28T17:28:19.160530] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-08. [2025-10-28T17:28:19.959371] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-07. [2025-10-28T17:28:20.062347] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-28T17:28:20.759348] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-09. [2025-10-28T17:28:21.008708] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-28T17:28:21.559353] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-01. [2025-10-28T17:28:21.815484] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-28T17:28:22.359338] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-08. [2025-10-28T17:28:22.868394] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-28T17:28:23.161917] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-05. [2025-10-28T17:28:23.173094] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-28T17:28:23.959340] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-10. [2025-10-28T17:28:24.062343] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-28T17:28:24.759353] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-06. [2025-10-28T17:28:25.088515] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-28T17:28:25.096824] [INFO ] [REMOTE ] BC: Full fetch complete (63879 records). [2025-10-28T17:28:25.096929] [DEBUG] [VALIDATOR ] BC: Validating primary data. [2025-10-28T17:28:25.479850] [DEBUG] [VALIDATOR ] BC: All expected trading days are present. [2025-10-28T17:28:25.479922] [DEBUG] [VALIDATOR ] BC: Primary data validation passed. [2025-10-28T17:28:25.480593] [INFO ] [MAIN ] BC: Fetched primary data is valid. [2025-10-28T17:28:25.480635] [DEBUG] [LOCAL ] BC: Saving primary data. [2025-10-28T17:28:25.481879] [DEBUG] [LOCAL ] BC: Trimmed 63879 records to 43774 (keeping 200 days of data) [2025-10-28T17:28:25.568804] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-09. [2025-10-28T17:28:25.628060] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-28T17:28:25.789287] [DEBUG] [LOCAL ] BC: Primary data saved (43774 records). [2025-10-28T17:28:25.789420] [INFO ] [MAIN ] BC: Full history saved. [2025-10-28T17:28:25.789503] [INFO ] [MAIN ] Update Progress: 231/2366 symbols completed. BC took 29.9s. Estimated remaining: 4h 22m 18s. Rate: 8.1 symbols/min [2025-10-28T17:28:25.956178] [INFO ] [MAIN ] BCH: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:28:25.983386] [DEBUG] [LOCAL ] BCH: Loaded 29646 existing records from primary storage. [2025-10-28T17:28:25.983670] [INFO ] [MAIN ] BCH: Loaded 29646 existing records. [2025-10-28T17:28:26.158799] [WARN ] [MAIN ] BCH: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:28:26.159006] [INFO ] [MAIN ] BCH: Wiping existing primary data before full refresh. [2025-10-28T17:28:26.159052] [INFO ] [LOCAL ] BCH: Starting deletion of primary data. [2025-10-28T17:28:26.159604] [DEBUG] [LOCAL ] BCH: Deleted primary data file. [2025-10-28T17:28:26.159699] [INFO ] [MAIN ] BCH: Starting full primary refresh. [2025-10-28T17:28:26.364514] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-02. [2025-10-28T17:28:26.542102] [INFO ] [REMOTE ] BCH: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:28:26.559825] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-28T17:28:27.159369] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-07. [2025-10-28T17:28:27.601214] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-28T17:28:27.959396] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-10. [2025-10-28T17:28:28.180262] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-28T17:28:28.759329] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-01. [2025-10-28T17:28:29.042068] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-28T17:28:29.048683] [INFO ] [REMOTE ] BCC: Full fetch complete (41771 records). [2025-10-28T17:28:29.048774] [DEBUG] [VALIDATOR ] BCC: Validating primary data. [2025-10-28T17:28:29.415897] [DEBUG] [VALIDATOR ] BCC: All expected trading days are present. [2025-10-28T17:28:29.415970] [DEBUG] [VALIDATOR ] BCC: Primary data validation passed. [2025-10-28T17:28:29.416434] [INFO ] [MAIN ] BCC: Fetched primary data is valid. [2025-10-28T17:28:29.416474] [DEBUG] [LOCAL ] BCC: Saving primary data. [2025-10-28T17:28:29.417434] [DEBUG] [LOCAL ] BCC: Trimmed 41771 records to 28455 (keeping 200 days of data) [2025-10-28T17:28:29.560109] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-03. [2025-10-28T17:28:29.590076] [DEBUG] [LOCAL ] BCC: Primary data saved (28455 records). [2025-10-28T17:28:29.590255] [INFO ] [MAIN ] BCC: Full history saved. [2025-10-28T17:28:29.590395] [INFO ] [MAIN ] Update Progress: 232/2366 symbols completed. BCC took 25.6s. Estimated remaining: 4h 21m 38s. Rate: 8.2 symbols/min [2025-10-28T17:28:29.749218] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-28T17:28:29.776785] [INFO ] [MAIN ] BCO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:28:29.798271] [DEBUG] [LOCAL ] BCO: Loaded 24419 existing records from primary storage. [2025-10-28T17:28:29.798513] [INFO ] [MAIN ] BCO: Loaded 24419 existing records. [2025-10-28T17:28:29.992712] [WARN ] [MAIN ] BCO: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:28:29.992905] [INFO ] [MAIN ] BCO: Wiping existing primary data before full refresh. [2025-10-28T17:28:29.992951] [INFO ] [LOCAL ] BCO: Starting deletion of primary data. [2025-10-28T17:28:29.993496] [DEBUG] [LOCAL ] BCO: Deleted primary data file. [2025-10-28T17:28:29.993553] [INFO ] [MAIN ] BCO: Starting full primary refresh. [2025-10-28T17:28:30.341050] [INFO ] [REMOTE ] BCO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:28:30.359293] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-01. [2025-10-28T17:28:31.166506] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-08. [2025-10-28T17:28:31.173223] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-28T17:28:31.198890] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-28T17:28:31.959370] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-04. [2025-10-28T17:28:32.122771] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-28T17:28:32.759362] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-02. [2025-10-28T17:28:33.194174] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-28T17:28:33.533378] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-28T17:28:33.559309] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-03. [2025-10-28T17:28:34.352996] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-28T17:28:34.359297] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-04. [2025-10-28T17:28:35.159362] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-09. [2025-10-28T17:28:35.365382] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-28T17:28:35.959371] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-05. [2025-10-28T17:28:36.238199] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-28T17:28:36.759356] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-05. [2025-10-28T17:28:37.238199] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-28T17:28:37.559337] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-10. [2025-10-28T17:28:37.670288] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-28T17:28:38.359390] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-06. [2025-10-28T17:28:38.575172] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-28T17:28:38.582282] [INFO ] [REMOTE ] BCAT: Full fetch complete (50058 records). [2025-10-28T17:28:38.582385] [DEBUG] [VALIDATOR ] BCAT: Validating primary data. [2025-10-28T17:28:38.959243] [DEBUG] [VALIDATOR ] BCAT: All expected trading days are present. [2025-10-28T17:28:38.959341] [DEBUG] [VALIDATOR ] BCAT: Primary data validation passed. [2025-10-28T17:28:38.959943] [INFO ] [MAIN ] BCAT: Fetched primary data is valid. [2025-10-28T17:28:38.960004] [DEBUG] [LOCAL ] BCAT: Saving primary data. [2025-10-28T17:28:38.961130] [DEBUG] [LOCAL ] BCAT: Trimmed 50058 records to 33937 (keeping 200 days of data) [2025-10-28T17:28:39.167055] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-02. [2025-10-28T17:28:39.170571] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-28T17:28:39.202707] [DEBUG] [LOCAL ] BCAT: Primary data saved (33937 records). [2025-10-28T17:28:39.202858] [INFO ] [MAIN ] BCAT: Full history saved. [2025-10-28T17:28:39.202941] [INFO ] [MAIN ] Update Progress: 233/2366 symbols completed. BCAT took 36.7s. Estimated remaining: 4h 21m 51s. Rate: 8.1 symbols/min [2025-10-28T17:28:39.380384] [INFO ] [MAIN ] BCS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:28:39.428680] [DEBUG] [LOCAL ] BCS: Loaded 53437 existing records from primary storage. [2025-10-28T17:28:39.429003] [INFO ] [MAIN ] BCS: Loaded 53437 existing records. [2025-10-28T17:28:39.632531] [WARN ] [MAIN ] BCS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:28:39.632765] [INFO ] [MAIN ] BCS: Wiping existing primary data before full refresh. [2025-10-28T17:28:39.632818] [INFO ] [LOCAL ] BCS: Starting deletion of primary data. [2025-10-28T17:28:39.633686] [DEBUG] [LOCAL ] BCS: Deleted primary data file. [2025-10-28T17:28:39.633745] [INFO ] [MAIN ] BCS: Starting full primary refresh. [2025-10-28T17:28:39.960504] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-06. [2025-10-28T17:28:40.049896] [INFO ] [REMOTE ] BCS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:28:40.064295] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-28T17:28:40.759340] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-03. [2025-10-28T17:28:41.534252] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-28T17:28:41.559301] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-07. [2025-10-28T17:28:41.676973] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-28T17:28:42.359388] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-07. [2025-10-28T17:28:42.653632] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-28T17:28:43.159419] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-01. [2025-10-28T17:28:43.311865] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-28T17:28:43.959440] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-08. [2025-10-28T17:28:44.641491] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-28T17:28:44.759384] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-09. [2025-10-28T17:28:45.009479] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-28T17:28:45.554356] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-28T17:28:45.560681] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-08. [2025-10-28T17:28:46.359435] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-04. [2025-10-28T17:28:46.938922] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-28T17:28:47.159335] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-02. [2025-10-28T17:28:47.190089] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-28T17:28:47.959347] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-10. [2025-10-28T17:28:48.426711] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-28T17:28:48.759375] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-05. [2025-10-28T17:28:48.855185] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-28T17:28:48.861987] [INFO ] [REMOTE ] BCH: Full fetch complete (41760 records). [2025-10-28T17:28:48.862135] [DEBUG] [VALIDATOR ] BCH: Validating primary data. [2025-10-28T17:28:49.236460] [DEBUG] [VALIDATOR ] BCH: All expected trading days are present. [2025-10-28T17:28:49.236563] [DEBUG] [VALIDATOR ] BCH: Primary data validation passed. [2025-10-28T17:28:49.237146] [INFO ] [MAIN ] BCH: Fetched primary data is valid. [2025-10-28T17:28:49.237241] [DEBUG] [LOCAL ] BCH: Saving primary data. [2025-10-28T17:28:49.238288] [DEBUG] [LOCAL ] BCH: Trimmed 41760 records to 29555 (keeping 200 days of data) [2025-10-28T17:28:49.417345] [DEBUG] [LOCAL ] BCH: Primary data saved (29555 records). [2025-10-28T17:28:49.417532] [INFO ] [MAIN ] BCH: Full history saved. [2025-10-28T17:28:49.417626] [INFO ] [MAIN ] Update Progress: 234/2366 symbols completed. BCH took 23.6s. Estimated remaining: 4h 22m 10s. Rate: 8.1 symbols/min [2025-10-28T17:28:49.560584] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-09. [2025-10-28T17:28:49.609507] [INFO ] [MAIN ] BCSF: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:28:49.628588] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-28T17:28:49.657426] [DEBUG] [LOCAL ] BCSF: Loaded 27770 existing records from primary storage. [2025-10-28T17:28:49.657751] [INFO ] [MAIN ] BCSF: Loaded 27770 existing records. [2025-10-28T17:28:49.837116] [WARN ] [MAIN ] BCSF: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:28:49.837372] [INFO ] [MAIN ] BCSF: Wiping existing primary data before full refresh. [2025-10-28T17:28:49.837419] [INFO ] [LOCAL ] BCSF: Starting deletion of primary data. [2025-10-28T17:28:49.837985] [DEBUG] [LOCAL ] BCSF: Deleted primary data file. [2025-10-28T17:28:49.838044] [INFO ] [MAIN ] BCSF: Starting full primary refresh. [2025-10-28T17:28:50.192784] [INFO ] [REMOTE ] BCSF: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:28:50.359387] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-03. [2025-10-28T17:28:50.836688] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-28T17:28:51.159332] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-10. [2025-10-28T17:28:51.631942] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-28T17:28:51.959343] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-04. [2025-10-28T17:28:52.537948] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-28T17:28:52.547923] [INFO ] [REMOTE ] BCE: Full fetch complete (75708 records). [2025-10-28T17:28:52.548056] [DEBUG] [VALIDATOR ] BCE: Validating primary data. [2025-10-28T17:28:52.548683] [FATAL] [VALIDATOR ] BCE: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T17:28:52.548765] [FATAL] [MAIN ] BCE: Fetched primary data is invalid. Refusing to save it. [2025-10-28T17:28:52.548807] [WARN ] [MAIN ] BCE: Deleting existing primary and derivative data due to validation failure. [2025-10-28T17:28:52.548844] [INFO ] [LOCAL ] BCE: Starting deletion of primary data. [2025-10-28T17:28:52.548898] [DEBUG] [LOCAL ] BCE: No primary data file found to delete. [2025-10-28T17:28:52.548933] [INFO ] [LOCAL ] BCE: Starting deletion of derivative data. [2025-10-28T17:28:52.549748] [DEBUG] [LOCAL ] BCE: Deleted derivative data file. [2025-10-28T17:28:52.550410] [INFO ] [MAIN ] Update Progress: 235/2366 symbols completed. BCE took 35.8s. Estimated remaining: 4h 21m 24s. Rate: 8.2 symbols/min [2025-10-28T17:28:52.718021] [INFO ] [MAIN ] BCX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:28:52.738422] [DEBUG] [LOCAL ] BCX: Loaded 21778 existing records from primary storage. [2025-10-28T17:28:52.738699] [INFO ] [MAIN ] BCX: Loaded 21778 existing records. [2025-10-28T17:28:52.768572] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-01. [2025-10-28T17:28:52.913690] [WARN ] [MAIN ] BCX: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:28:52.913894] [INFO ] [MAIN ] BCX: Wiping existing primary data before full refresh. [2025-10-28T17:28:52.913939] [INFO ] [LOCAL ] BCX: Starting deletion of primary data. [2025-10-28T17:28:52.914502] [DEBUG] [LOCAL ] BCX: Deleted primary data file. [2025-10-28T17:28:52.914560] [INFO ] [MAIN ] BCX: Starting full primary refresh. [2025-10-28T17:28:53.263148] [INFO ] [REMOTE ] BCX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:28:53.357846] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-28T17:28:53.559335] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-01. [2025-10-28T17:28:53.965032] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-28T17:28:54.339374] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-28T17:28:54.359346] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-02. [2025-10-28T17:28:55.159352] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-02. [2025-10-28T17:28:55.253847] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-28T17:28:55.855416] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-28T17:28:55.959345] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-03. [2025-10-28T17:28:56.759404] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-06. [2025-10-28T17:28:56.981278] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-28T17:28:57.559395] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-03. [2025-10-28T17:28:57.666529] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-28T17:28:58.359327] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-07. [2025-10-28T17:28:58.582813] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-28T17:28:59.104101] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-28T17:28:59.159334] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-04. [2025-10-28T17:28:59.908343] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-28T17:28:59.959300] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-05. [2025-10-28T17:29:00.641789] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-28T17:29:00.759339] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-06. [2025-10-28T17:29:01.559329] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-05. [2025-10-28T17:29:01.575483] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-28T17:29:02.359346] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-08. [2025-10-28T17:29:03.137799] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-28T17:29:03.159305] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-06. [2025-10-28T17:29:03.221822] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-28T17:29:03.959351] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-09. [2025-10-28T17:29:04.478971] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-28T17:29:04.664697] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-28T17:29:04.759332] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-10. [2025-10-28T17:29:05.559384] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-04. [2025-10-28T17:29:05.618885] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-28T17:29:05.624807] [INFO ] [REMOTE ] BCO: Full fetch complete (35899 records). [2025-10-28T17:29:05.625041] [DEBUG] [VALIDATOR ] BCO: Validating primary data. [2025-10-28T17:29:06.201403] [DEBUG] [VALIDATOR ] BCO: All expected trading days are present. [2025-10-28T17:29:06.201522] [DEBUG] [VALIDATOR ] BCO: Primary data validation passed. [2025-10-28T17:29:06.202236] [INFO ] [MAIN ] BCO: Fetched primary data is valid. [2025-10-28T17:29:06.202320] [DEBUG] [LOCAL ] BCO: Saving primary data. [2025-10-28T17:29:06.203684] [DEBUG] [LOCAL ] BCO: Trimmed 35899 records to 24272 (keeping 200 days of data) [2025-10-28T17:29:06.359797] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-07. [2025-10-28T17:29:06.393153] [DEBUG] [LOCAL ] BCO: Primary data saved (24272 records). [2025-10-28T17:29:06.393262] [INFO ] [MAIN ] BCO: Full history saved. [2025-10-28T17:29:06.393335] [INFO ] [MAIN ] Update Progress: 236/2366 symbols completed. BCO took 36.8s. Estimated remaining: 4h 22m 15s. Rate: 8.1 symbols/min [2025-10-28T17:29:06.570282] [INFO ] [MAIN ] BDC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:29:06.589349] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-28T17:29:06.615503] [DEBUG] [LOCAL ] BDC: Loaded 23527 existing records from primary storage. [2025-10-28T17:29:06.615756] [INFO ] [MAIN ] BDC: Loaded 23527 existing records. [2025-10-28T17:29:06.791188] [WARN ] [MAIN ] BDC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:29:06.791387] [INFO ] [MAIN ] BDC: Wiping existing primary data before full refresh. [2025-10-28T17:29:06.791436] [INFO ] [LOCAL ] BDC: Starting deletion of primary data. [2025-10-28T17:29:06.791621] [DEBUG] [LOCAL ] BDC: Deleted primary data file. [2025-10-28T17:29:06.791700] [INFO ] [MAIN ] BDC: Starting full primary refresh. [2025-10-28T17:29:07.154883] [INFO ] [REMOTE ] BDC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:29:07.159294] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-01. [2025-10-28T17:29:07.186879] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-28T17:29:07.959328] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-05. [2025-10-28T17:29:08.119018] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-28T17:29:08.759347] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-07. [2025-10-28T17:29:08.850017] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-28T17:29:09.559349] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-08. [2025-10-28T17:29:10.233473] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-28T17:29:10.245692] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-28T17:29:10.359331] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-08. [2025-10-28T17:29:11.159397] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-09. [2025-10-28T17:29:11.714297] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-28T17:29:11.737955] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-28T17:29:11.959364] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-09. [2025-10-28T17:29:12.759404] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-06. [2025-10-28T17:29:13.535336] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-28T17:29:13.559297] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-07. [2025-10-28T17:29:13.801263] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-10-28T17:29:14.251295] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-28T17:29:14.359295] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-08. [2025-10-28T17:29:15.097913] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-28T17:29:15.159295] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-09. [2025-10-28T17:29:15.959358] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-02. [2025-10-28T17:29:16.041554] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-28T17:29:16.710711] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-28T17:29:16.759315] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-03. [2025-10-28T17:29:17.563479] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-10. [2025-10-28T17:29:17.567537] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-28T17:29:18.359342] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-10. [2025-10-28T17:29:18.600498] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-28T17:29:18.605932] [INFO ] [REMOTE ] BCX: Full fetch complete (33577 records). [2025-10-28T17:29:18.606070] [DEBUG] [VALIDATOR ] BCX: Validating primary data. [2025-10-28T17:29:18.971882] [DEBUG] [VALIDATOR ] BCX: All expected trading days are present. [2025-10-28T17:29:18.971958] [DEBUG] [VALIDATOR ] BCX: Primary data validation passed. [2025-10-28T17:29:18.972363] [INFO ] [MAIN ] BCX: Fetched primary data is valid. [2025-10-28T17:29:18.972401] [DEBUG] [LOCAL ] BCX: Saving primary data. [2025-10-28T17:29:18.973110] [DEBUG] [LOCAL ] BCX: Trimmed 33577 records to 21667 (keeping 200 days of data) [2025-10-28T17:29:19.099023] [DEBUG] [LOCAL ] BCX: Primary data saved (21667 records). [2025-10-28T17:29:19.099141] [INFO ] [MAIN ] BCX: Full history saved. [2025-10-28T17:29:19.099214] [INFO ] [MAIN ] Update Progress: 237/2366 symbols completed. BCX took 26.5s. Estimated remaining: 4h 22m 55s. Rate: 8.1 symbols/min [2025-10-28T17:29:19.159322] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-04. [2025-10-28T17:29:19.774871] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-28T17:29:19.790954] [INFO ] [REMOTE ] BCS: Full fetch complete (77525 records). [2025-10-28T17:29:19.791133] [DEBUG] [VALIDATOR ] BCS: Validating primary data. [2025-10-28T17:29:19.962756] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-10. [2025-10-28T17:29:20.225934] [DEBUG] [VALIDATOR ] BCS: All expected trading days are present. [2025-10-28T17:29:20.226076] [DEBUG] [VALIDATOR ] BCS: Primary data validation passed. [2025-10-28T17:29:20.226938] [INFO ] [MAIN ] BCS: Fetched primary data is valid. [2025-10-28T17:29:20.227082] [DEBUG] [LOCAL ] BCS: Saving primary data. [2025-10-28T17:29:20.244815] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-28T17:29:20.250929] [DEBUG] [LOCAL ] BCS: Trimmed 77525 records to 53436 (keeping 200 days of data) [2025-10-28T17:29:20.574212] [DEBUG] [LOCAL ] BCS: Primary data saved (53436 records). [2025-10-28T17:29:20.574335] [INFO ] [MAIN ] BCS: Full history saved. [2025-10-28T17:29:20.574412] [INFO ] [MAIN ] Update Progress: 238/2366 symbols completed. BCS took 41.4s. Estimated remaining: 4h 21m 55s. Rate: 8.1 symbols/min [2025-10-28T17:29:20.759348] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-05. [2025-10-28T17:29:21.266749] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-28T17:29:21.273719] [INFO ] [REMOTE ] BCSF: Full fetch complete (40099 records). [2025-10-28T17:29:21.273805] [DEBUG] [VALIDATOR ] BCSF: Validating primary data. [2025-10-28T17:29:21.659895] [DEBUG] [VALIDATOR ] BCSF: All expected trading days are present. [2025-10-28T17:29:21.660079] [DEBUG] [VALIDATOR ] BCSF: Primary data validation passed. [2025-10-28T17:29:21.660560] [INFO ] [MAIN ] BCSF: Fetched primary data is valid. [2025-10-28T17:29:21.660636] [DEBUG] [LOCAL ] BCSF: Saving primary data. [2025-10-28T17:29:21.676039] [DEBUG] [LOCAL ] BCSF: Trimmed 40099 records to 27752 (keeping 200 days of data) [2025-10-28T17:29:21.675937] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-28T17:29:21.682112] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-06. [2025-10-28T17:29:21.845737] [DEBUG] [LOCAL ] BCSF: Primary data saved (27752 records). [2025-10-28T17:29:21.845846] [INFO ] [MAIN ] BCSF: Full history saved. [2025-10-28T17:29:21.845920] [INFO ] [MAIN ] Update Progress: 239/2366 symbols completed. BCSF took 32.4s. Estimated remaining: 4h 20m 53s. Rate: 8.2 symbols/min [2025-10-28T17:29:22.695860] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-28T17:29:22.700821] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-07. [2025-10-28T17:29:23.942715] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-28T17:29:23.949464] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-08. [2025-10-28T17:29:24.817193] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-28T17:29:24.822743] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-09. [2025-10-28T17:29:25.565903] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-28T17:29:25.571133] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-10. [2025-10-28T17:29:26.436184] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-28T17:29:26.440847] [INFO ] [REMOTE ] BDC: Full fetch complete (35554 records). [2025-10-28T17:29:26.441029] [DEBUG] [VALIDATOR ] BDC: Validating primary data. [2025-10-28T17:29:26.803241] [DEBUG] [VALIDATOR ] BDC: All expected trading days are present. [2025-10-28T17:29:26.803317] [DEBUG] [VALIDATOR ] BDC: Primary data validation passed. [2025-10-28T17:29:26.803749] [INFO ] [MAIN ] BDC: Fetched primary data is valid. [2025-10-28T17:29:26.803809] [DEBUG] [LOCAL ] BDC: Saving primary data. [2025-10-28T17:29:26.804601] [DEBUG] [LOCAL ] BDC: Trimmed 35554 records to 23420 (keeping 200 days of data) [2025-10-28T17:29:26.948828] [DEBUG] [LOCAL ] BDC: Primary data saved (23420 records). [2025-10-28T17:29:26.949007] [INFO ] [MAIN ] BDC: Full history saved. [2025-10-28T17:29:26.949120] [INFO ] [MAIN ] Update Progress: 240/2366 symbols completed. BDC took 20.6s. Estimated remaining: 4h 20m 26s. Rate: 8.2 symbols/min [2025-10-28T17:29:27.572933] [INFO ] [MAIN ] BDN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:29:27.618263] [INFO ] [MAIN ] BDJ: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:29:27.658888] [INFO ] [MAIN ] BDX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:29:27.709997] [INFO ] [MAIN ] BE: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:29:27.742914] [DEBUG] [LOCAL ] BDJ: Loaded 28843 existing records from primary storage. [2025-10-28T17:29:27.743274] [INFO ] [MAIN ] BDJ: Loaded 28843 existing records. [2025-10-28T17:29:27.885625] [DEBUG] [LOCAL ] BDN: Loaded 47524 existing records from primary storage. [2025-10-28T17:29:27.915121] [INFO ] [MAIN ] BDN: Loaded 47524 existing records. [2025-10-28T17:29:28.054857] [WARN ] [MAIN ] BDJ: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:29:28.067140] [DEBUG] [LOCAL ] BE: Loaded 53661 existing records from primary storage. [2025-10-28T17:29:28.110440] [INFO ] [MAIN ] BE: Loaded 53661 existing records. [2025-10-28T17:29:28.096313] [INFO ] [MAIN ] BDJ: Wiping existing primary data before full refresh. [2025-10-28T17:29:28.116275] [INFO ] [LOCAL ] BDJ: Starting deletion of primary data. [2025-10-28T17:29:28.127411] [DEBUG] [LOCAL ] BDX: Loaded 52047 existing records from primary storage. [2025-10-28T17:29:28.127909] [INFO ] [MAIN ] BDX: Loaded 52047 existing records. [2025-10-28T17:29:28.138211] [DEBUG] [LOCAL ] BDJ: Deleted primary data file. [2025-10-28T17:29:28.154023] [INFO ] [MAIN ] BDJ: Starting full primary refresh. [2025-10-28T17:29:28.333678] [WARN ] [MAIN ] BDN: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:29:28.353888] [INFO ] [MAIN ] BDN: Wiping existing primary data before full refresh. [2025-10-28T17:29:28.353992] [INFO ] [LOCAL ] BDN: Starting deletion of primary data. [2025-10-28T17:29:28.388826] [DEBUG] [LOCAL ] BDN: Deleted primary data file. [2025-10-28T17:29:28.455795] [INFO ] [MAIN ] BDN: Starting full primary refresh. [2025-10-28T17:29:28.763077] [WARN ] [MAIN ] BE: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:29:28.785323] [WARN ] [MAIN ] BDX: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:29:28.791038] [INFO ] [MAIN ] BE: Wiping existing primary data before full refresh. [2025-10-28T17:29:28.806676] [INFO ] [LOCAL ] BE: Starting deletion of primary data. [2025-10-28T17:29:28.807447] [INFO ] [MAIN ] BDX: Wiping existing primary data before full refresh. [2025-10-28T17:29:28.807536] [INFO ] [LOCAL ] BDX: Starting deletion of primary data. [2025-10-28T17:29:28.813188] [DEBUG] [LOCAL ] BE: Deleted primary data file. [2025-10-28T17:29:28.847264] [DEBUG] [LOCAL ] BDX: Deleted primary data file. [2025-10-28T17:29:28.852592] [INFO ] [MAIN ] BE: Starting full primary refresh. [2025-10-28T17:29:28.866446] [INFO ] [MAIN ] BDX: Starting full primary refresh. [2025-10-28T17:29:29.631163] [INFO ] [REMOTE ] BDJ: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:29:29.690244] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-01. [2025-10-28T17:29:30.104959] [INFO ] [REMOTE ] BDN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:29:30.158959] [INFO ] [REMOTE ] BDX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:29:30.167527] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-01. [2025-10-28T17:29:30.185526] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-01. [2025-10-28T17:29:30.191972] [INFO ] [REMOTE ] BE: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:29:30.194432] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-01. [2025-10-28T17:29:31.150464] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-28T17:29:31.157359] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-02. [2025-10-28T17:29:31.474380] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-28T17:29:31.484134] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-02. [2025-10-28T17:29:31.913454] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-28T17:29:31.924272] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-02. [2025-10-28T17:29:31.940891] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-28T17:29:31.947142] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-03. [2025-10-28T17:29:32.004542] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-10-28T17:29:32.015597] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-02. [2025-10-28T17:29:32.620499] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-28T17:29:32.759362] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-03. [2025-10-28T17:29:33.000720] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-28T17:29:33.236430] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-28T17:29:33.379737] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-28T17:29:33.559305] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-03. [2025-10-28T17:29:33.839818] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-28T17:29:34.359386] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-04. [2025-10-28T17:29:35.159404] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-03. [2025-10-28T17:29:35.248683] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-28T17:29:35.334662] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-28T17:29:35.959385] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-04. [2025-10-28T17:29:36.759338] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-05. [2025-10-28T17:29:37.044295] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-28T17:29:37.241977] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-28T17:29:37.564428] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-04. [2025-10-28T17:29:37.575042] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-28T17:29:38.359397] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-05. [2025-10-28T17:29:38.819822] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-28T17:29:39.159380] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-05. [2025-10-28T17:29:39.694062] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-28T17:29:39.959341] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-06. [2025-10-28T17:29:40.369194] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-28T17:29:40.759297] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-04. [2025-10-28T17:29:41.052209] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-28T17:29:41.559362] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-06. [2025-10-28T17:29:42.189022] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-28T17:29:42.359345] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-06. [2025-10-28T17:29:42.701815] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-28T17:29:43.159376] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-07. [2025-10-28T17:29:43.789228] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-28T17:29:43.959321] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-07. [2025-10-28T17:29:44.200373] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-28T17:29:44.759321] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-08. [2025-10-28T17:29:45.416518] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-28T17:29:45.536321] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-28T17:29:45.559330] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-07. [2025-10-28T17:29:46.359361] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-09. [2025-10-28T17:29:46.695442] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-28T17:29:47.042570] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-28T17:29:47.159311] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-08. [2025-10-28T17:29:47.959325] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-10. [2025-10-28T17:29:48.395572] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-28T17:29:48.759337] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-09. [2025-10-28T17:29:48.957730] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-28T17:29:48.963712] [INFO ] [REMOTE ] BDJ: Full fetch complete (42697 records). [2025-10-28T17:29:48.963807] [DEBUG] [VALIDATOR ] BDJ: Validating primary data. [2025-10-28T17:29:49.332985] [DEBUG] [VALIDATOR ] BDJ: All expected trading days are present. [2025-10-28T17:29:49.333057] [DEBUG] [VALIDATOR ] BDJ: Primary data validation passed. [2025-10-28T17:29:49.333524] [INFO ] [MAIN ] BDJ: Fetched primary data is valid. [2025-10-28T17:29:49.333565] [DEBUG] [LOCAL ] BDJ: Saving primary data. [2025-10-28T17:29:49.334417] [DEBUG] [LOCAL ] BDJ: Trimmed 42697 records to 28805 (keeping 200 days of data) [2025-10-28T17:29:49.496190] [DEBUG] [LOCAL ] BDJ: Primary data saved (28805 records). [2025-10-28T17:29:49.496312] [INFO ] [MAIN ] BDJ: Full history saved. [2025-10-28T17:29:49.496387] [INFO ] [MAIN ] Update Progress: 241/2366 symbols completed. BDJ took 22.5s. Estimated remaining: 4h 22m 32s. Rate: 8.1 symbols/min [2025-10-28T17:29:49.564566] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-05. [2025-10-28T17:29:49.663762] [INFO ] [MAIN ] BEDU: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:29:49.663900] [DEBUG] [LOCAL ] BEDU: No existing data file found in primary storage. [2025-10-28T17:29:49.663937] [WARN ] [MAIN ] BEDU: No existing data found, performing full refresh instead. [2025-10-28T17:29:49.664042] [INFO ] [MAIN ] BEDU: Wiping existing primary data before full refresh. [2025-10-28T17:29:49.664083] [INFO ] [LOCAL ] BEDU: Starting deletion of primary data. [2025-10-28T17:29:49.664124] [DEBUG] [LOCAL ] BEDU: No primary data file found to delete. [2025-10-28T17:29:49.664157] [INFO ] [MAIN ] BEDU: Starting full primary refresh. [2025-10-28T17:29:50.029303] [INFO ] [REMOTE ] BEDU: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:29:50.054880] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-28T17:29:50.359305] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-08. [2025-10-28T17:29:51.159315] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-10. [2025-10-28T17:29:51.205159] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-28T17:29:51.520862] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-28T17:29:51.959330] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-09. [2025-10-28T17:29:52.477840] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-28T17:29:52.487222] [INFO ] [REMOTE ] BDN: Full fetch complete (69011 records). [2025-10-28T17:29:52.487385] [DEBUG] [VALIDATOR ] BDN: Validating primary data. [2025-10-28T17:29:52.488083] [FATAL] [VALIDATOR ] BDN: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T17:29:52.488176] [FATAL] [MAIN ] BDN: Fetched primary data is invalid. Refusing to save it. [2025-10-28T17:29:52.488225] [WARN ] [MAIN ] BDN: Deleting existing primary and derivative data due to validation failure. [2025-10-28T17:29:52.488301] [INFO ] [LOCAL ] BDN: Starting deletion of primary data. [2025-10-28T17:29:52.488378] [DEBUG] [LOCAL ] BDN: No primary data file found to delete. [2025-10-28T17:29:52.488430] [INFO ] [LOCAL ] BDN: Starting deletion of derivative data. [2025-10-28T17:29:52.489782] [DEBUG] [LOCAL ] BDN: Deleted derivative data file. [2025-10-28T17:29:52.489899] [INFO ] [MAIN ] Update Progress: 242/2366 symbols completed. BDN took 25.5s. Estimated remaining: 4h 21m 46s. Rate: 8.1 symbols/min [2025-10-28T17:29:52.660054] [INFO ] [MAIN ] BEKE: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:29:52.707119] [DEBUG] [LOCAL ] BEKE: Loaded 53182 existing records from primary storage. [2025-10-28T17:29:52.707438] [INFO ] [MAIN ] BEKE: Loaded 53182 existing records. [2025-10-28T17:29:52.769341] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-06. [2025-10-28T17:29:52.884684] [WARN ] [MAIN ] BEKE: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:29:52.884899] [INFO ] [MAIN ] BEKE: Wiping existing primary data before full refresh. [2025-10-28T17:29:52.884965] [INFO ] [LOCAL ] BEKE: Starting deletion of primary data. [2025-10-28T17:29:52.885834] [DEBUG] [LOCAL ] BEKE: Deleted primary data file. [2025-10-28T17:29:52.885892] [INFO ] [MAIN ] BEKE: Starting full primary refresh. [2025-10-28T17:29:53.248679] [INFO ] [REMOTE ] BEKE: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:29:53.394042] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-28T17:29:53.559313] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-01. [2025-10-28T17:29:53.989695] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-28T17:29:54.360119] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-10. [2025-10-28T17:29:54.365590] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-28T17:29:55.159579] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-01. [2025-10-28T17:29:55.745111] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-28T17:29:55.755204] [INFO ] [REMOTE ] BDX: Full fetch complete (75367 records). [2025-10-28T17:29:55.755366] [DEBUG] [VALIDATOR ] BDX: Validating primary data. [2025-10-28T17:29:55.969200] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-02. [2025-10-28T17:29:56.167914] [DEBUG] [VALIDATOR ] BDX: All expected trading days are present. [2025-10-28T17:29:56.168001] [DEBUG] [VALIDATOR ] BDX: Primary data validation passed. [2025-10-28T17:29:56.168790] [INFO ] [MAIN ] BDX: Fetched primary data is valid. [2025-10-28T17:29:56.168855] [DEBUG] [LOCAL ] BDX: Saving primary data. [2025-10-28T17:29:56.170977] [DEBUG] [LOCAL ] BDX: Trimmed 75367 records to 52015 (keeping 200 days of data) [2025-10-28T17:29:56.237767] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-02 (0.27 seconds). [2025-10-28T17:29:56.460187] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-28T17:29:56.543887] [DEBUG] [LOCAL ] BDX: Primary data saved (52015 records). [2025-10-28T17:29:56.544007] [INFO ] [MAIN ] BDX: Full history saved. [2025-10-28T17:29:56.544099] [INFO ] [MAIN ] Update Progress: 243/2366 symbols completed. BDX took 29.6s. Estimated remaining: 4h 21m 10s. Rate: 8.1 symbols/min [2025-10-28T17:29:56.709670] [INFO ] [MAIN ] BEN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:29:56.760144] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-03. [2025-10-28T17:29:56.760069] [DEBUG] [LOCAL ] BEN: Loaded 53102 existing records from primary storage. [2025-10-28T17:29:56.760725] [INFO ] [MAIN ] BEN: Loaded 53102 existing records. [2025-10-28T17:29:56.967153] [WARN ] [MAIN ] BEN: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:29:56.967364] [INFO ] [MAIN ] BEN: Wiping existing primary data before full refresh. [2025-10-28T17:29:56.967410] [INFO ] [LOCAL ] BEN: Starting deletion of primary data. [2025-10-28T17:29:56.967949] [DEBUG] [LOCAL ] BEN: Deleted primary data file. [2025-10-28T17:29:56.968007] [INFO ] [MAIN ] BEN: Starting full primary refresh. [2025-10-28T17:29:57.140546] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-10-28T17:29:57.326120] [INFO ] [REMOTE ] BEN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:29:57.559384] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-07. [2025-10-28T17:29:58.359355] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-01. [2025-10-28T17:29:59.159327] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-02. [2025-10-28T17:29:59.440867] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-28T17:29:59.713348] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-28T17:29:59.959352] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-02. [2025-10-28T17:30:00.658434] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-28T17:30:00.759311] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-08. [2025-10-28T17:30:01.369587] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-28T17:30:01.559420] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-04. [2025-10-28T17:30:01.864309] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-04 (0.30 seconds). [2025-10-28T17:30:02.359319] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-05. [2025-10-28T17:30:02.571411] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-28T17:30:02.768780] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-10-28T17:30:03.159356] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-06. [2025-10-28T17:30:03.414833] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-06 (0.26 seconds). [2025-10-28T17:30:03.959339] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-09. [2025-10-28T17:30:04.759353] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-03. [2025-10-28T17:30:05.559357] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-03. [2025-10-28T17:30:06.260967] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-09 (2.30 seconds). [2025-10-28T17:30:06.306448] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-28T17:30:06.359298] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-10. [2025-10-28T17:30:07.104100] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-28T17:30:07.159342] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-04. [2025-10-28T17:30:07.959404] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-04. [2025-10-28T17:30:08.453285] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-10 (2.09 seconds). [2025-10-28T17:30:08.464001] [INFO ] [REMOTE ] BE: Full fetch complete (77816 records). [2025-10-28T17:30:08.464149] [DEBUG] [VALIDATOR ] BE: Validating primary data. [2025-10-28T17:30:08.759733] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-07. [2025-10-28T17:30:08.889105] [DEBUG] [VALIDATOR ] BE: All expected trading days are present. [2025-10-28T17:30:08.889221] [DEBUG] [VALIDATOR ] BE: Primary data validation passed. [2025-10-28T17:30:08.890097] [INFO ] [MAIN ] BE: Fetched primary data is valid. [2025-10-28T17:30:08.890239] [DEBUG] [LOCAL ] BE: Saving primary data. [2025-10-28T17:30:08.891829] [DEBUG] [LOCAL ] BE: Trimmed 77816 records to 53661 (keeping 200 days of data) [2025-10-28T17:30:09.020638] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-28T17:30:09.145205] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-10-28T17:30:09.263667] [DEBUG] [LOCAL ] BE: Primary data saved (53661 records). [2025-10-28T17:30:09.263823] [INFO ] [MAIN ] BE: Full history saved. [2025-10-28T17:30:09.263914] [INFO ] [MAIN ] Update Progress: 244/2366 symbols completed. BE took 42.3s. Estimated remaining: 4h 21m 49s. Rate: 8.1 symbols/min [2025-10-28T17:30:09.446117] [INFO ] [MAIN ] BEP: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:30:09.480625] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-28T17:30:09.519124] [DEBUG] [LOCAL ] BEP: Loaded 38684 existing records from primary storage. [2025-10-28T17:30:09.519429] [INFO ] [MAIN ] BEP: Loaded 38684 existing records. [2025-10-28T17:30:09.564556] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-05. [2025-10-28T17:30:09.729869] [WARN ] [MAIN ] BEP: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:30:09.731105] [INFO ] [MAIN ] BEP: Wiping existing primary data before full refresh. [2025-10-28T17:30:09.731167] [INFO ] [LOCAL ] BEP: Starting deletion of primary data. [2025-10-28T17:30:09.732400] [DEBUG] [LOCAL ] BEP: Deleted primary data file. [2025-10-28T17:30:09.732463] [INFO ] [MAIN ] BEP: Starting full primary refresh. [2025-10-28T17:30:10.098303] [INFO ] [REMOTE ] BEP: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:30:10.359350] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-08. [2025-10-28T17:30:10.602811] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-08 (0.24 seconds). [2025-10-28T17:30:11.159316] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-05. [2025-10-28T17:30:11.334788] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-28T17:30:11.959317] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-09. [2025-10-28T17:30:12.193098] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-09 (0.23 seconds). [2025-10-28T17:30:12.752832] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-28T17:30:12.763368] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-10. [2025-10-28T17:30:13.260325] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-28T17:30:13.261232] [INFO ] [REMOTE ] BEDU: Full fetch complete (1328 records). [2025-10-28T17:30:13.261299] [DEBUG] [VALIDATOR ] BEDU: Validating primary data. [2025-10-28T17:30:13.444109] [WARN ] [VALIDATOR ] BEDU: Validation failed - insufficient historical data. Have 169 unique days, need 200 days [2025-10-28T17:30:13.444292] [FATAL] [MAIN ] BEDU: Fetched primary data is invalid. Refusing to save it. [2025-10-28T17:30:13.444365] [WARN ] [MAIN ] BEDU: Deleting existing primary and derivative data due to validation failure. [2025-10-28T17:30:13.444434] [INFO ] [LOCAL ] BEDU: Starting deletion of primary data. [2025-10-28T17:30:13.444500] [DEBUG] [LOCAL ] BEDU: No primary data file found to delete. [2025-10-28T17:30:13.444537] [INFO ] [LOCAL ] BEDU: Starting deletion of derivative data. [2025-10-28T17:30:13.444577] [DEBUG] [LOCAL ] BEDU: No derivative data file found to delete. [2025-10-28T17:30:13.444632] [INFO ] [MAIN ] Update Progress: 245/2366 symbols completed. BEDU took 23.9s. Estimated remaining: 4h 21m 13s. Rate: 8.1 symbols/min [2025-10-28T17:30:13.564465] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-06. [2025-10-28T17:30:13.627107] [INFO ] [MAIN ] BEPC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:30:13.669161] [DEBUG] [LOCAL ] BEPC: Loaded 46201 existing records from primary storage. [2025-10-28T17:30:13.669449] [INFO ] [MAIN ] BEPC: Loaded 46201 existing records. [2025-10-28T17:30:13.846436] [WARN ] [MAIN ] BEPC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:30:13.846685] [INFO ] [MAIN ] BEPC: Wiping existing primary data before full refresh. [2025-10-28T17:30:13.846743] [INFO ] [LOCAL ] BEPC: Starting deletion of primary data. [2025-10-28T17:30:13.847508] [DEBUG] [LOCAL ] BEPC: Deleted primary data file. [2025-10-28T17:30:13.847566] [INFO ] [MAIN ] BEPC: Starting full primary refresh. [2025-10-28T17:30:14.218479] [INFO ] [REMOTE ] BEPC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:30:14.359339] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-01. [2025-10-28T17:30:14.925083] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-28T17:30:15.159361] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-06. [2025-10-28T17:30:15.959336] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-01. [2025-10-28T17:30:16.343256] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-28T17:30:16.759357] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-07. [2025-10-28T17:30:17.215063] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-28T17:30:17.436271] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-01 (3.08 seconds). [2025-10-28T17:30:17.559317] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-02. [2025-10-28T17:30:18.063447] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-28T17:30:18.359381] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-02. [2025-10-28T17:30:18.849455] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-28T17:30:19.159350] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-03. [2025-10-28T17:30:19.389389] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-28T17:30:19.959329] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-08. [2025-10-28T17:30:20.741868] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-28T17:30:20.759295] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-04. [2025-10-28T17:30:21.490562] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-28T17:30:21.559341] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-07. [2025-10-28T17:30:21.931384] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-28T17:30:22.359351] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-03. [2025-10-28T17:30:23.165696] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-09. [2025-10-28T17:30:23.169413] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-28T17:30:23.509359] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-28T17:30:23.959394] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-08. [2025-10-28T17:30:24.553510] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-28T17:30:24.759331] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-04. [2025-10-28T17:30:25.336339] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-28T17:30:25.559352] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-09. [2025-10-28T17:30:26.099548] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-28T17:30:26.359333] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-10. [2025-10-28T17:30:26.944735] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-28T17:30:27.159342] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-05. [2025-10-28T17:30:27.959312] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-05. [2025-10-28T17:30:28.523413] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-28T17:30:28.676153] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-10 (2.32 seconds). [2025-10-28T17:30:28.686990] [INFO ] [REMOTE ] BEKE: Full fetch complete (77315 records). [2025-10-28T17:30:28.687155] [DEBUG] [VALIDATOR ] BEKE: Validating primary data. [2025-10-28T17:30:28.764426] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-10. [2025-10-28T17:30:29.106223] [DEBUG] [VALIDATOR ] BEKE: All expected trading days are present. [2025-10-28T17:30:29.106391] [DEBUG] [VALIDATOR ] BEKE: Primary data validation passed. [2025-10-28T17:30:29.107363] [INFO ] [MAIN ] BEKE: Fetched primary data is valid. [2025-10-28T17:30:29.107495] [DEBUG] [LOCAL ] BEKE: Saving primary data. [2025-10-28T17:30:29.109066] [DEBUG] [LOCAL ] BEKE: Trimmed 77315 records to 53169 (keeping 200 days of data) [2025-10-28T17:30:29.242422] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-28T17:30:29.466628] [DEBUG] [LOCAL ] BEKE: Primary data saved (53169 records). [2025-10-28T17:30:29.466804] [INFO ] [MAIN ] BEKE: Full history saved. [2025-10-28T17:30:29.466894] [INFO ] [MAIN ] Update Progress: 246/2366 symbols completed. BEKE took 37.0s. Estimated remaining: 4h 22m 20s. Rate: 8.1 symbols/min [2025-10-28T17:30:29.564427] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-06. [2025-10-28T17:30:29.656590] [INFO ] [MAIN ] BEPH: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:30:29.662566] [DEBUG] [LOCAL ] BEPH: Loaded 4804 existing records from primary storage. [2025-10-28T17:30:29.662766] [INFO ] [MAIN ] BEPH: Loaded 4804 existing records. [2025-10-28T17:30:29.836290] [WARN ] [MAIN ] BEPH: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:30:29.836502] [INFO ] [MAIN ] BEPH: Wiping existing primary data before full refresh. [2025-10-28T17:30:29.836551] [INFO ] [LOCAL ] BEPH: Starting deletion of primary data. [2025-10-28T17:30:29.836787] [DEBUG] [LOCAL ] BEPH: Deleted primary data file. [2025-10-28T17:30:29.836843] [INFO ] [MAIN ] BEPH: Starting full primary refresh. [2025-10-28T17:30:30.189134] [INFO ] [REMOTE ] BEPH: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:30:30.359337] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-01. [2025-10-28T17:30:30.435858] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-28T17:30:30.447129] [INFO ] [REMOTE ] BEN: Full fetch complete (77050 records). [2025-10-28T17:30:30.447490] [DEBUG] [VALIDATOR ] BEN: Validating primary data. [2025-10-28T17:30:30.770270] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-10-28T17:30:30.865444] [DEBUG] [VALIDATOR ] BEN: All expected trading days are present. [2025-10-28T17:30:30.865532] [DEBUG] [VALIDATOR ] BEN: Primary data validation passed. [2025-10-28T17:30:30.866339] [INFO ] [MAIN ] BEN: Fetched primary data is valid. [2025-10-28T17:30:30.866402] [DEBUG] [LOCAL ] BEN: Saving primary data. [2025-10-28T17:30:30.868096] [DEBUG] [LOCAL ] BEN: Trimmed 77050 records to 53093 (keeping 200 days of data) [2025-10-28T17:30:30.893974] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-28T17:30:31.173155] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-07. [2025-10-28T17:30:31.218680] [DEBUG] [LOCAL ] BEN: Primary data saved (53093 records). [2025-10-28T17:30:31.218792] [INFO ] [MAIN ] BEN: Full history saved. [2025-10-28T17:30:31.218864] [INFO ] [MAIN ] Update Progress: 247/2366 symbols completed. BEN took 34.7s. Estimated remaining: 4h 21m 24s. Rate: 8.1 symbols/min [2025-10-28T17:30:31.390699] [INFO ] [MAIN ] BEPI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:30:31.396703] [DEBUG] [LOCAL ] BEPI: Loaded 3495 existing records from primary storage. [2025-10-28T17:30:31.396885] [INFO ] [MAIN ] BEPI: Loaded 3495 existing records. [2025-10-28T17:30:31.569630] [WARN ] [MAIN ] BEPI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:30:31.569868] [INFO ] [MAIN ] BEPI: Wiping existing primary data before full refresh. [2025-10-28T17:30:31.569935] [INFO ] [LOCAL ] BEPI: Starting deletion of primary data. [2025-10-28T17:30:31.570134] [DEBUG] [LOCAL ] BEPI: Deleted primary data file. [2025-10-28T17:30:31.570190] [INFO ] [MAIN ] BEPI: Starting full primary refresh. [2025-10-28T17:30:31.918442] [INFO ] [REMOTE ] BEPI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:30:31.959297] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-01. [2025-10-28T17:30:32.429693] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-28T17:30:32.535239] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-28T17:30:32.759337] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-06. [2025-10-28T17:30:33.559350] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-02. [2025-10-28T17:30:33.877198] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-10-28T17:30:34.043002] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-28T17:30:34.359368] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-02. [2025-10-28T17:30:34.742943] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-10-28T17:30:35.159355] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-03. [2025-10-28T17:30:35.544362] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-10-28T17:30:35.959384] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-07. [2025-10-28T17:30:36.759375] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-04. [2025-10-28T17:30:37.097483] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-10-28T17:30:37.097177] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-28T17:30:37.559336] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-08. [2025-10-28T17:30:38.359348] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-08. [2025-10-28T17:30:38.623809] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-28T17:30:39.159352] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-09. [2025-10-28T17:30:39.671732] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-28T17:30:39.959366] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-03. [2025-10-28T17:30:40.091473] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-28T17:30:40.380049] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-28T17:30:40.759376] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-10. [2025-10-28T17:30:41.559371] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-05. [2025-10-28T17:30:41.951995] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-10-28T17:30:42.267735] [DEBUG] [REMOTE ] BEPC: Error fetching primary data for 2025-10: ("Connection broken: ConnectionResetError(104, 'Connection reset by peer')", ConnectionResetError(104, 'Connection reset by peer')) [2025-10-28T17:30:42.267975] [WARN ] [REMOTE ] BEPC: No data returned for month 2025-10 [2025-10-28T17:30:42.268051] [FATAL] [REMOTE ] BEPC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-28T17:30:42.268098] [FATAL] [MAIN ] BEPC: Failed to fetch primary data. [2025-10-28T17:30:42.268132] [WARN ] [MAIN ] BEPC: Deleting existing primary and derivative data due to fetch failure. [2025-10-28T17:30:42.268173] [INFO ] [LOCAL ] BEPC: Starting deletion of primary data. [2025-10-28T17:30:42.268239] [DEBUG] [LOCAL ] BEPC: No primary data file found to delete. [2025-10-28T17:30:42.268277] [INFO ] [LOCAL ] BEPC: Starting deletion of derivative data. [2025-10-28T17:30:42.268508] [DEBUG] [LOCAL ] BEPC: Deleted derivative data file. [2025-10-28T17:30:42.268617] [INFO ] [MAIN ] Update Progress: 248/2366 symbols completed. BEPC took 28.8s. Estimated remaining: 4h 21m 48s. Rate: 8.1 symbols/min [2025-10-28T17:30:42.364494] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-04. [2025-10-28T17:30:42.447297] [INFO ] [MAIN ] BEPJ: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:30:42.452511] [DEBUG] [LOCAL ] BEPJ: Loaded 3063 existing records from primary storage. [2025-10-28T17:30:42.452720] [INFO ] [MAIN ] BEPJ: Loaded 3063 existing records. [2025-10-28T17:30:42.638184] [WARN ] [MAIN ] BEPJ: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:30:42.638376] [INFO ] [MAIN ] BEPJ: Wiping existing primary data before full refresh. [2025-10-28T17:30:42.638421] [INFO ] [LOCAL ] BEPJ: Starting deletion of primary data. [2025-10-28T17:30:42.638591] [DEBUG] [LOCAL ] BEPJ: Deleted primary data file. [2025-10-28T17:30:42.638629] [INFO ] [MAIN ] BEPJ: Starting full primary refresh. [2025-10-28T17:30:42.936480] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-28T17:30:42.994519] [INFO ] [REMOTE ] BEPJ: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:30:43.159328] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-01. [2025-10-28T17:30:43.611048] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-28T17:30:43.959370] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-02. [2025-10-28T17:30:44.300327] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-10-28T17:30:44.759447] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-09. [2025-10-28T17:30:45.559339] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-05. [2025-10-28T17:30:45.943399] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-28T17:30:45.947015] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-10-28T17:30:46.359360] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-03. [2025-10-28T17:30:46.675776] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-10-28T17:30:47.159415] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-06. [2025-10-28T17:30:47.615415] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-28T17:30:47.959325] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-04. [2025-10-28T17:30:48.383703] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-28T17:30:48.759339] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-05. [2025-10-28T17:30:49.060377] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-05 (0.30 seconds). [2025-10-28T17:30:49.559363] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-07. [2025-10-28T17:30:49.911056] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-10-28T17:30:50.359360] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-08. [2025-10-28T17:30:50.648114] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-08 (0.29 seconds). [2025-10-28T17:30:51.159340] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-06. [2025-10-28T17:30:51.572274] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-10-28T17:30:51.959333] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-06. [2025-10-28T17:30:52.405517] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-28T17:30:52.759365] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-09. [2025-10-28T17:30:53.071698] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-09 (0.31 seconds). [2025-10-28T17:30:53.559335] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-07. [2025-10-28T17:30:54.037139] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-28T17:30:54.359379] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-07. [2025-10-28T17:30:55.082832] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-28T17:30:55.159312] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-08. [2025-10-28T17:30:55.558130] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-10-28T17:30:55.959344] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-09. [2025-10-28T17:30:56.283988] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-09 (0.32 seconds). [2025-10-28T17:30:56.759357] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-10. [2025-10-28T17:30:57.559349] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-08. [2025-10-28T17:30:57.932677] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-10-28T17:30:58.219430] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-28T17:30:58.228845] [INFO ] [REMOTE ] BEP: Full fetch complete (59208 records). [2025-10-28T17:30:58.229002] [DEBUG] [VALIDATOR ] BEP: Validating primary data. [2025-10-28T17:30:58.364461] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-10. [2025-10-28T17:30:58.629810] [DEBUG] [VALIDATOR ] BEP: All expected trading days are present. [2025-10-28T17:30:58.629903] [DEBUG] [VALIDATOR ] BEP: Primary data validation passed. [2025-10-28T17:30:58.630522] [INFO ] [MAIN ] BEP: Fetched primary data is valid. [2025-10-28T17:30:58.630565] [DEBUG] [LOCAL ] BEP: Saving primary data. [2025-10-28T17:30:58.631952] [DEBUG] [LOCAL ] BEP: Trimmed 59208 records to 38735 (keeping 200 days of data) [2025-10-28T17:30:58.861355] [DEBUG] [LOCAL ] BEP: Primary data saved (38735 records). [2025-10-28T17:30:58.861576] [INFO ] [MAIN ] BEP: Full history saved. [2025-10-28T17:30:58.861691] [INFO ] [MAIN ] Update Progress: 249/2366 symbols completed. BEP took 49.6s. Estimated remaining: 4h 22m 59s. Rate: 8.1 symbols/min [2025-10-28T17:30:58.959267] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-28T17:30:58.972409] [INFO ] [REMOTE ] BEPJ: Full fetch complete (4398 records). [2025-10-28T17:30:58.988313] [DEBUG] [VALIDATOR ] BEPJ: Validating primary data. [2025-10-28T17:30:59.121486] [INFO ] [MAIN ] BFAM: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:30:59.161227] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-09. [2025-10-28T17:30:59.426964] [DEBUG] [LOCAL ] BFAM: Loaded 33693 existing records from primary storage. [2025-10-28T17:30:59.450279] [INFO ] [MAIN ] BFAM: Loaded 33693 existing records. [2025-10-28T17:30:59.450397] [DEBUG] [VALIDATOR ] BEPJ: All expected trading days are present. [2025-10-28T17:30:59.450491] [DEBUG] [VALIDATOR ] BEPJ: Primary data validation passed. [2025-10-28T17:30:59.450725] [INFO ] [MAIN ] BEPJ: Fetched primary data is valid. [2025-10-28T17:30:59.483134] [DEBUG] [LOCAL ] BEPJ: Saving primary data. [2025-10-28T17:30:59.531189] [DEBUG] [LOCAL ] BEPJ: Trimmed 4398 records to 3060 (keeping 200 days of data) [2025-10-28T17:30:59.633409] [DEBUG] [LOCAL ] BEPJ: Primary data saved (3060 records). [2025-10-28T17:30:59.661174] [INFO ] [MAIN ] BEPJ: Full history saved. [2025-10-28T17:30:59.665190] [INFO ] [MAIN ] Update Progress: 250/2366 symbols completed. BEPJ took 17.4s. Estimated remaining: 4h 21m 55s. Rate: 8.1 symbols/min [2025-10-28T17:30:59.664980] [WARN ] [MAIN ] BFAM: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:30:59.733150] [INFO ] [MAIN ] BFAM: Wiping existing primary data before full refresh. [2025-10-28T17:30:59.744608] [INFO ] [LOCAL ] BFAM: Starting deletion of primary data. [2025-10-28T17:30:59.777995] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-28T17:30:59.778174] [DEBUG] [LOCAL ] BFAM: Deleted primary data file. [2025-10-28T17:30:59.780596] [INFO ] [MAIN ] BFAM: Starting full primary refresh. [2025-10-28T17:30:59.956849] [INFO ] [MAIN ] BFH: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:30:59.964482] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-10. [2025-10-28T17:31:00.277268] [INFO ] [REMOTE ] BFAM: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:31:00.279128] [DEBUG] [LOCAL ] BFH: Loaded 41171 existing records from primary storage. [2025-10-28T17:31:00.279564] [INFO ] [MAIN ] BFH: Loaded 41171 existing records. [2025-10-28T17:31:00.477358] [WARN ] [MAIN ] BFH: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:31:00.477586] [INFO ] [MAIN ] BFH: Wiping existing primary data before full refresh. [2025-10-28T17:31:00.477691] [INFO ] [LOCAL ] BFH: Starting deletion of primary data. [2025-10-28T17:31:00.478566] [DEBUG] [LOCAL ] BFH: Deleted primary data file. [2025-10-28T17:31:00.478627] [INFO ] [MAIN ] BFH: Starting full primary refresh. [2025-10-28T17:31:00.590738] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-28T17:31:00.619557] [INFO ] [REMOTE ] BEPI: Full fetch complete (4703 records). [2025-10-28T17:31:00.637992] [DEBUG] [VALIDATOR ] BEPI: Validating primary data. [2025-10-28T17:31:00.764443] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-10. [2025-10-28T17:31:01.171328] [INFO ] [REMOTE ] BFH: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:31:01.262475] [DEBUG] [VALIDATOR ] BEPI: All expected trading days are present. [2025-10-28T17:31:01.262560] [DEBUG] [VALIDATOR ] BEPI: Primary data validation passed. [2025-10-28T17:31:01.262729] [INFO ] [MAIN ] BEPI: Fetched primary data is valid. [2025-10-28T17:31:01.262791] [DEBUG] [LOCAL ] BEPI: Saving primary data. [2025-10-28T17:31:01.263217] [DEBUG] [LOCAL ] BEPI: Trimmed 4703 records to 3456 (keeping 200 days of data) [2025-10-28T17:31:01.284964] [DEBUG] [LOCAL ] BEPI: Primary data saved (3456 records). [2025-10-28T17:31:01.285086] [INFO ] [MAIN ] BEPI: Full history saved. [2025-10-28T17:31:01.285184] [INFO ] [MAIN ] Update Progress: 251/2366 symbols completed. BEPI took 30.1s. Estimated remaining: 4h 20m 59s. Rate: 8.1 symbols/min [2025-10-28T17:31:01.395060] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-28T17:31:01.422922] [INFO ] [REMOTE ] BEPH: Full fetch complete (7498 records). [2025-10-28T17:31:01.442612] [DEBUG] [VALIDATOR ] BEPH: Validating primary data. [2025-10-28T17:31:01.469420] [INFO ] [MAIN ] BFK: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:31:01.538133] [DEBUG] [LOCAL ] BFK: No existing data file found in primary storage. [2025-10-28T17:31:01.560394] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-01. [2025-10-28T17:31:01.549196] [WARN ] [MAIN ] BFK: No existing data found, performing full refresh instead. [2025-10-28T17:31:01.579588] [INFO ] [MAIN ] BFK: Wiping existing primary data before full refresh. [2025-10-28T17:31:01.590632] [INFO ] [LOCAL ] BFK: Starting deletion of primary data. [2025-10-28T17:31:01.639767] [DEBUG] [LOCAL ] BFK: No primary data file found to delete. [2025-10-28T17:31:01.655688] [INFO ] [MAIN ] BFK: Starting full primary refresh. [2025-10-28T17:31:02.053734] [DEBUG] [VALIDATOR ] BEPH: All expected trading days are present. [2025-10-28T17:31:02.054786] [DEBUG] [VALIDATOR ] BEPH: Primary data validation passed. [2025-10-28T17:31:02.107145] [INFO ] [MAIN ] BEPH: Fetched primary data is valid. [2025-10-28T17:31:02.131379] [DEBUG] [LOCAL ] BEPH: Saving primary data. [2025-10-28T17:31:02.195482] [DEBUG] [LOCAL ] BEPH: Trimmed 7498 records to 4778 (keeping 200 days of data) [2025-10-28T17:31:02.321069] [INFO ] [REMOTE ] BFK: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:31:02.326012] [DEBUG] [LOCAL ] BEPH: Primary data saved (4778 records). [2025-10-28T17:31:02.326362] [INFO ] [MAIN ] BEPH: Full history saved. [2025-10-28T17:31:02.326445] [INFO ] [MAIN ] Update Progress: 252/2366 symbols completed. BEPH took 32.9s. Estimated remaining: 4h 19m 58s. Rate: 8.1 symbols/min [2025-10-28T17:31:02.368404] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-01. [2025-10-28T17:31:02.495483] [INFO ] [MAIN ] BFLY: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:31:02.545974] [DEBUG] [LOCAL ] BFLY: Loaded 51867 existing records from primary storage. [2025-10-28T17:31:02.546280] [INFO ] [MAIN ] BFLY: Loaded 51867 existing records. [2025-10-28T17:31:02.725700] [WARN ] [MAIN ] BFLY: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:31:02.725979] [INFO ] [MAIN ] BFLY: Wiping existing primary data before full refresh. [2025-10-28T17:31:02.726041] [INFO ] [LOCAL ] BFLY: Starting deletion of primary data. [2025-10-28T17:31:02.726457] [DEBUG] [LOCAL ] BFLY: Deleted primary data file. [2025-10-28T17:31:02.726525] [INFO ] [MAIN ] BFLY: Starting full primary refresh. [2025-10-28T17:31:02.904453] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-28T17:31:03.129614] [INFO ] [REMOTE ] BFLY: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:31:03.159292] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-02. [2025-10-28T17:31:03.480879] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-28T17:31:03.959367] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-01. [2025-10-28T17:31:04.278083] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-28T17:31:04.418398] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-28T17:31:04.759394] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-03. [2025-10-28T17:31:05.559322] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-02. [2025-10-28T17:31:05.888555] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-28T17:31:06.359348] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-04. [2025-10-28T17:31:06.434747] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-28T17:31:07.159393] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-01. [2025-10-28T17:31:07.616458] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-28T17:31:07.959351] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-05. [2025-10-28T17:31:08.551426] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-28T17:31:08.759346] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-03. [2025-10-28T17:31:09.322906] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-28T17:31:09.559337] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-02. [2025-10-28T17:31:09.842987] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-28T17:31:10.359381] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-06. [2025-10-28T17:31:10.725963] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-28T17:31:11.159360] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-02. [2025-10-28T17:31:11.673394] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-28T17:31:11.719455] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-28T17:31:11.959343] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-07. [2025-10-28T17:31:12.759399] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-04. [2025-10-28T17:31:13.131346] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-28T17:31:13.559398] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-03. [2025-10-28T17:31:13.971210] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-28T17:31:14.359354] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-05. [2025-10-28T17:31:14.817559] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-28T17:31:15.159362] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-04. [2025-10-28T17:31:15.230904] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-28T17:31:15.959386] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-03. [2025-10-28T17:31:16.443711] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-28T17:31:16.621045] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-28T17:31:16.759409] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-04. [2025-10-28T17:31:17.454001] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-28T17:31:17.559402] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-06. [2025-10-28T17:31:18.331544] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-28T17:31:18.359338] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-07. [2025-10-28T17:31:19.159307] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-05. [2025-10-28T17:31:19.353167] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-28T17:31:19.705157] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-28T17:31:19.959367] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-06. [2025-10-28T17:31:20.480956] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-28T17:31:20.759335] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-08. [2025-10-28T17:31:21.559360] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-08. [2025-10-28T17:31:21.653062] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-28T17:31:22.359310] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-09. [2025-10-28T17:31:22.469757] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-28T17:31:23.159388] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-05. [2025-10-28T17:31:23.412476] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-28T17:31:23.959357] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-10. [2025-10-28T17:31:24.492532] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-28T17:31:24.759380] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-06. [2025-10-28T17:31:25.559325] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-09. [2025-10-28T17:31:25.610204] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-28T17:31:25.617792] [INFO ] [REMOTE ] BFAM: Full fetch complete (47612 records). [2025-10-28T17:31:25.617993] [DEBUG] [VALIDATOR ] BFAM: Validating primary data. [2025-10-28T17:31:26.012870] [DEBUG] [VALIDATOR ] BFAM: All expected trading days are present. [2025-10-28T17:31:26.012953] [DEBUG] [VALIDATOR ] BFAM: Primary data validation passed. [2025-10-28T17:31:26.013579] [INFO ] [MAIN ] BFAM: Fetched primary data is valid. [2025-10-28T17:31:26.013635] [DEBUG] [LOCAL ] BFAM: Saving primary data. [2025-10-28T17:31:26.014861] [DEBUG] [LOCAL ] BFAM: Trimmed 47612 records to 33747 (keeping 200 days of data) [2025-10-28T17:31:26.218487] [DEBUG] [LOCAL ] BFAM: Primary data saved (33747 records). [2025-10-28T17:31:26.218753] [INFO ] [MAIN ] BFAM: Full history saved. [2025-10-28T17:31:26.218869] [INFO ] [MAIN ] Update Progress: 253/2366 symbols completed. BFAM took 27.4s. Estimated remaining: 4h 22m 8s. Rate: 8.1 symbols/min [2025-10-28T17:31:26.347563] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-28T17:31:26.367782] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-07. [2025-10-28T17:31:26.440109] [INFO ] [MAIN ] BFS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:31:26.450766] [DEBUG] [LOCAL ] BFS: Loaded 9503 existing records from primary storage. [2025-10-28T17:31:26.450966] [INFO ] [MAIN ] BFS: Loaded 9503 existing records. [2025-10-28T17:31:26.634781] [WARN ] [MAIN ] BFS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:31:26.635404] [INFO ] [MAIN ] BFS: Wiping existing primary data before full refresh. [2025-10-28T17:31:26.635536] [INFO ] [LOCAL ] BFS: Starting deletion of primary data. [2025-10-28T17:31:26.636035] [DEBUG] [LOCAL ] BFS: Deleted primary data file. [2025-10-28T17:31:26.636105] [INFO ] [MAIN ] BFS: Starting full primary refresh. [2025-10-28T17:31:26.854134] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-28T17:31:27.047276] [INFO ] [REMOTE ] BFS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:31:27.059445] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-28T17:31:27.159297] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-08. [2025-10-28T17:31:27.658306] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-28T17:31:27.959316] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-09. [2025-10-28T17:31:28.507631] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-28T17:31:28.759363] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-01. [2025-10-28T17:31:29.559336] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-07. [2025-10-28T17:31:29.680552] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-28T17:31:30.359338] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-02. [2025-10-28T17:31:30.872477] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-28T17:31:31.004427] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-28T17:31:31.159319] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-08. [2025-10-28T17:31:31.959330] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-03. [2025-10-28T17:31:32.548900] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-28T17:31:32.620220] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-28T17:31:32.759325] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-04. [2025-10-28T17:31:33.317515] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-28T17:31:33.559345] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-05. [2025-10-28T17:31:34.048263] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-28T17:31:34.359344] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-10. [2025-10-28T17:31:35.159340] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-06. [2025-10-28T17:31:35.757428] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-28T17:31:35.766246] [INFO ] [REMOTE ] BFH: Full fetch complete (60309 records). [2025-10-28T17:31:35.766383] [DEBUG] [VALIDATOR ] BFH: Validating primary data. [2025-10-28T17:31:35.885343] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-28T17:31:35.967777] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-07. [2025-10-28T17:31:36.172984] [DEBUG] [VALIDATOR ] BFH: All expected trading days are present. [2025-10-28T17:31:36.173080] [DEBUG] [VALIDATOR ] BFH: Primary data validation passed. [2025-10-28T17:31:36.173743] [INFO ] [MAIN ] BFH: Fetched primary data is valid. [2025-10-28T17:31:36.173807] [DEBUG] [LOCAL ] BFH: Saving primary data. [2025-10-28T17:31:36.175010] [DEBUG] [LOCAL ] BFH: Trimmed 60309 records to 41132 (keeping 200 days of data) [2025-10-28T17:31:36.422356] [DEBUG] [LOCAL ] BFH: Primary data saved (41132 records). [2025-10-28T17:31:36.422472] [INFO ] [MAIN ] BFH: Full history saved. [2025-10-28T17:31:36.422547] [INFO ] [MAIN ] Update Progress: 254/2366 symbols completed. BFH took 36.8s. Estimated remaining: 4h 22m 24s. Rate: 8.0 symbols/min [2025-10-28T17:31:36.596274] [INFO ] [MAIN ] BFZ: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:31:36.607887] [DEBUG] [LOCAL ] BFZ: Loaded 11944 existing records from primary storage. [2025-10-28T17:31:36.608062] [INFO ] [MAIN ] BFZ: Loaded 11944 existing records. [2025-10-28T17:31:36.722836] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-28T17:31:36.765688] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-08. [2025-10-28T17:31:36.806573] [WARN ] [MAIN ] BFZ: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:31:36.807000] [INFO ] [MAIN ] BFZ: Wiping existing primary data before full refresh. [2025-10-28T17:31:36.807050] [INFO ] [LOCAL ] BFZ: Starting deletion of primary data. [2025-10-28T17:31:36.807378] [DEBUG] [LOCAL ] BFZ: Deleted primary data file. [2025-10-28T17:31:36.807437] [INFO ] [MAIN ] BFZ: Starting full primary refresh. [2025-10-28T17:31:37.169387] [INFO ] [REMOTE ] BFZ: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:31:37.362195] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-28T17:31:37.559328] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-01. [2025-10-28T17:31:38.146077] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-28T17:31:38.359439] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-09. [2025-10-28T17:31:38.900672] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-28T17:31:39.159353] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-02. [2025-10-28T17:31:39.786591] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-28T17:31:39.959359] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-10. [2025-10-28T17:31:40.759319] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-09. [2025-10-28T17:31:40.830082] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-28T17:31:40.835386] [INFO ] [REMOTE ] BFK: Full fetch complete (19494 records). [2025-10-28T17:31:40.835558] [DEBUG] [VALIDATOR ] BFK: Validating primary data. [2025-10-28T17:31:41.199613] [DEBUG] [VALIDATOR ] BFK: All expected trading days are present. [2025-10-28T17:31:41.199714] [DEBUG] [VALIDATOR ] BFK: Primary data validation passed. [2025-10-28T17:31:41.200088] [INFO ] [MAIN ] BFK: Fetched primary data is valid. [2025-10-28T17:31:41.200127] [DEBUG] [LOCAL ] BFK: Saving primary data. [2025-10-28T17:31:41.200708] [DEBUG] [LOCAL ] BFK: Trimmed 19494 records to 13780 (keeping 200 days of data) [2025-10-28T17:31:41.281189] [DEBUG] [LOCAL ] BFK: Primary data saved (13780 records). [2025-10-28T17:31:41.281324] [INFO ] [MAIN ] BFK: Full history saved. [2025-10-28T17:31:41.281393] [INFO ] [MAIN ] Update Progress: 255/2366 symbols completed. BFK took 40.0s. Estimated remaining: 4h 21m 55s. Rate: 8.1 symbols/min [2025-10-28T17:31:41.447047] [INFO ] [MAIN ] BG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:31:41.447236] [DEBUG] [LOCAL ] BG: No existing data file found in primary storage. [2025-10-28T17:31:41.447284] [WARN ] [MAIN ] BG: No existing data found, performing full refresh instead. [2025-10-28T17:31:41.447390] [INFO ] [MAIN ] BG: Wiping existing primary data before full refresh. [2025-10-28T17:31:41.447430] [INFO ] [LOCAL ] BG: Starting deletion of primary data. [2025-10-28T17:31:41.447469] [DEBUG] [LOCAL ] BG: No primary data file found to delete. [2025-10-28T17:31:41.447500] [INFO ] [MAIN ] BG: Starting full primary refresh. [2025-10-28T17:31:41.564608] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-10. [2025-10-28T17:31:41.808126] [INFO ] [REMOTE ] BG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:31:42.219032] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-28T17:31:42.359298] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-10. [2025-10-28T17:31:42.441951] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-28T17:31:42.444459] [INFO ] [REMOTE ] BFS: Full fetch complete (13107 records). [2025-10-28T17:31:42.444526] [DEBUG] [VALIDATOR ] BFS: Validating primary data. [2025-10-28T17:31:42.822770] [DEBUG] [VALIDATOR ] BFS: All expected trading days are present. [2025-10-28T17:31:42.822839] [DEBUG] [VALIDATOR ] BFS: Primary data validation passed. [2025-10-28T17:31:42.823120] [INFO ] [MAIN ] BFS: Fetched primary data is valid. [2025-10-28T17:31:42.823159] [DEBUG] [LOCAL ] BFS: Saving primary data. [2025-10-28T17:31:42.823615] [DEBUG] [LOCAL ] BFS: Trimmed 13107 records to 9454 (keeping 200 days of data) [2025-10-28T17:31:42.879314] [DEBUG] [LOCAL ] BFS: Primary data saved (9454 records). [2025-10-28T17:31:42.879428] [INFO ] [MAIN ] BFS: Full history saved. [2025-10-28T17:31:42.879505] [INFO ] [MAIN ] Update Progress: 256/2366 symbols completed. BFS took 16.7s. Estimated remaining: 4h 20m 59s. Rate: 8.1 symbols/min [2025-10-28T17:31:43.046748] [INFO ] [MAIN ] BGB: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:31:43.062902] [DEBUG] [LOCAL ] BGB: Loaded 17226 existing records from primary storage. [2025-10-28T17:31:43.063122] [INFO ] [MAIN ] BGB: Loaded 17226 existing records. [2025-10-28T17:31:43.164572] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-01. [2025-10-28T17:31:43.248431] [WARN ] [MAIN ] BGB: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:31:43.248670] [INFO ] [MAIN ] BGB: Wiping existing primary data before full refresh. [2025-10-28T17:31:43.248741] [INFO ] [LOCAL ] BGB: Starting deletion of primary data. [2025-10-28T17:31:43.249199] [DEBUG] [LOCAL ] BGB: Deleted primary data file. [2025-10-28T17:31:43.249259] [INFO ] [MAIN ] BGB: Starting full primary refresh. [2025-10-28T17:31:43.616054] [INFO ] [REMOTE ] BGB: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:31:43.881450] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-28T17:31:43.891871] [INFO ] [REMOTE ] BFLY: Full fetch complete (75484 records). [2025-10-28T17:31:43.891989] [DEBUG] [VALIDATOR ] BFLY: Validating primary data. [2025-10-28T17:31:43.966741] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-03. [2025-10-28T17:31:44.286953] [DEBUG] [VALIDATOR ] BFLY: All expected trading days are present. [2025-10-28T17:31:44.287031] [DEBUG] [VALIDATOR ] BFLY: Primary data validation passed. [2025-10-28T17:31:44.287842] [INFO ] [MAIN ] BFLY: Fetched primary data is valid. [2025-10-28T17:31:44.287928] [DEBUG] [LOCAL ] BFLY: Saving primary data. [2025-10-28T17:31:44.289309] [DEBUG] [LOCAL ] BFLY: Trimmed 75484 records to 51850 (keeping 200 days of data) [2025-10-28T17:31:44.603118] [DEBUG] [LOCAL ] BFLY: Primary data saved (51850 records). [2025-10-28T17:31:44.603324] [INFO ] [MAIN ] BFLY: Full history saved. [2025-10-28T17:31:44.610149] [INFO ] [MAIN ] Update Progress: 257/2366 symbols completed. BFLY took 42.3s. Estimated remaining: 4h 20m 5s. Rate: 8.1 symbols/min [2025-10-28T17:31:44.632677] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-28T17:31:44.646958] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-28T17:31:44.769955] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-02. [2025-10-28T17:31:44.803252] [INFO ] [MAIN ] BGH: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:31:44.803379] [DEBUG] [LOCAL ] BGH: No existing data file found in primary storage. [2025-10-28T17:31:44.803423] [WARN ] [MAIN ] BGH: No existing data found, performing full refresh instead. [2025-10-28T17:31:44.803526] [INFO ] [MAIN ] BGH: Wiping existing primary data before full refresh. [2025-10-28T17:31:44.803566] [INFO ] [LOCAL ] BGH: Starting deletion of primary data. [2025-10-28T17:31:44.803605] [DEBUG] [LOCAL ] BGH: No primary data file found to delete. [2025-10-28T17:31:44.804162] [INFO ] [MAIN ] BGH: Starting full primary refresh. [2025-10-28T17:31:45.158330] [INFO ] [REMOTE ] BGH: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:31:45.559390] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-01. [2025-10-28T17:31:46.057848] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-28T17:31:46.359390] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-04. [2025-10-28T17:31:46.457173] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-28T17:31:46.775445] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-28T17:31:47.159352] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-05. [2025-10-28T17:31:47.637681] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-28T17:31:47.959382] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-01. [2025-10-28T17:31:48.549490] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-28T17:31:48.759349] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-02. [2025-10-28T17:31:49.229254] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-28T17:31:49.559336] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-06. [2025-10-28T17:31:50.156303] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-28T17:31:50.359348] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-03. [2025-10-28T17:31:50.911923] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-28T17:31:51.159333] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-07. [2025-10-28T17:31:51.661538] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-10-28T17:31:51.959348] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-04. [2025-10-28T17:31:52.759315] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-08. [2025-10-28T17:31:52.893529] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-28T17:31:53.559395] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-03. [2025-10-28T17:31:53.623832] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-28T17:31:54.359335] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-09. [2025-10-28T17:31:54.894699] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-28T17:31:55.064702] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-28T17:31:55.159346] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-04. [2025-10-28T17:31:55.959334] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-02. [2025-10-28T17:31:56.521639] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-28T17:31:56.644710] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-28T17:31:56.759354] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-03. [2025-10-28T17:31:57.463412] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-28T17:31:57.559337] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-10. [2025-10-28T17:31:58.115865] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-28T17:31:58.118532] [INFO ] [REMOTE ] BFZ: Full fetch complete (17576 records). [2025-10-28T17:31:58.118601] [DEBUG] [VALIDATOR ] BFZ: Validating primary data. [2025-10-28T17:31:58.119055] [FATAL] [VALIDATOR ] BFZ: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T17:31:58.119133] [FATAL] [MAIN ] BFZ: Fetched primary data is invalid. Refusing to save it. [2025-10-28T17:31:58.119175] [WARN ] [MAIN ] BFZ: Deleting existing primary and derivative data due to validation failure. [2025-10-28T17:31:58.119237] [INFO ] [LOCAL ] BFZ: Starting deletion of primary data. [2025-10-28T17:31:58.119300] [DEBUG] [LOCAL ] BFZ: No primary data file found to delete. [2025-10-28T17:31:58.119336] [INFO ] [LOCAL ] BFZ: Starting deletion of derivative data. [2025-10-28T17:31:58.119512] [DEBUG] [LOCAL ] BFZ: Deleted derivative data file. [2025-10-28T17:31:58.119595] [INFO ] [MAIN ] Update Progress: 258/2366 symbols completed. BFZ took 21.7s. Estimated remaining: 4h 20m 48s. Rate: 8.1 symbols/min [2025-10-28T17:31:58.292909] [INFO ] [MAIN ] BGR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:31:58.305714] [DEBUG] [LOCAL ] BGR: Loaded 13127 existing records from primary storage. [2025-10-28T17:31:58.305897] [INFO ] [MAIN ] BGR: Loaded 13127 existing records. [2025-10-28T17:31:58.366317] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-05. [2025-10-28T17:31:58.488639] [WARN ] [MAIN ] BGR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:31:58.488866] [INFO ] [MAIN ] BGR: Wiping existing primary data before full refresh. [2025-10-28T17:31:58.488914] [INFO ] [LOCAL ] BGR: Starting deletion of primary data. [2025-10-28T17:31:58.489236] [DEBUG] [LOCAL ] BGR: Deleted primary data file. [2025-10-28T17:31:58.489297] [INFO ] [MAIN ] BGR: Starting full primary refresh. [2025-10-28T17:31:58.838937] [INFO ] [REMOTE ] BGR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:31:59.159311] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-04. [2025-10-28T17:31:59.171896] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-28T17:31:59.925766] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-28T17:31:59.959318] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-05. [2025-10-28T17:32:00.759340] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-06. [2025-10-28T17:32:01.341396] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-28T17:32:01.559333] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-07. [2025-10-28T17:32:01.740082] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-10-28T17:32:02.319766] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-28T17:32:02.359298] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-08. [2025-10-28T17:32:03.084353] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-28T17:32:03.159299] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-09. [2025-10-28T17:32:03.799535] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-28T17:32:03.959380] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-05. [2025-10-28T17:32:04.624884] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-28T17:32:04.759370] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-10. [2025-10-28T17:32:05.505766] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-28T17:32:05.511307] [INFO ] [REMOTE ] BGH: Full fetch complete (23082 records). [2025-10-28T17:32:05.511476] [DEBUG] [VALIDATOR ] BGH: Validating primary data. [2025-10-28T17:32:05.564476] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-01. [2025-10-28T17:32:05.931946] [DEBUG] [VALIDATOR ] BGH: All expected trading days are present. [2025-10-28T17:32:05.932021] [DEBUG] [VALIDATOR ] BGH: Primary data validation passed. [2025-10-28T17:32:05.932355] [INFO ] [MAIN ] BGH: Fetched primary data is valid. [2025-10-28T17:32:05.932394] [DEBUG] [LOCAL ] BGH: Saving primary data. [2025-10-28T17:32:05.933141] [DEBUG] [LOCAL ] BGH: Trimmed 23082 records to 16819 (keeping 200 days of data) [2025-10-28T17:32:06.035880] [DEBUG] [LOCAL ] BGH: Primary data saved (16819 records). [2025-10-28T17:32:06.036016] [INFO ] [MAIN ] BGH: Full history saved. [2025-10-28T17:32:06.036087] [INFO ] [MAIN ] Update Progress: 259/2366 symbols completed. BGH took 21.4s. Estimated remaining: 4h 20m 44s. Rate: 8.1 symbols/min [2025-10-28T17:32:06.208071] [INFO ] [MAIN ] BGS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:32:06.248713] [DEBUG] [LOCAL ] BGS: Loaded 50455 existing records from primary storage. [2025-10-28T17:32:06.249026] [INFO ] [MAIN ] BGS: Loaded 50455 existing records. [2025-10-28T17:32:06.364395] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-06. [2025-10-28T17:32:06.437368] [WARN ] [MAIN ] BGS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:32:06.437633] [INFO ] [MAIN ] BGS: Wiping existing primary data before full refresh. [2025-10-28T17:32:06.437727] [INFO ] [LOCAL ] BGS: Starting deletion of primary data. [2025-10-28T17:32:06.438967] [DEBUG] [LOCAL ] BGS: Deleted primary data file. [2025-10-28T17:32:06.439028] [INFO ] [MAIN ] BGS: Starting full primary refresh. [2025-10-28T17:32:06.608933] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-28T17:32:06.823498] [INFO ] [REMOTE ] BGS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:32:07.124625] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-28T17:32:07.159319] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-07. [2025-10-28T17:32:07.800908] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-28T17:32:07.959356] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-08. [2025-10-28T17:32:08.522817] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-28T17:32:08.759372] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-09. [2025-10-28T17:32:09.349045] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-28T17:32:09.559354] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-06. [2025-10-28T17:32:10.359382] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-10. [2025-10-28T17:32:11.159344] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-02. [2025-10-28T17:32:11.177747] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-28T17:32:11.183004] [INFO ] [REMOTE ] BGB: Full fetch complete (26386 records). [2025-10-28T17:32:11.183139] [DEBUG] [VALIDATOR ] BGB: Validating primary data. [2025-10-28T17:32:11.183824] [FATAL] [VALIDATOR ] BGB: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T17:32:11.183930] [FATAL] [MAIN ] BGB: Fetched primary data is invalid. Refusing to save it. [2025-10-28T17:32:11.183986] [WARN ] [MAIN ] BGB: Deleting existing primary and derivative data due to validation failure. [2025-10-28T17:32:11.184066] [INFO ] [LOCAL ] BGB: Starting deletion of primary data. [2025-10-28T17:32:11.184146] [DEBUG] [LOCAL ] BGB: No primary data file found to delete. [2025-10-28T17:32:11.184196] [INFO ] [LOCAL ] BGB: Starting deletion of derivative data. [2025-10-28T17:32:11.184488] [DEBUG] [LOCAL ] BGB: Deleted derivative data file. [2025-10-28T17:32:11.184628] [INFO ] [MAIN ] Update Progress: 260/2366 symbols completed. BGB took 28.3s. Estimated remaining: 4h 20m 18s. Rate: 8.1 symbols/min [2025-10-28T17:32:11.400612] [INFO ] [MAIN ] BGSF: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:32:11.407537] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-28T17:32:11.426171] [DEBUG] [LOCAL ] BGSF: Loaded 8297 existing records from primary storage. [2025-10-28T17:32:11.426388] [INFO ] [MAIN ] BGSF: Loaded 8297 existing records. [2025-10-28T17:32:11.628701] [WARN ] [MAIN ] BGSF: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:32:11.628919] [INFO ] [MAIN ] BGSF: Wiping existing primary data before full refresh. [2025-10-28T17:32:11.628968] [INFO ] [LOCAL ] BGSF: Starting deletion of primary data. [2025-10-28T17:32:11.629187] [DEBUG] [LOCAL ] BGSF: Deleted primary data file. [2025-10-28T17:32:11.629228] [INFO ] [MAIN ] BGSF: Starting full primary refresh. [2025-10-28T17:32:11.938864] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-28T17:32:11.964460] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-07. [2025-10-28T17:32:12.023346] [INFO ] [REMOTE ] BGSF: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:32:12.759409] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-03. [2025-10-28T17:32:13.324729] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-28T17:32:13.364570] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-28T17:32:13.559341] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-04. [2025-10-28T17:32:14.225424] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-28T17:32:14.359357] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-08. [2025-10-28T17:32:15.159325] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-01. [2025-10-28T17:32:15.562840] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-10-28T17:32:15.639011] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-28T17:32:15.959324] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-05. [2025-10-28T17:32:16.721724] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-28T17:32:16.759322] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-06. [2025-10-28T17:32:17.539434] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-28T17:32:17.559298] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-07. [2025-10-28T17:32:18.088212] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-28T17:32:18.359341] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-02. [2025-10-28T17:32:18.637373] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-02 (0.28 seconds). [2025-10-28T17:32:19.159334] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-08. [2025-10-28T17:32:19.814225] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-28T17:32:19.959332] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-09. [2025-10-28T17:32:20.759346] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-03. [2025-10-28T17:32:20.902305] [DEBUG] [REMOTE ] BGSF: Error fetching primary data for 2025-03: 'API call returned an empty response.' [2025-10-28T17:32:20.902678] [WARN ] [REMOTE ] BGSF: No data returned for month 2025-03 [2025-10-28T17:32:20.902766] [FATAL] [REMOTE ] BGSF: API call failed - aborting fetch to avoid wasting further API calls [2025-10-28T17:32:20.902850] [FATAL] [MAIN ] BGSF: Failed to fetch primary data. [2025-10-28T17:32:20.902919] [WARN ] [MAIN ] BGSF: Deleting existing primary and derivative data due to fetch failure. [2025-10-28T17:32:20.902972] [INFO ] [LOCAL ] BGSF: Starting deletion of primary data. [2025-10-28T17:32:20.903059] [DEBUG] [LOCAL ] BGSF: No primary data file found to delete. [2025-10-28T17:32:20.903106] [INFO ] [LOCAL ] BGSF: Starting deletion of derivative data. [2025-10-28T17:32:20.903618] [DEBUG] [LOCAL ] BGSF: Deleted derivative data file. [2025-10-28T17:32:20.903737] [INFO ] [MAIN ] Update Progress: 261/2366 symbols completed. BGSF took 9.7s. Estimated remaining: 4h 20m 29s. Rate: 8.1 symbols/min [2025-10-28T17:32:21.102683] [INFO ] [MAIN ] BGT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:32:21.124153] [DEBUG] [LOCAL ] BGT: Loaded 15819 existing records from primary storage. [2025-10-28T17:32:21.124416] [INFO ] [MAIN ] BGT: Loaded 15819 existing records. [2025-10-28T17:32:21.300575] [WARN ] [MAIN ] BGT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:32:21.300851] [INFO ] [MAIN ] BGT: Wiping existing primary data before full refresh. [2025-10-28T17:32:21.300979] [INFO ] [LOCAL ] BGT: Starting deletion of primary data. [2025-10-28T17:32:21.301305] [DEBUG] [LOCAL ] BGT: Deleted primary data file. [2025-10-28T17:32:21.301368] [INFO ] [MAIN ] BGT: Starting full primary refresh. [2025-10-28T17:32:21.564490] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-09. [2025-10-28T17:32:21.659462] [INFO ] [REMOTE ] BGT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:32:21.709330] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-28T17:32:22.156249] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-28T17:32:22.359341] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-01. [2025-10-28T17:32:23.159322] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-01. [2025-10-28T17:32:23.276552] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-28T17:32:23.959351] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-10. [2025-10-28T17:32:24.400133] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-28T17:32:24.759391] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-02. [2025-10-28T17:32:24.849458] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-28T17:32:24.852353] [INFO ] [REMOTE ] BGR: Full fetch complete (19878 records). [2025-10-28T17:32:24.852425] [DEBUG] [VALIDATOR ] BGR: Validating primary data. [2025-10-28T17:32:25.213092] [DEBUG] [VALIDATOR ] BGR: All expected trading days are present. [2025-10-28T17:32:25.213227] [DEBUG] [VALIDATOR ] BGR: Primary data validation passed. [2025-10-28T17:32:25.213579] [INFO ] [MAIN ] BGR: Fetched primary data is valid. [2025-10-28T17:32:25.213622] [DEBUG] [LOCAL ] BGR: Saving primary data. [2025-10-28T17:32:25.214390] [DEBUG] [LOCAL ] BGR: Trimmed 19878 records to 13033 (keeping 200 days of data) [2025-10-28T17:32:25.296558] [DEBUG] [LOCAL ] BGR: Primary data saved (13033 records). [2025-10-28T17:32:25.296772] [INFO ] [MAIN ] BGR: Full history saved. [2025-10-28T17:32:25.296893] [INFO ] [MAIN ] Update Progress: 262/2366 symbols completed. BGR took 27.2s. Estimated remaining: 4h 19m 58s. Rate: 8.1 symbols/min [2025-10-28T17:32:25.408932] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-28T17:32:25.479342] [INFO ] [MAIN ] BGX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:32:25.489817] [DEBUG] [LOCAL ] BGX: Loaded 10924 existing records from primary storage. [2025-10-28T17:32:25.490000] [INFO ] [MAIN ] BGX: Loaded 10924 existing records. [2025-10-28T17:32:25.564464] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-03. [2025-10-28T17:32:25.668905] [WARN ] [MAIN ] BGX: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:32:25.669074] [INFO ] [MAIN ] BGX: Wiping existing primary data before full refresh. [2025-10-28T17:32:25.669124] [INFO ] [LOCAL ] BGX: Starting deletion of primary data. [2025-10-28T17:32:25.669430] [DEBUG] [LOCAL ] BGX: Deleted primary data file. [2025-10-28T17:32:25.669487] [INFO ] [MAIN ] BGX: Starting full primary refresh. [2025-10-28T17:32:26.030374] [INFO ] [REMOTE ] BGX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:32:26.187060] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-28T17:32:26.359329] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-10. [2025-10-28T17:32:27.159361] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-04. [2025-10-28T17:32:27.758432] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-28T17:32:27.769579] [INFO ] [REMOTE ] BG: Full fetch complete (73032 records). [2025-10-28T17:32:27.769747] [DEBUG] [VALIDATOR ] BG: Validating primary data. [2025-10-28T17:32:27.921777] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-28T17:32:27.979925] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-05. [2025-10-28T17:32:28.198443] [DEBUG] [VALIDATOR ] BG: All expected trading days are present. [2025-10-28T17:32:28.198520] [DEBUG] [VALIDATOR ] BG: Primary data validation passed. [2025-10-28T17:32:28.199233] [INFO ] [MAIN ] BG: Fetched primary data is valid. [2025-10-28T17:32:28.199294] [DEBUG] [LOCAL ] BG: Saving primary data. [2025-10-28T17:32:28.200685] [DEBUG] [LOCAL ] BG: Trimmed 73032 records to 50357 (keeping 200 days of data) [2025-10-28T17:32:28.500037] [DEBUG] [LOCAL ] BG: Primary data saved (50357 records). [2025-10-28T17:32:28.500166] [INFO ] [MAIN ] BG: Full history saved. [2025-10-28T17:32:28.500234] [INFO ] [MAIN ] Update Progress: 263/2366 symbols completed. BG took 47.2s. Estimated remaining: 4h 19m 17s. Rate: 8.1 symbols/min [2025-10-28T17:32:28.667581] [INFO ] [MAIN ] BGY: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:32:28.686560] [DEBUG] [LOCAL ] BGY: Loaded 21175 existing records from primary storage. [2025-10-28T17:32:28.686826] [INFO ] [MAIN ] BGY: Loaded 21175 existing records. [2025-10-28T17:32:28.759921] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-02. [2025-10-28T17:32:28.877689] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-28T17:32:28.877274] [WARN ] [MAIN ] BGY: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:32:28.878014] [INFO ] [MAIN ] BGY: Wiping existing primary data before full refresh. [2025-10-28T17:32:28.881274] [INFO ] [LOCAL ] BGY: Starting deletion of primary data. [2025-10-28T17:32:28.882084] [DEBUG] [LOCAL ] BGY: Deleted primary data file. [2025-10-28T17:32:28.882153] [INFO ] [MAIN ] BGY: Starting full primary refresh. [2025-10-28T17:32:29.224775] [INFO ] [REMOTE ] BGY: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:32:29.559350] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-01. [2025-10-28T17:32:29.922764] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-28T17:32:30.359326] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-06. [2025-10-28T17:32:30.410051] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-28T17:32:30.918028] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-28T17:32:31.159350] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-03. [2025-10-28T17:32:31.959345] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-07. [2025-10-28T17:32:32.351470] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-28T17:32:32.764184] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-04. [2025-10-28T17:32:32.770701] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-28T17:32:33.559346] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-08. [2025-10-28T17:32:33.990330] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-28T17:32:34.263198] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-28T17:32:34.359313] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-01. [2025-10-28T17:32:34.926994] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-28T17:32:35.159370] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-02. [2025-10-28T17:32:35.764326] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-28T17:32:35.959357] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-05. [2025-10-28T17:32:36.759368] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-02. [2025-10-28T17:32:37.244418] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-28T17:32:37.311680] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-28T17:32:37.559355] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-03. [2025-10-28T17:32:38.094360] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-28T17:32:38.359334] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-06. [2025-10-28T17:32:39.159318] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-04. [2025-10-28T17:32:39.452312] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-28T17:32:39.589859] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-28T17:32:39.959351] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-09. [2025-10-28T17:32:40.508688] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-28T17:32:40.759414] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-05. [2025-10-28T17:32:41.278793] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-28T17:32:41.559336] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-03. [2025-10-28T17:32:42.359351] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-06. [2025-10-28T17:32:42.555913] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-28T17:32:42.857731] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-28T17:32:43.159370] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-07. [2025-10-28T17:32:43.677373] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-28T17:32:43.959334] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-08. [2025-10-28T17:32:44.425274] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-28T17:32:44.759335] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-10. [2025-10-28T17:32:45.559310] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-09. [2025-10-28T17:32:45.756444] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-28T17:32:45.759603] [INFO ] [REMOTE ] BGT: Full fetch complete (23974 records). [2025-10-28T17:32:45.759706] [DEBUG] [VALIDATOR ] BGT: Validating primary data. [2025-10-28T17:32:46.136442] [DEBUG] [VALIDATOR ] BGT: All expected trading days are present. [2025-10-28T17:32:46.136542] [DEBUG] [VALIDATOR ] BGT: Primary data validation passed. [2025-10-28T17:32:46.137000] [INFO ] [MAIN ] BGT: Fetched primary data is valid. [2025-10-28T17:32:46.137063] [DEBUG] [LOCAL ] BGT: Saving primary data. [2025-10-28T17:32:46.137852] [DEBUG] [LOCAL ] BGT: Trimmed 23974 records to 15761 (keeping 200 days of data) [2025-10-28T17:32:46.232368] [DEBUG] [LOCAL ] BGT: Primary data saved (15761 records). [2025-10-28T17:32:46.232499] [INFO ] [MAIN ] BGT: Full history saved. [2025-10-28T17:32:46.232573] [INFO ] [MAIN ] Update Progress: 264/2366 symbols completed. BGT took 25.3s. Estimated remaining: 4h 20m 32s. Rate: 8.1 symbols/min [2025-10-28T17:32:46.364386] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-04. [2025-10-28T17:32:46.410236] [INFO ] [MAIN ] BH: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:32:46.410547] [DEBUG] [LOCAL ] BH: No existing data file found in primary storage. [2025-10-28T17:32:46.410773] [WARN ] [MAIN ] BH: No existing data found, performing full refresh instead. [2025-10-28T17:32:46.411413] [INFO ] [MAIN ] BH: Wiping existing primary data before full refresh. [2025-10-28T17:32:46.411488] [INFO ] [LOCAL ] BH: Starting deletion of primary data. [2025-10-28T17:32:46.411573] [DEBUG] [LOCAL ] BH: No primary data file found to delete. [2025-10-28T17:32:46.411618] [INFO ] [MAIN ] BH: Starting full primary refresh. [2025-10-28T17:32:46.541780] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-28T17:32:46.783492] [INFO ] [REMOTE ] BH: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:32:47.146978] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-28T17:32:47.159293] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-05. [2025-10-28T17:32:47.867564] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-28T17:32:47.959326] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-06. [2025-10-28T17:32:48.633030] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-28T17:32:48.759324] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-07. [2025-10-28T17:32:49.550149] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-28T17:32:49.559295] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-08. [2025-10-28T17:32:50.206092] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-28T17:32:50.359333] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-07. [2025-10-28T17:32:51.159399] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-09. [2025-10-28T17:32:51.766519] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-28T17:32:51.968365] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-10. [2025-10-28T17:32:51.988422] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-28T17:32:52.759345] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-01. [2025-10-28T17:32:52.961864] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-28T17:32:52.966471] [INFO ] [REMOTE ] BGY: Full fetch complete (32918 records). [2025-10-28T17:32:52.966565] [DEBUG] [VALIDATOR ] BGY: Validating primary data. [2025-10-28T17:32:53.355046] [DEBUG] [VALIDATOR ] BGY: All expected trading days are present. [2025-10-28T17:32:53.355124] [DEBUG] [VALIDATOR ] BGY: Primary data validation passed. [2025-10-28T17:32:53.355525] [INFO ] [MAIN ] BGY: Fetched primary data is valid. [2025-10-28T17:32:53.355565] [DEBUG] [LOCAL ] BGY: Saving primary data. [2025-10-28T17:32:53.356293] [DEBUG] [LOCAL ] BGY: Trimmed 32918 records to 21157 (keeping 200 days of data) [2025-10-28T17:32:53.462030] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-28T17:32:53.488661] [DEBUG] [LOCAL ] BGY: Primary data saved (21157 records). [2025-10-28T17:32:53.488796] [INFO ] [MAIN ] BGY: Full history saved. [2025-10-28T17:32:53.488888] [INFO ] [MAIN ] Update Progress: 265/2366 symbols completed. BGY took 25.0s. Estimated remaining: 4h 20m 23s. Rate: 8.1 symbols/min [2025-10-28T17:32:53.564434] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-10. [2025-10-28T17:32:53.665132] [INFO ] [MAIN ] BHC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:32:53.704986] [DEBUG] [LOCAL ] BHC: Loaded 46452 existing records from primary storage. [2025-10-28T17:32:53.705276] [INFO ] [MAIN ] BHC: Loaded 46452 existing records. [2025-10-28T17:32:53.877391] [WARN ] [MAIN ] BHC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:32:53.877582] [INFO ] [MAIN ] BHC: Wiping existing primary data before full refresh. [2025-10-28T17:32:53.877630] [INFO ] [LOCAL ] BHC: Starting deletion of primary data. [2025-10-28T17:32:53.878120] [DEBUG] [LOCAL ] BHC: Deleted primary data file. [2025-10-28T17:32:53.878177] [INFO ] [MAIN ] BHC: Starting full primary refresh. [2025-10-28T17:32:54.226203] [INFO ] [REMOTE ] BHC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:32:54.315216] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-28T17:32:54.318707] [INFO ] [REMOTE ] BGX: Full fetch complete (16463 records). [2025-10-28T17:32:54.318783] [DEBUG] [VALIDATOR ] BGX: Validating primary data. [2025-10-28T17:32:54.364405] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-02. [2025-10-28T17:32:54.687673] [DEBUG] [VALIDATOR ] BGX: All expected trading days are present. [2025-10-28T17:32:54.687770] [DEBUG] [VALIDATOR ] BGX: Primary data validation passed. [2025-10-28T17:32:54.688089] [INFO ] [MAIN ] BGX: Fetched primary data is valid. [2025-10-28T17:32:54.688131] [DEBUG] [LOCAL ] BGX: Saving primary data. [2025-10-28T17:32:54.688601] [DEBUG] [LOCAL ] BGX: Trimmed 16463 records to 10865 (keeping 200 days of data) [2025-10-28T17:32:54.753786] [DEBUG] [LOCAL ] BGX: Primary data saved (10865 records). [2025-10-28T17:32:54.753911] [INFO ] [MAIN ] BGX: Full history saved. [2025-10-28T17:32:54.754029] [INFO ] [MAIN ] Update Progress: 266/2366 symbols completed. BGX took 29.5s. Estimated remaining: 4h 19m 27s. Rate: 8.1 symbols/min [2025-10-28T17:32:54.868356] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-28T17:32:54.926503] [INFO ] [MAIN ] BHE: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:32:54.926677] [DEBUG] [LOCAL ] BHE: No existing data file found in primary storage. [2025-10-28T17:32:54.926731] [WARN ] [MAIN ] BHE: No existing data found, performing full refresh instead. [2025-10-28T17:32:54.926841] [INFO ] [MAIN ] BHE: Wiping existing primary data before full refresh. [2025-10-28T17:32:54.926882] [INFO ] [LOCAL ] BHE: Starting deletion of primary data. [2025-10-28T17:32:54.926924] [DEBUG] [LOCAL ] BHE: No primary data file found to delete. [2025-10-28T17:32:54.926974] [INFO ] [MAIN ] BHE: Starting full primary refresh. [2025-10-28T17:32:55.164524] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-03. [2025-10-28T17:32:55.273887] [INFO ] [REMOTE ] BHE: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:32:55.691847] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-28T17:32:55.959343] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-08. [2025-10-28T17:32:56.759394] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-01. [2025-10-28T17:32:57.559314] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-04. [2025-10-28T17:32:57.673831] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-28T17:32:57.859450] [DEBUG] [REMOTE ] BHC: Error fetching primary data for 2025-01: ("Connection broken: ConnectionResetError(104, 'Connection reset by peer')", ConnectionResetError(104, 'Connection reset by peer')) [2025-10-28T17:32:57.859582] [WARN ] [REMOTE ] BHC: No data returned for month 2025-01 [2025-10-28T17:32:57.859681] [FATAL] [REMOTE ] BHC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-28T17:32:57.859746] [FATAL] [MAIN ] BHC: Failed to fetch primary data. [2025-10-28T17:32:57.859810] [WARN ] [MAIN ] BHC: Deleting existing primary and derivative data due to fetch failure. [2025-10-28T17:32:57.859877] [INFO ] [LOCAL ] BHC: Starting deletion of primary data. [2025-10-28T17:32:57.859940] [DEBUG] [LOCAL ] BHC: No primary data file found to delete. [2025-10-28T17:32:57.859976] [INFO ] [LOCAL ] BHC: Starting deletion of derivative data. [2025-10-28T17:32:57.860143] [DEBUG] [LOCAL ] BHC: Deleted derivative data file. [2025-10-28T17:32:57.860212] [INFO ] [MAIN ] Update Progress: 267/2366 symbols completed. BHC took 4.4s. Estimated remaining: 4h 18m 45s. Rate: 8.1 symbols/min [2025-10-28T17:32:58.030832] [INFO ] [MAIN ] BHK: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:32:58.037136] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-28T17:32:58.059913] [DEBUG] [LOCAL ] BHK: Loaded 23928 existing records from primary storage. [2025-10-28T17:32:58.060172] [INFO ] [MAIN ] BHK: Loaded 23928 existing records. [2025-10-28T17:32:58.230271] [WARN ] [MAIN ] BHK: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:32:58.230461] [INFO ] [MAIN ] BHK: Wiping existing primary data before full refresh. [2025-10-28T17:32:58.230506] [INFO ] [LOCAL ] BHK: Starting deletion of primary data. [2025-10-28T17:32:58.231523] [DEBUG] [LOCAL ] BHK: Deleted primary data file. [2025-10-28T17:32:58.231582] [INFO ] [MAIN ] BHK: Starting full primary refresh. [2025-10-28T17:32:58.366525] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-05. [2025-10-28T17:32:58.577236] [INFO ] [REMOTE ] BHK: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:32:58.978371] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-28T17:32:59.159329] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-09. [2025-10-28T17:32:59.959330] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-01. [2025-10-28T17:33:00.401264] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-28T17:33:00.759336] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-06. [2025-10-28T17:33:00.981306] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-28T17:33:01.507296] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-28T17:33:01.559377] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-01. [2025-10-28T17:33:02.249704] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-28T17:33:02.359370] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-07. [2025-10-28T17:33:03.093605] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-28T17:33:03.159333] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-02. [2025-10-28T17:33:03.956629] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-28T17:33:03.961161] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-10. [2025-10-28T17:33:04.759384] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-02. [2025-10-28T17:33:05.559353] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-08. [2025-10-28T17:33:05.700564] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-28T17:33:05.710791] [INFO ] [REMOTE ] BGS: Full fetch complete (72293 records). [2025-10-28T17:33:05.711030] [DEBUG] [VALIDATOR ] BGS: Validating primary data. [2025-10-28T17:33:05.723977] [FATAL] [VALIDATOR ] BGS: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T17:33:05.725938] [FATAL] [MAIN ] BGS: Fetched primary data is invalid. Refusing to save it. [2025-10-28T17:33:05.726527] [WARN ] [MAIN ] BGS: Deleting existing primary and derivative data due to validation failure. [2025-10-28T17:33:05.727463] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-28T17:33:05.727570] [INFO ] [LOCAL ] BGS: Starting deletion of primary data. [2025-10-28T17:33:05.733497] [DEBUG] [LOCAL ] BGS: No primary data file found to delete. [2025-10-28T17:33:05.733892] [INFO ] [LOCAL ] BGS: Starting deletion of derivative data. [2025-10-28T17:33:05.734064] [DEBUG] [LOCAL ] BGS: Deleted derivative data file. [2025-10-28T17:33:05.734154] [INFO ] [MAIN ] Update Progress: 268/2366 symbols completed. BGS took 59.7s. Estimated remaining: 4h 18m 42s. Rate: 8.1 symbols/min [2025-10-28T17:33:05.905329] [INFO ] [MAIN ] BHP: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:33:05.950494] [DEBUG] [LOCAL ] BHP: Loaded 53359 existing records from primary storage. [2025-10-28T17:33:05.950819] [INFO ] [MAIN ] BHP: Loaded 53359 existing records. [2025-10-28T17:33:06.126426] [WARN ] [MAIN ] BHP: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:33:06.126685] [INFO ] [MAIN ] BHP: Wiping existing primary data before full refresh. [2025-10-28T17:33:06.126750] [INFO ] [LOCAL ] BHP: Starting deletion of primary data. [2025-10-28T17:33:06.127726] [DEBUG] [LOCAL ] BHP: Deleted primary data file. [2025-10-28T17:33:06.127784] [INFO ] [MAIN ] BHP: Starting full primary refresh. [2025-10-28T17:33:06.364718] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-03. [2025-10-28T17:33:06.506700] [INFO ] [REMOTE ] BHP: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:33:06.557759] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-28T17:33:07.159344] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-01. [2025-10-28T17:33:07.403590] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-28T17:33:07.959379] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-03. [2025-10-28T17:33:08.682372] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-28T17:33:08.767190] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-04. [2025-10-28T17:33:08.790269] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-28T17:33:09.559328] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-02. [2025-10-28T17:33:09.767545] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-28T17:33:10.359342] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-05. [2025-10-28T17:33:11.117532] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-28T17:33:11.159297] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-03. [2025-10-28T17:33:11.463040] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-28T17:33:11.959336] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-06. [2025-10-28T17:33:12.617536] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-28T17:33:12.759343] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-04. [2025-10-28T17:33:12.965473] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-28T17:33:13.516874] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-28T17:33:13.559333] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-05. [2025-10-28T17:33:14.359355] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-09. [2025-10-28T17:33:14.532338] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-28T17:33:15.023099] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-28T17:33:15.159362] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-10. [2025-10-28T17:33:15.962431] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-07. [2025-10-28T17:33:15.965279] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-28T17:33:15.968746] [INFO ] [REMOTE ] BH: Full fetch complete (19622 records). [2025-10-28T17:33:15.968821] [DEBUG] [VALIDATOR ] BH: Validating primary data. [2025-10-28T17:33:16.326827] [DEBUG] [VALIDATOR ] BH: All expected trading days are present. [2025-10-28T17:33:16.326905] [DEBUG] [VALIDATOR ] BH: Primary data validation passed. [2025-10-28T17:33:16.327282] [INFO ] [MAIN ] BH: Fetched primary data is valid. [2025-10-28T17:33:16.327341] [DEBUG] [LOCAL ] BH: Saving primary data. [2025-10-28T17:33:16.327945] [DEBUG] [LOCAL ] BH: Trimmed 19622 records to 16681 (keeping 200 days of data) [2025-10-28T17:33:16.423135] [DEBUG] [LOCAL ] BH: Primary data saved (16681 records). [2025-10-28T17:33:16.423261] [INFO ] [MAIN ] BH: Full history saved. [2025-10-28T17:33:16.423329] [INFO ] [MAIN ] Update Progress: 269/2366 symbols completed. BH took 30.2s. Estimated remaining: 4h 18m 60s. Rate: 8.1 symbols/min [2025-10-28T17:33:16.593224] [INFO ] [MAIN ] BHR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:33:16.612596] [DEBUG] [LOCAL ] BHR: Loaded 21977 existing records from primary storage. [2025-10-28T17:33:16.612863] [INFO ] [MAIN ] BHR: Loaded 21977 existing records. [2025-10-28T17:33:16.765483] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-06. [2025-10-28T17:33:16.800182] [WARN ] [MAIN ] BHR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:33:16.800608] [INFO ] [MAIN ] BHR: Wiping existing primary data before full refresh. [2025-10-28T17:33:16.800814] [INFO ] [LOCAL ] BHR: Starting deletion of primary data. [2025-10-28T17:33:16.801409] [DEBUG] [LOCAL ] BHR: Deleted primary data file. [2025-10-28T17:33:16.801471] [INFO ] [MAIN ] BHR: Starting full primary refresh. [2025-10-28T17:33:16.946271] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-28T17:33:17.216851] [INFO ] [REMOTE ] BHR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:33:17.559350] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-04. [2025-10-28T17:33:17.660331] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-28T17:33:18.359353] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-01. [2025-10-28T17:33:19.162268] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-07. [2025-10-28T17:33:19.165549] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-28T17:33:19.446099] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-28T17:33:19.959351] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-05. [2025-10-28T17:33:20.087330] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-28T17:33:20.759345] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-08. [2025-10-28T17:33:21.427421] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-28T17:33:21.559331] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-06. [2025-10-28T17:33:21.578964] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-28T17:33:22.359357] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-02. [2025-10-28T17:33:22.999767] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-28T17:33:23.159313] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-03. [2025-10-28T17:33:23.235951] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-28T17:33:23.846951] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-28T17:33:23.959340] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-04. [2025-10-28T17:33:24.622411] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-28T17:33:24.759377] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-08. [2025-10-28T17:33:25.559350] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-07. [2025-10-28T17:33:25.724447] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-28T17:33:26.359316] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-09. [2025-10-28T17:33:27.148485] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-28T17:33:27.166956] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-05. [2025-10-28T17:33:27.188972] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-10-28T17:33:27.939825] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-28T17:33:27.959307] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-06. [2025-10-28T17:33:28.598441] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-28T17:33:28.759331] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-07. [2025-10-28T17:33:29.520771] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-28T17:33:29.559327] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-08. [2025-10-28T17:33:30.208447] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-28T17:33:30.359352] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-09. [2025-10-28T17:33:31.166101] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-09. [2025-10-28T17:33:31.168000] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-28T17:33:31.959377] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-08. [2025-10-28T17:33:32.269282] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-28T17:33:32.759417] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-10. [2025-10-28T17:33:33.448768] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-28T17:33:33.559349] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-10. [2025-10-28T17:33:33.780759] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-28T17:33:33.786317] [INFO ] [REMOTE ] BHR: Full fetch complete (30924 records). [2025-10-28T17:33:33.786433] [DEBUG] [VALIDATOR ] BHR: Validating primary data. [2025-10-28T17:33:33.786995] [FATAL] [VALIDATOR ] BHR: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T17:33:33.787097] [FATAL] [MAIN ] BHR: Fetched primary data is invalid. Refusing to save it. [2025-10-28T17:33:33.787185] [WARN ] [MAIN ] BHR: Deleting existing primary and derivative data due to validation failure. [2025-10-28T17:33:33.787240] [INFO ] [LOCAL ] BHR: Starting deletion of primary data. [2025-10-28T17:33:33.787297] [DEBUG] [LOCAL ] BHR: No primary data file found to delete. [2025-10-28T17:33:33.787331] [INFO ] [LOCAL ] BHR: Starting deletion of derivative data. [2025-10-28T17:33:33.787479] [DEBUG] [LOCAL ] BHR: Deleted derivative data file. [2025-10-28T17:33:33.787549] [INFO ] [MAIN ] Update Progress: 270/2366 symbols completed. BHR took 17.4s. Estimated remaining: 4h 20m 10s. Rate: 8.1 symbols/min [2025-10-28T17:33:33.960019] [INFO ] [MAIN ] BHV: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:33:33.960193] [DEBUG] [LOCAL ] BHV: No existing data file found in primary storage. [2025-10-28T17:33:33.960247] [WARN ] [MAIN ] BHV: No existing data found, performing full refresh instead. [2025-10-28T17:33:33.960361] [INFO ] [MAIN ] BHV: Wiping existing primary data before full refresh. [2025-10-28T17:33:33.960426] [INFO ] [LOCAL ] BHV: Starting deletion of primary data. [2025-10-28T17:33:33.960488] [DEBUG] [LOCAL ] BHV: No primary data file found to delete. [2025-10-28T17:33:33.960533] [INFO ] [MAIN ] BHV: Starting full primary refresh. [2025-10-28T17:33:34.324269] [INFO ] [REMOTE ] BHV: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:33:34.336340] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-28T17:33:34.340722] [INFO ] [REMOTE ] BHE: Full fetch complete (36248 records). [2025-10-28T17:33:34.340798] [DEBUG] [VALIDATOR ] BHE: Validating primary data. [2025-10-28T17:33:34.369449] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-09. [2025-10-28T17:33:34.705057] [DEBUG] [VALIDATOR ] BHE: All expected trading days are present. [2025-10-28T17:33:34.705140] [DEBUG] [VALIDATOR ] BHE: Primary data validation passed. [2025-10-28T17:33:34.705585] [INFO ] [MAIN ] BHE: Fetched primary data is valid. [2025-10-28T17:33:34.705626] [DEBUG] [LOCAL ] BHE: Saving primary data. [2025-10-28T17:33:34.706540] [DEBUG] [LOCAL ] BHE: Trimmed 36248 records to 23133 (keeping 200 days of data) [2025-10-28T17:33:34.839466] [DEBUG] [LOCAL ] BHE: Primary data saved (23133 records). [2025-10-28T17:33:34.839580] [INFO ] [MAIN ] BHE: Full history saved. [2025-10-28T17:33:34.839667] [INFO ] [MAIN ] Update Progress: 271/2366 symbols completed. BHE took 40.1s. Estimated remaining: 4h 19m 13s. Rate: 8.1 symbols/min [2025-10-28T17:33:35.006892] [INFO ] [MAIN ] BHVN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:33:35.051499] [DEBUG] [LOCAL ] BHVN: Loaded 50598 existing records from primary storage. [2025-10-28T17:33:35.051827] [INFO ] [MAIN ] BHVN: Loaded 50598 existing records. [2025-10-28T17:33:35.164525] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-01. [2025-10-28T17:33:35.233614] [WARN ] [MAIN ] BHVN: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:33:35.233829] [INFO ] [MAIN ] BHVN: Wiping existing primary data before full refresh. [2025-10-28T17:33:35.233876] [INFO ] [LOCAL ] BHVN: Starting deletion of primary data. [2025-10-28T17:33:35.234759] [DEBUG] [LOCAL ] BHVN: Deleted primary data file. [2025-10-28T17:33:35.234816] [INFO ] [MAIN ] BHVN: Starting full primary refresh. [2025-10-28T17:33:35.591203] [INFO ] [REMOTE ] BHVN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:33:35.900171] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-28T17:33:35.959301] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-01. [2025-10-28T17:33:36.267432] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-10-28T17:33:36.759331] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-02. [2025-10-28T17:33:36.992601] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-02 (0.23 seconds). [2025-10-28T17:33:37.162119] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-28T17:33:37.559337] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-10. [2025-10-28T17:33:38.359320] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-10. [2025-10-28T17:33:38.476976] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-28T17:33:38.481824] [INFO ] [REMOTE ] BHK: Full fetch complete (30832 records). [2025-10-28T17:33:38.481923] [DEBUG] [VALIDATOR ] BHK: Validating primary data. [2025-10-28T17:33:38.890365] [DEBUG] [VALIDATOR ] BHK: All expected trading days are present. [2025-10-28T17:33:38.890441] [DEBUG] [VALIDATOR ] BHK: Primary data validation passed. [2025-10-28T17:33:38.890922] [INFO ] [MAIN ] BHK: Fetched primary data is valid. [2025-10-28T17:33:38.890982] [DEBUG] [LOCAL ] BHK: Saving primary data. [2025-10-28T17:33:38.891738] [DEBUG] [LOCAL ] BHK: Trimmed 30832 records to 24002 (keeping 200 days of data) [2025-10-28T17:33:39.027755] [DEBUG] [LOCAL ] BHK: Primary data saved (24002 records). [2025-10-28T17:33:39.027878] [INFO ] [MAIN ] BHK: Full history saved. [2025-10-28T17:33:39.027951] [INFO ] [MAIN ] Update Progress: 272/2366 symbols completed. BHK took 41.2s. Estimated remaining: 4h 18m 40s. Rate: 8.1 symbols/min [2025-10-28T17:33:39.164796] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-03. [2025-10-28T17:33:39.196527] [INFO ] [MAIN ] BILL: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:33:39.244400] [DEBUG] [LOCAL ] BILL: Loaded 52486 existing records from primary storage. [2025-10-28T17:33:39.244753] [INFO ] [MAIN ] BILL: Loaded 52486 existing records. [2025-10-28T17:33:39.423712] [WARN ] [MAIN ] BILL: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:33:39.423967] [INFO ] [MAIN ] BILL: Wiping existing primary data before full refresh. [2025-10-28T17:33:39.424020] [INFO ] [LOCAL ] BILL: Starting deletion of primary data. [2025-10-28T17:33:39.424411] [DEBUG] [LOCAL ] BILL: Deleted primary data file. [2025-10-28T17:33:39.424469] [INFO ] [MAIN ] BILL: Starting full primary refresh. [2025-10-28T17:33:39.495606] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-10-28T17:33:39.774154] [INFO ] [REMOTE ] BILL: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:33:39.959307] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-01. [2025-10-28T17:33:40.186865] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-28T17:33:40.197526] [INFO ] [REMOTE ] BHP: Full fetch complete (77441 records). [2025-10-28T17:33:40.197680] [DEBUG] [VALIDATOR ] BHP: Validating primary data. [2025-10-28T17:33:40.594531] [DEBUG] [VALIDATOR ] BHP: All expected trading days are present. [2025-10-28T17:33:40.594660] [DEBUG] [VALIDATOR ] BHP: Primary data validation passed. [2025-10-28T17:33:40.595505] [INFO ] [MAIN ] BHP: Fetched primary data is valid. [2025-10-28T17:33:40.595623] [DEBUG] [LOCAL ] BHP: Saving primary data. [2025-10-28T17:33:40.597127] [DEBUG] [LOCAL ] BHP: Trimmed 77441 records to 53359 (keeping 200 days of data) [2025-10-28T17:33:40.769902] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-04. [2025-10-28T17:33:40.917659] [DEBUG] [LOCAL ] BHP: Primary data saved (53359 records). [2025-10-28T17:33:40.917802] [INFO ] [MAIN ] BHP: Full history saved. [2025-10-28T17:33:40.917879] [INFO ] [MAIN ] Update Progress: 273/2366 symbols completed. BHP took 35.2s. Estimated remaining: 4h 17m 51s. Rate: 8.1 symbols/min [2025-10-28T17:33:41.085354] [INFO ] [MAIN ] BIO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:33:41.107574] [DEBUG] [LOCAL ] BIO: Loaded 23423 existing records from primary storage. [2025-10-28T17:33:41.107825] [INFO ] [MAIN ] BIO: Loaded 23423 existing records. [2025-10-28T17:33:41.288328] [WARN ] [MAIN ] BIO: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:33:41.290929] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-28T17:33:41.291131] [INFO ] [MAIN ] BIO: Wiping existing primary data before full refresh. [2025-10-28T17:33:41.292398] [INFO ] [LOCAL ] BIO: Starting deletion of primary data. [2025-10-28T17:33:41.292597] [DEBUG] [LOCAL ] BIO: Deleted primary data file. [2025-10-28T17:33:41.292678] [INFO ] [MAIN ] BIO: Starting full primary refresh. [2025-10-28T17:33:41.564494] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-02. [2025-10-28T17:33:41.663008] [INFO ] [REMOTE ] BIO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:33:41.689818] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-28T17:33:42.359335] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-02. [2025-10-28T17:33:42.758565] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-28T17:33:43.159384] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-01. [2025-10-28T17:33:43.959390] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-05. [2025-10-28T17:33:44.060981] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-28T17:33:44.079032] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-28T17:33:44.222064] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-05 (0.26 seconds). [2025-10-28T17:33:44.759341] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-02. [2025-10-28T17:33:45.559352] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-06. [2025-10-28T17:33:45.873358] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-28T17:33:45.910815] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-28T17:33:46.359338] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-03. [2025-10-28T17:33:47.159345] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-07. [2025-10-28T17:33:47.514709] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-10-28T17:33:47.758218] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-28T17:33:47.959360] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-04. [2025-10-28T17:33:48.759347] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-08. [2025-10-28T17:33:49.015214] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-08 (0.26 seconds). [2025-10-28T17:33:49.402897] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-28T17:33:49.559341] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-03. [2025-10-28T17:33:50.359334] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-09. [2025-10-28T17:33:50.636470] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-09 (0.28 seconds). [2025-10-28T17:33:50.803882] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-28T17:33:51.159359] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-04. [2025-10-28T17:33:51.959383] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-10. [2025-10-28T17:33:52.308540] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-10 (0.35 seconds). [2025-10-28T17:33:52.309380] [INFO ] [REMOTE ] BHV: Full fetch complete (1428 records). [2025-10-28T17:33:52.309446] [DEBUG] [VALIDATOR ] BHV: Validating primary data. [2025-10-28T17:33:52.490940] [WARN ] [VALIDATOR ] BHV: Validation failed - insufficient historical data. Have 194 unique days, need 200 days [2025-10-28T17:33:52.491143] [FATAL] [MAIN ] BHV: Fetched primary data is invalid. Refusing to save it. [2025-10-28T17:33:52.491229] [WARN ] [MAIN ] BHV: Deleting existing primary and derivative data due to validation failure. [2025-10-28T17:33:52.491320] [INFO ] [LOCAL ] BHV: Starting deletion of primary data. [2025-10-28T17:33:52.491402] [DEBUG] [LOCAL ] BHV: No primary data file found to delete. [2025-10-28T17:33:52.491441] [INFO ] [LOCAL ] BHV: Starting deletion of derivative data. [2025-10-28T17:33:52.491482] [DEBUG] [LOCAL ] BHV: No derivative data file found to delete. [2025-10-28T17:33:52.491537] [INFO ] [MAIN ] Update Progress: 274/2366 symbols completed. BHV took 18.7s. Estimated remaining: 4h 18m 15s. Rate: 8.1 symbols/min [2025-10-28T17:33:52.666242] [INFO ] [MAIN ] BIP: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:33:52.700841] [DEBUG] [LOCAL ] BIP: Loaded 38519 existing records from primary storage. [2025-10-28T17:33:52.701220] [INFO ] [MAIN ] BIP: Loaded 38519 existing records. [2025-10-28T17:33:52.764574] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-05. [2025-10-28T17:33:52.844068] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-28T17:33:52.926073] [WARN ] [MAIN ] BIP: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:33:52.926293] [INFO ] [MAIN ] BIP: Wiping existing primary data before full refresh. [2025-10-28T17:33:52.926352] [INFO ] [LOCAL ] BIP: Starting deletion of primary data. [2025-10-28T17:33:52.926775] [DEBUG] [LOCAL ] BIP: Deleted primary data file. [2025-10-28T17:33:52.926834] [INFO ] [MAIN ] BIP: Starting full primary refresh. [2025-10-28T17:33:53.274468] [INFO ] [REMOTE ] BIP: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:33:53.559354] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-01. [2025-10-28T17:33:54.359363] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-03. [2025-10-28T17:33:54.440256] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-10-28T17:33:54.635962] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-28T17:33:55.159343] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-06. [2025-10-28T17:33:55.295233] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-28T17:33:55.959332] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-04. [2025-10-28T17:33:56.238615] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-28T17:33:56.759356] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-02. [2025-10-28T17:33:56.839506] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-28T17:33:57.559321] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-05. [2025-10-28T17:33:57.993580] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-28T17:33:58.325061] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-28T17:33:58.359300] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-06. [2025-10-28T17:33:59.159302] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-05. [2025-10-28T17:33:59.364055] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-28T17:33:59.959333] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-07. [2025-10-28T17:34:00.549238] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-28T17:34:00.759327] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-07. [2025-10-28T17:34:00.954891] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-28T17:34:01.559349] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-03. [2025-10-28T17:34:02.090888] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-28T17:34:02.359411] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-08. [2025-10-28T17:34:02.697385] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-28T17:34:03.159349] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-04. [2025-10-28T17:34:03.780429] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-28T17:34:03.959306] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-09. [2025-10-28T17:34:04.407920] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-28T17:34:04.759383] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-05. [2025-10-28T17:34:05.281126] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-28T17:34:05.559356] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-08. [2025-10-28T17:34:05.804179] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-28T17:34:06.359329] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-10. [2025-10-28T17:34:06.814683] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-28T17:34:07.159342] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-09. [2025-10-28T17:34:07.753081] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-28T17:34:07.957556] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-28T17:34:07.967417] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-06. [2025-10-28T17:34:07.969869] [INFO ] [REMOTE ] BILL: Full fetch complete (76120 records). [2025-10-28T17:34:07.969968] [DEBUG] [VALIDATOR ] BILL: Validating primary data. [2025-10-28T17:34:08.361702] [DEBUG] [VALIDATOR ] BILL: All expected trading days are present. [2025-10-28T17:34:08.361778] [DEBUG] [VALIDATOR ] BILL: Primary data validation passed. [2025-10-28T17:34:08.362519] [INFO ] [MAIN ] BILL: Fetched primary data is valid. [2025-10-28T17:34:08.362580] [DEBUG] [LOCAL ] BILL: Saving primary data. [2025-10-28T17:34:08.363970] [DEBUG] [LOCAL ] BILL: Trimmed 76120 records to 52480 (keeping 200 days of data) [2025-10-28T17:34:08.657785] [DEBUG] [LOCAL ] BILL: Primary data saved (52480 records). [2025-10-28T17:34:08.657910] [INFO ] [MAIN ] BILL: Full history saved. [2025-10-28T17:34:08.657985] [INFO ] [MAIN ] Update Progress: 275/2366 symbols completed. BILL took 29.6s. Estimated remaining: 4h 19m 14s. Rate: 8.1 symbols/min [2025-10-28T17:34:08.764443] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-06. [2025-10-28T17:34:08.829330] [INFO ] [MAIN ] BIPC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:34:08.851091] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-28T17:34:08.893476] [DEBUG] [LOCAL ] BIPC: Loaded 40781 existing records from primary storage. [2025-10-28T17:34:08.893776] [INFO ] [MAIN ] BIPC: Loaded 40781 existing records. [2025-10-28T17:34:09.080137] [WARN ] [MAIN ] BIPC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:34:09.080376] [INFO ] [MAIN ] BIPC: Wiping existing primary data before full refresh. [2025-10-28T17:34:09.080429] [INFO ] [LOCAL ] BIPC: Starting deletion of primary data. [2025-10-28T17:34:09.080888] [DEBUG] [LOCAL ] BIPC: Deleted primary data file. [2025-10-28T17:34:09.080965] [INFO ] [MAIN ] BIPC: Starting full primary refresh. [2025-10-28T17:34:09.488539] [INFO ] [REMOTE ] BIPC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:34:09.559327] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-07. [2025-10-28T17:34:10.316838] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-28T17:34:10.359300] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-07. [2025-10-28T17:34:10.513024] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-28T17:34:11.159364] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-08. [2025-10-28T17:34:11.609397] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-28T17:34:11.959438] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-01. [2025-10-28T17:34:12.316688] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-28T17:34:12.759481] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-09. [2025-10-28T17:34:13.065685] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-28T17:34:13.559380] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-10. [2025-10-28T17:34:13.831450] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-28T17:34:14.359368] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-02. [2025-10-28T17:34:14.498035] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-28T17:34:14.502001] [INFO ] [REMOTE ] BIO: Full fetch complete (34526 records). [2025-10-28T17:34:14.502098] [DEBUG] [VALIDATOR ] BIO: Validating primary data. [2025-10-28T17:34:14.502626] [FATAL] [VALIDATOR ] BIO: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T17:34:14.502741] [FATAL] [MAIN ] BIO: Fetched primary data is invalid. Refusing to save it. [2025-10-28T17:34:14.502783] [WARN ] [MAIN ] BIO: Deleting existing primary and derivative data due to validation failure. [2025-10-28T17:34:14.502821] [INFO ] [LOCAL ] BIO: Starting deletion of primary data. [2025-10-28T17:34:14.502876] [DEBUG] [LOCAL ] BIO: No primary data file found to delete. [2025-10-28T17:34:14.502911] [INFO ] [LOCAL ] BIO: Starting deletion of derivative data. [2025-10-28T17:34:14.503089] [DEBUG] [LOCAL ] BIO: Deleted derivative data file. [2025-10-28T17:34:14.503178] [INFO ] [MAIN ] Update Progress: 276/2366 symbols completed. BIO took 33.6s. Estimated remaining: 4h 18m 55s. Rate: 8.1 symbols/min [2025-10-28T17:34:14.678196] [INFO ] [MAIN ] BIPH: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:34:14.682747] [DEBUG] [LOCAL ] BIPH: Loaded 2251 existing records from primary storage. [2025-10-28T17:34:14.682903] [INFO ] [MAIN ] BIPH: Loaded 2251 existing records. [2025-10-28T17:34:14.858179] [WARN ] [MAIN ] BIPH: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:34:14.858393] [INFO ] [MAIN ] BIPH: Wiping existing primary data before full refresh. [2025-10-28T17:34:14.858438] [INFO ] [LOCAL ] BIPH: Starting deletion of primary data. [2025-10-28T17:34:14.858559] [DEBUG] [LOCAL ] BIPH: Deleted primary data file. [2025-10-28T17:34:14.858602] [INFO ] [MAIN ] BIPH: Starting full primary refresh. [2025-10-28T17:34:15.164553] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-10. [2025-10-28T17:34:15.224223] [INFO ] [REMOTE ] BIPH: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:34:15.560490] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-28T17:34:15.959337] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-08. [2025-10-28T17:34:16.759331] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-01. [2025-10-28T17:34:16.846234] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-28T17:34:16.858415] [INFO ] [REMOTE ] BIP: Full fetch complete (57712 records). [2025-10-28T17:34:16.858585] [DEBUG] [VALIDATOR ] BIP: Validating primary data. [2025-10-28T17:34:17.251737] [DEBUG] [VALIDATOR ] BIP: All expected trading days are present. [2025-10-28T17:34:17.251918] [DEBUG] [VALIDATOR ] BIP: Primary data validation passed. [2025-10-28T17:34:17.252595] [INFO ] [MAIN ] BIP: Fetched primary data is valid. [2025-10-28T17:34:17.252695] [DEBUG] [LOCAL ] BIP: Saving primary data. [2025-10-28T17:34:17.253901] [DEBUG] [LOCAL ] BIP: Trimmed 57712 records to 38427 (keeping 200 days of data) [2025-10-28T17:34:17.484583] [DEBUG] [LOCAL ] BIP: Primary data saved (38427 records). [2025-10-28T17:34:17.484778] [INFO ] [MAIN ] BIP: Full history saved. [2025-10-28T17:34:17.484888] [INFO ] [MAIN ] Update Progress: 277/2366 symbols completed. BIP took 25.0s. Estimated remaining: 4h 18m 14s. Rate: 8.1 symbols/min [2025-10-28T17:34:17.559332] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-03. [2025-10-28T17:34:17.622924] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-28T17:34:17.660605] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-28T17:34:18.359403] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-09. [2025-10-28T17:34:18.725095] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-28T17:34:19.159375] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-04. [2025-10-28T17:34:19.826993] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-28T17:34:19.959362] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-02. [2025-10-28T17:34:20.412843] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-28T17:34:20.462017] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-28T17:34:20.759371] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-03. [2025-10-28T17:34:21.206851] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-28T17:34:21.559350] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-10. [2025-10-28T17:34:22.359387] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-04. [2025-10-28T17:34:22.798709] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-28T17:34:23.159357] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-05. [2025-10-28T17:34:23.244480] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-28T17:34:23.254830] [INFO ] [REMOTE ] BHVN: Full fetch complete (70838 records). [2025-10-28T17:34:23.254995] [DEBUG] [VALIDATOR ] BHVN: Validating primary data. [2025-10-28T17:34:23.638727] [DEBUG] [VALIDATOR ] BHVN: All expected trading days are present. [2025-10-28T17:34:23.638816] [DEBUG] [VALIDATOR ] BHVN: Primary data validation passed. [2025-10-28T17:34:23.639516] [INFO ] [MAIN ] BHVN: Fetched primary data is valid. [2025-10-28T17:34:23.639558] [DEBUG] [LOCAL ] BHVN: Saving primary data. [2025-10-28T17:34:23.640958] [DEBUG] [LOCAL ] BHVN: Trimmed 70838 records to 50589 (keeping 200 days of data) [2025-10-28T17:34:23.930392] [DEBUG] [LOCAL ] BHVN: Primary data saved (50589 records). [2025-10-28T17:34:23.930550] [INFO ] [MAIN ] BHVN: Full history saved. [2025-10-28T17:34:23.931140] [INFO ] [MAIN ] Update Progress: 278/2366 symbols completed. BHVN took 49.1s. Estimated remaining: 4h 17m 59s. Rate: 8.1 symbols/min [2025-10-28T17:34:23.959423] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-05. [2025-10-28T17:34:24.261504] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-05 (0.30 seconds). [2025-10-28T17:34:24.265095] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-28T17:34:24.759314] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-06. [2025-10-28T17:34:25.559390] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-06. [2025-10-28T17:34:25.826559] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-28T17:34:25.930458] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-10-28T17:34:26.359405] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-07. [2025-10-28T17:34:27.159393] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-07. [2025-10-28T17:34:27.465957] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-28T17:34:27.713183] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-28T17:34:27.959338] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-08. [2025-10-28T17:34:28.759454] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-08. [2025-10-28T17:34:29.056565] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-08 (0.30 seconds). [2025-10-28T17:34:29.241577] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-28T17:34:29.559348] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-09. [2025-10-28T17:34:30.359409] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-09. [2025-10-28T17:34:30.503326] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-28T17:34:30.606385] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-09 (0.25 seconds). [2025-10-28T17:34:31.159341] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-10. [2025-10-28T17:34:31.959388] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-10. [2025-10-28T17:34:32.352039] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-10-28T17:34:32.353627] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-28T17:34:32.365711] [INFO ] [REMOTE ] BIPH: Full fetch complete (3601 records). [2025-10-28T17:34:32.366356] [DEBUG] [VALIDATOR ] BIPH: Validating primary data. [2025-10-28T17:34:32.432185] [INFO ] [REMOTE ] BIPC: Full fetch complete (59882 records). [2025-10-28T17:34:32.443680] [DEBUG] [VALIDATOR ] BIPC: Validating primary data. [2025-10-28T17:34:32.481542] [FATAL] [VALIDATOR ] BIPC: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T17:34:32.520262] [FATAL] [MAIN ] BIPC: Fetched primary data is invalid. Refusing to save it. [2025-10-28T17:34:32.546792] [WARN ] [MAIN ] BIPC: Deleting existing primary and derivative data due to validation failure. [2025-10-28T17:34:32.632400] [INFO ] [LOCAL ] BIPC: Starting deletion of primary data. [2025-10-28T17:34:32.653580] [DEBUG] [LOCAL ] BIPC: No primary data file found to delete. [2025-10-28T17:34:32.654003] [INFO ] [LOCAL ] BIPC: Starting deletion of derivative data. [2025-10-28T17:34:32.669903] [DEBUG] [LOCAL ] BIPC: Deleted derivative data file. [2025-10-28T17:34:32.680389] [INFO ] [MAIN ] Update Progress: 279/2366 symbols completed. BIPC took 24.0s. Estimated remaining: 4h 18m 2s. Rate: 8.1 symbols/min [2025-10-28T17:34:32.732410] [DEBUG] [VALIDATOR ] BIPH: All expected trading days are present. [2025-10-28T17:34:32.732484] [DEBUG] [VALIDATOR ] BIPH: Primary data validation passed. [2025-10-28T17:34:32.732661] [INFO ] [MAIN ] BIPH: Fetched primary data is valid. [2025-10-28T17:34:32.732723] [DEBUG] [LOCAL ] BIPH: Saving primary data. [2025-10-28T17:34:32.733133] [DEBUG] [LOCAL ] BIPH: Trimmed 3601 records to 2221 (keeping 200 days of data) [2025-10-28T17:34:32.746479] [DEBUG] [LOCAL ] BIPH: Primary data saved (2221 records). [2025-10-28T17:34:32.746539] [INFO ] [MAIN ] BIPH: Full history saved. [2025-10-28T17:34:32.746605] [INFO ] [MAIN ] Update Progress: 280/2366 symbols completed. BIPH took 18.2s. Estimated remaining: 4h 16m 60s. Rate: 8.1 symbols/min [2025-10-28T17:34:33.308259] [INFO ] [MAIN ] BIPJ: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:34:33.439519] [INFO ] [MAIN ] BIRK: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:34:33.445783] [INFO ] [MAIN ] BIPI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:34:33.466149] [INFO ] [MAIN ] BIT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:34:33.445922] [DEBUG] [LOCAL ] BIPJ: No existing data file found in primary storage. [2025-10-28T17:34:33.466731] [WARN ] [MAIN ] BIPJ: No existing data found, performing full refresh instead. [2025-10-28T17:34:33.468599] [INFO ] [MAIN ] BIPJ: Wiping existing primary data before full refresh. [2025-10-28T17:34:33.469112] [INFO ] [LOCAL ] BIPJ: Starting deletion of primary data. [2025-10-28T17:34:33.469187] [DEBUG] [LOCAL ] BIPJ: No primary data file found to delete. [2025-10-28T17:34:33.469224] [INFO ] [MAIN ] BIPJ: Starting full primary refresh. [2025-10-28T17:34:33.543721] [DEBUG] [LOCAL ] BIPI: Loaded 2727 existing records from primary storage. [2025-10-28T17:34:33.563497] [INFO ] [MAIN ] BIPI: Loaded 2727 existing records. [2025-10-28T17:34:33.704300] [DEBUG] [LOCAL ] BIT: Loaded 23558 existing records from primary storage. [2025-10-28T17:34:33.849157] [DEBUG] [LOCAL ] BIRK: Loaded 51082 existing records from primary storage. [2025-10-28T17:34:33.937858] [WARN ] [MAIN ] BIPI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:34:33.960236] [INFO ] [MAIN ] BIRK: Loaded 51082 existing records. [2025-10-28T17:34:33.841830] [INFO ] [MAIN ] BIT: Loaded 23558 existing records. [2025-10-28T17:34:33.965623] [INFO ] [MAIN ] BIPI: Wiping existing primary data before full refresh. [2025-10-28T17:34:34.002797] [INFO ] [LOCAL ] BIPI: Starting deletion of primary data. [2025-10-28T17:34:34.026433] [DEBUG] [LOCAL ] BIPI: Deleted primary data file. [2025-10-28T17:34:34.080721] [INFO ] [MAIN ] BIPI: Starting full primary refresh. [2025-10-28T17:34:34.442836] [WARN ] [MAIN ] BIT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:34:34.445998] [INFO ] [REMOTE ] BIPJ: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:34:34.482536] [INFO ] [MAIN ] BIT: Wiping existing primary data before full refresh. [2025-10-28T17:34:34.511639] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-01. [2025-10-28T17:34:34.543487] [INFO ] [LOCAL ] BIT: Starting deletion of primary data. [2025-10-28T17:34:34.613493] [DEBUG] [LOCAL ] BIT: Deleted primary data file. [2025-10-28T17:34:34.586272] [WARN ] [MAIN ] BIRK: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:34:34.613938] [INFO ] [MAIN ] BIT: Starting full primary refresh. [2025-10-28T17:34:34.619403] [INFO ] [MAIN ] BIRK: Wiping existing primary data before full refresh. [2025-10-28T17:34:34.635148] [INFO ] [LOCAL ] BIRK: Starting deletion of primary data. [2025-10-28T17:34:34.668961] [DEBUG] [LOCAL ] BIRK: Deleted primary data file. [2025-10-28T17:34:34.683549] [INFO ] [MAIN ] BIRK: Starting full primary refresh. [2025-10-28T17:34:35.032449] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-28T17:34:35.128397] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-02. [2025-10-28T17:34:35.121697] [INFO ] [REMOTE ] BIPI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:34:35.160564] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-01. [2025-10-28T17:34:35.570913] [INFO ] [REMOTE ] BIRK: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:34:35.565509] [INFO ] [REMOTE ] BIT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:34:35.571396] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-01. [2025-10-28T17:34:35.575728] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-28T17:34:35.711901] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-28T17:34:35.959366] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-03. [2025-10-28T17:34:36.380750] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-28T17:34:36.407945] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-28T17:34:36.759342] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-02. [2025-10-28T17:34:37.437520] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-28T17:34:37.559372] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-02. [2025-10-28T17:34:37.992944] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-28T17:34:38.359346] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-01. [2025-10-28T17:34:39.159335] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-04. [2025-10-28T17:34:39.517994] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-10-28T17:34:39.771756] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-28T17:34:39.959340] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-02. [2025-10-28T17:34:40.759347] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-03. [2025-10-28T17:34:41.264917] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-28T17:34:41.559320] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-03. [2025-10-28T17:34:41.572546] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-28T17:34:42.359367] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-04. [2025-10-28T17:34:42.638830] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-28T17:34:42.997851] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-28T17:34:43.159326] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-04. [2025-10-28T17:34:43.959351] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-03. [2025-10-28T17:34:44.326119] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-28T17:34:44.362715] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-10-28T17:34:44.759325] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-05. [2025-10-28T17:34:45.295746] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-28T17:34:45.559347] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-04. [2025-10-28T17:34:46.009715] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-28T17:34:46.359352] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-06. [2025-10-28T17:34:47.159323] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-05. [2025-10-28T17:34:47.207461] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-28T17:34:47.959350] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-05. [2025-10-28T17:34:48.339927] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-28T17:34:48.405055] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-28T17:34:48.759344] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-07. [2025-10-28T17:34:49.521914] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-28T17:34:49.559308] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-06. [2025-10-28T17:34:49.801678] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-06 (0.24 seconds). [2025-10-28T17:34:50.359335] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-05. [2025-10-28T17:34:50.731313] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-10-28T17:34:51.159353] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-07. [2025-10-28T17:34:51.463421] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-07 (0.30 seconds). [2025-10-28T17:34:51.959384] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-06. [2025-10-28T17:34:52.759355] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-08. [2025-10-28T17:34:53.110959] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-28T17:34:53.559335] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-07. [2025-10-28T17:34:53.897322] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-28T17:34:54.359391] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-06. [2025-10-28T17:34:54.719730] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-10-28T17:34:54.722633] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-28T17:34:55.159377] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-08. [2025-10-28T17:34:55.959348] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-08. [2025-10-28T17:34:56.389718] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-28T17:34:56.512878] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-28T17:34:56.759346] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-09. [2025-10-28T17:34:57.096880] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-10-28T17:34:57.559340] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-10. [2025-10-28T17:34:58.020943] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-28T17:34:58.022017] [INFO ] [REMOTE ] BIPI: Full fetch complete (4495 records). [2025-10-28T17:34:58.022088] [DEBUG] [VALIDATOR ] BIPI: Validating primary data. [2025-10-28T17:34:58.367559] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-09. [2025-10-28T17:34:58.391114] [DEBUG] [VALIDATOR ] BIPI: All expected trading days are present. [2025-10-28T17:34:58.391185] [DEBUG] [VALIDATOR ] BIPI: Primary data validation passed. [2025-10-28T17:34:58.391322] [INFO ] [MAIN ] BIPI: Fetched primary data is valid. [2025-10-28T17:34:58.391359] [DEBUG] [LOCAL ] BIPI: Saving primary data. [2025-10-28T17:34:58.391794] [DEBUG] [LOCAL ] BIPI: Trimmed 4495 records to 2702 (keeping 200 days of data) [2025-10-28T17:34:58.407841] [DEBUG] [LOCAL ] BIPI: Primary data saved (2702 records). [2025-10-28T17:34:58.407937] [INFO ] [MAIN ] BIPI: Full history saved. [2025-10-28T17:34:58.408013] [INFO ] [MAIN ] Update Progress: 281/2366 symbols completed. BIPI took 25.7s. Estimated remaining: 4h 19m 8s. Rate: 8.0 symbols/min [2025-10-28T17:34:58.576945] [INFO ] [MAIN ] BJ: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:34:58.623208] [DEBUG] [LOCAL ] BJ: Loaded 51411 existing records from primary storage. [2025-10-28T17:34:58.623522] [INFO ] [MAIN ] BJ: Loaded 51411 existing records. [2025-10-28T17:34:58.800741] [WARN ] [MAIN ] BJ: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:34:58.800972] [INFO ] [MAIN ] BJ: Wiping existing primary data before full refresh. [2025-10-28T17:34:58.801020] [INFO ] [LOCAL ] BJ: Starting deletion of primary data. [2025-10-28T17:34:58.801934] [DEBUG] [LOCAL ] BJ: Deleted primary data file. [2025-10-28T17:34:58.801990] [INFO ] [MAIN ] BJ: Starting full primary refresh. [2025-10-28T17:34:59.152085] [INFO ] [REMOTE ] BJ: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:34:59.159304] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-01. [2025-10-28T17:34:59.427820] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-28T17:34:59.959383] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-09. [2025-10-28T17:35:00.444700] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-28T17:35:00.759404] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-10. [2025-10-28T17:35:01.361723] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-28T17:35:01.559426] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-07. [2025-10-28T17:35:01.812438] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-28T17:35:01.820490] [INFO ] [REMOTE ] BIT: Full fetch complete (32259 records). [2025-10-28T17:35:01.820851] [DEBUG] [VALIDATOR ] BIT: Validating primary data. [2025-10-28T17:35:01.821706] [FATAL] [VALIDATOR ] BIT: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T17:35:01.821803] [FATAL] [MAIN ] BIT: Fetched primary data is invalid. Refusing to save it. [2025-10-28T17:35:01.821861] [WARN ] [MAIN ] BIT: Deleting existing primary and derivative data due to validation failure. [2025-10-28T17:35:01.821915] [INFO ] [LOCAL ] BIT: Starting deletion of primary data. [2025-10-28T17:35:01.821995] [DEBUG] [LOCAL ] BIT: No primary data file found to delete. [2025-10-28T17:35:01.822043] [INFO ] [LOCAL ] BIT: Starting deletion of derivative data. [2025-10-28T17:35:01.822257] [DEBUG] [LOCAL ] BIT: Deleted derivative data file. [2025-10-28T17:35:01.822365] [INFO ] [MAIN ] Update Progress: 282/2366 symbols completed. BIT took 29.1s. Estimated remaining: 4h 18m 30s. Rate: 8.1 symbols/min [2025-10-28T17:35:02.016555] [INFO ] [MAIN ] BK: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:35:02.072963] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-28T17:35:02.074178] [DEBUG] [LOCAL ] BK: Loaded 53535 existing records from primary storage. [2025-10-28T17:35:02.076454] [INFO ] [MAIN ] BK: Loaded 53535 existing records. [2025-10-28T17:35:02.275974] [WARN ] [MAIN ] BK: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:35:02.276187] [INFO ] [MAIN ] BK: Wiping existing primary data before full refresh. [2025-10-28T17:35:02.276232] [INFO ] [LOCAL ] BK: Starting deletion of primary data. [2025-10-28T17:35:02.276813] [DEBUG] [LOCAL ] BK: Deleted primary data file. [2025-10-28T17:35:02.276871] [INFO ] [MAIN ] BK: Starting full primary refresh. [2025-10-28T17:35:02.364571] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-08. [2025-10-28T17:35:02.646213] [INFO ] [REMOTE ] BK: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:35:02.864206] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-28T17:35:03.159366] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-02. [2025-10-28T17:35:03.959353] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-10. [2025-10-28T17:35:04.405941] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-28T17:35:04.759400] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-03. [2025-10-28T17:35:05.559318] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-01. [2025-10-28T17:35:05.617207] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-28T17:35:05.627562] [INFO ] [REMOTE ] BIRK: Full fetch complete (73468 records). [2025-10-28T17:35:05.627732] [DEBUG] [VALIDATOR ] BIRK: Validating primary data. [2025-10-28T17:35:06.035224] [DEBUG] [VALIDATOR ] BIRK: All expected trading days are present. [2025-10-28T17:35:06.035334] [DEBUG] [VALIDATOR ] BIRK: Primary data validation passed. [2025-10-28T17:35:06.036135] [INFO ] [MAIN ] BIRK: Fetched primary data is valid. [2025-10-28T17:35:06.036215] [DEBUG] [LOCAL ] BIRK: Saving primary data. [2025-10-28T17:35:06.037711] [DEBUG] [LOCAL ] BIRK: Trimmed 73468 records to 51067 (keeping 200 days of data) [2025-10-28T17:35:06.273403] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-28T17:35:06.361034] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-04. [2025-10-28T17:35:06.376610] [DEBUG] [LOCAL ] BIRK: Primary data saved (51067 records). [2025-10-28T17:35:06.376716] [INFO ] [MAIN ] BIRK: Full history saved. [2025-10-28T17:35:06.376799] [INFO ] [MAIN ] Update Progress: 283/2366 symbols completed. BIRK took 33.6s. Estimated remaining: 4h 18m 2s. Rate: 8.1 symbols/min [2025-10-28T17:35:06.541544] [INFO ] [MAIN ] BKD: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:35:06.581850] [DEBUG] [LOCAL ] BKD: Loaded 50297 existing records from primary storage. [2025-10-28T17:35:06.582141] [INFO ] [MAIN ] BKD: Loaded 50297 existing records. [2025-10-28T17:35:06.758043] [WARN ] [MAIN ] BKD: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:35:06.758214] [INFO ] [MAIN ] BKD: Wiping existing primary data before full refresh. [2025-10-28T17:35:06.758261] [INFO ] [LOCAL ] BKD: Starting deletion of primary data. [2025-10-28T17:35:06.758979] [DEBUG] [LOCAL ] BKD: Deleted primary data file. [2025-10-28T17:35:06.759036] [INFO ] [MAIN ] BKD: Starting full primary refresh. [2025-10-28T17:35:07.116124] [INFO ] [REMOTE ] BKD: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:35:07.162975] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-01. [2025-10-28T17:35:07.165316] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-28T17:35:07.923271] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-28T17:35:07.959305] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-02. [2025-10-28T17:35:08.630886] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-28T17:35:08.759353] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-05. [2025-10-28T17:35:09.460938] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-28T17:35:09.559319] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-03. [2025-10-28T17:35:10.026635] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-28T17:35:10.359342] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-09. [2025-10-28T17:35:10.789864] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-28T17:35:10.968820] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-28T17:35:11.159361] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-04. [2025-10-28T17:35:11.959331] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-02. [2025-10-28T17:35:12.710887] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-28T17:35:12.759295] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-05. [2025-10-28T17:35:13.395451] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-28T17:35:13.559416] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-03. [2025-10-28T17:35:14.351513] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-28T17:35:14.362204] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-06. [2025-10-28T17:35:14.555233] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-28T17:35:15.159363] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-04. [2025-10-28T17:35:15.839956] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-28T17:35:15.959368] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-07. [2025-10-28T17:35:16.281404] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-28T17:35:16.759340] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-06. [2025-10-28T17:35:17.062403] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-28T17:35:17.559348] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-05. [2025-10-28T17:35:18.062035] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-28T17:35:18.359383] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-07. [2025-10-28T17:35:18.727853] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-28T17:35:19.159350] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-06. [2025-10-28T17:35:19.921245] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-28T17:35:19.959294] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-08. [2025-10-28T17:35:20.429921] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-28T17:35:20.759393] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-08. [2025-10-28T17:35:21.280935] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-28T17:35:21.559336] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-10. [2025-10-28T17:35:22.010126] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-28T17:35:22.150528] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-28T17:35:22.151526] [INFO ] [REMOTE ] BIPJ: Full fetch complete (4113 records). [2025-10-28T17:35:22.151595] [DEBUG] [VALIDATOR ] BIPJ: Validating primary data. [2025-10-28T17:35:22.366431] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-09. [2025-10-28T17:35:22.539080] [DEBUG] [VALIDATOR ] BIPJ: All expected trading days are present. [2025-10-28T17:35:22.539152] [DEBUG] [VALIDATOR ] BIPJ: Primary data validation passed. [2025-10-28T17:35:22.539293] [INFO ] [MAIN ] BIPJ: Fetched primary data is valid. [2025-10-28T17:35:22.539338] [DEBUG] [LOCAL ] BIPJ: Saving primary data. [2025-10-28T17:35:22.539722] [DEBUG] [LOCAL ] BIPJ: Trimmed 4113 records to 3000 (keeping 200 days of data) [2025-10-28T17:35:22.558249] [DEBUG] [LOCAL ] BIPJ: Primary data saved (3000 records). [2025-10-28T17:35:22.558320] [INFO ] [MAIN ] BIPJ: Full history saved. [2025-10-28T17:35:22.558388] [INFO ] [MAIN ] Update Progress: 284/2366 symbols completed. BIPJ took 49.8s. Estimated remaining: 4h 18m 58s. Rate: 8.0 symbols/min [2025-10-28T17:35:22.728961] [INFO ] [MAIN ] BKE: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:35:22.759495] [DEBUG] [LOCAL ] BKE: Loaded 33221 existing records from primary storage. [2025-10-28T17:35:22.759781] [INFO ] [MAIN ] BKE: Loaded 33221 existing records. [2025-10-28T17:35:22.937539] [WARN ] [MAIN ] BKE: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:35:22.937778] [INFO ] [MAIN ] BKE: Wiping existing primary data before full refresh. [2025-10-28T17:35:22.937826] [INFO ] [LOCAL ] BKE: Starting deletion of primary data. [2025-10-28T17:35:22.938384] [DEBUG] [LOCAL ] BKE: Deleted primary data file. [2025-10-28T17:35:22.938439] [INFO ] [MAIN ] BKE: Starting full primary refresh. [2025-10-28T17:35:23.164419] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-09. [2025-10-28T17:35:23.309579] [INFO ] [REMOTE ] BKE: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:35:23.669905] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-28T17:35:23.959334] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-01. [2025-10-28T17:35:24.693421] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-28T17:35:24.759334] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-10. [2025-10-28T17:35:24.934696] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-28T17:35:25.559393] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-07. [2025-10-28T17:35:26.163379] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-28T17:35:26.173807] [INFO ] [REMOTE ] BJ: Full fetch complete (74374 records). [2025-10-28T17:35:26.173939] [DEBUG] [VALIDATOR ] BJ: Validating primary data. [2025-10-28T17:35:26.366561] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-10. [2025-10-28T17:35:26.561235] [DEBUG] [VALIDATOR ] BJ: All expected trading days are present. [2025-10-28T17:35:26.561311] [DEBUG] [VALIDATOR ] BJ: Primary data validation passed. [2025-10-28T17:35:26.562081] [INFO ] [MAIN ] BJ: Fetched primary data is valid. [2025-10-28T17:35:26.562142] [DEBUG] [LOCAL ] BJ: Saving primary data. [2025-10-28T17:35:26.563542] [DEBUG] [LOCAL ] BJ: Trimmed 74374 records to 51394 (keeping 200 days of data) [2025-10-28T17:35:26.863983] [DEBUG] [LOCAL ] BJ: Primary data saved (51394 records). [2025-10-28T17:35:26.864194] [INFO ] [MAIN ] BJ: Full history saved. [2025-10-28T17:35:26.864285] [INFO ] [MAIN ] Update Progress: 285/2366 symbols completed. BJ took 28.5s. Estimated remaining: 4h 18m 28s. Rate: 8.1 symbols/min [2025-10-28T17:35:27.005694] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-28T17:35:27.081254] [INFO ] [MAIN ] BKH: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:35:27.081899] [DEBUG] [LOCAL ] BKH: No existing data file found in primary storage. [2025-10-28T17:35:27.081944] [WARN ] [MAIN ] BKH: No existing data found, performing full refresh instead. [2025-10-28T17:35:27.082052] [INFO ] [MAIN ] BKH: Wiping existing primary data before full refresh. [2025-10-28T17:35:27.082093] [INFO ] [LOCAL ] BKH: Starting deletion of primary data. [2025-10-28T17:35:27.082133] [DEBUG] [LOCAL ] BKH: No primary data file found to delete. [2025-10-28T17:35:27.082166] [INFO ] [MAIN ] BKH: Starting full primary refresh. [2025-10-28T17:35:27.169615] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-02. [2025-10-28T17:35:27.428100] [INFO ] [REMOTE ] BKH: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:35:27.844797] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-28T17:35:27.855623] [INFO ] [REMOTE ] BK: Full fetch complete (77668 records). [2025-10-28T17:35:27.855819] [DEBUG] [VALIDATOR ] BK: Validating primary data. [2025-10-28T17:35:27.964452] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-08. [2025-10-28T17:35:28.264324] [DEBUG] [VALIDATOR ] BK: All expected trading days are present. [2025-10-28T17:35:28.264472] [DEBUG] [VALIDATOR ] BK: Primary data validation passed. [2025-10-28T17:35:28.266002] [INFO ] [MAIN ] BK: Fetched primary data is valid. [2025-10-28T17:35:28.266117] [DEBUG] [LOCAL ] BK: Saving primary data. [2025-10-28T17:35:28.277015] [DEBUG] [LOCAL ] BK: Trimmed 77668 records to 53534 (keeping 200 days of data) [2025-10-28T17:35:28.293626] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-28T17:35:28.761208] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-03. [2025-10-28T17:35:28.798010] [DEBUG] [LOCAL ] BK: Primary data saved (53534 records). [2025-10-28T17:35:28.798205] [INFO ] [MAIN ] BK: Full history saved. [2025-10-28T17:35:28.798330] [INFO ] [MAIN ] Update Progress: 286/2366 symbols completed. BK took 27.0s. Estimated remaining: 4h 17m 40s. Rate: 8.1 symbols/min [2025-10-28T17:35:29.058573] [INFO ] [MAIN ] BKKT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:35:29.110471] [DEBUG] [LOCAL ] BKKT: Loaded 37775 existing records from primary storage. [2025-10-28T17:35:29.110970] [INFO ] [MAIN ] BKKT: Loaded 37775 existing records. [2025-10-28T17:35:29.339823] [WARN ] [MAIN ] BKKT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:35:29.340140] [INFO ] [MAIN ] BKKT: Wiping existing primary data before full refresh. [2025-10-28T17:35:29.340238] [INFO ] [LOCAL ] BKKT: Starting deletion of primary data. [2025-10-28T17:35:29.340639] [DEBUG] [LOCAL ] BKKT: Deleted primary data file. [2025-10-28T17:35:29.340795] [INFO ] [MAIN ] BKKT: Starting full primary refresh. [2025-10-28T17:35:29.537031] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-28T17:35:29.561348] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-01. [2025-10-28T17:35:29.752925] [INFO ] [REMOTE ] BKKT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:35:29.899154] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-28T17:35:30.359349] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-04. [2025-10-28T17:35:30.808891] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-28T17:35:31.159356] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-01. [2025-10-28T17:35:31.354398] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-28T17:35:31.959401] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-09. [2025-10-28T17:35:32.410208] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-28T17:35:32.759353] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-02. [2025-10-28T17:35:33.171911] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-28T17:35:33.559371] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-05. [2025-10-28T17:35:33.686926] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-28T17:35:34.359348] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-10. [2025-10-28T17:35:34.638459] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-28T17:35:35.159345] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-03. [2025-10-28T17:35:35.883257] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-28T17:35:35.893330] [INFO ] [REMOTE ] BKD: Full fetch complete (72132 records). [2025-10-28T17:35:35.893463] [DEBUG] [VALIDATOR ] BKD: Validating primary data. [2025-10-28T17:35:35.964727] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-02. [2025-10-28T17:35:36.290310] [DEBUG] [VALIDATOR ] BKD: All expected trading days are present. [2025-10-28T17:35:36.290477] [DEBUG] [VALIDATOR ] BKD: Primary data validation passed. [2025-10-28T17:35:36.291354] [INFO ] [MAIN ] BKD: Fetched primary data is valid. [2025-10-28T17:35:36.291538] [DEBUG] [LOCAL ] BKD: Saving primary data. [2025-10-28T17:35:36.293000] [DEBUG] [LOCAL ] BKD: Trimmed 72132 records to 50272 (keeping 200 days of data) [2025-10-28T17:35:36.586905] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-28T17:35:36.603374] [DEBUG] [LOCAL ] BKD: Primary data saved (50272 records). [2025-10-28T17:35:36.603468] [INFO ] [MAIN ] BKD: Full history saved. [2025-10-28T17:35:36.603544] [INFO ] [MAIN ] Update Progress: 287/2366 symbols completed. BKD took 30.2s. Estimated remaining: 4h 17m 36s. Rate: 8.1 symbols/min [2025-10-28T17:35:36.770897] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-04. [2025-10-28T17:35:36.774708] [INFO ] [MAIN ] BKN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:35:36.783896] [DEBUG] [LOCAL ] BKN: Loaded 7164 existing records from primary storage. [2025-10-28T17:35:36.784110] [INFO ] [MAIN ] BKN: Loaded 7164 existing records. [2025-10-28T17:35:36.971797] [WARN ] [MAIN ] BKN: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:35:36.972159] [INFO ] [MAIN ] BKN: Wiping existing primary data before full refresh. [2025-10-28T17:35:36.972231] [INFO ] [LOCAL ] BKN: Starting deletion of primary data. [2025-10-28T17:35:36.972754] [DEBUG] [LOCAL ] BKN: Deleted primary data file. [2025-10-28T17:35:36.972811] [INFO ] [MAIN ] BKN: Starting full primary refresh. [2025-10-28T17:35:37.155975] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-28T17:35:37.360538] [INFO ] [REMOTE ] BKN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:35:37.559329] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-01. [2025-10-28T17:35:37.847321] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-28T17:35:38.185480] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-28T17:35:38.359404] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-06. [2025-10-28T17:35:39.159320] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-05. [2025-10-28T17:35:39.533841] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-28T17:35:39.959371] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-07. [2025-10-28T17:35:40.176994] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-28T17:35:40.759932] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-06. [2025-10-28T17:35:40.759857] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-28T17:35:41.559346] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-02. [2025-10-28T17:35:41.828007] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-28T17:35:41.962244] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-28T17:35:42.359360] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-03. [2025-10-28T17:35:43.159439] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-08. [2025-10-28T17:35:43.395928] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-28T17:35:43.959355] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-04. [2025-10-28T17:35:44.388629] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-28T17:35:44.759421] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-09. [2025-10-28T17:35:44.902759] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-28T17:35:45.559369] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-05. [2025-10-28T17:35:45.797920] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-28T17:35:46.359359] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-10. [2025-10-28T17:35:46.614084] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-28T17:35:47.159333] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-03. [2025-10-28T17:35:47.526158] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-28T17:35:47.533304] [INFO ] [REMOTE ] BKE: Full fetch complete (49917 records). [2025-10-28T17:35:47.533456] [DEBUG] [VALIDATOR ] BKE: Validating primary data. [2025-10-28T17:35:47.849253] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-28T17:35:47.928629] [DEBUG] [VALIDATOR ] BKE: All expected trading days are present. [2025-10-28T17:35:47.928751] [DEBUG] [VALIDATOR ] BKE: Primary data validation passed. [2025-10-28T17:35:47.929303] [INFO ] [MAIN ] BKE: Fetched primary data is valid. [2025-10-28T17:35:47.929342] [DEBUG] [LOCAL ] BKE: Saving primary data. [2025-10-28T17:35:47.930308] [DEBUG] [LOCAL ] BKE: Trimmed 49917 records to 33084 (keeping 200 days of data) [2025-10-28T17:35:47.981893] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-06. [2025-10-28T17:35:48.126737] [DEBUG] [LOCAL ] BKE: Primary data saved (33084 records). [2025-10-28T17:35:48.126865] [INFO ] [MAIN ] BKE: Full history saved. [2025-10-28T17:35:48.127434] [INFO ] [MAIN ] Update Progress: 288/2366 symbols completed. BKE took 25.6s. Estimated remaining: 4h 17m 58s. Rate: 8.1 symbols/min [2025-10-28T17:35:48.293441] [INFO ] [MAIN ] BKSY: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:35:48.338824] [DEBUG] [LOCAL ] BKSY: Loaded 48907 existing records from primary storage. [2025-10-28T17:35:48.339173] [INFO ] [MAIN ] BKSY: Loaded 48907 existing records. [2025-10-28T17:35:48.515960] [WARN ] [MAIN ] BKSY: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:35:48.516205] [INFO ] [MAIN ] BKSY: Wiping existing primary data before full refresh. [2025-10-28T17:35:48.516251] [INFO ] [LOCAL ] BKSY: Starting deletion of primary data. [2025-10-28T17:35:48.516757] [DEBUG] [LOCAL ] BKSY: Deleted primary data file. [2025-10-28T17:35:48.516815] [INFO ] [MAIN ] BKSY: Starting full primary refresh. [2025-10-28T17:35:48.762219] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-04. [2025-10-28T17:35:48.868735] [INFO ] [REMOTE ] BKSY: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:35:49.113376] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-28T17:35:49.483537] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-28T17:35:49.559308] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-07. [2025-10-28T17:35:50.359335] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-07. [2025-10-28T17:35:51.053990] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-28T17:35:51.159352] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-08. [2025-10-28T17:35:51.727021] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-28T17:35:51.959334] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-05. [2025-10-28T17:35:52.571709] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-28T17:35:52.759498] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-06. [2025-10-28T17:35:52.761582] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-28T17:35:53.232947] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-28T17:35:53.559338] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-08. [2025-10-28T17:35:54.359355] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-01. [2025-10-28T17:35:54.779721] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-28T17:35:55.159340] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-07. [2025-10-28T17:35:55.709704] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-28T17:35:55.854238] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-28T17:35:55.959314] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-09. [2025-10-28T17:35:56.759379] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-02. [2025-10-28T17:35:57.034350] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-28T17:35:57.559338] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-10. [2025-10-28T17:35:58.120637] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-28T17:35:58.359343] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-08. [2025-10-28T17:35:58.629129] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-28T17:35:58.637278] [INFO ] [REMOTE ] BKH: Full fetch complete (53344 records). [2025-10-28T17:35:58.637417] [DEBUG] [VALIDATOR ] BKH: Validating primary data. [2025-10-28T17:35:58.869842] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-28T17:35:59.032674] [DEBUG] [VALIDATOR ] BKH: All expected trading days are present. [2025-10-28T17:35:59.032763] [DEBUG] [VALIDATOR ] BKH: Primary data validation passed. [2025-10-28T17:35:59.033359] [INFO ] [MAIN ] BKH: Fetched primary data is valid. [2025-10-28T17:35:59.033419] [DEBUG] [LOCAL ] BKH: Saving primary data. [2025-10-28T17:35:59.034546] [DEBUG] [LOCAL ] BKH: Trimmed 53344 records to 37298 (keeping 200 days of data) [2025-10-28T17:35:59.194836] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-09. [2025-10-28T17:35:59.255106] [DEBUG] [LOCAL ] BKH: Primary data saved (37298 records). [2025-10-28T17:35:59.255218] [INFO ] [MAIN ] BKH: Full history saved. [2025-10-28T17:35:59.255286] [INFO ] [MAIN ] Update Progress: 289/2366 symbols completed. BKH took 32.4s. Estimated remaining: 4h 18m 17s. Rate: 8.0 symbols/min [2025-10-28T17:35:59.424834] [INFO ] [MAIN ] BKT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:35:59.438985] [DEBUG] [LOCAL ] BKT: Loaded 12719 existing records from primary storage. [2025-10-28T17:35:59.439215] [INFO ] [MAIN ] BKT: Loaded 12719 existing records. [2025-10-28T17:35:59.619215] [WARN ] [MAIN ] BKT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:35:59.619408] [INFO ] [MAIN ] BKT: Wiping existing primary data before full refresh. [2025-10-28T17:35:59.619455] [INFO ] [LOCAL ] BKT: Starting deletion of primary data. [2025-10-28T17:35:59.619632] [DEBUG] [LOCAL ] BKT: Deleted primary data file. [2025-10-28T17:35:59.619723] [INFO ] [MAIN ] BKT: Starting full primary refresh. [2025-10-28T17:35:59.974759] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-03. [2025-10-28T17:35:59.980187] [INFO ] [REMOTE ] BKT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:36:00.759329] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-01. [2025-10-28T17:36:00.878873] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-28T17:36:01.410240] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-28T17:36:01.483938] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-28T17:36:01.559337] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-10. [2025-10-28T17:36:02.359358] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-02. [2025-10-28T17:36:02.890701] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-28T17:36:03.159334] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-03. [2025-10-28T17:36:03.721991] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-28T17:36:03.721781] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-10 (2.16 seconds). [2025-10-28T17:36:03.734942] [INFO ] [REMOTE ] BKKT: Full fetch complete (52569 records). [2025-10-28T17:36:03.735058] [DEBUG] [VALIDATOR ] BKKT: Validating primary data. [2025-10-28T17:36:03.964592] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-09. [2025-10-28T17:36:04.114276] [DEBUG] [VALIDATOR ] BKKT: All expected trading days are present. [2025-10-28T17:36:04.114357] [DEBUG] [VALIDATOR ] BKKT: Primary data validation passed. [2025-10-28T17:36:04.114971] [INFO ] [MAIN ] BKKT: Fetched primary data is valid. [2025-10-28T17:36:04.115031] [DEBUG] [LOCAL ] BKKT: Saving primary data. [2025-10-28T17:36:04.116172] [DEBUG] [LOCAL ] BKKT: Trimmed 52569 records to 37975 (keeping 200 days of data) [2025-10-28T17:36:04.329793] [DEBUG] [LOCAL ] BKKT: Primary data saved (37975 records). [2025-10-28T17:36:04.329920] [INFO ] [MAIN ] BKKT: Full history saved. [2025-10-28T17:36:04.329994] [INFO ] [MAIN ] Update Progress: 290/2366 symbols completed. BKKT took 35.5s. Estimated remaining: 4h 17m 52s. Rate: 8.1 symbols/min [2025-10-28T17:36:04.501067] [INFO ] [MAIN ] BKU: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:36:04.538730] [DEBUG] [LOCAL ] BKU: Loaded 42038 existing records from primary storage. [2025-10-28T17:36:04.539056] [INFO ] [MAIN ] BKU: Loaded 42038 existing records. [2025-10-28T17:36:04.651601] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-28T17:36:04.733848] [WARN ] [MAIN ] BKU: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:36:04.734054] [INFO ] [MAIN ] BKU: Wiping existing primary data before full refresh. [2025-10-28T17:36:04.734100] [INFO ] [LOCAL ] BKU: Starting deletion of primary data. [2025-10-28T17:36:04.734519] [DEBUG] [LOCAL ] BKU: Deleted primary data file. [2025-10-28T17:36:04.734562] [INFO ] [MAIN ] BKU: Starting full primary refresh. [2025-10-28T17:36:04.764415] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-10. [2025-10-28T17:36:05.091214] [INFO ] [REMOTE ] BKU: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:36:05.434922] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-28T17:36:05.436795] [INFO ] [REMOTE ] BKN: Full fetch complete (11160 records). [2025-10-28T17:36:05.436865] [DEBUG] [VALIDATOR ] BKN: Validating primary data. [2025-10-28T17:36:05.574845] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-04. [2025-10-28T17:36:05.799030] [DEBUG] [VALIDATOR ] BKN: All expected trading days are present. [2025-10-28T17:36:05.799101] [DEBUG] [VALIDATOR ] BKN: Primary data validation passed. [2025-10-28T17:36:05.799345] [INFO ] [MAIN ] BKN: Fetched primary data is valid. [2025-10-28T17:36:05.799391] [DEBUG] [LOCAL ] BKN: Saving primary data. [2025-10-28T17:36:05.799840] [DEBUG] [LOCAL ] BKN: Trimmed 11160 records to 7211 (keeping 200 days of data) [2025-10-28T17:36:05.842102] [DEBUG] [LOCAL ] BKN: Primary data saved (7211 records). [2025-10-28T17:36:05.842200] [INFO ] [MAIN ] BKN: Full history saved. [2025-10-28T17:36:05.842272] [INFO ] [MAIN ] Update Progress: 291/2366 symbols completed. BKN took 29.2s. Estimated remaining: 4h 17m 2s. Rate: 8.1 symbols/min [2025-10-28T17:36:06.011463] [INFO ] [MAIN ] BKV: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:36:06.037126] [DEBUG] [LOCAL ] BKV: Loaded 29033 existing records from primary storage. [2025-10-28T17:36:06.037408] [INFO ] [MAIN ] BKV: Loaded 29033 existing records. [2025-10-28T17:36:06.211724] [WARN ] [MAIN ] BKV: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:36:06.211936] [INFO ] [MAIN ] BKV: Wiping existing primary data before full refresh. [2025-10-28T17:36:06.211988] [INFO ] [LOCAL ] BKV: Starting deletion of primary data. [2025-10-28T17:36:06.212459] [DEBUG] [LOCAL ] BKV: Deleted primary data file. [2025-10-28T17:36:06.212528] [INFO ] [MAIN ] BKV: Starting full primary refresh. [2025-10-28T17:36:06.367841] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-01. [2025-10-28T17:36:06.564878] [INFO ] [REMOTE ] BKV: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:36:06.831953] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-28T17:36:07.159326] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-04. [2025-10-28T17:36:07.684022] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-28T17:36:07.881636] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-28T17:36:07.959334] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-02. [2025-10-28T17:36:08.759306] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-05. [2025-10-28T17:36:08.803625] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-28T17:36:09.303588] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-28T17:36:09.559328] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-06. [2025-10-28T17:36:10.009417] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-28T17:36:10.359333] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-07. [2025-10-28T17:36:10.812813] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-28T17:36:11.159337] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-08. [2025-10-28T17:36:11.776671] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-28T17:36:11.959364] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-05. [2025-10-28T17:36:12.759377] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-03. [2025-10-28T17:36:13.122821] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-28T17:36:13.559347] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-09. [2025-10-28T17:36:13.894732] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-28T17:36:14.163054] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-28T17:36:14.359371] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-01. [2025-10-28T17:36:15.159342] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-10. [2025-10-28T17:36:15.611964] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-28T17:36:15.959418] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-02. [2025-10-28T17:36:16.143610] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-28T17:36:16.148568] [INFO ] [REMOTE ] BKT: Full fetch complete (16852 records). [2025-10-28T17:36:16.148767] [DEBUG] [VALIDATOR ] BKT: Validating primary data. [2025-10-28T17:36:16.552991] [DEBUG] [VALIDATOR ] BKT: All expected trading days are present. [2025-10-28T17:36:16.553066] [DEBUG] [VALIDATOR ] BKT: Primary data validation passed. [2025-10-28T17:36:16.553408] [INFO ] [MAIN ] BKT: Fetched primary data is valid. [2025-10-28T17:36:16.553448] [DEBUG] [LOCAL ] BKT: Saving primary data. [2025-10-28T17:36:16.553997] [DEBUG] [LOCAL ] BKT: Trimmed 16852 records to 12704 (keeping 200 days of data) [2025-10-28T17:36:16.631748] [DEBUG] [LOCAL ] BKT: Primary data saved (12704 records). [2025-10-28T17:36:16.631878] [INFO ] [MAIN ] BKT: Full history saved. [2025-10-28T17:36:16.631955] [INFO ] [MAIN ] Update Progress: 292/2366 symbols completed. BKT took 17.4s. Estimated remaining: 4h 17m 19s. Rate: 8.1 symbols/min [2025-10-28T17:36:16.771840] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-06. [2025-10-28T17:36:16.805617] [INFO ] [MAIN ] BLCO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:36:16.838156] [DEBUG] [LOCAL ] BLCO: Loaded 34457 existing records from primary storage. [2025-10-28T17:36:16.838440] [INFO ] [MAIN ] BLCO: Loaded 34457 existing records. [2025-10-28T17:36:17.019547] [WARN ] [MAIN ] BLCO: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:36:17.019884] [INFO ] [MAIN ] BLCO: Wiping existing primary data before full refresh. [2025-10-28T17:36:17.020018] [INFO ] [LOCAL ] BLCO: Starting deletion of primary data. [2025-10-28T17:36:17.037857] [DEBUG] [LOCAL ] BLCO: Deleted primary data file. [2025-10-28T17:36:17.038495] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-28T17:36:17.038745] [INFO ] [MAIN ] BLCO: Starting full primary refresh. [2025-10-28T17:36:17.408705] [INFO ] [REMOTE ] BLCO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:36:17.559323] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-03. [2025-10-28T17:36:18.359341] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-01. [2025-10-28T17:36:18.501014] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-10-28T17:36:18.591244] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-28T17:36:19.159341] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-04. [2025-10-28T17:36:19.236711] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-28T17:36:19.959346] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-07. [2025-10-28T17:36:20.394937] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-28T17:36:20.759327] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-05. [2025-10-28T17:36:21.559320] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-04. [2025-10-28T17:36:21.679129] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-28T17:36:21.819496] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-28T17:36:22.359342] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-06. [2025-10-28T17:36:22.784758] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-28T17:36:23.157070] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-28T17:36:23.163194] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-02. [2025-10-28T17:36:23.959335] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-07. [2025-10-28T17:36:24.097324] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-28T17:36:24.758636] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-28T17:36:24.765101] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-03. [2025-10-28T17:36:25.559345] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-05. [2025-10-28T17:36:25.962184] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-28T17:36:26.359394] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-04. [2025-10-28T17:36:26.632611] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-28T17:36:27.159345] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-08. [2025-10-28T17:36:27.324491] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-28T17:36:27.894693] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-28T17:36:27.959380] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-05. [2025-10-28T17:36:28.759309] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-06. [2025-10-28T17:36:28.951301] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-28T17:36:29.559403] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-08. [2025-10-28T17:36:29.923155] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-28T17:36:30.359397] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-09. [2025-10-28T17:36:31.159353] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-06. [2025-10-28T17:36:31.193623] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-28T17:36:31.337153] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-28T17:36:31.959362] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-07. [2025-10-28T17:36:32.221224] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-28T17:36:32.759323] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-07. [2025-10-28T17:36:33.295735] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-28T17:36:33.559295] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-08. [2025-10-28T17:36:33.672969] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-28T17:36:34.359383] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-09. [2025-10-28T17:36:34.713444] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-28T17:36:35.159350] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-10. [2025-10-28T17:36:35.959405] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-09. [2025-10-28T17:36:36.200965] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-28T17:36:36.207599] [INFO ] [REMOTE ] BKV: Full fetch complete (44764 records). [2025-10-28T17:36:36.207758] [DEBUG] [VALIDATOR ] BKV: Validating primary data. [2025-10-28T17:36:36.599196] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-09 (2.24 seconds). [2025-10-28T17:36:36.642872] [DEBUG] [VALIDATOR ] BKV: All expected trading days are present. [2025-10-28T17:36:36.643233] [DEBUG] [VALIDATOR ] BKV: Primary data validation passed. [2025-10-28T17:36:36.643871] [INFO ] [MAIN ] BKV: Fetched primary data is valid. [2025-10-28T17:36:36.644088] [DEBUG] [LOCAL ] BKV: Saving primary data. [2025-10-28T17:36:36.645347] [DEBUG] [LOCAL ] BKV: Trimmed 44764 records to 28974 (keeping 200 days of data) [2025-10-28T17:36:36.761474] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-10. [2025-10-28T17:36:36.814606] [DEBUG] [LOCAL ] BKV: Primary data saved (28974 records). [2025-10-28T17:36:36.814765] [INFO ] [MAIN ] BKV: Full history saved. [2025-10-28T17:36:36.814849] [INFO ] [MAIN ] Update Progress: 293/2366 symbols completed. BKV took 31.0s. Estimated remaining: 4h 18m 41s. Rate: 8.0 symbols/min [2025-10-28T17:36:36.993206] [INFO ] [MAIN ] BLD: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:36:37.042350] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-28T17:36:37.071531] [DEBUG] [LOCAL ] BLD: Loaded 26648 existing records from primary storage. [2025-10-28T17:36:37.071812] [INFO ] [MAIN ] BLD: Loaded 26648 existing records. [2025-10-28T17:36:37.245305] [WARN ] [MAIN ] BLD: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:36:37.245516] [INFO ] [MAIN ] BLD: Wiping existing primary data before full refresh. [2025-10-28T17:36:37.245563] [INFO ] [LOCAL ] BLD: Starting deletion of primary data. [2025-10-28T17:36:37.245887] [DEBUG] [LOCAL ] BLD: Deleted primary data file. [2025-10-28T17:36:37.245944] [INFO ] [MAIN ] BLD: Starting full primary refresh. [2025-10-28T17:36:37.566328] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-08. [2025-10-28T17:36:37.595405] [INFO ] [REMOTE ] BLD: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:36:38.359350] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-01. [2025-10-28T17:36:38.395148] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-28T17:36:38.667426] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-10 (1.91 seconds). [2025-10-28T17:36:38.679357] [INFO ] [REMOTE ] BKSY: Full fetch complete (70785 records). [2025-10-28T17:36:38.679522] [DEBUG] [VALIDATOR ] BKSY: Validating primary data. [2025-10-28T17:36:39.117217] [DEBUG] [VALIDATOR ] BKSY: All expected trading days are present. [2025-10-28T17:36:39.117542] [DEBUG] [VALIDATOR ] BKSY: Primary data validation passed. [2025-10-28T17:36:39.118469] [INFO ] [MAIN ] BKSY: Fetched primary data is valid. [2025-10-28T17:36:39.118532] [DEBUG] [LOCAL ] BKSY: Saving primary data. [2025-10-28T17:36:39.119903] [DEBUG] [LOCAL ] BKSY: Trimmed 70785 records to 48927 (keeping 200 days of data) [2025-10-28T17:36:39.171000] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-10. [2025-10-28T17:36:39.413556] [DEBUG] [LOCAL ] BKSY: Primary data saved (48927 records). [2025-10-28T17:36:39.413801] [INFO ] [MAIN ] BKSY: Full history saved. [2025-10-28T17:36:39.414383] [INFO ] [MAIN ] Update Progress: 294/2366 symbols completed. BKSY took 51.3s. Estimated remaining: 4h 17m 60s. Rate: 8.0 symbols/min [2025-10-28T17:36:39.583517] [INFO ] [MAIN ] BLDR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:36:39.599579] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-28T17:36:39.652853] [DEBUG] [LOCAL ] BLDR: Loaded 51805 existing records from primary storage. [2025-10-28T17:36:39.653161] [INFO ] [MAIN ] BLDR: Loaded 51805 existing records. [2025-10-28T17:36:39.830267] [WARN ] [MAIN ] BLDR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:36:39.830508] [INFO ] [MAIN ] BLDR: Wiping existing primary data before full refresh. [2025-10-28T17:36:39.830554] [INFO ] [LOCAL ] BLDR: Starting deletion of primary data. [2025-10-28T17:36:39.830903] [DEBUG] [LOCAL ] BLDR: Deleted primary data file. [2025-10-28T17:36:39.830960] [INFO ] [MAIN ] BLDR: Starting full primary refresh. [2025-10-28T17:36:39.964497] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-09. [2025-10-28T17:36:40.194596] [INFO ] [REMOTE ] BLDR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:36:40.430582] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-28T17:36:40.441248] [INFO ] [REMOTE ] BKU: Full fetch complete (61238 records). [2025-10-28T17:36:40.441412] [DEBUG] [VALIDATOR ] BKU: Validating primary data. [2025-10-28T17:36:40.769280] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-01. [2025-10-28T17:36:40.881086] [DEBUG] [VALIDATOR ] BKU: All expected trading days are present. [2025-10-28T17:36:40.881364] [DEBUG] [VALIDATOR ] BKU: Primary data validation passed. [2025-10-28T17:36:40.882223] [INFO ] [MAIN ] BKU: Fetched primary data is valid. [2025-10-28T17:36:40.882366] [DEBUG] [LOCAL ] BKU: Saving primary data. [2025-10-28T17:36:40.900302] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-28T17:36:40.906555] [DEBUG] [LOCAL ] BKU: Trimmed 61238 records to 42090 (keeping 200 days of data) [2025-10-28T17:36:41.186791] [DEBUG] [LOCAL ] BKU: Primary data saved (42090 records). [2025-10-28T17:36:41.186902] [INFO ] [MAIN ] BKU: Full history saved. [2025-10-28T17:36:41.186981] [INFO ] [MAIN ] Update Progress: 295/2366 symbols completed. BKU took 36.9s. Estimated remaining: 4h 17m 12s. Rate: 8.1 symbols/min [2025-10-28T17:36:41.358174] [INFO ] [MAIN ] BLE: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:36:41.376250] [DEBUG] [LOCAL ] BLE: Loaded 13448 existing records from primary storage. [2025-10-28T17:36:41.376554] [INFO ] [MAIN ] BLE: Loaded 13448 existing records. [2025-10-28T17:36:41.560257] [WARN ] [MAIN ] BLE: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:36:41.560403] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-02. [2025-10-28T17:36:41.561448] [INFO ] [MAIN ] BLE: Wiping existing primary data before full refresh. [2025-10-28T17:36:41.561518] [INFO ] [LOCAL ] BLE: Starting deletion of primary data. [2025-10-28T17:36:41.561883] [DEBUG] [LOCAL ] BLE: Deleted primary data file. [2025-10-28T17:36:41.561945] [INFO ] [MAIN ] BLE: Starting full primary refresh. [2025-10-28T17:36:41.924837] [INFO ] [REMOTE ] BLE: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:36:42.098813] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-28T17:36:42.359351] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-01. [2025-10-28T17:36:42.520759] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-28T17:36:42.945675] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-28T17:36:43.159350] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-02. [2025-10-28T17:36:43.626505] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-28T17:36:43.959323] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-03. [2025-10-28T17:36:44.576529] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-28T17:36:44.759344] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-02. [2025-10-28T17:36:45.559399] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-10. [2025-10-28T17:36:46.129944] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-28T17:36:46.359392] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-03. [2025-10-28T17:36:46.664446] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-28T17:36:46.670860] [INFO ] [REMOTE ] BLCO: Full fetch complete (52050 records). [2025-10-28T17:36:46.671003] [DEBUG] [VALIDATOR ] BLCO: Validating primary data. [2025-10-28T17:36:47.070546] [DEBUG] [VALIDATOR ] BLCO: All expected trading days are present. [2025-10-28T17:36:47.070615] [DEBUG] [VALIDATOR ] BLCO: Primary data validation passed. [2025-10-28T17:36:47.071252] [INFO ] [MAIN ] BLCO: Fetched primary data is valid. [2025-10-28T17:36:47.071314] [DEBUG] [LOCAL ] BLCO: Saving primary data. [2025-10-28T17:36:47.072453] [DEBUG] [LOCAL ] BLCO: Trimmed 52050 records to 34377 (keeping 200 days of data) [2025-10-28T17:36:47.173810] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-04. [2025-10-28T17:36:47.270684] [DEBUG] [LOCAL ] BLCO: Primary data saved (34377 records). [2025-10-28T17:36:47.270808] [INFO ] [MAIN ] BLCO: Full history saved. [2025-10-28T17:36:47.270888] [INFO ] [MAIN ] Update Progress: 296/2366 symbols completed. BLCO took 30.6s. Estimated remaining: 4h 16m 55s. Rate: 8.1 symbols/min [2025-10-28T17:36:47.443830] [INFO ] [MAIN ] BLK: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:36:47.462504] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-28T17:36:47.499353] [DEBUG] [LOCAL ] BLK: Loaded 33685 existing records from primary storage. [2025-10-28T17:36:47.499729] [INFO ] [MAIN ] BLK: Loaded 33685 existing records. [2025-10-28T17:36:47.673086] [WARN ] [MAIN ] BLK: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:36:47.673293] [INFO ] [MAIN ] BLK: Wiping existing primary data before full refresh. [2025-10-28T17:36:47.673339] [INFO ] [LOCAL ] BLK: Starting deletion of primary data. [2025-10-28T17:36:47.674161] [DEBUG] [LOCAL ] BLK: Deleted primary data file. [2025-10-28T17:36:47.674218] [INFO ] [MAIN ] BLK: Starting full primary refresh. [2025-10-28T17:36:47.965427] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-03. [2025-10-28T17:36:48.043923] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-28T17:36:48.049500] [INFO ] [REMOTE ] BLK: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:36:48.759343] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-04. [2025-10-28T17:36:49.177549] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-28T17:36:49.559314] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-05. [2025-10-28T17:36:49.621223] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-28T17:36:49.958031] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-10-28T17:36:50.359351] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-06. [2025-10-28T17:36:51.046125] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-28T17:36:51.159341] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-07. [2025-10-28T17:36:51.752560] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-28T17:36:51.959345] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-08. [2025-10-28T17:36:52.485232] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-28T17:36:52.759340] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-04. [2025-10-28T17:36:53.559339] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-09. [2025-10-28T17:36:54.131029] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-28T17:36:54.339399] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-28T17:36:54.359299] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-01. [2025-10-28T17:36:55.159326] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-05. [2025-10-28T17:36:55.682867] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-28T17:36:55.959318] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-10. [2025-10-28T17:36:56.543037] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-28T17:36:56.545809] [INFO ] [REMOTE ] BLE: Full fetch complete (19614 records). [2025-10-28T17:36:56.545878] [DEBUG] [VALIDATOR ] BLE: Validating primary data. [2025-10-28T17:36:56.761544] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-02. [2025-10-28T17:36:56.923207] [DEBUG] [VALIDATOR ] BLE: All expected trading days are present. [2025-10-28T17:36:56.923346] [DEBUG] [VALIDATOR ] BLE: Primary data validation passed. [2025-10-28T17:36:56.923840] [INFO ] [MAIN ] BLE: Fetched primary data is valid. [2025-10-28T17:36:56.923919] [DEBUG] [LOCAL ] BLE: Saving primary data. [2025-10-28T17:36:56.924591] [DEBUG] [LOCAL ] BLE: Trimmed 19614 records to 13409 (keeping 200 days of data) [2025-10-28T17:36:57.002946] [DEBUG] [LOCAL ] BLE: Primary data saved (13409 records). [2025-10-28T17:36:57.003120] [INFO ] [MAIN ] BLE: Full history saved. [2025-10-28T17:36:57.003228] [INFO ] [MAIN ] Update Progress: 297/2366 symbols completed. BLE took 15.8s. Estimated remaining: 4h 17m 4s. Rate: 8.0 symbols/min [2025-10-28T17:36:57.172598] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-28T17:36:57.214156] [INFO ] [MAIN ] BLND: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:36:57.256364] [DEBUG] [LOCAL ] BLND: Loaded 49191 existing records from primary storage. [2025-10-28T17:36:57.256681] [INFO ] [MAIN ] BLND: Loaded 49191 existing records. [2025-10-28T17:36:57.427446] [WARN ] [MAIN ] BLND: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:36:57.427664] [INFO ] [MAIN ] BLND: Wiping existing primary data before full refresh. [2025-10-28T17:36:57.427741] [INFO ] [LOCAL ] BLND: Starting deletion of primary data. [2025-10-28T17:36:57.427994] [DEBUG] [LOCAL ] BLND: Deleted primary data file. [2025-10-28T17:36:57.428036] [INFO ] [MAIN ] BLND: Starting full primary refresh. [2025-10-28T17:36:57.564522] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-05. [2025-10-28T17:36:57.777528] [INFO ] [REMOTE ] BLND: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:36:58.292765] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-28T17:36:58.332667] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-28T17:36:58.359292] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-06. [2025-10-28T17:36:59.159300] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-01. [2025-10-28T17:36:59.326175] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-28T17:36:59.959368] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-06. [2025-10-28T17:37:00.285096] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-28T17:37:00.759320] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-03. [2025-10-28T17:37:01.468139] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-28T17:37:01.559325] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-07. [2025-10-28T17:37:02.239669] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-28T17:37:02.359352] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-07. [2025-10-28T17:37:03.144881] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-28T17:37:03.159297] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-08. [2025-10-28T17:37:03.375141] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-28T17:37:03.959374] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-02. [2025-10-28T17:37:04.681740] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-28T17:37:04.759300] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-09. [2025-10-28T17:37:05.195061] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-28T17:37:05.559328] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-04. [2025-10-28T17:37:06.203171] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-28T17:37:06.359349] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-08. [2025-10-28T17:37:07.159330] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-03. [2025-10-28T17:37:07.279796] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-28T17:37:07.329531] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-28T17:37:07.960332] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-05. [2025-10-28T17:37:08.375318] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-28T17:37:08.759368] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-10. [2025-10-28T17:37:09.372681] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-28T17:37:09.559350] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-06. [2025-10-28T17:37:10.359349] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-09. [2025-10-28T17:37:11.118934] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-10 (2.36 seconds). [2025-10-28T17:37:11.129729] [INFO ] [REMOTE ] BLDR: Full fetch complete (74760 records). [2025-10-28T17:37:11.129948] [DEBUG] [VALIDATOR ] BLDR: Validating primary data. [2025-10-28T17:37:11.162459] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-04. [2025-10-28T17:37:11.460393] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-28T17:37:11.598026] [DEBUG] [VALIDATOR ] BLDR: All expected trading days are present. [2025-10-28T17:37:11.598161] [DEBUG] [VALIDATOR ] BLDR: Primary data validation passed. [2025-10-28T17:37:11.599045] [INFO ] [MAIN ] BLDR: Fetched primary data is valid. [2025-10-28T17:37:11.599914] [DEBUG] [LOCAL ] BLDR: Saving primary data. [2025-10-28T17:37:11.601354] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-28T17:37:11.611316] [DEBUG] [LOCAL ] BLDR: Trimmed 74760 records to 51799 (keeping 200 days of data) [2025-10-28T17:37:11.962717] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-10. [2025-10-28T17:37:11.973633] [DEBUG] [LOCAL ] BLDR: Primary data saved (51799 records). [2025-10-28T17:37:11.975247] [INFO ] [MAIN ] BLDR: Full history saved. [2025-10-28T17:37:11.975376] [INFO ] [MAIN ] Update Progress: 298/2366 symbols completed. BLDR took 32.6s. Estimated remaining: 4h 17m 48s. Rate: 8.0 symbols/min [2025-10-28T17:37:12.168331] [INFO ] [MAIN ] BLSH: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:37:12.168506] [DEBUG] [LOCAL ] BLSH: No existing data file found in primary storage. [2025-10-28T17:37:12.168543] [WARN ] [MAIN ] BLSH: No existing data found, performing full refresh instead. [2025-10-28T17:37:12.168676] [INFO ] [MAIN ] BLSH: Wiping existing primary data before full refresh. [2025-10-28T17:37:12.168731] [INFO ] [LOCAL ] BLSH: Starting deletion of primary data. [2025-10-28T17:37:12.168772] [DEBUG] [LOCAL ] BLSH: No primary data file found to delete. [2025-10-28T17:37:12.168804] [INFO ] [MAIN ] BLSH: Starting full primary refresh. [2025-10-28T17:37:12.546246] [INFO ] [REMOTE ] BLSH: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:37:12.586578] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-28T17:37:12.759308] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-01. [2025-10-28T17:37:12.967591] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-28T17:37:12.968612] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-28T17:37:12.968829] [WARN ] [REMOTE ] BLSH: No data returned for month 2025-01 [2025-10-28T17:37:12.973245] [FATAL] [REMOTE ] BLSH: API call failed - aborting fetch to avoid wasting further API calls [2025-10-28T17:37:12.973808] [FATAL] [MAIN ] BLSH: Failed to fetch primary data. [2025-10-28T17:37:12.973881] [WARN ] [MAIN ] BLSH: Deleting existing primary and derivative data due to fetch failure. [2025-10-28T17:37:12.973959] [INFO ] [LOCAL ] BLSH: Starting deletion of primary data. [2025-10-28T17:37:12.974033] [INFO ] [REMOTE ] BLD: Full fetch complete (39700 records). [2025-10-28T17:37:12.974242] [DEBUG] [LOCAL ] BLSH: No primary data file found to delete. [2025-10-28T17:37:12.974159] [DEBUG] [VALIDATOR ] BLD: Validating primary data. [2025-10-28T17:37:12.974340] [INFO ] [LOCAL ] BLSH: Starting deletion of derivative data. [2025-10-28T17:37:12.974591] [DEBUG] [LOCAL ] BLSH: No derivative data file found to delete. [2025-10-28T17:37:12.974687] [INFO ] [MAIN ] Update Progress: 299/2366 symbols completed. BLSH took 1.0s. Estimated remaining: 4h 16m 56s. Rate: 8.0 symbols/min [2025-10-28T17:37:13.328155] [INFO ] [MAIN ] BLW: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:37:13.502241] [DEBUG] [LOCAL ] BLW: Loaded 12668 existing records from primary storage. [2025-10-28T17:37:13.520009] [INFO ] [MAIN ] BLW: Loaded 12668 existing records. [2025-10-28T17:37:13.564454] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-05. [2025-10-28T17:37:13.642045] [DEBUG] [VALIDATOR ] BLD: All expected trading days are present. [2025-10-28T17:37:13.652818] [DEBUG] [VALIDATOR ] BLD: Primary data validation passed. [2025-10-28T17:37:13.653314] [INFO ] [MAIN ] BLD: Fetched primary data is valid. [2025-10-28T17:37:13.653386] [DEBUG] [LOCAL ] BLD: Saving primary data. [2025-10-28T17:37:13.703191] [DEBUG] [LOCAL ] BLD: Trimmed 39700 records to 26517 (keeping 200 days of data) [2025-10-28T17:37:13.731987] [WARN ] [MAIN ] BLW: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:37:13.788750] [INFO ] [MAIN ] BLW: Wiping existing primary data before full refresh. [2025-10-28T17:37:13.815573] [INFO ] [LOCAL ] BLW: Starting deletion of primary data. [2025-10-28T17:37:13.819112] [DEBUG] [LOCAL ] BLW: Deleted primary data file. [2025-10-28T17:37:13.819913] [INFO ] [MAIN ] BLW: Starting full primary refresh. [2025-10-28T17:37:14.178361] [DEBUG] [LOCAL ] BLD: Primary data saved (26517 records). [2025-10-28T17:37:14.178632] [INFO ] [MAIN ] BLD: Full history saved. [2025-10-28T17:37:14.179128] [INFO ] [MAIN ] Update Progress: 300/2366 symbols completed. BLD took 37.4s. Estimated remaining: 4h 16m 5s. Rate: 8.1 symbols/min [2025-10-28T17:37:14.371732] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-07. [2025-10-28T17:37:14.371662] [INFO ] [REMOTE ] BLW: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:37:14.455446] [INFO ] [MAIN ] BLX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:37:14.471446] [DEBUG] [LOCAL ] BLX: Loaded 14966 existing records from primary storage. [2025-10-28T17:37:14.471745] [INFO ] [MAIN ] BLX: Loaded 14966 existing records. [2025-10-28T17:37:14.647468] [WARN ] [MAIN ] BLX: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:37:14.647746] [INFO ] [MAIN ] BLX: Wiping existing primary data before full refresh. [2025-10-28T17:37:14.647801] [INFO ] [LOCAL ] BLX: Starting deletion of primary data. [2025-10-28T17:37:14.648123] [DEBUG] [LOCAL ] BLX: Deleted primary data file. [2025-10-28T17:37:14.648163] [INFO ] [MAIN ] BLX: Starting full primary refresh. [2025-10-28T17:37:15.009010] [INFO ] [REMOTE ] BLX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:37:15.037303] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-28T17:37:15.159295] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-06. [2025-10-28T17:37:15.790457] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-28T17:37:15.959322] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-08. [2025-10-28T17:37:16.207732] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-28T17:37:16.759473] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-07. [2025-10-28T17:37:16.983408] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-28T17:37:17.559399] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-09. [2025-10-28T17:37:17.988610] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-28T17:37:18.359469] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-01. [2025-10-28T17:37:18.649278] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-28T17:37:19.004485] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-28T17:37:19.159333] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-02. [2025-10-28T17:37:19.759967] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-28T17:37:19.959368] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-08. [2025-10-28T17:37:20.759398] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-03. [2025-10-28T17:37:21.257805] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-28T17:37:21.564453] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-01. [2025-10-28T17:37:21.573659] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-28T17:37:22.359381] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-04. [2025-10-28T17:37:22.531930] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-28T17:37:23.159312] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-10. [2025-10-28T17:37:23.345710] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-28T17:37:23.959363] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-02. [2025-10-28T17:37:24.445511] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-28T17:37:24.722993] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-28T17:37:24.730536] [INFO ] [REMOTE ] BLK: Full fetch complete (52617 records). [2025-10-28T17:37:24.730699] [DEBUG] [VALIDATOR ] BLK: Validating primary data. [2025-10-28T17:37:24.766729] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-09. [2025-10-28T17:37:25.154015] [DEBUG] [VALIDATOR ] BLK: All expected trading days are present. [2025-10-28T17:37:25.154093] [DEBUG] [VALIDATOR ] BLK: Primary data validation passed. [2025-10-28T17:37:25.154728] [INFO ] [MAIN ] BLK: Fetched primary data is valid. [2025-10-28T17:37:25.154788] [DEBUG] [LOCAL ] BLK: Saving primary data. [2025-10-28T17:37:25.155831] [DEBUG] [LOCAL ] BLK: Trimmed 52617 records to 33493 (keeping 200 days of data) [2025-10-28T17:37:25.365915] [DEBUG] [LOCAL ] BLK: Primary data saved (33493 records). [2025-10-28T17:37:25.366068] [INFO ] [MAIN ] BLK: Full history saved. [2025-10-28T17:37:25.366939] [INFO ] [MAIN ] Update Progress: 301/2366 symbols completed. BLK took 38.1s. Estimated remaining: 4h 16m 24s. Rate: 8.1 symbols/min [2025-10-28T17:37:25.530527] [INFO ] [MAIN ] BMA: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:37:25.563559] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-05. [2025-10-28T17:37:25.565312] [DEBUG] [LOCAL ] BMA: Loaded 36661 existing records from primary storage. [2025-10-28T17:37:25.565719] [INFO ] [MAIN ] BMA: Loaded 36661 existing records. [2025-10-28T17:37:25.739849] [WARN ] [MAIN ] BMA: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:37:25.740053] [INFO ] [MAIN ] BMA: Wiping existing primary data before full refresh. [2025-10-28T17:37:25.740100] [INFO ] [LOCAL ] BMA: Starting deletion of primary data. [2025-10-28T17:37:25.740757] [DEBUG] [LOCAL ] BMA: Deleted primary data file. [2025-10-28T17:37:25.740814] [INFO ] [MAIN ] BMA: Starting full primary refresh. [2025-10-28T17:37:26.103431] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-28T17:37:26.103052] [INFO ] [REMOTE ] BMA: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:37:26.167978] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-28T17:37:26.359329] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-01. [2025-10-28T17:37:27.159352] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-06. [2025-10-28T17:37:27.524441] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-28T17:37:27.735846] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-28T17:37:27.959356] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-10. [2025-10-28T17:37:28.759416] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-07. [2025-10-28T17:37:29.212894] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-28T17:37:29.222866] [INFO ] [REMOTE ] BLND: Full fetch complete (72181 records). [2025-10-28T17:37:29.222980] [DEBUG] [VALIDATOR ] BLND: Validating primary data. [2025-10-28T17:37:29.553355] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-28T17:37:29.571131] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-02. [2025-10-28T17:37:29.631555] [DEBUG] [VALIDATOR ] BLND: All expected trading days are present. [2025-10-28T17:37:29.631630] [DEBUG] [VALIDATOR ] BLND: Primary data validation passed. [2025-10-28T17:37:29.632385] [INFO ] [MAIN ] BLND: Fetched primary data is valid. [2025-10-28T17:37:29.632434] [DEBUG] [LOCAL ] BLND: Saving primary data. [2025-10-28T17:37:29.633797] [DEBUG] [LOCAL ] BLND: Trimmed 72181 records to 49182 (keeping 200 days of data) [2025-10-28T17:37:29.909464] [DEBUG] [LOCAL ] BLND: Primary data saved (49182 records). [2025-10-28T17:37:29.909585] [INFO ] [MAIN ] BLND: Full history saved. [2025-10-28T17:37:29.909681] [INFO ] [MAIN ] Update Progress: 302/2366 symbols completed. BLND took 32.9s. Estimated remaining: 4h 15m 56s. Rate: 8.1 symbols/min [2025-10-28T17:37:30.084714] [INFO ] [MAIN ] BME: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:37:30.095090] [DEBUG] [LOCAL ] BME: Loaded 11046 existing records from primary storage. [2025-10-28T17:37:30.095254] [INFO ] [MAIN ] BME: Loaded 11046 existing records. [2025-10-28T17:37:30.267552] [WARN ] [MAIN ] BME: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:37:30.267831] [INFO ] [MAIN ] BME: Wiping existing primary data before full refresh. [2025-10-28T17:37:30.267885] [INFO ] [LOCAL ] BME: Starting deletion of primary data. [2025-10-28T17:37:30.268175] [DEBUG] [LOCAL ] BME: Deleted primary data file. [2025-10-28T17:37:30.268233] [INFO ] [MAIN ] BME: Starting full primary refresh. [2025-10-28T17:37:30.364537] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-03. [2025-10-28T17:37:30.638927] [INFO ] [REMOTE ] BME: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:37:30.657915] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-28T17:37:31.159325] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-08. [2025-10-28T17:37:31.285924] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-28T17:37:31.761469] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-28T17:37:31.959418] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-04. [2025-10-28T17:37:32.759349] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-03. [2025-10-28T17:37:32.841297] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-28T17:37:33.559322] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-05. [2025-10-28T17:37:33.677060] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-28T17:37:34.086520] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-28T17:37:34.359464] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-09. [2025-10-28T17:37:35.113114] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-28T17:37:35.159352] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-06. [2025-10-28T17:37:35.833708] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-28T17:37:35.959346] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-10. [2025-10-28T17:37:36.633275] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-28T17:37:36.636753] [INFO ] [REMOTE ] BLW: Full fetch complete (19168 records). [2025-10-28T17:37:36.636876] [DEBUG] [VALIDATOR ] BLW: Validating primary data. [2025-10-28T17:37:36.774343] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-04. [2025-10-28T17:37:37.002016] [DEBUG] [VALIDATOR ] BLW: All expected trading days are present. [2025-10-28T17:37:37.002082] [DEBUG] [VALIDATOR ] BLW: Primary data validation passed. [2025-10-28T17:37:37.002410] [INFO ] [MAIN ] BLW: Fetched primary data is valid. [2025-10-28T17:37:37.002449] [DEBUG] [LOCAL ] BLW: Saving primary data. [2025-10-28T17:37:37.002985] [DEBUG] [LOCAL ] BLW: Trimmed 19168 records to 12656 (keeping 200 days of data) [2025-10-28T17:37:37.079824] [DEBUG] [LOCAL ] BLW: Primary data saved (12656 records). [2025-10-28T17:37:37.079942] [INFO ] [MAIN ] BLW: Full history saved. [2025-10-28T17:37:37.080016] [INFO ] [MAIN ] Update Progress: 303/2366 symbols completed. BLW took 24.1s. Estimated remaining: 4h 15m 47s. Rate: 8.1 symbols/min [2025-10-28T17:37:37.244392] [INFO ] [MAIN ] BMEZ: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:37:37.265929] [DEBUG] [LOCAL ] BMEZ: Loaded 24659 existing records from primary storage. [2025-10-28T17:37:37.266165] [INFO ] [MAIN ] BMEZ: Loaded 24659 existing records. [2025-10-28T17:37:37.448112] [WARN ] [MAIN ] BMEZ: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:37:37.448317] [INFO ] [MAIN ] BMEZ: Wiping existing primary data before full refresh. [2025-10-28T17:37:37.448378] [INFO ] [LOCAL ] BMEZ: Starting deletion of primary data. [2025-10-28T17:37:37.449004] [DEBUG] [LOCAL ] BMEZ: Deleted primary data file. [2025-10-28T17:37:37.449066] [INFO ] [MAIN ] BMEZ: Starting full primary refresh. [2025-10-28T17:37:37.564453] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-01. [2025-10-28T17:37:37.825334] [INFO ] [REMOTE ] BMEZ: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:37:38.234515] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-28T17:37:38.359309] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-01. [2025-10-28T17:37:38.406710] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-28T17:37:39.159313] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-05. [2025-10-28T17:37:39.300185] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-28T17:37:39.959405] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-02. [2025-10-28T17:37:40.286730] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-28T17:37:40.750938] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-28T17:37:40.759290] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-03. [2025-10-28T17:37:41.559332] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-06. [2025-10-28T17:37:41.729327] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-28T17:37:42.359304] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-07. [2025-10-28T17:37:42.529836] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-28T17:37:43.080732] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-28T17:37:43.159323] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-08. [2025-10-28T17:37:43.774221] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-28T17:37:43.959351] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-04. [2025-10-28T17:37:44.759313] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-09. [2025-10-28T17:37:44.868452] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-28T17:37:45.467731] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-28T17:37:45.559326] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-05. [2025-10-28T17:37:46.359870] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-10. [2025-10-28T17:37:46.363606] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-28T17:37:47.159339] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-07. [2025-10-28T17:37:47.189983] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-28T17:37:47.193289] [INFO ] [REMOTE ] BLX: Full fetch complete (22350 records). [2025-10-28T17:37:47.193362] [DEBUG] [VALIDATOR ] BLX: Validating primary data. [2025-10-28T17:37:47.563162] [DEBUG] [VALIDATOR ] BLX: All expected trading days are present. [2025-10-28T17:37:47.563234] [DEBUG] [VALIDATOR ] BLX: Primary data validation passed. [2025-10-28T17:37:47.563590] [INFO ] [MAIN ] BLX: Fetched primary data is valid. [2025-10-28T17:37:47.563627] [DEBUG] [LOCAL ] BLX: Saving primary data. [2025-10-28T17:37:47.564231] [DEBUG] [LOCAL ] BLX: Trimmed 22350 records to 14892 (keeping 200 days of data) [2025-10-28T17:37:47.651751] [DEBUG] [LOCAL ] BLX: Primary data saved (14892 records). [2025-10-28T17:37:47.651877] [INFO ] [MAIN ] BLX: Full history saved. [2025-10-28T17:37:47.651952] [INFO ] [MAIN ] Update Progress: 304/2366 symbols completed. BLX took 33.5s. Estimated remaining: 4h 16m 1s. Rate: 8.1 symbols/min [2025-10-28T17:37:47.820201] [INFO ] [MAIN ] BMI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:37:47.845387] [DEBUG] [LOCAL ] BMI: Loaded 24626 existing records from primary storage. [2025-10-28T17:37:47.845597] [INFO ] [MAIN ] BMI: Loaded 24626 existing records. [2025-10-28T17:37:47.964432] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-02. [2025-10-28T17:37:48.029568] [WARN ] [MAIN ] BMI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:37:48.029858] [INFO ] [MAIN ] BMI: Wiping existing primary data before full refresh. [2025-10-28T17:37:48.029922] [INFO ] [LOCAL ] BMI: Starting deletion of primary data. [2025-10-28T17:37:48.030356] [DEBUG] [LOCAL ] BMI: Deleted primary data file. [2025-10-28T17:37:48.030421] [INFO ] [MAIN ] BMI: Starting full primary refresh. [2025-10-28T17:37:48.399883] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-28T17:37:48.446356] [INFO ] [REMOTE ] BMI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:37:48.691988] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-28T17:37:48.759347] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-01. [2025-10-28T17:37:49.559384] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-03. [2025-10-28T17:37:49.758533] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-28T17:37:50.069712] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-28T17:37:50.359381] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-02. [2025-10-28T17:37:51.099220] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-28T17:37:51.159387] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-06. [2025-10-28T17:37:51.959343] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-08. [2025-10-28T17:37:52.106129] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-28T17:37:52.759341] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-07. [2025-10-28T17:37:53.129416] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-28T17:37:53.463156] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-28T17:37:53.559307] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-08. [2025-10-28T17:37:54.359302] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-09. [2025-10-28T17:37:54.462555] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-28T17:37:55.159334] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-03. [2025-10-28T17:37:55.481827] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-28T17:37:55.925126] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-28T17:37:55.959390] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-04. [2025-10-28T17:37:56.592169] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-28T17:37:56.759363] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-05. [2025-10-28T17:37:57.297153] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-28T17:37:57.559386] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-09. [2025-10-28T17:37:58.359324] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-06. [2025-10-28T17:37:58.426348] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-28T17:37:58.910377] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-28T17:37:59.159350] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-04. [2025-10-28T17:37:59.959343] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-10. [2025-10-28T17:38:00.039870] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-28T17:38:00.759338] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-10. [2025-10-28T17:38:01.559312] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-05. [2025-10-28T17:38:01.693752] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-28T17:38:01.702729] [INFO ] [REMOTE ] BMA: Full fetch complete (52686 records). [2025-10-28T17:38:01.702863] [DEBUG] [VALIDATOR ] BMA: Validating primary data. [2025-10-28T17:38:01.982281] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-28T17:38:02.030110] [INFO ] [REMOTE ] BMEZ: Full fetch complete (38877 records). [2025-10-28T17:38:02.045898] [DEBUG] [VALIDATOR ] BMEZ: Validating primary data. [2025-10-28T17:38:02.253312] [DEBUG] [VALIDATOR ] BMA: All expected trading days are present. [2025-10-28T17:38:02.253439] [DEBUG] [VALIDATOR ] BMA: Primary data validation passed. [2025-10-28T17:38:02.254463] [INFO ] [MAIN ] BMA: Fetched primary data is valid. [2025-10-28T17:38:02.255187] [DEBUG] [LOCAL ] BMA: Saving primary data. [2025-10-28T17:38:02.369003] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-07. [2025-10-28T17:38:02.359047] [DEBUG] [LOCAL ] BMA: Trimmed 52686 records to 36732 (keeping 200 days of data) [2025-10-28T17:38:02.593342] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-28T17:38:02.711729] [DEBUG] [VALIDATOR ] BMEZ: All expected trading days are present. [2025-10-28T17:38:02.719788] [DEBUG] [VALIDATOR ] BMEZ: Primary data validation passed. [2025-10-28T17:38:02.722450] [INFO ] [MAIN ] BMEZ: Fetched primary data is valid. [2025-10-28T17:38:02.722577] [DEBUG] [LOCAL ] BMEZ: Saving primary data. [2025-10-28T17:38:02.794994] [DEBUG] [LOCAL ] BMEZ: Trimmed 38877 records to 24568 (keeping 200 days of data) [2025-10-28T17:38:02.925909] [DEBUG] [LOCAL ] BMA: Primary data saved (36732 records). [2025-10-28T17:38:02.926783] [INFO ] [MAIN ] BMA: Full history saved. [2025-10-28T17:38:02.927220] [INFO ] [MAIN ] Update Progress: 305/2366 symbols completed. BMA took 37.6s. Estimated remaining: 4h 16m 46s. Rate: 8.0 symbols/min [2025-10-28T17:38:03.083722] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-28T17:38:03.160132] [INFO ] [MAIN ] BMN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:38:03.160195] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-06. [2025-10-28T17:38:03.171922] [DEBUG] [LOCAL ] BMN: Loaded 2612 existing records from primary storage. [2025-10-28T17:38:03.172447] [INFO ] [MAIN ] BMN: Loaded 2612 existing records. [2025-10-28T17:38:03.232178] [DEBUG] [LOCAL ] BMEZ: Primary data saved (24568 records). [2025-10-28T17:38:03.246778] [INFO ] [MAIN ] BMEZ: Full history saved. [2025-10-28T17:38:03.252628] [INFO ] [MAIN ] Update Progress: 306/2366 symbols completed. BMEZ took 26.2s. Estimated remaining: 4h 15m 51s. Rate: 8.1 symbols/min [2025-10-28T17:38:03.508479] [WARN ] [MAIN ] BMN: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:38:03.520886] [INFO ] [MAIN ] BMN: Wiping existing primary data before full refresh. [2025-10-28T17:38:03.541382] [INFO ] [MAIN ] BMO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:38:03.541965] [INFO ] [LOCAL ] BMN: Starting deletion of primary data. [2025-10-28T17:38:03.542175] [DEBUG] [LOCAL ] BMN: Deleted primary data file. [2025-10-28T17:38:03.542224] [INFO ] [MAIN ] BMN: Starting full primary refresh. [2025-10-28T17:38:03.878846] [DEBUG] [LOCAL ] BMO: Loaded 40521 existing records from primary storage. [2025-10-28T17:38:03.929668] [INFO ] [MAIN ] BMO: Loaded 40521 existing records. [2025-10-28T17:38:03.967888] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-08. [2025-10-28T17:38:04.006622] [INFO ] [REMOTE ] BMN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:38:04.086875] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-28T17:38:04.178767] [WARN ] [MAIN ] BMO: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:38:04.178935] [INFO ] [MAIN ] BMO: Wiping existing primary data before full refresh. [2025-10-28T17:38:04.178983] [INFO ] [LOCAL ] BMO: Starting deletion of primary data. [2025-10-28T17:38:04.179304] [DEBUG] [LOCAL ] BMO: Deleted primary data file. [2025-10-28T17:38:04.179360] [INFO ] [MAIN ] BMO: Starting full primary refresh. [2025-10-28T17:38:04.522447] [INFO ] [REMOTE ] BMO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:38:04.672082] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-28T17:38:04.759317] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-09. [2025-10-28T17:38:05.362697] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-28T17:38:05.559350] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-07. [2025-10-28T17:38:06.359392] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-01. [2025-10-28T17:38:06.547059] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-28T17:38:06.803274] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-28T17:38:07.159415] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-10. [2025-10-28T17:38:07.959326] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-02. [2025-10-28T17:38:08.092804] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-28T17:38:08.095612] [INFO ] [REMOTE ] BME: Full fetch complete (15547 records). [2025-10-28T17:38:08.095737] [DEBUG] [VALIDATOR ] BME: Validating primary data. [2025-10-28T17:38:08.266740] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-10-28T17:38:08.493315] [DEBUG] [VALIDATOR ] BME: All expected trading days are present. [2025-10-28T17:38:08.493397] [DEBUG] [VALIDATOR ] BME: Primary data validation passed. [2025-10-28T17:38:08.493756] [INFO ] [MAIN ] BME: Fetched primary data is valid. [2025-10-28T17:38:08.493817] [DEBUG] [LOCAL ] BME: Saving primary data. [2025-10-28T17:38:08.494370] [DEBUG] [LOCAL ] BME: Trimmed 15547 records to 11003 (keeping 200 days of data) [2025-10-28T17:38:08.569434] [DEBUG] [LOCAL ] BME: Primary data saved (11003 records). [2025-10-28T17:38:08.569576] [INFO ] [MAIN ] BME: Full history saved. [2025-10-28T17:38:08.569685] [INFO ] [MAIN ] Update Progress: 307/2366 symbols completed. BME took 38.7s. Estimated remaining: 4h 15m 29s. Rate: 8.1 symbols/min [2025-10-28T17:38:08.736630] [INFO ] [MAIN ] BMY: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:38:08.761429] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-01. [2025-10-28T17:38:08.785053] [DEBUG] [LOCAL ] BMY: Loaded 53757 existing records from primary storage. [2025-10-28T17:38:08.785437] [INFO ] [MAIN ] BMY: Loaded 53757 existing records. [2025-10-28T17:38:08.968092] [WARN ] [MAIN ] BMY: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:38:08.968314] [INFO ] [MAIN ] BMY: Wiping existing primary data before full refresh. [2025-10-28T17:38:08.968361] [INFO ] [LOCAL ] BMY: Starting deletion of primary data. [2025-10-28T17:38:08.969348] [DEBUG] [LOCAL ] BMY: Deleted primary data file. [2025-10-28T17:38:08.969408] [INFO ] [MAIN ] BMY: Starting full primary refresh. [2025-10-28T17:38:09.328868] [INFO ] [REMOTE ] BMY: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:38:09.559364] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-08. [2025-10-28T17:38:10.226744] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-28T17:38:10.359318] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-02. [2025-10-28T17:38:10.809511] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-28T17:38:11.159361] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-03. [2025-10-28T17:38:11.480591] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-10-28T17:38:11.623481] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-28T17:38:11.959394] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-04. [2025-10-28T17:38:12.392028] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-28T17:38:12.759356] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-05. [2025-10-28T17:38:13.052743] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-05 (0.29 seconds). [2025-10-28T17:38:13.559352] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-09. [2025-10-28T17:38:14.359306] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-01. [2025-10-28T17:38:14.530782] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-28T17:38:15.159431] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-03. [2025-10-28T17:38:15.809985] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-28T17:38:15.959348] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-06. [2025-10-28T17:38:16.403346] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-28T17:38:16.415689] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-28T17:38:16.759366] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-04. [2025-10-28T17:38:17.559329] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-07. [2025-10-28T17:38:17.985765] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-28T17:38:18.021306] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-28T17:38:18.359341] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-05. [2025-10-28T17:38:19.159318] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-02. [2025-10-28T17:38:19.400068] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-28T17:38:19.959333] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-08. [2025-10-28T17:38:20.266320] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-08 (0.31 seconds). [2025-10-28T17:38:20.759313] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-09. [2025-10-28T17:38:20.805293] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-28T17:38:21.237627] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-28T17:38:21.559337] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-10. [2025-10-28T17:38:22.359387] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-06. [2025-10-28T17:38:23.022062] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-28T17:38:23.027731] [INFO ] [REMOTE ] BMI: Full fetch complete (34226 records). [2025-10-28T17:38:23.027824] [DEBUG] [VALIDATOR ] BMI: Validating primary data. [2025-10-28T17:38:23.164529] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-03. [2025-10-28T17:38:23.391636] [DEBUG] [VALIDATOR ] BMI: All expected trading days are present. [2025-10-28T17:38:23.391747] [DEBUG] [VALIDATOR ] BMI: Primary data validation passed. [2025-10-28T17:38:23.392213] [INFO ] [MAIN ] BMI: Fetched primary data is valid. [2025-10-28T17:38:23.392253] [DEBUG] [LOCAL ] BMI: Saving primary data. [2025-10-28T17:38:23.393061] [DEBUG] [LOCAL ] BMI: Trimmed 34226 records to 24547 (keeping 200 days of data) [2025-10-28T17:38:23.537344] [DEBUG] [LOCAL ] BMI: Primary data saved (24547 records). [2025-10-28T17:38:23.537466] [INFO ] [MAIN ] BMI: Full history saved. [2025-10-28T17:38:23.537571] [INFO ] [MAIN ] Update Progress: 308/2366 symbols completed. BMI took 35.9s. Estimated remaining: 4h 16m 12s. Rate: 8.0 symbols/min [2025-10-28T17:38:23.702967] [INFO ] [MAIN ] BN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:38:23.748398] [DEBUG] [LOCAL ] BN: Loaded 52973 existing records from primary storage. [2025-10-28T17:38:23.748733] [INFO ] [MAIN ] BN: Loaded 52973 existing records. [2025-10-28T17:38:23.923534] [WARN ] [MAIN ] BN: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:38:23.923895] [INFO ] [MAIN ] BN: Wiping existing primary data before full refresh. [2025-10-28T17:38:23.923969] [INFO ] [LOCAL ] BN: Starting deletion of primary data. [2025-10-28T17:38:23.931594] [DEBUG] [LOCAL ] BN: Deleted primary data file. [2025-10-28T17:38:23.945320] [INFO ] [MAIN ] BN: Starting full primary refresh. [2025-10-28T17:38:23.982585] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-28T17:38:23.975506] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-10. [2025-10-28T17:38:24.339092] [INFO ] [REMOTE ] BN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:38:24.722577] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-28T17:38:24.737814] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-28T17:38:24.739124] [INFO ] [REMOTE ] BMN: Full fetch complete (3745 records). [2025-10-28T17:38:24.739194] [DEBUG] [VALIDATOR ] BMN: Validating primary data. [2025-10-28T17:38:24.764509] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-07. [2025-10-28T17:38:25.100322] [DEBUG] [VALIDATOR ] BMN: All expected trading days are present. [2025-10-28T17:38:25.100394] [DEBUG] [VALIDATOR ] BMN: Primary data validation passed. [2025-10-28T17:38:25.100513] [INFO ] [MAIN ] BMN: Fetched primary data is valid. [2025-10-28T17:38:25.100550] [DEBUG] [LOCAL ] BMN: Saving primary data. [2025-10-28T17:38:25.100912] [DEBUG] [LOCAL ] BMN: Trimmed 3745 records to 2634 (keeping 200 days of data) [2025-10-28T17:38:25.116566] [DEBUG] [LOCAL ] BMN: Primary data saved (2634 records). [2025-10-28T17:38:25.116628] [INFO ] [MAIN ] BMN: Full history saved. [2025-10-28T17:38:25.116727] [INFO ] [MAIN ] Update Progress: 309/2366 symbols completed. BMN took 22.2s. Estimated remaining: 4h 15m 25s. Rate: 8.1 symbols/min [2025-10-28T17:38:25.280213] [INFO ] [MAIN ] BNED: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:38:25.307178] [DEBUG] [LOCAL ] BNED: Loaded 27853 existing records from primary storage. [2025-10-28T17:38:25.307424] [INFO ] [MAIN ] BNED: Loaded 27853 existing records. [2025-10-28T17:38:25.478118] [WARN ] [MAIN ] BNED: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:38:25.478304] [INFO ] [MAIN ] BNED: Wiping existing primary data before full refresh. [2025-10-28T17:38:25.478350] [INFO ] [LOCAL ] BNED: Starting deletion of primary data. [2025-10-28T17:38:25.478527] [DEBUG] [LOCAL ] BNED: Deleted primary data file. [2025-10-28T17:38:25.478585] [INFO ] [MAIN ] BNED: Starting full primary refresh. [2025-10-28T17:38:25.565810] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-01. [2025-10-28T17:38:25.841876] [INFO ] [REMOTE ] BNED: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:38:26.103999] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-28T17:38:26.359327] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-01. [2025-10-28T17:38:27.164495] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-04. [2025-10-28T17:38:27.183471] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-28T17:38:27.380067] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-28T17:38:27.959391] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-02. [2025-10-28T17:38:28.759384] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-02. [2025-10-28T17:38:28.899531] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-28T17:38:29.549070] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-04 (2.38 seconds). [2025-10-28T17:38:29.559768] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-03. [2025-10-28T17:38:30.136943] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-28T17:38:30.359366] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-08. [2025-10-28T17:38:30.643089] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-28T17:38:31.159349] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-05. [2025-10-28T17:38:31.354832] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-28T17:38:31.959358] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-09. [2025-10-28T17:38:32.730810] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-28T17:38:32.759317] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-06. [2025-10-28T17:38:33.155347] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-28T17:38:33.559341] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-10. [2025-10-28T17:38:34.359328] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-04. [2025-10-28T17:38:34.458467] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-28T17:38:35.159315] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-07. [2025-10-28T17:38:35.216032] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-28T17:38:35.223984] [INFO ] [REMOTE ] BMO: Full fetch complete (59677 records). [2025-10-28T17:38:35.224101] [DEBUG] [VALIDATOR ] BMO: Validating primary data. [2025-10-28T17:38:35.430137] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-28T17:38:35.628429] [DEBUG] [VALIDATOR ] BMO: All expected trading days are present. [2025-10-28T17:38:35.628505] [DEBUG] [VALIDATOR ] BMO: Primary data validation passed. [2025-10-28T17:38:35.629163] [INFO ] [MAIN ] BMO: Fetched primary data is valid. [2025-10-28T17:38:35.629227] [DEBUG] [LOCAL ] BMO: Saving primary data. [2025-10-28T17:38:35.630385] [DEBUG] [LOCAL ] BMO: Trimmed 59677 records to 40411 (keeping 200 days of data) [2025-10-28T17:38:35.869205] [DEBUG] [LOCAL ] BMO: Primary data saved (40411 records). [2025-10-28T17:38:35.869324] [INFO ] [MAIN ] BMO: Full history saved. [2025-10-28T17:38:35.869916] [INFO ] [MAIN ] Update Progress: 310/2366 symbols completed. BMO took 32.6s. Estimated remaining: 4h 15m 40s. Rate: 8.0 symbols/min [2025-10-28T17:38:35.968118] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-03. [2025-10-28T17:38:36.038264] [INFO ] [MAIN ] BNH: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:38:36.046881] [DEBUG] [LOCAL ] BNH: Loaded 4511 existing records from primary storage. [2025-10-28T17:38:36.047088] [INFO ] [MAIN ] BNH: Loaded 4511 existing records. [2025-10-28T17:38:36.221927] [WARN ] [MAIN ] BNH: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:38:36.222154] [INFO ] [MAIN ] BNH: Wiping existing primary data before full refresh. [2025-10-28T17:38:36.222201] [INFO ] [LOCAL ] BNH: Starting deletion of primary data. [2025-10-28T17:38:36.222343] [DEBUG] [LOCAL ] BNH: Deleted primary data file. [2025-10-28T17:38:36.222398] [INFO ] [MAIN ] BNH: Starting full primary refresh. [2025-10-28T17:38:36.566522] [INFO ] [REMOTE ] BNH: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:38:36.713484] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-28T17:38:36.759303] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-01. [2025-10-28T17:38:37.559343] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-08. [2025-10-28T17:38:37.611006] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-28T17:38:37.898040] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-28T17:38:38.359334] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-05. [2025-10-28T17:38:39.023724] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-28T17:38:39.159362] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-04. [2025-10-28T17:38:39.461173] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-28T17:38:39.959397] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-06. [2025-10-28T17:38:40.759388] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-02. [2025-10-28T17:38:40.800869] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-10-28T17:38:40.843589] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-28T17:38:41.130282] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-10-28T17:38:41.559344] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-03. [2025-10-28T17:38:41.932456] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-10-28T17:38:42.359360] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-04. [2025-10-28T17:38:42.774565] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-28T17:38:43.159353] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-07. [2025-10-28T17:38:43.959353] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-09. [2025-10-28T17:38:44.268790] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-28T17:38:44.759310] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-08. [2025-10-28T17:38:45.559412] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-05. [2025-10-28T17:38:45.676174] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-28T17:38:45.934280] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-10-28T17:38:46.101699] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-10-28T17:38:46.359339] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-10. [2025-10-28T17:38:47.077340] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-28T17:38:47.087908] [INFO ] [REMOTE ] BMY: Full fetch complete (77937 records). [2025-10-28T17:38:47.088050] [DEBUG] [VALIDATOR ] BMY: Validating primary data. [2025-10-28T17:38:47.164455] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-09. [2025-10-28T17:38:47.473519] [DEBUG] [VALIDATOR ] BMY: All expected trading days are present. [2025-10-28T17:38:47.473608] [DEBUG] [VALIDATOR ] BMY: Primary data validation passed. [2025-10-28T17:38:47.474418] [INFO ] [MAIN ] BMY: Fetched primary data is valid. [2025-10-28T17:38:47.474480] [DEBUG] [LOCAL ] BMY: Saving primary data. [2025-10-28T17:38:47.476016] [DEBUG] [LOCAL ] BMY: Trimmed 77937 records to 53757 (keeping 200 days of data) [2025-10-28T17:38:47.798289] [DEBUG] [LOCAL ] BMY: Primary data saved (53757 records). [2025-10-28T17:38:47.798384] [INFO ] [MAIN ] BMY: Full history saved. [2025-10-28T17:38:47.798455] [INFO ] [MAIN ] Update Progress: 311/2366 symbols completed. BMY took 39.2s. Estimated remaining: 4h 16m 2s. Rate: 8.0 symbols/min [2025-10-28T17:38:47.963847] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-06. [2025-10-28T17:38:47.963775] [INFO ] [MAIN ] BNJ: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:38:47.968708] [DEBUG] [LOCAL ] BNJ: Loaded 2407 existing records from primary storage. [2025-10-28T17:38:47.968916] [INFO ] [MAIN ] BNJ: Loaded 2407 existing records. [2025-10-28T17:38:48.152147] [WARN ] [MAIN ] BNJ: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:38:48.152328] [INFO ] [MAIN ] BNJ: Wiping existing primary data before full refresh. [2025-10-28T17:38:48.152373] [INFO ] [LOCAL ] BNJ: Starting deletion of primary data. [2025-10-28T17:38:48.152594] [DEBUG] [LOCAL ] BNJ: Deleted primary data file. [2025-10-28T17:38:48.152685] [INFO ] [MAIN ] BNJ: Starting full primary refresh. [2025-10-28T17:38:48.425807] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-28T17:38:48.539074] [INFO ] [REMOTE ] BNJ: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:38:48.581192] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-28T17:38:48.759346] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-01. [2025-10-28T17:38:49.559333] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-07. [2025-10-28T17:38:49.651316] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-28T17:38:49.870879] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-07 (0.31 seconds). [2025-10-28T17:38:50.359334] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-02. [2025-10-28T17:38:50.640341] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-02 (0.28 seconds). [2025-10-28T17:38:51.159334] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-05. [2025-10-28T17:38:51.959350] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-10. [2025-10-28T17:38:52.760350] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-08. [2025-10-28T17:38:52.994965] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-28T17:38:53.218215] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-28T17:38:53.559335] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-09. [2025-10-28T17:38:53.572768] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-28T17:38:53.577215] [INFO ] [REMOTE ] BNED: Full fetch complete (41372 records). [2025-10-28T17:38:53.577299] [DEBUG] [VALIDATOR ] BNED: Validating primary data. [2025-10-28T17:38:53.945278] [DEBUG] [VALIDATOR ] BNED: All expected trading days are present. [2025-10-28T17:38:53.945357] [DEBUG] [VALIDATOR ] BNED: Primary data validation passed. [2025-10-28T17:38:53.945887] [INFO ] [MAIN ] BNED: Fetched primary data is valid. [2025-10-28T17:38:53.945949] [DEBUG] [LOCAL ] BNED: Saving primary data. [2025-10-28T17:38:53.946883] [DEBUG] [LOCAL ] BNED: Trimmed 41372 records to 27781 (keeping 200 days of data) [2025-10-28T17:38:54.052851] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-28T17:38:54.108527] [DEBUG] [LOCAL ] BNED: Primary data saved (27781 records). [2025-10-28T17:38:54.108673] [INFO ] [MAIN ] BNED: Full history saved. [2025-10-28T17:38:54.108769] [INFO ] [MAIN ] Update Progress: 312/2366 symbols completed. BNED took 29.0s. Estimated remaining: 4h 15m 46s. Rate: 8.0 symbols/min [2025-10-28T17:38:54.274019] [INFO ] [MAIN ] BNL: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:38:54.315819] [DEBUG] [LOCAL ] BNL: Loaded 46837 existing records from primary storage. [2025-10-28T17:38:54.316112] [INFO ] [MAIN ] BNL: Loaded 46837 existing records. [2025-10-28T17:38:54.367728] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-03. [2025-10-28T17:38:54.492925] [WARN ] [MAIN ] BNL: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:38:54.493104] [INFO ] [MAIN ] BNL: Wiping existing primary data before full refresh. [2025-10-28T17:38:54.493150] [INFO ] [LOCAL ] BNL: Starting deletion of primary data. [2025-10-28T17:38:54.493587] [DEBUG] [LOCAL ] BNL: Deleted primary data file. [2025-10-28T17:38:54.493626] [INFO ] [MAIN ] BNL: Starting full primary refresh. [2025-10-28T17:38:54.839489] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-28T17:38:54.844876] [INFO ] [REMOTE ] BNL: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:38:55.159327] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-04. [2025-10-28T17:38:55.530348] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-10-28T17:38:55.959378] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-01. [2025-10-28T17:38:56.759344] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-06. [2025-10-28T17:38:57.425362] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-28T17:38:57.559321] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-10. [2025-10-28T17:38:58.132884] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-28T17:38:58.232252] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-28T17:38:58.233816] [INFO ] [REMOTE ] BNH: Full fetch complete (6840 records). [2025-10-28T17:38:58.233885] [DEBUG] [VALIDATOR ] BNH: Validating primary data. [2025-10-28T17:38:58.364441] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-02. [2025-10-28T17:38:58.614274] [DEBUG] [VALIDATOR ] BNH: All expected trading days are present. [2025-10-28T17:38:58.614354] [DEBUG] [VALIDATOR ] BNH: Primary data validation passed. [2025-10-28T17:38:58.614548] [INFO ] [MAIN ] BNH: Fetched primary data is valid. [2025-10-28T17:38:58.614586] [DEBUG] [LOCAL ] BNH: Saving primary data. [2025-10-28T17:38:58.615073] [DEBUG] [LOCAL ] BNH: Trimmed 6840 records to 4480 (keeping 200 days of data) [2025-10-28T17:38:58.643177] [DEBUG] [LOCAL ] BNH: Primary data saved (4480 records). [2025-10-28T17:38:58.643321] [INFO ] [MAIN ] BNH: Full history saved. [2025-10-28T17:38:58.643400] [INFO ] [MAIN ] Update Progress: 313/2366 symbols completed. BNH took 22.8s. Estimated remaining: 4h 15m 20s. Rate: 8.0 symbols/min [2025-10-28T17:38:58.829190] [INFO ] [MAIN ] BNS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:38:58.880455] [DEBUG] [LOCAL ] BNS: Loaded 51296 existing records from primary storage. [2025-10-28T17:38:58.880852] [INFO ] [MAIN ] BNS: Loaded 51296 existing records. [2025-10-28T17:38:59.056226] [WARN ] [MAIN ] BNS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:38:59.056445] [INFO ] [MAIN ] BNS: Wiping existing primary data before full refresh. [2025-10-28T17:38:59.056491] [INFO ] [LOCAL ] BNS: Starting deletion of primary data. [2025-10-28T17:38:59.057097] [DEBUG] [LOCAL ] BNS: Deleted primary data file. [2025-10-28T17:38:59.057173] [INFO ] [MAIN ] BNS: Starting full primary refresh. [2025-10-28T17:38:59.164478] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-05. [2025-10-28T17:38:59.430087] [INFO ] [REMOTE ] BNS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:38:59.523695] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-10-28T17:38:59.555188] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-28T17:38:59.959383] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-03. [2025-10-28T17:39:00.759344] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-07. [2025-10-28T17:39:01.534403] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-28T17:39:01.559354] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-04. [2025-10-28T17:39:02.260898] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-28T17:39:02.359346] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-08. [2025-10-28T17:39:02.803771] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-28T17:39:03.159340] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-01. [2025-10-28T17:39:03.959377] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-05. [2025-10-28T17:39:04.066215] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-28T17:39:04.483469] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-28T17:39:04.759358] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-06. [2025-10-28T17:39:05.265805] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-28T17:39:05.559330] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-09. [2025-10-28T17:39:05.942522] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-28T17:39:06.359346] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-02. [2025-10-28T17:39:06.956075] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-28T17:39:07.159333] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-07. [2025-10-28T17:39:07.455724] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-07 (0.30 seconds). [2025-10-28T17:39:07.735678] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-28T17:39:07.959344] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-10. [2025-10-28T17:39:08.759352] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-03. [2025-10-28T17:39:09.559347] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-08. [2025-10-28T17:39:09.860985] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-28T17:39:09.871711] [INFO ] [REMOTE ] BN: Full fetch complete (76947 records). [2025-10-28T17:39:09.871852] [DEBUG] [VALIDATOR ] BN: Validating primary data. [2025-10-28T17:39:09.978466] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-10-28T17:39:10.297572] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-28T17:39:10.327838] [DEBUG] [VALIDATOR ] BN: All expected trading days are present. [2025-10-28T17:39:10.328283] [DEBUG] [VALIDATOR ] BN: Primary data validation passed. [2025-10-28T17:39:10.329263] [INFO ] [MAIN ] BN: Fetched primary data is valid. [2025-10-28T17:39:10.329347] [DEBUG] [LOCAL ] BN: Saving primary data. [2025-10-28T17:39:10.330897] [DEBUG] [LOCAL ] BN: Trimmed 76947 records to 52969 (keeping 200 days of data) [2025-10-28T17:39:10.382596] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-04. [2025-10-28T17:39:10.648076] [DEBUG] [LOCAL ] BN: Primary data saved (52969 records). [2025-10-28T17:39:10.648207] [INFO ] [MAIN ] BN: Full history saved. [2025-10-28T17:39:10.648283] [INFO ] [MAIN ] Update Progress: 314/2366 symbols completed. BN took 47.1s. Estimated remaining: 4h 15m 42s. Rate: 8.0 symbols/min [2025-10-28T17:39:10.815419] [INFO ] [MAIN ] BNT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:39:10.820165] [DEBUG] [LOCAL ] BNT: Loaded 3318 existing records from primary storage. [2025-10-28T17:39:10.820326] [INFO ] [MAIN ] BNT: Loaded 3318 existing records. [2025-10-28T17:39:10.996043] [WARN ] [MAIN ] BNT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:39:10.996284] [INFO ] [MAIN ] BNT: Wiping existing primary data before full refresh. [2025-10-28T17:39:10.996337] [INFO ] [LOCAL ] BNT: Starting deletion of primary data. [2025-10-28T17:39:10.996546] [DEBUG] [LOCAL ] BNT: Deleted primary data file. [2025-10-28T17:39:10.996601] [INFO ] [MAIN ] BNT: Starting full primary refresh. [2025-10-28T17:39:11.166772] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-06. [2025-10-28T17:39:11.351069] [INFO ] [REMOTE ] BNT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:39:11.959339] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-09. [2025-10-28T17:39:12.148815] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-28T17:39:12.323508] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-10-28T17:39:12.759317] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-05. [2025-10-28T17:39:12.871113] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-28T17:39:13.559398] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-07. [2025-10-28T17:39:14.334502] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-28T17:39:14.359295] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-01. [2025-10-28T17:39:14.816188] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-28T17:39:15.105851] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-28T17:39:15.159357] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-02. [2025-10-28T17:39:15.488068] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-10-28T17:39:15.959396] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-10. [2025-10-28T17:39:16.759295] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-08. [2025-10-28T17:39:16.819720] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-28T17:39:16.820817] [INFO ] [REMOTE ] BNJ: Full fetch complete (3853 records). [2025-10-28T17:39:16.820890] [DEBUG] [VALIDATOR ] BNJ: Validating primary data. [2025-10-28T17:39:17.208069] [DEBUG] [VALIDATOR ] BNJ: All expected trading days are present. [2025-10-28T17:39:17.208172] [DEBUG] [VALIDATOR ] BNJ: Primary data validation passed. [2025-10-28T17:39:17.208306] [INFO ] [MAIN ] BNJ: Fetched primary data is valid. [2025-10-28T17:39:17.208346] [DEBUG] [LOCAL ] BNJ: Saving primary data. [2025-10-28T17:39:17.208774] [DEBUG] [LOCAL ] BNJ: Trimmed 3853 records to 2411 (keeping 200 days of data) [2025-10-28T17:39:17.223116] [DEBUG] [LOCAL ] BNJ: Primary data saved (2411 records). [2025-10-28T17:39:17.223177] [INFO ] [MAIN ] BNJ: Full history saved. [2025-10-28T17:39:17.223243] [INFO ] [MAIN ] Update Progress: 315/2366 symbols completed. BNJ took 29.4s. Estimated remaining: 4h 15m 29s. Rate: 8.0 symbols/min [2025-10-28T17:39:17.390554] [INFO ] [MAIN ] BNY: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:39:17.399054] [DEBUG] [LOCAL ] BNY: Loaded 7109 existing records from primary storage. [2025-10-28T17:39:17.399220] [INFO ] [MAIN ] BNY: Loaded 7109 existing records. [2025-10-28T17:39:17.568891] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-03. [2025-10-28T17:39:17.595168] [WARN ] [MAIN ] BNY: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:39:17.595477] [INFO ] [MAIN ] BNY: Wiping existing primary data before full refresh. [2025-10-28T17:39:17.595525] [INFO ] [LOCAL ] BNY: Starting deletion of primary data. [2025-10-28T17:39:17.595710] [DEBUG] [LOCAL ] BNY: Deleted primary data file. [2025-10-28T17:39:17.595767] [INFO ] [MAIN ] BNY: Starting full primary refresh. [2025-10-28T17:39:17.958746] [INFO ] [REMOTE ] BNY: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:39:18.031357] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-28T17:39:18.094612] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-28T17:39:18.359351] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-04. [2025-10-28T17:39:18.952146] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-28T17:39:19.159321] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-05. [2025-10-28T17:39:19.527318] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-10-28T17:39:19.959337] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-09. [2025-10-28T17:39:20.759372] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-06. [2025-10-28T17:39:21.246888] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-28T17:39:21.559328] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-10. [2025-10-28T17:39:22.005190] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-28T17:39:22.359376] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-06. [2025-10-28T17:39:22.660457] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-06 (0.30 seconds). [2025-10-28T17:39:23.159359] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-01. [2025-10-28T17:39:23.959306] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-07. [2025-10-28T17:39:24.382079] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-10 (2.82 seconds). [2025-10-28T17:39:24.392124] [INFO ] [REMOTE ] BNL: Full fetch complete (67253 records). [2025-10-28T17:39:24.392276] [DEBUG] [VALIDATOR ] BNL: Validating primary data. [2025-10-28T17:39:24.500538] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-28T17:39:24.767285] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-07. [2025-10-28T17:39:24.790460] [DEBUG] [VALIDATOR ] BNL: All expected trading days are present. [2025-10-28T17:39:24.790558] [DEBUG] [VALIDATOR ] BNL: Primary data validation passed. [2025-10-28T17:39:24.791399] [INFO ] [MAIN ] BNL: Fetched primary data is valid. [2025-10-28T17:39:24.791586] [DEBUG] [LOCAL ] BNL: Saving primary data. [2025-10-28T17:39:24.793152] [DEBUG] [LOCAL ] BNL: Trimmed 67253 records to 46779 (keeping 200 days of data) [2025-10-28T17:39:25.071522] [DEBUG] [LOCAL ] BNL: Primary data saved (46779 records). [2025-10-28T17:39:25.071683] [INFO ] [MAIN ] BNL: Full history saved. [2025-10-28T17:39:25.071778] [INFO ] [MAIN ] Update Progress: 316/2366 symbols completed. BNL took 31.0s. Estimated remaining: 4h 15m 24s. Rate: 8.0 symbols/min [2025-10-28T17:39:25.241213] [INFO ] [MAIN ] BOC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:39:25.241364] [DEBUG] [LOCAL ] BOC: No existing data file found in primary storage. [2025-10-28T17:39:25.241401] [WARN ] [MAIN ] BOC: No existing data found, performing full refresh instead. [2025-10-28T17:39:25.241510] [INFO ] [MAIN ] BOC: Wiping existing primary data before full refresh. [2025-10-28T17:39:25.241552] [INFO ] [LOCAL ] BOC: Starting deletion of primary data. [2025-10-28T17:39:25.241592] [DEBUG] [LOCAL ] BOC: No primary data file found to delete. [2025-10-28T17:39:25.241626] [INFO ] [MAIN ] BOC: Starting full primary refresh. [2025-10-28T17:39:25.564127] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-02. [2025-10-28T17:39:25.632164] [INFO ] [REMOTE ] BOC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:39:25.636568] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-28T17:39:25.667698] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-28T17:39:26.052827] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-28T17:39:26.359351] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-08. [2025-10-28T17:39:26.629627] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-08 (0.27 seconds). [2025-10-28T17:39:27.159350] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-01. [2025-10-28T17:39:27.959364] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-08. [2025-10-28T17:39:28.457714] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-28T17:39:28.759320] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-02. [2025-10-28T17:39:29.400365] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-28T17:39:29.424532] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-28T17:39:29.559327] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-03. [2025-10-28T17:39:30.224809] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-28T17:39:30.359320] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-04. [2025-10-28T17:39:31.145936] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-28T17:39:31.159297] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-05. [2025-10-28T17:39:31.783850] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-28T17:39:31.959378] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-03. [2025-10-28T17:39:32.459836] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-28T17:39:32.759369] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-09. [2025-10-28T17:39:33.559393] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-09. [2025-10-28T17:39:34.004168] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-28T17:39:34.359306] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-10. [2025-10-28T17:39:34.417588] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-28T17:39:35.159310] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-06. [2025-10-28T17:39:35.184213] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-28T17:39:35.185861] [INFO ] [REMOTE ] BNT: Full fetch complete (4855 records). [2025-10-28T17:39:35.185935] [DEBUG] [VALIDATOR ] BNT: Validating primary data. [2025-10-28T17:39:35.573468] [DEBUG] [VALIDATOR ] BNT: All expected trading days are present. [2025-10-28T17:39:35.573551] [DEBUG] [VALIDATOR ] BNT: Primary data validation passed. [2025-10-28T17:39:35.573723] [INFO ] [MAIN ] BNT: Fetched primary data is valid. [2025-10-28T17:39:35.573783] [DEBUG] [LOCAL ] BNT: Saving primary data. [2025-10-28T17:39:35.574139] [DEBUG] [LOCAL ] BNT: Trimmed 4855 records to 3298 (keeping 200 days of data) [2025-10-28T17:39:35.594512] [DEBUG] [LOCAL ] BNT: Primary data saved (3298 records). [2025-10-28T17:39:35.594592] [INFO ] [MAIN ] BNT: Full history saved. [2025-10-28T17:39:35.594691] [INFO ] [MAIN ] Update Progress: 317/2366 symbols completed. BNT took 24.9s. Estimated remaining: 4h 15m 36s. Rate: 8.0 symbols/min [2025-10-28T17:39:35.778314] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-28T17:39:35.959374] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-07. [2025-10-28T17:39:36.658162] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-28T17:39:36.759317] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-04. [2025-10-28T17:39:37.559403] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-08. [2025-10-28T17:39:37.824208] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-28T17:39:38.359350] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-05. [2025-10-28T17:39:38.782849] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-28T17:39:38.795080] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-28T17:39:39.159331] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-10. [2025-10-28T17:39:39.959390] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-06. [2025-10-28T17:39:40.430982] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-28T17:39:40.759338] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-07. [2025-10-28T17:39:41.274689] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-28T17:39:41.559322] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-08. [2025-10-28T17:39:41.687012] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-10 (2.53 seconds). [2025-10-28T17:39:41.698045] [INFO ] [REMOTE ] BNS: Full fetch complete (74545 records). [2025-10-28T17:39:41.698172] [DEBUG] [VALIDATOR ] BNS: Validating primary data. [2025-10-28T17:39:42.082500] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-28T17:39:42.170530] [DEBUG] [VALIDATOR ] BNS: All expected trading days are present. [2025-10-28T17:39:42.170623] [DEBUG] [VALIDATOR ] BNS: Primary data validation passed. [2025-10-28T17:39:42.171516] [INFO ] [MAIN ] BNS: Fetched primary data is valid. [2025-10-28T17:39:42.171579] [DEBUG] [LOCAL ] BNS: Saving primary data. [2025-10-28T17:39:42.173072] [DEBUG] [LOCAL ] BNS: Trimmed 74545 records to 51279 (keeping 200 days of data) [2025-10-28T17:39:42.381948] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-09. [2025-10-28T17:39:42.483832] [DEBUG] [LOCAL ] BNS: Primary data saved (51279 records). [2025-10-28T17:39:42.483964] [INFO ] [MAIN ] BNS: Full history saved. [2025-10-28T17:39:42.484041] [INFO ] [MAIN ] Update Progress: 318/2366 symbols completed. BNS took 43.8s. Estimated remaining: 4h 15m 25s. Rate: 8.0 symbols/min [2025-10-28T17:39:43.093083] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-28T17:39:43.159344] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-09. [2025-10-28T17:39:43.688282] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-28T17:39:43.959347] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-10. [2025-10-28T17:39:44.759359] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-10. [2025-10-28T17:39:45.061460] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-28T17:39:45.063714] [INFO ] [REMOTE ] BNY: Full fetch complete (10420 records). [2025-10-28T17:39:45.063784] [DEBUG] [VALIDATOR ] BNY: Validating primary data. [2025-10-28T17:39:45.425622] [DEBUG] [VALIDATOR ] BNY: All expected trading days are present. [2025-10-28T17:39:45.425726] [DEBUG] [VALIDATOR ] BNY: Primary data validation passed. [2025-10-28T17:39:45.425970] [INFO ] [MAIN ] BNY: Fetched primary data is valid. [2025-10-28T17:39:45.426008] [DEBUG] [LOCAL ] BNY: Saving primary data. [2025-10-28T17:39:45.426453] [DEBUG] [LOCAL ] BNY: Trimmed 10420 records to 7132 (keeping 200 days of data) [2025-10-28T17:39:45.467324] [DEBUG] [LOCAL ] BNY: Primary data saved (7132 records). [2025-10-28T17:39:45.467433] [INFO ] [MAIN ] BNY: Full history saved. [2025-10-28T17:39:45.467519] [INFO ] [MAIN ] Update Progress: 319/2366 symbols completed. BNY took 28.2s. Estimated remaining: 4h 14m 48s. Rate: 8.0 symbols/min [2025-10-28T17:39:46.112427] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-28T17:39:46.117617] [INFO ] [REMOTE ] BOC: Full fetch complete (25776 records). [2025-10-28T17:39:46.117763] [DEBUG] [VALIDATOR ] BOC: Validating primary data. [2025-10-28T17:39:46.492901] [DEBUG] [VALIDATOR ] BOC: All expected trading days are present. [2025-10-28T17:39:46.492975] [DEBUG] [VALIDATOR ] BOC: Primary data validation passed. [2025-10-28T17:39:46.493379] [INFO ] [MAIN ] BOC: Fetched primary data is valid. [2025-10-28T17:39:46.493416] [DEBUG] [LOCAL ] BOC: Saving primary data. [2025-10-28T17:39:46.494056] [DEBUG] [LOCAL ] BOC: Trimmed 25776 records to 17761 (keeping 200 days of data) [2025-10-28T17:39:46.592065] [DEBUG] [LOCAL ] BOC: Primary data saved (17761 records). [2025-10-28T17:39:46.592185] [INFO ] [MAIN ] BOC: Full history saved. [2025-10-28T17:39:46.592267] [INFO ] [MAIN ] Update Progress: 320/2366 symbols completed. BOC took 21.5s. Estimated remaining: 4h 14m 0s. Rate: 8.1 symbols/min [2025-10-28T17:39:47.205946] [INFO ] [MAIN ] BOE: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:39:47.265204] [INFO ] [MAIN ] BOH: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:39:47.275867] [INFO ] [MAIN ] BOND: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:39:47.303858] [INFO ] [MAIN ] BOOT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:39:47.335537] [DEBUG] [LOCAL ] BOE: Loaded 17571 existing records from primary storage. [2025-10-28T17:39:47.336030] [INFO ] [MAIN ] BOE: Loaded 17571 existing records. [2025-10-28T17:39:47.375669] [DEBUG] [LOCAL ] BOH: Loaded 30475 existing records from primary storage. [2025-10-28T17:39:47.438120] [INFO ] [MAIN ] BOH: Loaded 30475 existing records. [2025-10-28T17:39:47.485789] [DEBUG] [LOCAL ] BOND: Loaded 32267 existing records from primary storage. [2025-10-28T17:39:47.537173] [INFO ] [MAIN ] BOND: Loaded 32267 existing records. [2025-10-28T17:39:47.644473] [DEBUG] [LOCAL ] BOOT: Loaded 39109 existing records from primary storage. [2025-10-28T17:39:47.671781] [WARN ] [MAIN ] BOE: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:39:47.699092] [INFO ] [MAIN ] BOOT: Loaded 39109 existing records. [2025-10-28T17:39:47.726546] [INFO ] [MAIN ] BOE: Wiping existing primary data before full refresh. [2025-10-28T17:39:47.753639] [INFO ] [LOCAL ] BOE: Starting deletion of primary data. [2025-10-28T17:39:47.763387] [DEBUG] [LOCAL ] BOE: Deleted primary data file. [2025-10-28T17:39:47.789215] [INFO ] [MAIN ] BOE: Starting full primary refresh. [2025-10-28T17:39:47.978731] [WARN ] [MAIN ] BOH: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:39:48.068628] [INFO ] [MAIN ] BOH: Wiping existing primary data before full refresh. [2025-10-28T17:39:48.085545] [INFO ] [LOCAL ] BOH: Starting deletion of primary data. [2025-10-28T17:39:48.147341] [DEBUG] [LOCAL ] BOH: Deleted primary data file. [2025-10-28T17:39:48.147477] [INFO ] [MAIN ] BOH: Starting full primary refresh. [2025-10-28T17:39:48.153099] [WARN ] [MAIN ] BOND: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:39:48.226915] [INFO ] [MAIN ] BOND: Wiping existing primary data before full refresh. [2025-10-28T17:39:48.241366] [INFO ] [LOCAL ] BOND: Starting deletion of primary data. [2025-10-28T17:39:48.288386] [DEBUG] [LOCAL ] BOND: Deleted primary data file. [2025-10-28T17:39:48.381456] [INFO ] [MAIN ] BOND: Starting full primary refresh. [2025-10-28T17:39:48.373765] [WARN ] [MAIN ] BOOT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:39:48.480105] [INFO ] [MAIN ] BOOT: Wiping existing primary data before full refresh. [2025-10-28T17:39:48.598489] [INFO ] [LOCAL ] BOOT: Starting deletion of primary data. [2025-10-28T17:39:48.743526] [DEBUG] [LOCAL ] BOOT: Deleted primary data file. [2025-10-28T17:39:48.871420] [INFO ] [MAIN ] BOOT: Starting full primary refresh. [2025-10-28T17:39:49.045243] [INFO ] [REMOTE ] BOE: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:39:49.149600] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-01. [2025-10-28T17:39:49.323553] [INFO ] [REMOTE ] BOH: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:39:49.334787] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-01. [2025-10-28T17:39:49.476360] [INFO ] [REMOTE ] BOND: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:39:49.508742] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-01. [2025-10-28T17:39:49.694285] [INFO ] [REMOTE ] BOOT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:39:49.694637] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-01. [2025-10-28T17:39:50.458780] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-28T17:39:50.463274] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-02. [2025-10-28T17:39:50.836118] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-28T17:39:50.871156] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-02. [2025-10-28T17:39:50.874971] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-28T17:39:50.885802] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-02. [2025-10-28T17:39:51.126575] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-28T17:39:51.159340] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-03. [2025-10-28T17:39:51.538323] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-28T17:39:51.579037] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-28T17:39:51.696962] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-28T17:39:51.766117] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-28T17:39:51.959341] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-03. [2025-10-28T17:39:52.759312] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-04. [2025-10-28T17:39:52.864781] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-28T17:39:53.517031] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-28T17:39:53.559315] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-04. [2025-10-28T17:39:54.359328] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-05. [2025-10-28T17:39:54.965773] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-28T17:39:55.014031] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-28T17:39:55.159368] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-06. [2025-10-28T17:39:55.879613] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-28T17:39:55.959321] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-02. [2025-10-28T17:39:56.759395] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-05. [2025-10-28T17:39:57.160045] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-28T17:39:57.559317] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-03. [2025-10-28T17:39:57.702037] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-28T17:39:58.359320] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-07. [2025-10-28T17:39:58.388743] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-28T17:39:59.057046] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-28T17:39:59.159353] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-04. [2025-10-28T17:39:59.959321] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-06. [2025-10-28T17:40:00.160636] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-28T17:40:00.759313] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-05. [2025-10-28T17:40:00.891706] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-28T17:40:01.559362] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-08. [2025-10-28T17:40:02.346126] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-28T17:40:02.367242] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-09. [2025-10-28T17:40:02.384491] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-28T17:40:03.159356] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-06. [2025-10-28T17:40:03.383833] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-28T17:40:03.959394] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-10. [2025-10-28T17:40:04.354705] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-28T17:40:04.759367] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-03. [2025-10-28T17:40:05.559335] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-07. [2025-10-28T17:40:05.935167] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-28T17:40:05.939891] [INFO ] [REMOTE ] BOE: Full fetch complete (26588 records). [2025-10-28T17:40:05.939974] [DEBUG] [VALIDATOR ] BOE: Validating primary data. [2025-10-28T17:40:05.940440] [FATAL] [VALIDATOR ] BOE: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T17:40:05.940524] [FATAL] [MAIN ] BOE: Fetched primary data is invalid. Refusing to save it. [2025-10-28T17:40:05.940570] [WARN ] [MAIN ] BOE: Deleting existing primary and derivative data due to validation failure. [2025-10-28T17:40:05.940610] [INFO ] [LOCAL ] BOE: Starting deletion of primary data. [2025-10-28T17:40:05.940700] [DEBUG] [LOCAL ] BOE: No primary data file found to delete. [2025-10-28T17:40:05.940786] [INFO ] [LOCAL ] BOE: Starting deletion of derivative data. [2025-10-28T17:40:05.940940] [DEBUG] [LOCAL ] BOE: Deleted derivative data file. [2025-10-28T17:40:05.941025] [INFO ] [MAIN ] Update Progress: 321/2366 symbols completed. BOE took 19.3s. Estimated remaining: 4h 15m 8s. Rate: 8.0 symbols/min [2025-10-28T17:40:06.129379] [INFO ] [MAIN ] BORR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:40:06.174786] [DEBUG] [LOCAL ] BORR: Loaded 51047 existing records from primary storage. [2025-10-28T17:40:06.175090] [INFO ] [MAIN ] BORR: Loaded 51047 existing records. [2025-10-28T17:40:06.358139] [WARN ] [MAIN ] BORR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:40:06.358464] [INFO ] [MAIN ] BORR: Wiping existing primary data before full refresh. [2025-10-28T17:40:06.358626] [INFO ] [LOCAL ] BORR: Starting deletion of primary data. [2025-10-28T17:40:06.359302] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-07. [2025-10-28T17:40:06.360088] [DEBUG] [LOCAL ] BORR: Deleted primary data file. [2025-10-28T17:40:06.360221] [INFO ] [MAIN ] BORR: Starting full primary refresh. [2025-10-28T17:40:06.644116] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-28T17:40:06.750607] [INFO ] [REMOTE ] BORR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:40:06.922110] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-28T17:40:07.159397] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-08. [2025-10-28T17:40:07.243302] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-28T17:40:07.959330] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-08. [2025-10-28T17:40:08.096969] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-28T17:40:08.759343] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-01. [2025-10-28T17:40:08.909171] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-28T17:40:09.559444] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-09. [2025-10-28T17:40:10.359341] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-04. [2025-10-28T17:40:10.539576] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-10-28T17:40:10.780566] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-28T17:40:11.159426] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-10. [2025-10-28T17:40:11.648319] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-28T17:40:11.959446] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-02. [2025-10-28T17:40:12.759382] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-09. [2025-10-28T17:40:13.117412] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-28T17:40:13.124160] [INFO ] [REMOTE ] BOND: Full fetch complete (46373 records). [2025-10-28T17:40:13.124317] [DEBUG] [VALIDATOR ] BOND: Validating primary data. [2025-10-28T17:40:13.125053] [FATAL] [VALIDATOR ] BOND: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T17:40:13.125137] [FATAL] [MAIN ] BOND: Fetched primary data is invalid. Refusing to save it. [2025-10-28T17:40:13.125179] [WARN ] [MAIN ] BOND: Deleting existing primary and derivative data due to validation failure. [2025-10-28T17:40:13.125217] [INFO ] [LOCAL ] BOND: Starting deletion of primary data. [2025-10-28T17:40:13.125271] [DEBUG] [LOCAL ] BOND: No primary data file found to delete. [2025-10-28T17:40:13.125306] [INFO ] [LOCAL ] BOND: Starting deletion of derivative data. [2025-10-28T17:40:13.125483] [DEBUG] [LOCAL ] BOND: Deleted derivative data file. [2025-10-28T17:40:13.125572] [INFO ] [MAIN ] Update Progress: 322/2366 symbols completed. BOND took 26.5s. Estimated remaining: 4h 14m 59s. Rate: 8.0 symbols/min [2025-10-28T17:40:13.327769] [INFO ] [MAIN ] BOW: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:40:13.347785] [DEBUG] [LOCAL ] BOW: Loaded 22536 existing records from primary storage. [2025-10-28T17:40:13.348048] [INFO ] [MAIN ] BOW: Loaded 22536 existing records. [2025-10-28T17:40:13.527668] [WARN ] [MAIN ] BOW: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:40:13.527864] [INFO ] [MAIN ] BOW: Wiping existing primary data before full refresh. [2025-10-28T17:40:13.527910] [INFO ] [LOCAL ] BOW: Starting deletion of primary data. [2025-10-28T17:40:13.528320] [DEBUG] [LOCAL ] BOW: Deleted primary data file. [2025-10-28T17:40:13.528375] [INFO ] [MAIN ] BOW: Starting full primary refresh. [2025-10-28T17:40:13.559363] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-05. [2025-10-28T17:40:13.943111] [INFO ] [REMOTE ] BOW: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:40:13.951515] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-28T17:40:13.986321] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-10-28T17:40:14.359409] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-01. [2025-10-28T17:40:15.159379] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-10. [2025-10-28T17:40:15.390581] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-28T17:40:15.959351] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-03. [2025-10-28T17:40:16.409036] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-05 (2.85 seconds). [2025-10-28T17:40:16.701606] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-28T17:40:16.708458] [INFO ] [REMOTE ] BOH: Full fetch complete (45478 records). [2025-10-28T17:40:16.708553] [DEBUG] [VALIDATOR ] BOH: Validating primary data. [2025-10-28T17:40:16.771997] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-06. [2025-10-28T17:40:17.091331] [DEBUG] [VALIDATOR ] BOH: All expected trading days are present. [2025-10-28T17:40:17.091410] [DEBUG] [VALIDATOR ] BOH: Primary data validation passed. [2025-10-28T17:40:17.092022] [INFO ] [MAIN ] BOH: Fetched primary data is valid. [2025-10-28T17:40:17.092087] [DEBUG] [LOCAL ] BOH: Saving primary data. [2025-10-28T17:40:17.093202] [DEBUG] [LOCAL ] BOH: Trimmed 45478 records to 30444 (keeping 200 days of data) [2025-10-28T17:40:17.276979] [DEBUG] [LOCAL ] BOH: Primary data saved (30444 records). [2025-10-28T17:40:17.277192] [INFO ] [MAIN ] BOH: Full history saved. [2025-10-28T17:40:17.277320] [INFO ] [MAIN ] Update Progress: 323/2366 symbols completed. BOH took 30.7s. Estimated remaining: 4h 14m 31s. Rate: 8.0 symbols/min [2025-10-28T17:40:17.446632] [INFO ] [MAIN ] BOX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:40:17.489125] [DEBUG] [LOCAL ] BOX: Loaded 49989 existing records from primary storage. [2025-10-28T17:40:17.489433] [INFO ] [MAIN ] BOX: Loaded 49989 existing records. [2025-10-28T17:40:17.564465] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-02. [2025-10-28T17:40:17.672461] [WARN ] [MAIN ] BOX: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:40:17.672732] [INFO ] [MAIN ] BOX: Wiping existing primary data before full refresh. [2025-10-28T17:40:17.672790] [INFO ] [LOCAL ] BOX: Starting deletion of primary data. [2025-10-28T17:40:17.673601] [DEBUG] [LOCAL ] BOX: Deleted primary data file. [2025-10-28T17:40:17.673694] [INFO ] [MAIN ] BOX: Starting full primary refresh. [2025-10-28T17:40:18.050117] [INFO ] [REMOTE ] BOX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:40:18.088315] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-10-28T17:40:18.191310] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-28T17:40:18.299366] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-28T17:40:18.359315] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-07. [2025-10-28T17:40:19.159336] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-03. [2025-10-28T17:40:19.292830] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-28T17:40:19.959332] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-01. [2025-10-28T17:40:20.142878] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-28T17:40:20.759341] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-04. [2025-10-28T17:40:21.303693] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-28T17:40:21.559320] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-02. [2025-10-28T17:40:21.627785] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-28T17:40:22.359373] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-08. [2025-10-28T17:40:22.700724] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-28T17:40:23.159315] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-03. [2025-10-28T17:40:23.458581] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-28T17:40:23.959346] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-04. [2025-10-28T17:40:24.452516] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-28T17:40:24.759365] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-04. [2025-10-28T17:40:25.567881] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-05. [2025-10-28T17:40:25.594274] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-10-28T17:40:26.092332] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-28T17:40:26.359366] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-05. [2025-10-28T17:40:26.426138] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-28T17:40:27.159339] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-09. [2025-10-28T17:40:27.716486] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-28T17:40:27.959372] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-06. [2025-10-28T17:40:28.265129] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-28T17:40:28.759365] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-10. [2025-10-28T17:40:29.149335] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-28T17:40:29.559340] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-07. [2025-10-28T17:40:30.140822] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-28T17:40:30.148500] [INFO ] [REMOTE ] BOOT: Full fetch complete (59725 records). [2025-10-28T17:40:30.148718] [DEBUG] [VALIDATOR ] BOOT: Validating primary data. [2025-10-28T17:40:30.367221] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-06. [2025-10-28T17:40:30.546927] [DEBUG] [VALIDATOR ] BOOT: All expected trading days are present. [2025-10-28T17:40:30.546998] [DEBUG] [VALIDATOR ] BOOT: Primary data validation passed. [2025-10-28T17:40:30.547667] [INFO ] [MAIN ] BOOT: Fetched primary data is valid. [2025-10-28T17:40:30.547727] [DEBUG] [LOCAL ] BOOT: Saving primary data. [2025-10-28T17:40:30.548817] [DEBUG] [LOCAL ] BOOT: Trimmed 59725 records to 39014 (keeping 200 days of data) [2025-10-28T17:40:30.774057] [DEBUG] [LOCAL ] BOOT: Primary data saved (39014 records). [2025-10-28T17:40:30.774178] [INFO ] [MAIN ] BOOT: Full history saved. [2025-10-28T17:40:30.774253] [INFO ] [MAIN ] Update Progress: 324/2366 symbols completed. BOOT took 44.2s. Estimated remaining: 4h 15m 1s. Rate: 8.0 symbols/min [2025-10-28T17:40:30.941011] [INFO ] [MAIN ] BP: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:40:30.987358] [DEBUG] [LOCAL ] BP: Loaded 53705 existing records from primary storage. [2025-10-28T17:40:30.987800] [INFO ] [MAIN ] BP: Loaded 53705 existing records. [2025-10-28T17:40:31.168455] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-05. [2025-10-28T17:40:31.172548] [WARN ] [MAIN ] BP: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:40:31.172929] [INFO ] [MAIN ] BP: Wiping existing primary data before full refresh. [2025-10-28T17:40:31.173065] [INFO ] [LOCAL ] BP: Starting deletion of primary data. [2025-10-28T17:40:31.183242] [DEBUG] [LOCAL ] BP: Deleted primary data file. [2025-10-28T17:40:31.189421] [INFO ] [MAIN ] BP: Starting full primary refresh. [2025-10-28T17:40:31.283946] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-28T17:40:31.355058] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-28T17:40:31.589114] [INFO ] [REMOTE ] BP: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:40:31.959347] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-07. [2025-10-28T17:40:32.661477] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-28T17:40:32.759301] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-08. [2025-10-28T17:40:32.794077] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-28T17:40:33.559320] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-08. [2025-10-28T17:40:33.686591] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-28T17:40:34.359341] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-01. [2025-10-28T17:40:35.037913] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-28T17:40:35.159356] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-09. [2025-10-28T17:40:35.899975] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-28T17:40:35.959290] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-09. [2025-10-28T17:40:36.336951] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-10-28T17:40:36.759385] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-06. [2025-10-28T17:40:37.559390] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-10. [2025-10-28T17:40:37.590147] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-28T17:40:38.359372] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-10. [2025-10-28T17:40:38.428919] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-10-28T17:40:38.733079] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-28T17:40:38.738353] [INFO ] [REMOTE ] BOW: Full fetch complete (32163 records). [2025-10-28T17:40:38.738433] [DEBUG] [VALIDATOR ] BOW: Validating primary data. [2025-10-28T17:40:39.101717] [DEBUG] [VALIDATOR ] BOW: All expected trading days are present. [2025-10-28T17:40:39.101807] [DEBUG] [VALIDATOR ] BOW: Primary data validation passed. [2025-10-28T17:40:39.102241] [INFO ] [MAIN ] BOW: Fetched primary data is valid. [2025-10-28T17:40:39.102331] [DEBUG] [LOCAL ] BOW: Saving primary data. [2025-10-28T17:40:39.103076] [DEBUG] [LOCAL ] BOW: Trimmed 32163 records to 22520 (keeping 200 days of data) [2025-10-28T17:40:39.185225] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-02. [2025-10-28T17:40:39.231538] [DEBUG] [LOCAL ] BOW: Primary data saved (22520 records). [2025-10-28T17:40:39.231634] [INFO ] [MAIN ] BOW: Full history saved. [2025-10-28T17:40:39.231743] [INFO ] [MAIN ] Update Progress: 325/2366 symbols completed. BOW took 26.1s. Estimated remaining: 4h 14m 60s. Rate: 8.0 symbols/min [2025-10-28T17:40:39.397301] [INFO ] [MAIN ] BR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:40:39.427839] [DEBUG] [LOCAL ] BR: Loaded 34300 existing records from primary storage. [2025-10-28T17:40:39.428081] [INFO ] [MAIN ] BR: Loaded 34300 existing records. [2025-10-28T17:40:39.603911] [WARN ] [MAIN ] BR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:40:39.604105] [INFO ] [MAIN ] BR: Wiping existing primary data before full refresh. [2025-10-28T17:40:39.604150] [INFO ] [LOCAL ] BR: Starting deletion of primary data. [2025-10-28T17:40:39.604810] [DEBUG] [LOCAL ] BR: Deleted primary data file. [2025-10-28T17:40:39.604867] [INFO ] [MAIN ] BR: Starting full primary refresh. [2025-10-28T17:40:39.953012] [INFO ] [REMOTE ] BR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:40:39.964443] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-07. [2025-10-28T17:40:39.981309] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-28T17:40:39.991480] [INFO ] [REMOTE ] BORR: Full fetch complete (74546 records). [2025-10-28T17:40:39.991596] [DEBUG] [VALIDATOR ] BORR: Validating primary data. [2025-10-28T17:40:40.373573] [DEBUG] [VALIDATOR ] BORR: All expected trading days are present. [2025-10-28T17:40:40.373672] [DEBUG] [VALIDATOR ] BORR: Primary data validation passed. [2025-10-28T17:40:40.374429] [INFO ] [MAIN ] BORR: Fetched primary data is valid. [2025-10-28T17:40:40.374471] [DEBUG] [LOCAL ] BORR: Saving primary data. [2025-10-28T17:40:40.375788] [DEBUG] [LOCAL ] BORR: Trimmed 74546 records to 51050 (keeping 200 days of data) [2025-10-28T17:40:40.655524] [DEBUG] [LOCAL ] BORR: Primary data saved (51050 records). [2025-10-28T17:40:40.655682] [INFO ] [MAIN ] BORR: Full history saved. [2025-10-28T17:40:40.655778] [INFO ] [MAIN ] Update Progress: 326/2366 symbols completed. BORR took 34.7s. Estimated remaining: 4h 14m 14s. Rate: 8.0 symbols/min [2025-10-28T17:40:40.763985] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-01. [2025-10-28T17:40:40.829468] [INFO ] [MAIN ] BRBR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:40:40.876404] [DEBUG] [LOCAL ] BRBR: Loaded 51815 existing records from primary storage. [2025-10-28T17:40:40.876854] [INFO ] [MAIN ] BRBR: Loaded 51815 existing records. [2025-10-28T17:40:41.008478] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-10-28T17:40:41.096129] [WARN ] [MAIN ] BRBR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:40:41.096299] [INFO ] [MAIN ] BRBR: Wiping existing primary data before full refresh. [2025-10-28T17:40:41.096349] [INFO ] [LOCAL ] BRBR: Starting deletion of primary data. [2025-10-28T17:40:41.096786] [DEBUG] [LOCAL ] BRBR: Deleted primary data file. [2025-10-28T17:40:41.096856] [INFO ] [MAIN ] BRBR: Starting full primary refresh. [2025-10-28T17:40:41.455470] [INFO ] [REMOTE ] BRBR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:40:41.514189] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-28T17:40:41.559297] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-01. [2025-10-28T17:40:42.252217] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-28T17:40:42.359351] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-03. [2025-10-28T17:40:42.855383] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-28T17:40:43.159506] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-02. [2025-10-28T17:40:43.959329] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-08. [2025-10-28T17:40:44.040303] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-10-28T17:40:44.221412] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-28T17:40:44.759349] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-04. [2025-10-28T17:40:45.400527] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-28T17:40:45.559308] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-09. [2025-10-28T17:40:46.359390] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-02. [2025-10-28T17:40:46.975394] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-28T17:40:47.159312] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-03. [2025-10-28T17:40:47.251940] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-04 (2.49 seconds). [2025-10-28T17:40:47.564530] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-28T17:40:47.959343] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-03. [2025-10-28T17:40:48.281933] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-28T17:40:48.759335] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-04. [2025-10-28T17:40:49.316106] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-28T17:40:49.559346] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-05. [2025-10-28T17:40:49.880886] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-28T17:40:50.359332] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-10. [2025-10-28T17:40:51.159279] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-05. [2025-10-28T17:40:51.308765] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-28T17:40:51.553379] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-28T17:40:51.563551] [INFO ] [REMOTE ] BOX: Full fetch complete (72284 records). [2025-10-28T17:40:51.563753] [DEBUG] [VALIDATOR ] BOX: Validating primary data. [2025-10-28T17:40:51.963216] [DEBUG] [VALIDATOR ] BOX: All expected trading days are present. [2025-10-28T17:40:51.962964] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-04. [2025-10-28T17:40:51.964136] [DEBUG] [VALIDATOR ] BOX: Primary data validation passed. [2025-10-28T17:40:51.965178] [INFO ] [MAIN ] BOX: Fetched primary data is valid. [2025-10-28T17:40:51.965347] [DEBUG] [LOCAL ] BOX: Saving primary data. [2025-10-28T17:40:51.966817] [DEBUG] [LOCAL ] BOX: Trimmed 72284 records to 49960 (keeping 200 days of data) [2025-10-28T17:40:52.253843] [DEBUG] [LOCAL ] BOX: Primary data saved (49960 records). [2025-10-28T17:40:52.253986] [INFO ] [MAIN ] BOX: Full history saved. [2025-10-28T17:40:52.254399] [INFO ] [MAIN ] Update Progress: 327/2366 symbols completed. BOX took 35.0s. Estimated remaining: 4h 14m 32s. Rate: 8.0 symbols/min [2025-10-28T17:40:52.424068] [INFO ] [MAIN ] BRC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:40:52.442173] [DEBUG] [LOCAL ] BRC: Loaded 17909 existing records from primary storage. [2025-10-28T17:40:52.442439] [INFO ] [MAIN ] BRC: Loaded 17909 existing records. [2025-10-28T17:40:52.629841] [WARN ] [MAIN ] BRC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:40:52.630202] [INFO ] [MAIN ] BRC: Wiping existing primary data before full refresh. [2025-10-28T17:40:52.630427] [INFO ] [LOCAL ] BRC: Starting deletion of primary data. [2025-10-28T17:40:52.630973] [DEBUG] [LOCAL ] BRC: Deleted primary data file. [2025-10-28T17:40:52.631034] [INFO ] [MAIN ] BRC: Starting full primary refresh. [2025-10-28T17:40:52.765201] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-06. [2025-10-28T17:40:53.022398] [INFO ] [REMOTE ] BRC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:40:53.031139] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-10-28T17:40:53.559385] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-01. [2025-10-28T17:40:53.697163] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-28T17:40:54.309593] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-28T17:40:54.359304] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-02. [2025-10-28T17:40:54.545757] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-10-28T17:40:55.125052] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-28T17:40:55.159341] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-07. [2025-10-28T17:40:55.959353] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-03. [2025-10-28T17:40:56.764398] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-06. [2025-10-28T17:40:56.776601] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-28T17:40:57.232183] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-28T17:40:57.559338] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-04. [2025-10-28T17:40:57.881263] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-28T17:40:58.328196] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-28T17:40:58.359341] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-05. [2025-10-28T17:40:59.056218] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-28T17:40:59.159297] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-06. [2025-10-28T17:40:59.959341] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-08. [2025-10-28T17:40:59.978760] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-28T17:41:00.759388] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-05. [2025-10-28T17:41:01.555556] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-28T17:41:01.566019] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-07. [2025-10-28T17:41:02.249944] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-28T17:41:02.328144] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-28T17:41:02.359356] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-08. [2025-10-28T17:41:02.997811] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-28T17:41:03.159335] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-09. [2025-10-28T17:41:03.763780] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-28T17:41:03.959335] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-10. [2025-10-28T17:41:04.759334] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-09. [2025-10-28T17:41:05.071019] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-28T17:41:05.074742] [INFO ] [REMOTE ] BRC: Full fetch complete (28215 records). [2025-10-28T17:41:05.074815] [DEBUG] [VALIDATOR ] BRC: Validating primary data. [2025-10-28T17:41:05.455104] [DEBUG] [VALIDATOR ] BRC: All expected trading days are present. [2025-10-28T17:41:05.455181] [DEBUG] [VALIDATOR ] BRC: Primary data validation passed. [2025-10-28T17:41:05.455661] [INFO ] [MAIN ] BRC: Fetched primary data is valid. [2025-10-28T17:41:05.455723] [DEBUG] [LOCAL ] BRC: Saving primary data. [2025-10-28T17:41:05.456363] [DEBUG] [LOCAL ] BRC: Trimmed 28215 records to 17861 (keeping 200 days of data) [2025-10-28T17:41:05.565227] [DEBUG] [LOCAL ] BRC: Primary data saved (17861 records). [2025-10-28T17:41:05.559329] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-06. [2025-10-28T17:41:05.566215] [INFO ] [MAIN ] BRC: Full history saved. [2025-10-28T17:41:05.566326] [INFO ] [MAIN ] Update Progress: 328/2366 symbols completed. BRC took 13.3s. Estimated remaining: 4h 15m 1s. Rate: 8.0 symbols/min [2025-10-28T17:41:05.744434] [INFO ] [MAIN ] BRCC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:41:05.780256] [DEBUG] [LOCAL ] BRCC: Loaded 39939 existing records from primary storage. [2025-10-28T17:41:05.780541] [INFO ] [MAIN ] BRCC: Loaded 39939 existing records. [2025-10-28T17:41:05.958214] [WARN ] [MAIN ] BRCC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:41:05.958452] [INFO ] [MAIN ] BRCC: Wiping existing primary data before full refresh. [2025-10-28T17:41:05.958508] [INFO ] [LOCAL ] BRCC: Starting deletion of primary data. [2025-10-28T17:41:05.959184] [DEBUG] [LOCAL ] BRCC: Deleted primary data file. [2025-10-28T17:41:05.959240] [INFO ] [MAIN ] BRCC: Starting full primary refresh. [2025-10-28T17:41:06.305569] [INFO ] [REMOTE ] BRCC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:41:06.359306] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-01. [2025-10-28T17:41:06.576181] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-10-28T17:41:07.118921] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-28T17:41:07.159346] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-07. [2025-10-28T17:41:07.504594] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-28T17:41:07.959337] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-07. [2025-10-28T17:41:08.408566] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-28T17:41:08.759399] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-02. [2025-10-28T17:41:09.423747] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-28T17:41:09.559308] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-08. [2025-10-28T17:41:09.588594] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-28T17:41:10.359382] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-08. [2025-10-28T17:41:10.727757] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-28T17:41:11.159313] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-09. [2025-10-28T17:41:11.835577] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-28T17:41:11.959345] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-03. [2025-10-28T17:41:12.538765] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-28T17:41:12.759310] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-09. [2025-10-28T17:41:13.145036] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-28T17:41:13.559390] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-10. [2025-10-28T17:41:14.326886] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-28T17:41:14.359324] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-10. [2025-10-28T17:41:15.159381] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-10. [2025-10-28T17:41:15.565205] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-10 (2.01 seconds). [2025-10-28T17:41:15.576083] [INFO ] [REMOTE ] BP: Full fetch complete (77880 records). [2025-10-28T17:41:15.576236] [DEBUG] [VALIDATOR ] BP: Validating primary data. [2025-10-28T17:41:15.987218] [DEBUG] [VALIDATOR ] BP: All expected trading days are present. [2025-10-28T17:41:15.963265] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-04. [2025-10-28T17:41:15.988449] [DEBUG] [VALIDATOR ] BP: Primary data validation passed. [2025-10-28T17:41:15.989482] [INFO ] [MAIN ] BP: Fetched primary data is valid. [2025-10-28T17:41:15.989703] [DEBUG] [LOCAL ] BP: Saving primary data. [2025-10-28T17:41:15.991575] [DEBUG] [LOCAL ] BP: Trimmed 77880 records to 53705 (keeping 200 days of data) [2025-10-28T17:41:16.127887] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-28T17:41:16.155509] [INFO ] [REMOTE ] BRBR: Full fetch complete (73361 records). [2025-10-28T17:41:16.155731] [DEBUG] [VALIDATOR ] BRBR: Validating primary data. [2025-10-28T17:41:16.698269] [DEBUG] [LOCAL ] BP: Primary data saved (53705 records). [2025-10-28T17:41:16.709421] [INFO ] [MAIN ] BP: Full history saved. [2025-10-28T17:41:16.720031] [INFO ] [MAIN ] Update Progress: 329/2366 symbols completed. BP took 45.9s. Estimated remaining: 4h 15m 16s. Rate: 8.0 symbols/min [2025-10-28T17:41:16.893814] [DEBUG] [VALIDATOR ] BRBR: All expected trading days are present. [2025-10-28T17:41:16.909348] [DEBUG] [VALIDATOR ] BRBR: Primary data validation passed. [2025-10-28T17:41:16.909287] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-28T17:41:16.929262] [INFO ] [MAIN ] BRBR: Fetched primary data is valid. [2025-10-28T17:41:16.945421] [DEBUG] [LOCAL ] BRBR: Saving primary data. [2025-10-28T17:41:16.956048] [INFO ] [REMOTE ] BR: Full fetch complete (49854 records). [2025-10-28T17:41:16.966441] [DEBUG] [VALIDATOR ] BR: Validating primary data. [2025-10-28T17:41:17.016083] [INFO ] [MAIN ] BRCE: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:41:17.064603] [DEBUG] [LOCAL ] BRCE: No existing data file found in primary storage. [2025-10-28T17:41:17.085690] [WARN ] [MAIN ] BRCE: No existing data found, performing full refresh instead. [2025-10-28T17:41:17.086033] [DEBUG] [LOCAL ] BRBR: Trimmed 73361 records to 51854 (keeping 200 days of data) [2025-10-28T17:41:17.086169] [INFO ] [MAIN ] BRCE: Wiping existing primary data before full refresh. [2025-10-28T17:41:17.122425] [INFO ] [LOCAL ] BRCE: Starting deletion of primary data. [2025-10-28T17:41:17.123117] [DEBUG] [LOCAL ] BRCE: No primary data file found to delete. [2025-10-28T17:41:17.123489] [INFO ] [MAIN ] BRCE: Starting full primary refresh. [2025-10-28T17:41:17.378977] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-28T17:41:17.471833] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-05. [2025-10-28T17:41:17.941408] [DEBUG] [VALIDATOR ] BR: All expected trading days are present. [2025-10-28T17:41:17.947584] [DEBUG] [VALIDATOR ] BR: Primary data validation passed. [2025-10-28T17:41:17.975531] [INFO ] [MAIN ] BR: Fetched primary data is valid. [2025-10-28T17:41:17.984933] [DEBUG] [LOCAL ] BR: Saving primary data. [2025-10-28T17:41:18.081573] [INFO ] [REMOTE ] BRCE: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:41:18.082013] [DEBUG] [LOCAL ] BR: Trimmed 49854 records to 34189 (keeping 200 days of data) [2025-10-28T17:41:18.082962] [INFO ] [REMOTE ] BRCE: Fetching primary data for 2025-01. [2025-10-28T17:41:18.256375] [DEBUG] [LOCAL ] BRBR: Primary data saved (51854 records). [2025-10-28T17:41:18.263822] [INFO ] [MAIN ] BRBR: Full history saved. [2025-10-28T17:41:18.268890] [INFO ] [MAIN ] Update Progress: 330/2366 symbols completed. BRBR took 37.6s. Estimated remaining: 4h 14m 32s. Rate: 8.0 symbols/min [2025-10-28T17:41:18.310126] [DEBUG] [REMOTE ] BRCE: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-28T17:41:18.342533] [WARN ] [REMOTE ] BRCE: No data returned for month 2025-01 [2025-10-28T17:41:18.353411] [FATAL] [REMOTE ] BRCE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-28T17:41:18.362136] [FATAL] [MAIN ] BRCE: Failed to fetch primary data. [2025-10-28T17:41:18.426224] [WARN ] [MAIN ] BRCE: Deleting existing primary and derivative data due to fetch failure. [2025-10-28T17:41:18.457068] [INFO ] [LOCAL ] BRCE: Starting deletion of primary data. [2025-10-28T17:41:18.499203] [DEBUG] [LOCAL ] BRCE: No primary data file found to delete. [2025-10-28T17:41:18.518778] [INFO ] [LOCAL ] BRCE: Starting deletion of derivative data. [2025-10-28T17:41:18.570132] [INFO ] [MAIN ] BRIE: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:41:18.572259] [DEBUG] [LOCAL ] BRCE: No derivative data file found to delete. [2025-10-28T17:41:18.581052] [DEBUG] [LOCAL ] BR: Primary data saved (34189 records). [2025-10-28T17:41:18.581224] [DEBUG] [LOCAL ] BRIE: No existing data file found in primary storage. [2025-10-28T17:41:18.573273] [INFO ] [MAIN ] Update Progress: 331/2366 symbols completed. BRCE took 1.8s. Estimated remaining: 4h 13m 40s. Rate: 8.0 symbols/min [2025-10-28T17:41:18.581362] [INFO ] [MAIN ] BR: Full history saved. [2025-10-28T17:41:18.581437] [WARN ] [MAIN ] BRIE: No existing data found, performing full refresh instead. [2025-10-28T17:41:18.581856] [INFO ] [MAIN ] Update Progress: 332/2366 symbols completed. BR took 39.4s. Estimated remaining: 4h 12m 47s. Rate: 8.0 symbols/min [2025-10-28T17:41:18.635319] [INFO ] [MAIN ] BRIE: Wiping existing primary data before full refresh. [2025-10-28T17:41:18.719446] [INFO ] [LOCAL ] BRIE: Starting deletion of primary data. [2025-10-28T17:41:18.764135] [DEBUG] [LOCAL ] BRIE: No primary data file found to delete. [2025-10-28T17:41:18.804539] [INFO ] [MAIN ] BRIE: Starting full primary refresh. [2025-10-28T17:41:18.959695] [INFO ] [MAIN ] BRO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:41:19.059546] [INFO ] [MAIN ] BROS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:41:19.304952] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-28T17:41:19.330867] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-06. [2025-10-28T17:41:19.409607] [INFO ] [REMOTE ] BRIE: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:41:19.409984] [INFO ] [REMOTE ] BRIE: Fetching primary data for 2025-01. [2025-10-28T17:41:19.426794] [DEBUG] [LOCAL ] BRO: Loaded 52099 existing records from primary storage. [2025-10-28T17:41:19.429172] [INFO ] [MAIN ] BRO: Loaded 52099 existing records. [2025-10-28T17:41:19.428945] [DEBUG] [LOCAL ] BROS: Loaded 53298 existing records from primary storage. [2025-10-28T17:41:19.451629] [INFO ] [MAIN ] BROS: Loaded 53298 existing records. [2025-10-28T17:41:19.600281] [DEBUG] [REMOTE ] BRIE: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-28T17:41:19.638885] [WARN ] [REMOTE ] BRIE: No data returned for month 2025-01 [2025-10-28T17:41:19.639006] [FATAL] [REMOTE ] BRIE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-28T17:41:19.650282] [FATAL] [MAIN ] BRIE: Failed to fetch primary data. [2025-10-28T17:41:19.736992] [WARN ] [MAIN ] BRIE: Deleting existing primary and derivative data due to fetch failure. [2025-10-28T17:41:19.749187] [INFO ] [LOCAL ] BRIE: Starting deletion of primary data. [2025-10-28T17:41:19.778200] [DEBUG] [LOCAL ] BRIE: No primary data file found to delete. [2025-10-28T17:41:19.805735] [WARN ] [MAIN ] BRO: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:41:19.806128] [INFO ] [MAIN ] BRO: Wiping existing primary data before full refresh. [2025-10-28T17:41:19.805868] [INFO ] [LOCAL ] BRIE: Starting deletion of derivative data. [2025-10-28T17:41:19.806391] [DEBUG] [LOCAL ] BRIE: No derivative data file found to delete. [2025-10-28T17:41:19.806232] [INFO ] [LOCAL ] BRO: Starting deletion of primary data. [2025-10-28T17:41:19.806563] [INFO ] [MAIN ] Update Progress: 333/2366 symbols completed. BRIE took 1.5s. Estimated remaining: 4h 12m 1s. Rate: 8.1 symbols/min [2025-10-28T17:41:19.800089] [WARN ] [MAIN ] BROS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:41:19.827592] [DEBUG] [LOCAL ] BRO: Deleted primary data file. [2025-10-28T17:41:19.838027] [INFO ] [MAIN ] BRO: Starting full primary refresh. [2025-10-28T17:41:19.838169] [INFO ] [MAIN ] BROS: Wiping existing primary data before full refresh. [2025-10-28T17:41:19.916080] [INFO ] [LOCAL ] BROS: Starting deletion of primary data. [2025-10-28T17:41:19.973036] [DEBUG] [LOCAL ] BROS: Deleted primary data file. [2025-10-28T17:41:19.988278] [INFO ] [MAIN ] BROS: Starting full primary refresh. [2025-10-28T17:41:20.237000] [INFO ] [MAIN ] BRSL: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:41:20.250628] [DEBUG] [LOCAL ] BRSL: No existing data file found in primary storage. [2025-10-28T17:41:20.285398] [WARN ] [MAIN ] BRSL: No existing data found, performing full refresh instead. [2025-10-28T17:41:20.318095] [INFO ] [MAIN ] BRSL: Wiping existing primary data before full refresh. [2025-10-28T17:41:20.386768] [INFO ] [LOCAL ] BRSL: Starting deletion of primary data. [2025-10-28T17:41:20.442519] [DEBUG] [LOCAL ] BRSL: No primary data file found to delete. [2025-10-28T17:41:20.458283] [INFO ] [MAIN ] BRSL: Starting full primary refresh. [2025-10-28T17:41:20.773107] [INFO ] [REMOTE ] BRO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:41:20.794980] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-01. [2025-10-28T17:41:20.948170] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-28T17:41:20.967888] [INFO ] [REMOTE ] BROS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:41:20.984856] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-01. [2025-10-28T17:41:21.145867] [INFO ] [REMOTE ] BRSL: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:41:21.559356] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-07. [2025-10-28T17:41:22.359310] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-01. [2025-10-28T17:41:22.416974] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-28T17:41:22.635965] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-28T17:41:22.636260] [WARN ] [REMOTE ] BRSL: No data returned for month 2025-01 [2025-10-28T17:41:22.636349] [FATAL] [REMOTE ] BRSL: API call failed - aborting fetch to avoid wasting further API calls [2025-10-28T17:41:22.636393] [FATAL] [MAIN ] BRSL: Failed to fetch primary data. [2025-10-28T17:41:22.636448] [WARN ] [MAIN ] BRSL: Deleting existing primary and derivative data due to fetch failure. [2025-10-28T17:41:22.636515] [INFO ] [LOCAL ] BRSL: Starting deletion of primary data. [2025-10-28T17:41:22.636601] [DEBUG] [LOCAL ] BRSL: No primary data file found to delete. [2025-10-28T17:41:22.636695] [INFO ] [LOCAL ] BRSL: Starting deletion of derivative data. [2025-10-28T17:41:22.636757] [DEBUG] [LOCAL ] BRSL: No derivative data file found to delete. [2025-10-28T17:41:22.636804] [INFO ] [MAIN ] Update Progress: 334/2366 symbols completed. BRSL took 2.8s. Estimated remaining: 4h 11m 26s. Rate: 8.1 symbols/min [2025-10-28T17:41:22.807758] [INFO ] [MAIN ] BRSP: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:41:22.808062] [DEBUG] [LOCAL ] BRSP: No existing data file found in primary storage. [2025-10-28T17:41:22.808198] [WARN ] [MAIN ] BRSP: No existing data found, performing full refresh instead. [2025-10-28T17:41:22.808601] [INFO ] [MAIN ] BRSP: Wiping existing primary data before full refresh. [2025-10-28T17:41:22.808798] [INFO ] [LOCAL ] BRSP: Starting deletion of primary data. [2025-10-28T17:41:22.809382] [DEBUG] [LOCAL ] BRSP: No primary data file found to delete. [2025-10-28T17:41:22.809524] [INFO ] [MAIN ] BRSP: Starting full primary refresh. [2025-10-28T17:41:22.934762] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-28T17:41:23.121600] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-01 (2.14 seconds). [2025-10-28T17:41:23.164503] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-08. [2025-10-28T17:41:23.233917] [INFO ] [REMOTE ] BRSP: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:41:23.959387] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-01. [2025-10-28T17:41:24.307588] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-28T17:41:24.759362] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-09. [2025-10-28T17:41:25.112991] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-28T17:41:25.559334] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-02. [2025-10-28T17:41:26.152018] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-28T17:41:26.359349] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-02. [2025-10-28T17:41:26.814959] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-28T17:41:27.159386] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-02. [2025-10-28T17:41:27.443793] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-28T17:41:27.959349] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-03. [2025-10-28T17:41:28.764489] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-03. [2025-10-28T17:41:28.784221] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-28T17:41:29.330903] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-28T17:41:29.559309] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-10. [2025-10-28T17:41:29.847105] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-28T17:41:30.359489] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-04. [2025-10-28T17:41:31.019857] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-28T17:41:31.028569] [INFO ] [REMOTE ] BRCC: Full fetch complete (57370 records). [2025-10-28T17:41:31.028764] [DEBUG] [VALIDATOR ] BRCC: Validating primary data. [2025-10-28T17:41:31.164529] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-04. [2025-10-28T17:41:31.449830] [DEBUG] [VALIDATOR ] BRCC: All expected trading days are present. [2025-10-28T17:41:31.449915] [DEBUG] [VALIDATOR ] BRCC: Primary data validation passed. [2025-10-28T17:41:31.450626] [INFO ] [MAIN ] BRCC: Fetched primary data is valid. [2025-10-28T17:41:31.450715] [DEBUG] [LOCAL ] BRCC: Saving primary data. [2025-10-28T17:41:31.452187] [DEBUG] [LOCAL ] BRCC: Trimmed 57370 records to 39997 (keeping 200 days of data) [2025-10-28T17:41:31.693043] [DEBUG] [LOCAL ] BRCC: Primary data saved (39997 records). [2025-10-28T17:41:31.693288] [INFO ] [MAIN ] BRCC: Full history saved. [2025-10-28T17:41:31.693843] [INFO ] [MAIN ] Update Progress: 335/2366 symbols completed. BRCC took 26.1s. Estimated remaining: 4h 11m 28s. Rate: 8.1 symbols/min [2025-10-28T17:41:31.875002] [INFO ] [MAIN ] BRT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:41:31.909492] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-28T17:41:31.923907] [DEBUG] [LOCAL ] BRT: Loaded 5162 existing records from primary storage. [2025-10-28T17:41:31.924222] [INFO ] [MAIN ] BRT: Loaded 5162 existing records. [2025-10-28T17:41:31.965964] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-05. [2025-10-28T17:41:32.100230] [WARN ] [MAIN ] BRT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:41:32.100432] [INFO ] [MAIN ] BRT: Wiping existing primary data before full refresh. [2025-10-28T17:41:32.100480] [INFO ] [LOCAL ] BRT: Starting deletion of primary data. [2025-10-28T17:41:32.100807] [DEBUG] [LOCAL ] BRT: Deleted primary data file. [2025-10-28T17:41:32.100867] [INFO ] [MAIN ] BRT: Starting full primary refresh. [2025-10-28T17:41:32.459070] [INFO ] [REMOTE ] BRT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:41:32.485005] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-28T17:41:32.759338] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-05. [2025-10-28T17:41:33.346481] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-28T17:41:33.465283] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-28T17:41:33.559332] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-06. [2025-10-28T17:41:34.359307] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-01. [2025-10-28T17:41:34.483173] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-28T17:41:34.872511] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-28T17:41:35.159337] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-03. [2025-10-28T17:41:35.959340] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-02. [2025-10-28T17:41:36.278119] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-10-28T17:41:36.759328] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-07. [2025-10-28T17:41:36.857507] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-28T17:41:37.559345] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-03. [2025-10-28T17:41:37.944840] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-10-28T17:41:38.055614] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-28T17:41:38.359354] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-04. [2025-10-28T17:41:38.896318] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-28T17:41:39.159340] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-06. [2025-10-28T17:41:39.959349] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-05. [2025-10-28T17:41:40.553517] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-28T17:41:40.766687] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-06. [2025-10-28T17:41:40.785091] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-28T17:41:41.265733] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-28T17:41:41.559345] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-04. [2025-10-28T17:41:42.359349] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-07. [2025-10-28T17:41:42.772534] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-10-28T17:41:43.139862] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-28T17:41:43.159313] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-05. [2025-10-28T17:41:43.959353] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-08. [2025-10-28T17:41:44.759324] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-08. [2025-10-28T17:41:45.015899] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-28T17:41:45.057311] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-28T17:41:45.384851] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-28T17:41:45.559307] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-09. [2025-10-28T17:41:46.034136] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-28T17:41:46.359369] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-10. [2025-10-28T17:41:47.148808] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-28T17:41:47.150763] [INFO ] [REMOTE ] BRT: Full fetch complete (7115 records). [2025-10-28T17:41:47.150831] [DEBUG] [VALIDATOR ] BRT: Validating primary data. [2025-10-28T17:41:47.164434] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-09. [2025-10-28T17:41:47.521792] [DEBUG] [VALIDATOR ] BRT: All expected trading days are present. [2025-10-28T17:41:47.521868] [DEBUG] [VALIDATOR ] BRT: Primary data validation passed. [2025-10-28T17:41:47.522049] [INFO ] [MAIN ] BRT: Fetched primary data is valid. [2025-10-28T17:41:47.522089] [DEBUG] [LOCAL ] BRT: Saving primary data. [2025-10-28T17:41:47.522486] [DEBUG] [LOCAL ] BRT: Trimmed 7115 records to 5156 (keeping 200 days of data) [2025-10-28T17:41:47.553758] [DEBUG] [LOCAL ] BRT: Primary data saved (5156 records). [2025-10-28T17:41:47.553891] [INFO ] [MAIN ] BRT: Full history saved. [2025-10-28T17:41:47.553968] [INFO ] [MAIN ] Update Progress: 336/2366 symbols completed. BRT took 15.9s. Estimated remaining: 4h 12m 12s. Rate: 8.0 symbols/min [2025-10-28T17:41:47.723597] [INFO ] [MAIN ] BRW: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:41:47.741607] [DEBUG] [LOCAL ] BRW: Loaded 20882 existing records from primary storage. [2025-10-28T17:41:47.741885] [INFO ] [MAIN ] BRW: Loaded 20882 existing records. [2025-10-28T17:41:47.925067] [WARN ] [MAIN ] BRW: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:41:47.925323] [INFO ] [MAIN ] BRW: Wiping existing primary data before full refresh. [2025-10-28T17:41:47.925397] [INFO ] [LOCAL ] BRW: Starting deletion of primary data. [2025-10-28T17:41:47.925918] [DEBUG] [LOCAL ] BRW: Deleted primary data file. [2025-10-28T17:41:47.925993] [INFO ] [MAIN ] BRW: Starting full primary refresh. [2025-10-28T17:41:47.965979] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-07. [2025-10-28T17:41:48.286397] [INFO ] [REMOTE ] BRW: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:41:48.759307] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-06. [2025-10-28T17:41:48.840539] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-28T17:41:49.519219] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-28T17:41:49.559320] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-08. [2025-10-28T17:41:50.180860] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-28T17:41:50.359348] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-01. [2025-10-28T17:41:51.159322] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-07. [2025-10-28T17:41:51.266220] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-28T17:41:51.461451] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-28T17:41:51.959343] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-10. [2025-10-28T17:41:52.759362] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-09. [2025-10-28T17:41:52.877147] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-28T17:41:53.385575] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-28T17:41:53.396090] [INFO ] [REMOTE ] BRSP: Full fetch complete (53870 records). [2025-10-28T17:41:53.396250] [DEBUG] [VALIDATOR ] BRSP: Validating primary data. [2025-10-28T17:41:53.564463] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-02. [2025-10-28T17:41:53.810432] [DEBUG] [VALIDATOR ] BRSP: All expected trading days are present. [2025-10-28T17:41:53.810504] [DEBUG] [VALIDATOR ] BRSP: Primary data validation passed. [2025-10-28T17:41:53.811276] [INFO ] [MAIN ] BRSP: Fetched primary data is valid. [2025-10-28T17:41:53.811336] [DEBUG] [LOCAL ] BRSP: Saving primary data. [2025-10-28T17:41:53.812348] [DEBUG] [LOCAL ] BRSP: Trimmed 53870 records to 35933 (keeping 200 days of data) [2025-10-28T17:41:54.020481] [DEBUG] [LOCAL ] BRSP: Primary data saved (35933 records). [2025-10-28T17:41:54.020618] [INFO ] [MAIN ] BRSP: Full history saved. [2025-10-28T17:41:54.020723] [INFO ] [MAIN ] Update Progress: 337/2366 symbols completed. BRSP took 31.4s. Estimated remaining: 4h 11m 58s. Rate: 8.1 symbols/min [2025-10-28T17:41:54.194032] [INFO ] [MAIN ] BRX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:41:54.208378] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-28T17:41:54.249622] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-28T17:41:54.301628] [DEBUG] [LOCAL ] BRX: Loaded 51796 existing records from primary storage. [2025-10-28T17:41:54.302003] [INFO ] [MAIN ] BRX: Loaded 51796 existing records. [2025-10-28T17:41:54.367822] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-03. [2025-10-28T17:41:54.494136] [WARN ] [MAIN ] BRX: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:41:54.494379] [INFO ] [MAIN ] BRX: Wiping existing primary data before full refresh. [2025-10-28T17:41:54.494429] [INFO ] [LOCAL ] BRX: Starting deletion of primary data. [2025-10-28T17:41:54.495323] [DEBUG] [LOCAL ] BRX: Deleted primary data file. [2025-10-28T17:41:54.495381] [INFO ] [MAIN ] BRX: Starting full primary refresh. [2025-10-28T17:41:54.857567] [INFO ] [REMOTE ] BRX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:41:55.159303] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-01. [2025-10-28T17:41:55.243855] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-28T17:41:55.959340] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-04. [2025-10-28T17:41:56.659626] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-28T17:41:56.680919] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-28T17:41:56.759302] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-05. [2025-10-28T17:41:57.325349] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-28T17:41:57.559339] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-10. [2025-10-28T17:41:58.359336] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-06. [2025-10-28T17:41:59.159305] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-02. [2025-10-28T17:41:59.174323] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-28T17:41:59.346932] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-28T17:41:59.357698] [INFO ] [REMOTE ] BRO: Full fetch complete (75161 records). [2025-10-28T17:41:59.357847] [DEBUG] [VALIDATOR ] BRO: Validating primary data. [2025-10-28T17:41:59.740144] [DEBUG] [VALIDATOR ] BRO: All expected trading days are present. [2025-10-28T17:41:59.740234] [DEBUG] [VALIDATOR ] BRO: Primary data validation passed. [2025-10-28T17:41:59.741029] [INFO ] [MAIN ] BRO: Fetched primary data is valid. [2025-10-28T17:41:59.741092] [DEBUG] [LOCAL ] BRO: Saving primary data. [2025-10-28T17:41:59.742499] [DEBUG] [LOCAL ] BRO: Trimmed 75161 records to 52100 (keeping 200 days of data) [2025-10-28T17:41:59.962227] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-08. [2025-10-28T17:42:00.058388] [DEBUG] [LOCAL ] BRO: Primary data saved (52100 records). [2025-10-28T17:42:00.058623] [INFO ] [MAIN ] BRO: Full history saved. [2025-10-28T17:42:00.058743] [INFO ] [MAIN ] Update Progress: 338/2366 symbols completed. BRO took 41.5s. Estimated remaining: 4h 11m 42s. Rate: 8.1 symbols/min [2025-10-28T17:42:00.227537] [INFO ] [MAIN ] BSAC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:42:00.257385] [DEBUG] [LOCAL ] BSAC: Loaded 32455 existing records from primary storage. [2025-10-28T17:42:00.257633] [INFO ] [MAIN ] BSAC: Loaded 32455 existing records. [2025-10-28T17:42:00.435033] [WARN ] [MAIN ] BSAC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:42:00.435390] [INFO ] [MAIN ] BSAC: Wiping existing primary data before full refresh. [2025-10-28T17:42:00.435463] [INFO ] [LOCAL ] BSAC: Starting deletion of primary data. [2025-10-28T17:42:00.435871] [DEBUG] [LOCAL ] BSAC: Deleted primary data file. [2025-10-28T17:42:00.436004] [INFO ] [MAIN ] BSAC: Starting full primary refresh. [2025-10-28T17:42:00.739718] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-28T17:42:00.765945] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-03. [2025-10-28T17:42:00.826713] [INFO ] [REMOTE ] BSAC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:42:01.559331] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-07. [2025-10-28T17:42:01.918127] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-28T17:42:02.197257] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-28T17:42:02.359344] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-09. [2025-10-28T17:42:02.919733] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-28T17:42:03.159337] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-01. [2025-10-28T17:42:03.959324] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-04. [2025-10-28T17:42:04.093682] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-28T17:42:04.549728] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-28T17:42:04.759425] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-02. [2025-10-28T17:42:05.294942] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-28T17:42:05.559312] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-08. [2025-10-28T17:42:05.625743] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-28T17:42:06.243459] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-28T17:42:06.359302] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-09. [2025-10-28T17:42:07.159315] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-10. [2025-10-28T17:42:07.218601] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-28T17:42:07.959336] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-05. [2025-10-28T17:42:08.759392] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-10. [2025-10-28T17:42:09.225071] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-10 (2.07 seconds). [2025-10-28T17:42:09.235740] [INFO ] [REMOTE ] BROS: Full fetch complete (77278 records). [2025-10-28T17:42:09.235859] [DEBUG] [VALIDATOR ] BROS: Validating primary data. [2025-10-28T17:42:09.562223] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-03. [2025-10-28T17:42:09.667424] [DEBUG] [VALIDATOR ] BROS: All expected trading days are present. [2025-10-28T17:42:09.667590] [DEBUG] [VALIDATOR ] BROS: Primary data validation passed. [2025-10-28T17:42:09.668515] [INFO ] [MAIN ] BROS: Fetched primary data is valid. [2025-10-28T17:42:09.668819] [DEBUG] [LOCAL ] BROS: Saving primary data. [2025-10-28T17:42:09.692366] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-28T17:42:09.692622] [DEBUG] [LOCAL ] BROS: Trimmed 77278 records to 53295 (keeping 200 days of data) [2025-10-28T17:42:09.701476] [INFO ] [REMOTE ] BRW: Full fetch complete (30177 records). [2025-10-28T17:42:09.701751] [DEBUG] [VALIDATOR ] BRW: Validating primary data. [2025-10-28T17:42:09.897752] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-10-28T17:42:10.352525] [DEBUG] [VALIDATOR ] BRW: All expected trading days are present. [2025-10-28T17:42:10.353681] [DEBUG] [VALIDATOR ] BRW: Primary data validation passed. [2025-10-28T17:42:10.354527] [INFO ] [MAIN ] BRW: Fetched primary data is valid. [2025-10-28T17:42:10.362986] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-06. [2025-10-28T17:42:10.358915] [DEBUG] [LOCAL ] BRW: Saving primary data. [2025-10-28T17:42:10.428371] [DEBUG] [LOCAL ] BRW: Trimmed 30177 records to 20781 (keeping 200 days of data) [2025-10-28T17:42:10.506898] [DEBUG] [LOCAL ] BROS: Primary data saved (53295 records). [2025-10-28T17:42:10.540478] [INFO ] [MAIN ] BROS: Full history saved. [2025-10-28T17:42:10.548742] [INFO ] [MAIN ] Update Progress: 339/2366 symbols completed. BROS took 52.0s. Estimated remaining: 4h 11m 53s. Rate: 8.0 symbols/min [2025-10-28T17:42:10.626378] [DEBUG] [LOCAL ] BRW: Primary data saved (20781 records). [2025-10-28T17:42:10.640370] [INFO ] [MAIN ] BRW: Full history saved. [2025-10-28T17:42:10.652226] [INFO ] [MAIN ] Update Progress: 340/2366 symbols completed. BRW took 23.1s. Estimated remaining: 4h 11m 2s. Rate: 8.1 symbols/min [2025-10-28T17:42:10.851174] [INFO ] [MAIN ] BSBR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:42:10.862300] [DEBUG] [LOCAL ] BSBR: No existing data file found in primary storage. [2025-10-28T17:42:10.867621] [WARN ] [MAIN ] BSBR: No existing data found, performing full refresh instead. [2025-10-28T17:42:10.891386] [INFO ] [MAIN ] BSBR: Wiping existing primary data before full refresh. [2025-10-28T17:42:10.891500] [INFO ] [LOCAL ] BSBR: Starting deletion of primary data. [2025-10-28T17:42:10.941580] [INFO ] [MAIN ] BSL: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:42:10.922412] [DEBUG] [LOCAL ] BSBR: No primary data file found to delete. [2025-10-28T17:42:10.941864] [DEBUG] [LOCAL ] BSL: No existing data file found in primary storage. [2025-10-28T17:42:10.943555] [WARN ] [MAIN ] BSL: No existing data found, performing full refresh instead. [2025-10-28T17:42:10.943781] [INFO ] [MAIN ] BSL: Wiping existing primary data before full refresh. [2025-10-28T17:42:10.943479] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-28T17:42:10.944098] [INFO ] [MAIN ] BSBR: Starting full primary refresh. [2025-10-28T17:42:10.943976] [INFO ] [LOCAL ] BSL: Starting deletion of primary data. [2025-10-28T17:42:10.995505] [DEBUG] [LOCAL ] BSL: No primary data file found to delete. [2025-10-28T17:42:11.021715] [INFO ] [MAIN ] BSL: Starting full primary refresh. [2025-10-28T17:42:11.160522] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-04. [2025-10-28T17:42:11.655937] [INFO ] [REMOTE ] BSBR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:42:11.739328] [INFO ] [REMOTE ] BSL: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:42:11.767906] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-28T17:42:11.959341] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-01. [2025-10-28T17:42:12.174546] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-28T17:42:12.759344] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-01. [2025-10-28T17:42:12.879691] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-28T17:42:13.559332] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-02. [2025-10-28T17:42:13.932844] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-28T17:42:14.102560] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-28T17:42:14.359336] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-03. [2025-10-28T17:42:15.013371] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-28T17:42:15.159344] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-02. [2025-10-28T17:42:15.959395] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-07. [2025-10-28T17:42:16.174583] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-28T17:42:16.759337] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-03. [2025-10-28T17:42:17.294367] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-28T17:42:17.559303] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-04. [2025-10-28T17:42:17.813291] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-28T17:42:18.115091] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-28T17:42:18.359327] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-05. [2025-10-28T17:42:19.159323] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-08. [2025-10-28T17:42:19.615718] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-28T17:42:19.959338] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-05. [2025-10-28T17:42:20.636222] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-28T17:42:20.702967] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-28T17:42:20.759306] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-06. [2025-10-28T17:42:21.199771] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-28T17:42:21.559330] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-07. [2025-10-28T17:42:22.040930] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-28T17:42:22.359320] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-06. [2025-10-28T17:42:23.159345] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-09. [2025-10-28T17:42:23.340469] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-28T17:42:23.959342] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-07. [2025-10-28T17:42:24.261913] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-28T17:42:24.759305] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-08. [2025-10-28T17:42:24.797532] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-28T17:42:25.329728] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-28T17:42:25.559340] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-08. [2025-10-28T17:42:26.359307] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-09. [2025-10-28T17:42:26.432638] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-28T17:42:26.919710] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-28T17:42:27.159363] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-04. [2025-10-28T17:42:27.959354] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-10. [2025-10-28T17:42:28.266886] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-28T17:42:28.685962] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-28T17:42:28.688589] [INFO ] [REMOTE ] BSL: Full fetch complete (13094 records). [2025-10-28T17:42:28.688682] [DEBUG] [VALIDATOR ] BSL: Validating primary data. [2025-10-28T17:42:28.764379] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-05. [2025-10-28T17:42:29.043110] [DEBUG] [VALIDATOR ] BSL: All expected trading days are present. [2025-10-28T17:42:29.043182] [DEBUG] [VALIDATOR ] BSL: Primary data validation passed. [2025-10-28T17:42:29.043450] [INFO ] [MAIN ] BSL: Fetched primary data is valid. [2025-10-28T17:42:29.043488] [DEBUG] [LOCAL ] BSL: Saving primary data. [2025-10-28T17:42:29.043955] [DEBUG] [LOCAL ] BSL: Trimmed 13094 records to 7990 (keeping 200 days of data) [2025-10-28T17:42:29.090874] [DEBUG] [LOCAL ] BSL: Primary data saved (7990 records). [2025-10-28T17:42:29.090978] [INFO ] [MAIN ] BSL: Full history saved. [2025-10-28T17:42:29.091043] [INFO ] [MAIN ] Update Progress: 341/2366 symbols completed. BSL took 18.4s. Estimated remaining: 4h 11m 60s. Rate: 8.0 symbols/min [2025-10-28T17:42:29.260118] [INFO ] [MAIN ] BSM: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:42:29.260264] [DEBUG] [LOCAL ] BSM: No existing data file found in primary storage. [2025-10-28T17:42:29.260299] [WARN ] [MAIN ] BSM: No existing data found, performing full refresh instead. [2025-10-28T17:42:29.260410] [INFO ] [MAIN ] BSM: Wiping existing primary data before full refresh. [2025-10-28T17:42:29.260450] [INFO ] [LOCAL ] BSM: Starting deletion of primary data. [2025-10-28T17:42:29.260489] [DEBUG] [LOCAL ] BSM: No primary data file found to delete. [2025-10-28T17:42:29.260521] [INFO ] [MAIN ] BSM: Starting full primary refresh. [2025-10-28T17:42:29.564417] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-09. [2025-10-28T17:42:29.617571] [INFO ] [REMOTE ] BSM: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:42:29.887295] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-28T17:42:30.359341] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-01. [2025-10-28T17:42:30.894338] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-28T17:42:31.159336] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-06. [2025-10-28T17:42:31.242522] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-28T17:42:31.959335] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-10. [2025-10-28T17:42:32.161165] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-28T17:42:32.759368] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-02. [2025-10-28T17:42:33.124125] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-28T17:42:33.130472] [INFO ] [REMOTE ] BSAC: Full fetch complete (45471 records). [2025-10-28T17:42:33.130592] [DEBUG] [VALIDATOR ] BSAC: Validating primary data. [2025-10-28T17:42:33.519275] [DEBUG] [VALIDATOR ] BSAC: All expected trading days are present. [2025-10-28T17:42:33.519354] [DEBUG] [VALIDATOR ] BSAC: Primary data validation passed. [2025-10-28T17:42:33.519921] [INFO ] [MAIN ] BSAC: Fetched primary data is valid. [2025-10-28T17:42:33.519980] [DEBUG] [LOCAL ] BSAC: Saving primary data. [2025-10-28T17:42:33.521023] [DEBUG] [LOCAL ] BSAC: Trimmed 45471 records to 32305 (keeping 200 days of data) [2025-10-28T17:42:33.567745] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-10. [2025-10-28T17:42:33.710325] [DEBUG] [LOCAL ] BSAC: Primary data saved (32305 records). [2025-10-28T17:42:33.710470] [INFO ] [MAIN ] BSAC: Full history saved. [2025-10-28T17:42:33.710580] [INFO ] [MAIN ] Update Progress: 342/2366 symbols completed. BSAC took 33.7s. Estimated remaining: 4h 11m 35s. Rate: 8.0 symbols/min [2025-10-28T17:42:33.886809] [INFO ] [MAIN ] BST: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:42:33.903706] [DEBUG] [LOCAL ] BST: Loaded 17979 existing records from primary storage. [2025-10-28T17:42:33.903955] [INFO ] [MAIN ] BST: Loaded 17979 existing records. [2025-10-28T17:42:34.068911] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-28T17:42:34.116613] [WARN ] [MAIN ] BST: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:42:34.116850] [INFO ] [MAIN ] BST: Wiping existing primary data before full refresh. [2025-10-28T17:42:34.116897] [INFO ] [LOCAL ] BST: Starting deletion of primary data. [2025-10-28T17:42:34.117384] [DEBUG] [LOCAL ] BST: Deleted primary data file. [2025-10-28T17:42:34.117447] [INFO ] [MAIN ] BST: Starting full primary refresh. [2025-10-28T17:42:34.364630] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-07. [2025-10-28T17:42:34.478091] [INFO ] [REMOTE ] BST: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:42:35.159316] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-03. [2025-10-28T17:42:35.211326] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-28T17:42:35.221848] [INFO ] [REMOTE ] BRX: Full fetch complete (75165 records). [2025-10-28T17:42:35.222000] [DEBUG] [VALIDATOR ] BRX: Validating primary data. [2025-10-28T17:42:35.639236] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-28T17:42:35.647169] [DEBUG] [VALIDATOR ] BRX: All expected trading days are present. [2025-10-28T17:42:35.647633] [DEBUG] [VALIDATOR ] BRX: Primary data validation passed. [2025-10-28T17:42:35.648512] [INFO ] [MAIN ] BRX: Fetched primary data is valid. [2025-10-28T17:42:35.648584] [DEBUG] [LOCAL ] BRX: Saving primary data. [2025-10-28T17:42:35.650296] [DEBUG] [LOCAL ] BRX: Trimmed 75165 records to 51800 (keeping 200 days of data) [2025-10-28T17:42:35.955826] [DEBUG] [LOCAL ] BRX: Primary data saved (51800 records). [2025-10-28T17:42:35.955937] [INFO ] [MAIN ] BRX: Full history saved. [2025-10-28T17:42:35.956050] [INFO ] [MAIN ] Update Progress: 343/2366 symbols completed. BRX took 41.9s. Estimated remaining: 4h 10m 57s. Rate: 8.1 symbols/min [2025-10-28T17:42:35.966949] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-01. [2025-10-28T17:42:36.128564] [INFO ] [MAIN ] BSTZ: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:42:36.147387] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-28T17:42:36.172198] [DEBUG] [LOCAL ] BSTZ: Loaded 24166 existing records from primary storage. [2025-10-28T17:42:36.172422] [INFO ] [MAIN ] BSTZ: Loaded 24166 existing records. [2025-10-28T17:42:36.343812] [WARN ] [MAIN ] BSTZ: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:42:36.344016] [INFO ] [MAIN ] BSTZ: Wiping existing primary data before full refresh. [2025-10-28T17:42:36.344063] [INFO ] [LOCAL ] BSTZ: Starting deletion of primary data. [2025-10-28T17:42:36.344231] [DEBUG] [LOCAL ] BSTZ: Deleted primary data file. [2025-10-28T17:42:36.344285] [INFO ] [MAIN ] BSTZ: Starting full primary refresh. [2025-10-28T17:42:36.689244] [INFO ] [REMOTE ] BSTZ: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:42:36.759298] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-01. [2025-10-28T17:42:36.858578] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-28T17:42:37.559342] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-08. [2025-10-28T17:42:38.136622] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-28T17:42:38.359393] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-02. [2025-10-28T17:42:38.780532] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-28T17:42:39.111558] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-28T17:42:39.159313] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-04. [2025-10-28T17:42:39.959320] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-03. [2025-10-28T17:42:40.025753] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-28T17:42:40.759405] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-05. [2025-10-28T17:42:40.783710] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-28T17:42:41.559351] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-04. [2025-10-28T17:42:41.867159] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-28T17:42:42.317824] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-28T17:42:42.359299] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-05. [2025-10-28T17:42:43.127386] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-28T17:42:43.159329] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-06. [2025-10-28T17:42:43.922357] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-28T17:42:43.959316] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-09. [2025-10-28T17:42:44.759335] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-06. [2025-10-28T17:42:45.275937] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-28T17:42:45.559333] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-02. [2025-10-28T17:42:46.068508] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-28T17:42:46.359333] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-07. [2025-10-28T17:42:46.578701] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-28T17:42:47.159342] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-07. [2025-10-28T17:42:47.376365] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-28T17:42:47.871274] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-28T17:42:47.959321] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-08. [2025-10-28T17:42:48.706787] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-28T17:42:48.759307] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-10. [2025-10-28T17:42:49.559319] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-09. [2025-10-28T17:42:50.278353] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-28T17:42:50.359314] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-10. [2025-10-28T17:42:50.486120] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-28T17:42:50.493675] [INFO ] [REMOTE ] BSBR: Full fetch complete (50774 records). [2025-10-28T17:42:50.493800] [DEBUG] [VALIDATOR ] BSBR: Validating primary data. [2025-10-28T17:42:50.910518] [DEBUG] [VALIDATOR ] BSBR: All expected trading days are present. [2025-10-28T17:42:50.910614] [DEBUG] [VALIDATOR ] BSBR: Primary data validation passed. [2025-10-28T17:42:50.911339] [INFO ] [MAIN ] BSBR: Fetched primary data is valid. [2025-10-28T17:42:50.911392] [DEBUG] [LOCAL ] BSBR: Saving primary data. [2025-10-28T17:42:50.912568] [DEBUG] [LOCAL ] BSBR: Trimmed 50774 records to 35513 (keeping 200 days of data) [2025-10-28T17:42:51.113574] [DEBUG] [LOCAL ] BSBR: Primary data saved (35513 records). [2025-10-28T17:42:51.113703] [INFO ] [MAIN ] BSBR: Full history saved. [2025-10-28T17:42:51.113784] [INFO ] [MAIN ] Update Progress: 344/2366 symbols completed. BSBR took 40.6s. Estimated remaining: 4h 11m 35s. Rate: 8.0 symbols/min [2025-10-28T17:42:51.168426] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-03. [2025-10-28T17:42:51.285775] [INFO ] [MAIN ] BSX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:42:51.334202] [DEBUG] [LOCAL ] BSX: Loaded 53688 existing records from primary storage. [2025-10-28T17:42:51.334559] [INFO ] [MAIN ] BSX: Loaded 53688 existing records. [2025-10-28T17:42:51.454147] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-28T17:42:51.498088] [INFO ] [REMOTE ] BST: Full fetch complete (28061 records). [2025-10-28T17:42:51.516665] [DEBUG] [VALIDATOR ] BST: Validating primary data. [2025-10-28T17:42:51.538756] [WARN ] [MAIN ] BSX: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:42:51.538908] [INFO ] [MAIN ] BSX: Wiping existing primary data before full refresh. [2025-10-28T17:42:51.533828] [FATAL] [VALIDATOR ] BST: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T17:42:51.539076] [FATAL] [MAIN ] BST: Fetched primary data is invalid. Refusing to save it. [2025-10-28T17:42:51.539124] [INFO ] [LOCAL ] BSX: Starting deletion of primary data. [2025-10-28T17:42:51.539211] [WARN ] [MAIN ] BST: Deleting existing primary and derivative data due to validation failure. [2025-10-28T17:42:51.539357] [INFO ] [LOCAL ] BST: Starting deletion of primary data. [2025-10-28T17:42:51.539470] [DEBUG] [LOCAL ] BST: No primary data file found to delete. [2025-10-28T17:42:51.539517] [INFO ] [LOCAL ] BST: Starting deletion of derivative data. [2025-10-28T17:42:51.539687] [DEBUG] [LOCAL ] BST: Deleted derivative data file. [2025-10-28T17:42:51.539775] [INFO ] [MAIN ] Update Progress: 345/2366 symbols completed. BST took 17.8s. Estimated remaining: 4h 10m 46s. Rate: 8.1 symbols/min [2025-10-28T17:42:51.550762] [DEBUG] [LOCAL ] BSX: Deleted primary data file. [2025-10-28T17:42:51.571309] [INFO ] [MAIN ] BSX: Starting full primary refresh. [2025-10-28T17:42:51.864366] [INFO ] [MAIN ] BTA: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:42:51.964380] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-08. [2025-10-28T17:42:51.989923] [DEBUG] [LOCAL ] BTA: Loaded 5673 existing records from primary storage. [2025-10-28T17:42:51.995541] [INFO ] [MAIN ] BTA: Loaded 5673 existing records. [2025-10-28T17:42:52.176231] [INFO ] [REMOTE ] BSX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:42:52.249900] [WARN ] [MAIN ] BTA: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:42:52.250155] [INFO ] [MAIN ] BTA: Wiping existing primary data before full refresh. [2025-10-28T17:42:52.250314] [INFO ] [LOCAL ] BTA: Starting deletion of primary data. [2025-10-28T17:42:52.250559] [DEBUG] [LOCAL ] BTA: Deleted primary data file. [2025-10-28T17:42:52.250615] [INFO ] [MAIN ] BTA: Starting full primary refresh. [2025-10-28T17:42:52.406141] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-28T17:42:52.627557] [INFO ] [REMOTE ] BTA: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:42:52.759303] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-01. [2025-10-28T17:42:53.038594] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-28T17:42:53.403528] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-28T17:42:53.559377] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-04. [2025-10-28T17:42:54.359353] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-02. [2025-10-28T17:42:54.416097] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-28T17:42:54.853926] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-28T17:42:55.159340] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-01. [2025-10-28T17:42:55.959344] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-03. [2025-10-28T17:42:56.367696] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-10-28T17:42:56.596373] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-28T17:42:56.759313] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-02. [2025-10-28T17:42:57.559350] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-04. [2025-10-28T17:42:58.128352] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-28T17:42:58.245608] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-28T17:42:58.359339] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-05. [2025-10-28T17:42:59.140769] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-28T17:42:59.159294] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-06. [2025-10-28T17:42:59.959311] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-09. [2025-10-28T17:42:59.995240] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-28T17:43:00.759373] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-05. [2025-10-28T17:43:00.973194] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-28T17:43:01.202865] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-28T17:43:01.559390] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-03. [2025-10-28T17:43:02.359339] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-07. [2025-10-28T17:43:03.117572] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-28T17:43:03.159297] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-10. [2025-10-28T17:43:03.235545] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-28T17:43:03.959316] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-06. [2025-10-28T17:43:04.472279] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-28T17:43:04.641700] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-28T17:43:04.647547] [INFO ] [REMOTE ] BSM: Full fetch complete (46466 records). [2025-10-28T17:43:04.647632] [DEBUG] [VALIDATOR ] BSM: Validating primary data. [2025-10-28T17:43:04.764478] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-04. [2025-10-28T17:43:05.035882] [DEBUG] [VALIDATOR ] BSM: All expected trading days are present. [2025-10-28T17:43:05.035966] [DEBUG] [VALIDATOR ] BSM: Primary data validation passed. [2025-10-28T17:43:05.036540] [INFO ] [MAIN ] BSM: Fetched primary data is valid. [2025-10-28T17:43:05.036583] [DEBUG] [LOCAL ] BSM: Saving primary data. [2025-10-28T17:43:05.037686] [DEBUG] [LOCAL ] BSM: Trimmed 46466 records to 31800 (keeping 200 days of data) [2025-10-28T17:43:05.223330] [DEBUG] [LOCAL ] BSM: Primary data saved (31800 records). [2025-10-28T17:43:05.223459] [INFO ] [MAIN ] BSM: Full history saved. [2025-10-28T17:43:05.223527] [INFO ] [MAIN ] Update Progress: 346/2366 symbols completed. BSM took 36.1s. Estimated remaining: 4h 11m 15s. Rate: 8.0 symbols/min [2025-10-28T17:43:05.394699] [INFO ] [MAIN ] BTE: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:43:05.444158] [DEBUG] [LOCAL ] BTE: Loaded 52671 existing records from primary storage. [2025-10-28T17:43:05.444496] [INFO ] [MAIN ] BTE: Loaded 52671 existing records. [2025-10-28T17:43:05.564435] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-08. [2025-10-28T17:43:05.629322] [WARN ] [MAIN ] BTE: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:43:05.629550] [INFO ] [MAIN ] BTE: Wiping existing primary data before full refresh. [2025-10-28T17:43:05.629607] [INFO ] [LOCAL ] BTE: Starting deletion of primary data. [2025-10-28T17:43:05.630536] [DEBUG] [LOCAL ] BTE: Deleted primary data file. [2025-10-28T17:43:05.630596] [INFO ] [MAIN ] BTE: Starting full primary refresh. [2025-10-28T17:43:05.987701] [INFO ] [REMOTE ] BTE: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:43:06.197320] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-28T17:43:06.359308] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-05. [2025-10-28T17:43:06.395636] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-28T17:43:07.159395] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-07. [2025-10-28T17:43:07.725629] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-28T17:43:07.964340] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-08. [2025-10-28T17:43:07.972807] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-28T17:43:08.369758] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-10-28T17:43:08.759345] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-09. [2025-10-28T17:43:09.559951] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-09. [2025-10-28T17:43:09.563941] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-28T17:43:09.983817] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-10-28T17:43:10.359336] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-10. [2025-10-28T17:43:11.159341] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-01. [2025-10-28T17:43:11.256603] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-28T17:43:11.261831] [INFO ] [REMOTE ] BSTZ: Full fetch complete (36172 records). [2025-10-28T17:43:11.261922] [DEBUG] [VALIDATOR ] BSTZ: Validating primary data. [2025-10-28T17:43:11.626476] [DEBUG] [VALIDATOR ] BSTZ: All expected trading days are present. [2025-10-28T17:43:11.626547] [DEBUG] [VALIDATOR ] BSTZ: Primary data validation passed. [2025-10-28T17:43:11.627029] [INFO ] [MAIN ] BSTZ: Fetched primary data is valid. [2025-10-28T17:43:11.627091] [DEBUG] [LOCAL ] BSTZ: Saving primary data. [2025-10-28T17:43:11.627897] [DEBUG] [LOCAL ] BSTZ: Trimmed 36172 records to 24145 (keeping 200 days of data) [2025-10-28T17:43:11.772400] [DEBUG] [LOCAL ] BSTZ: Primary data saved (24145 records). [2025-10-28T17:43:11.772519] [INFO ] [MAIN ] BSTZ: Full history saved. [2025-10-28T17:43:11.772594] [INFO ] [MAIN ] Update Progress: 347/2366 symbols completed. BSTZ took 35.8s. Estimated remaining: 4h 11m 3s. Rate: 8.0 symbols/min [2025-10-28T17:43:11.952988] [INFO ] [MAIN ] BTI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:43:11.959369] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-10. [2025-10-28T17:43:11.999562] [DEBUG] [LOCAL ] BTI: Loaded 53583 existing records from primary storage. [2025-10-28T17:43:11.999887] [INFO ] [MAIN ] BTI: Loaded 53583 existing records. [2025-10-28T17:43:12.177306] [WARN ] [MAIN ] BTI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:43:12.177533] [INFO ] [MAIN ] BTI: Wiping existing primary data before full refresh. [2025-10-28T17:43:12.177596] [INFO ] [LOCAL ] BTI: Starting deletion of primary data. [2025-10-28T17:43:12.178494] [DEBUG] [LOCAL ] BTI: Deleted primary data file. [2025-10-28T17:43:12.178552] [INFO ] [MAIN ] BTI: Starting full primary refresh. [2025-10-28T17:43:12.569922] [INFO ] [REMOTE ] BTI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:43:12.662589] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-28T17:43:12.677297] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-28T17:43:12.680244] [INFO ] [REMOTE ] BTA: Full fetch complete (8972 records). [2025-10-28T17:43:12.680315] [DEBUG] [VALIDATOR ] BTA: Validating primary data. [2025-10-28T17:43:12.764513] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-06. [2025-10-28T17:43:13.034985] [DEBUG] [VALIDATOR ] BTA: All expected trading days are present. [2025-10-28T17:43:13.035058] [DEBUG] [VALIDATOR ] BTA: Primary data validation passed. [2025-10-28T17:43:13.035273] [INFO ] [MAIN ] BTA: Fetched primary data is valid. [2025-10-28T17:43:13.035309] [DEBUG] [LOCAL ] BTA: Saving primary data. [2025-10-28T17:43:13.035738] [DEBUG] [LOCAL ] BTA: Trimmed 8972 records to 5643 (keeping 200 days of data) [2025-10-28T17:43:13.069155] [DEBUG] [LOCAL ] BTA: Primary data saved (5643 records). [2025-10-28T17:43:13.069290] [INFO ] [MAIN ] BTA: Full history saved. [2025-10-28T17:43:13.069367] [INFO ] [MAIN ] Update Progress: 348/2366 symbols completed. BTA took 21.5s. Estimated remaining: 4h 10m 19s. Rate: 8.1 symbols/min [2025-10-28T17:43:13.240954] [INFO ] [MAIN ] BTO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:43:13.249721] [DEBUG] [LOCAL ] BTO: Loaded 8609 existing records from primary storage. [2025-10-28T17:43:13.249887] [INFO ] [MAIN ] BTO: Loaded 8609 existing records. [2025-10-28T17:43:13.423850] [WARN ] [MAIN ] BTO: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:43:13.424042] [INFO ] [MAIN ] BTO: Wiping existing primary data before full refresh. [2025-10-28T17:43:13.424089] [INFO ] [LOCAL ] BTO: Starting deletion of primary data. [2025-10-28T17:43:13.424334] [DEBUG] [LOCAL ] BTO: Deleted primary data file. [2025-10-28T17:43:13.424391] [INFO ] [MAIN ] BTO: Starting full primary refresh. [2025-10-28T17:43:13.569806] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-02. [2025-10-28T17:43:13.788750] [INFO ] [REMOTE ] BTO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:43:14.085444] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-28T17:43:14.359341] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-01. [2025-10-28T17:43:14.876579] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-28T17:43:15.028566] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-28T17:43:15.159368] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-03. [2025-10-28T17:43:15.959425] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-02. [2025-10-28T17:43:16.452119] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-28T17:43:16.747345] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-28T17:43:16.759295] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-03. [2025-10-28T17:43:17.256579] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-28T17:43:17.559342] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-04. [2025-10-28T17:43:18.045059] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-28T17:43:18.359332] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-01. [2025-10-28T17:43:19.159335] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-05. [2025-10-28T17:43:19.694211] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-28T17:43:19.959322] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-04. [2025-10-28T17:43:20.088008] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-28T17:43:20.759367] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-06. [2025-10-28T17:43:21.360040] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-28T17:43:21.377712] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-28T17:43:21.559359] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-07. [2025-10-28T17:43:22.085851] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-28T17:43:22.359371] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-05. [2025-10-28T17:43:23.159341] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-08. [2025-10-28T17:43:23.594893] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-28T17:43:23.747225] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-28T17:43:23.959340] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-09. [2025-10-28T17:43:24.452405] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-28T17:43:24.759385] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-07. [2025-10-28T17:43:25.559348] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-02. [2025-10-28T17:43:26.359361] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-10. [2025-10-28T17:43:26.830089] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-10-28T17:43:26.916574] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-28T17:43:27.159318] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-08. [2025-10-28T17:43:27.332594] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-28T17:43:27.335412] [INFO ] [REMOTE ] BTO: Full fetch complete (13289 records). [2025-10-28T17:43:27.335499] [DEBUG] [VALIDATOR ] BTO: Validating primary data. [2025-10-28T17:43:27.851145] [DEBUG] [VALIDATOR ] BTO: All expected trading days are present. [2025-10-28T17:43:27.851269] [DEBUG] [VALIDATOR ] BTO: Primary data validation passed. [2025-10-28T17:43:27.851994] [INFO ] [MAIN ] BTO: Fetched primary data is valid. [2025-10-28T17:43:27.852076] [DEBUG] [LOCAL ] BTO: Saving primary data. [2025-10-28T17:43:27.853025] [DEBUG] [LOCAL ] BTO: Trimmed 13289 records to 8608 (keeping 200 days of data) [2025-10-28T17:43:27.923915] [DEBUG] [LOCAL ] BTO: Primary data saved (8608 records). [2025-10-28T17:43:27.924092] [INFO ] [MAIN ] BTO: Full history saved. [2025-10-28T17:43:27.924204] [INFO ] [MAIN ] Update Progress: 349/2366 symbols completed. BTO took 14.9s. Estimated remaining: 4h 10m 55s. Rate: 8.0 symbols/min [2025-10-28T17:43:27.964598] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-06. [2025-10-28T17:43:28.199725] [INFO ] [MAIN ] BTT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:43:28.220465] [DEBUG] [LOCAL ] BTT: Loaded 15124 existing records from primary storage. [2025-10-28T17:43:28.220800] [INFO ] [MAIN ] BTT: Loaded 15124 existing records. [2025-10-28T17:43:28.412896] [WARN ] [MAIN ] BTT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:43:28.413162] [INFO ] [MAIN ] BTT: Wiping existing primary data before full refresh. [2025-10-28T17:43:28.413210] [INFO ] [LOCAL ] BTT: Starting deletion of primary data. [2025-10-28T17:43:28.413570] [DEBUG] [LOCAL ] BTT: Deleted primary data file. [2025-10-28T17:43:28.413628] [INFO ] [MAIN ] BTT: Starting full primary refresh. [2025-10-28T17:43:28.761357] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-03. [2025-10-28T17:43:28.800851] [INFO ] [REMOTE ] BTT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:43:28.833371] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-28T17:43:29.511807] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-28T17:43:29.559329] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-07. [2025-10-28T17:43:30.359355] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-09. [2025-10-28T17:43:30.709788] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-10-28T17:43:30.962779] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-28T17:43:31.159336] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-08. [2025-10-28T17:43:31.959306] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-01. [2025-10-28T17:43:31.993305] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-28T17:43:32.349871] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-28T17:43:32.728289] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-28T17:43:32.759297] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-02. [2025-10-28T17:43:33.361397] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-28T17:43:33.559340] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-03. [2025-10-28T17:43:34.202889] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-28T17:43:34.359352] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-09. [2025-10-28T17:43:35.159339] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-04. [2025-10-28T17:43:35.959341] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-10. [2025-10-28T17:43:36.019761] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-28T17:43:36.555250] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-28T17:43:36.567624] [INFO ] [REMOTE ] BSX: Full fetch complete (77865 records). [2025-10-28T17:43:36.567820] [DEBUG] [VALIDATOR ] BSX: Validating primary data. [2025-10-28T17:43:36.760932] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-04. [2025-10-28T17:43:37.029384] [DEBUG] [VALIDATOR ] BSX: All expected trading days are present. [2025-10-28T17:43:37.029492] [DEBUG] [VALIDATOR ] BSX: Primary data validation passed. [2025-10-28T17:43:37.030468] [INFO ] [MAIN ] BSX: Fetched primary data is valid. [2025-10-28T17:43:37.030554] [DEBUG] [LOCAL ] BSX: Saving primary data. [2025-10-28T17:43:37.032526] [DEBUG] [LOCAL ] BSX: Trimmed 77865 records to 53688 (keeping 200 days of data) [2025-10-28T17:43:37.162210] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-10-28T17:43:37.408756] [DEBUG] [LOCAL ] BSX: Primary data saved (53688 records). [2025-10-28T17:43:37.408906] [INFO ] [MAIN ] BSX: Full history saved. [2025-10-28T17:43:37.409009] [INFO ] [MAIN ] Update Progress: 350/2366 symbols completed. BSX took 46.3s. Estimated remaining: 4h 10m 59s. Rate: 8.0 symbols/min [2025-10-28T17:43:37.571275] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-10. [2025-10-28T17:43:37.590226] [INFO ] [MAIN ] BTU: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:43:37.633868] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-28T17:43:37.655354] [DEBUG] [LOCAL ] BTU: Loaded 53318 existing records from primary storage. [2025-10-28T17:43:37.655706] [INFO ] [MAIN ] BTU: Loaded 53318 existing records. [2025-10-28T17:43:37.844014] [WARN ] [MAIN ] BTU: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:43:37.844246] [INFO ] [MAIN ] BTU: Wiping existing primary data before full refresh. [2025-10-28T17:43:37.844295] [INFO ] [LOCAL ] BTU: Starting deletion of primary data. [2025-10-28T17:43:37.845204] [DEBUG] [LOCAL ] BTU: Deleted primary data file. [2025-10-28T17:43:37.845262] [INFO ] [MAIN ] BTU: Starting full primary refresh. [2025-10-28T17:43:38.217367] [INFO ] [REMOTE ] BTU: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:43:38.359346] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-05. [2025-10-28T17:43:39.018328] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-28T17:43:39.028778] [INFO ] [REMOTE ] BTE: Full fetch complete (76351 records). [2025-10-28T17:43:39.028895] [DEBUG] [VALIDATOR ] BTE: Validating primary data. [2025-10-28T17:43:39.165585] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-05. [2025-10-28T17:43:39.419535] [DEBUG] [VALIDATOR ] BTE: All expected trading days are present. [2025-10-28T17:43:39.419609] [DEBUG] [VALIDATOR ] BTE: Primary data validation passed. [2025-10-28T17:43:39.420402] [INFO ] [MAIN ] BTE: Fetched primary data is valid. [2025-10-28T17:43:39.420464] [DEBUG] [LOCAL ] BTE: Saving primary data. [2025-10-28T17:43:39.421861] [DEBUG] [LOCAL ] BTE: Trimmed 76351 records to 52665 (keeping 200 days of data) [2025-10-28T17:43:39.732243] [DEBUG] [LOCAL ] BTE: Primary data saved (52665 records). [2025-10-28T17:43:39.732358] [INFO ] [MAIN ] BTE: Full history saved. [2025-10-28T17:43:39.732872] [INFO ] [MAIN ] Update Progress: 351/2366 symbols completed. BTE took 34.5s. Estimated remaining: 4h 10m 22s. Rate: 8.0 symbols/min [2025-10-28T17:43:39.913518] [INFO ] [MAIN ] BTX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:43:39.914315] [DEBUG] [LOCAL ] BTX: No existing data file found in primary storage. [2025-10-28T17:43:39.914964] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-28T17:43:39.915199] [WARN ] [MAIN ] BTX: No existing data found, performing full refresh instead. [2025-10-28T17:43:39.918965] [INFO ] [MAIN ] BTX: Wiping existing primary data before full refresh. [2025-10-28T17:43:39.919228] [INFO ] [LOCAL ] BTX: Starting deletion of primary data. [2025-10-28T17:43:39.919546] [DEBUG] [LOCAL ] BTX: No primary data file found to delete. [2025-10-28T17:43:39.919895] [INFO ] [MAIN ] BTX: Starting full primary refresh. [2025-10-28T17:43:39.972718] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-01. [2025-10-28T17:43:40.236870] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-28T17:43:40.338156] [INFO ] [REMOTE ] BTX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:43:40.759348] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-06. [2025-10-28T17:43:41.427748] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-28T17:43:41.559303] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-07. [2025-10-28T17:43:41.677899] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-28T17:43:42.123335] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-28T17:43:42.359342] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-01. [2025-10-28T17:43:42.513088] [DEBUG] [REMOTE ] BTX: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-28T17:43:42.513409] [WARN ] [REMOTE ] BTX: No data returned for month 2025-01 [2025-10-28T17:43:42.513493] [FATAL] [REMOTE ] BTX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-28T17:43:42.513539] [FATAL] [MAIN ] BTX: Failed to fetch primary data. [2025-10-28T17:43:42.513571] [WARN ] [MAIN ] BTX: Deleting existing primary and derivative data due to fetch failure. [2025-10-28T17:43:42.513632] [INFO ] [LOCAL ] BTX: Starting deletion of primary data. [2025-10-28T17:43:42.513733] [DEBUG] [LOCAL ] BTX: No primary data file found to delete. [2025-10-28T17:43:42.513774] [INFO ] [LOCAL ] BTX: Starting deletion of derivative data. [2025-10-28T17:43:42.513813] [DEBUG] [LOCAL ] BTX: No derivative data file found to delete. [2025-10-28T17:43:42.513857] [INFO ] [MAIN ] Update Progress: 352/2366 symbols completed. BTX took 2.8s. Estimated remaining: 4h 9m 48s. Rate: 8.1 symbols/min [2025-10-28T17:43:42.707632] [INFO ] [MAIN ] BTZ: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:43:42.733001] [DEBUG] [LOCAL ] BTZ: Loaded 22002 existing records from primary storage. [2025-10-28T17:43:42.733270] [INFO ] [MAIN ] BTZ: Loaded 22002 existing records. [2025-10-28T17:43:42.909434] [WARN ] [MAIN ] BTZ: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:43:42.909665] [INFO ] [MAIN ] BTZ: Wiping existing primary data before full refresh. [2025-10-28T17:43:42.909723] [INFO ] [LOCAL ] BTZ: Starting deletion of primary data. [2025-10-28T17:43:42.910020] [DEBUG] [LOCAL ] BTZ: Deleted primary data file. [2025-10-28T17:43:42.910061] [INFO ] [MAIN ] BTZ: Starting full primary refresh. [2025-10-28T17:43:43.164556] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-06. [2025-10-28T17:43:43.262733] [INFO ] [REMOTE ] BTZ: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:43:43.959310] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-01. [2025-10-28T17:43:44.759301] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-02. [2025-10-28T17:43:44.857473] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-28T17:43:44.899855] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-28T17:43:45.559336] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-02. [2025-10-28T17:43:46.199967] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-28T17:43:46.274098] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-28T17:43:46.359309] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-03. [2025-10-28T17:43:47.090594] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-28T17:43:47.159354] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-07. [2025-10-28T17:43:47.959359] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-03. [2025-10-28T17:43:48.676599] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-28T17:43:48.759342] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-04. [2025-10-28T17:43:49.484087] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-28T17:43:49.562377] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-04. [2025-10-28T17:43:49.566453] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-28T17:43:50.359317] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-05. [2025-10-28T17:43:51.053333] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-28T17:43:51.083953] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-28T17:43:51.159307] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-05. [2025-10-28T17:43:51.959401] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-08. [2025-10-28T17:43:52.518902] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-28T17:43:52.627225] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-28T17:43:52.759353] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-08. [2025-10-28T17:43:53.559347] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-06. [2025-10-28T17:43:54.311385] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-28T17:43:54.345972] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-28T17:43:54.359386] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-09. [2025-10-28T17:43:55.092722] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-28T17:43:55.159309] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-10. [2025-10-28T17:43:55.794313] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-28T17:43:55.797524] [INFO ] [REMOTE ] BTT: Full fetch complete (22460 records). [2025-10-28T17:43:55.797601] [DEBUG] [VALIDATOR ] BTT: Validating primary data. [2025-10-28T17:43:55.973968] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-06. [2025-10-28T17:43:56.205613] [DEBUG] [VALIDATOR ] BTT: All expected trading days are present. [2025-10-28T17:43:56.205732] [DEBUG] [VALIDATOR ] BTT: Primary data validation passed. [2025-10-28T17:43:56.206187] [INFO ] [MAIN ] BTT: Fetched primary data is valid. [2025-10-28T17:43:56.206248] [DEBUG] [LOCAL ] BTT: Saving primary data. [2025-10-28T17:43:56.206864] [DEBUG] [LOCAL ] BTT: Trimmed 22460 records to 15008 (keeping 200 days of data) [2025-10-28T17:43:56.294038] [DEBUG] [LOCAL ] BTT: Primary data saved (15008 records). [2025-10-28T17:43:56.294161] [INFO ] [MAIN ] BTT: Full history saved. [2025-10-28T17:43:56.294237] [INFO ] [MAIN ] Update Progress: 353/2366 symbols completed. BTT took 28.4s. Estimated remaining: 4h 10m 17s. Rate: 8.0 symbols/min [2025-10-28T17:43:56.459490] [INFO ] [MAIN ] BUD: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:43:56.506502] [DEBUG] [LOCAL ] BUD: Loaded 52580 existing records from primary storage. [2025-10-28T17:43:56.506887] [INFO ] [MAIN ] BUD: Loaded 52580 existing records. [2025-10-28T17:43:56.687507] [WARN ] [MAIN ] BUD: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:43:56.687770] [INFO ] [MAIN ] BUD: Wiping existing primary data before full refresh. [2025-10-28T17:43:56.687832] [INFO ] [LOCAL ] BUD: Starting deletion of primary data. [2025-10-28T17:43:56.688192] [DEBUG] [LOCAL ] BUD: Deleted primary data file. [2025-10-28T17:43:56.688237] [INFO ] [MAIN ] BUD: Starting full primary refresh. [2025-10-28T17:43:56.764456] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-07. [2025-10-28T17:43:57.046861] [INFO ] [REMOTE ] BUD: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:43:57.258525] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-28T17:43:57.559301] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-01. [2025-10-28T17:43:57.581189] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-28T17:43:58.359349] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-07. [2025-10-28T17:43:58.951303] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-28T17:43:59.159355] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-02. [2025-10-28T17:43:59.813443] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-28T17:43:59.959360] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-08. [2025-10-28T17:44:00.595132] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-28T17:44:00.648222] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-28T17:44:00.759346] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-03. [2025-10-28T17:44:01.559352] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-09. [2025-10-28T17:44:02.359384] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-09. [2025-10-28T17:44:02.661014] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-28T17:44:02.796385] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-28T17:44:03.159327] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-04. [2025-10-28T17:44:03.952069] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-28T17:44:03.962810] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-08. [2025-10-28T17:44:04.759329] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-10. [2025-10-28T17:44:04.860324] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-10-28T17:44:05.517153] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-28T17:44:05.559378] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-10. [2025-10-28T17:44:06.359389] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-05. [2025-10-28T17:44:06.480292] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-28T17:44:06.487614] [INFO ] [REMOTE ] BTZ: Full fetch complete (33208 records). [2025-10-28T17:44:06.487947] [DEBUG] [VALIDATOR ] BTZ: Validating primary data. [2025-10-28T17:44:06.846473] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-10 (2.09 seconds). [2025-10-28T17:44:06.884545] [INFO ] [REMOTE ] BTI: Full fetch complete (77660 records). [2025-10-28T17:44:06.937541] [DEBUG] [VALIDATOR ] BTI: Validating primary data. [2025-10-28T17:44:07.028431] [DEBUG] [VALIDATOR ] BTZ: All expected trading days are present. [2025-10-28T17:44:07.050876] [DEBUG] [VALIDATOR ] BTZ: Primary data validation passed. [2025-10-28T17:44:07.076874] [INFO ] [MAIN ] BTZ: Fetched primary data is valid. [2025-10-28T17:44:07.082931] [DEBUG] [LOCAL ] BTZ: Saving primary data. [2025-10-28T17:44:07.138176] [DEBUG] [LOCAL ] BTZ: Trimmed 33208 records to 21866 (keeping 200 days of data) [2025-10-28T17:44:07.174577] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-09. [2025-10-28T17:44:07.492008] [DEBUG] [VALIDATOR ] BTI: All expected trading days are present. [2025-10-28T17:44:07.492512] [DEBUG] [VALIDATOR ] BTI: Primary data validation passed. [2025-10-28T17:44:07.493517] [INFO ] [MAIN ] BTI: Fetched primary data is valid. [2025-10-28T17:44:07.493873] [DEBUG] [LOCAL ] BTI: Saving primary data. [2025-10-28T17:44:07.506867] [DEBUG] [LOCAL ] BTI: Trimmed 77660 records to 53583 (keeping 200 days of data) [2025-10-28T17:44:07.579636] [DEBUG] [LOCAL ] BTZ: Primary data saved (21866 records). [2025-10-28T17:44:07.588210] [INFO ] [MAIN ] BTZ: Full history saved. [2025-10-28T17:44:07.588829] [INFO ] [MAIN ] Update Progress: 354/2366 symbols completed. BTZ took 25.1s. Estimated remaining: 4h 10m 31s. Rate: 8.0 symbols/min [2025-10-28T17:44:07.815789] [INFO ] [MAIN ] BUI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:44:07.963591] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-28T17:44:07.953796] [DEBUG] [LOCAL ] BUI: Loaded 11639 existing records from primary storage. [2025-10-28T17:44:07.984117] [INFO ] [MAIN ] BUI: Loaded 11639 existing records. [2025-10-28T17:44:07.983904] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-06. [2025-10-28T17:44:08.279951] [WARN ] [MAIN ] BUI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:44:08.281508] [INFO ] [MAIN ] BUI: Wiping existing primary data before full refresh. [2025-10-28T17:44:08.281910] [INFO ] [LOCAL ] BUI: Starting deletion of primary data. [2025-10-28T17:44:08.283383] [DEBUG] [LOCAL ] BUI: Deleted primary data file. [2025-10-28T17:44:08.284030] [INFO ] [MAIN ] BUI: Starting full primary refresh. [2025-10-28T17:44:08.375842] [DEBUG] [LOCAL ] BTI: Primary data saved (53583 records). [2025-10-28T17:44:08.394384] [INFO ] [MAIN ] BTI: Full history saved. [2025-10-28T17:44:08.396826] [INFO ] [MAIN ] Update Progress: 355/2366 symbols completed. BTI took 56.6s. Estimated remaining: 4h 9m 46s. Rate: 8.1 symbols/min [2025-10-28T17:44:08.733855] [INFO ] [MAIN ] BUR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:44:08.861910] [INFO ] [REMOTE ] BUI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:44:08.862408] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-01. [2025-10-28T17:44:08.900981] [DEBUG] [LOCAL ] BUR: Loaded 45425 existing records from primary storage. [2025-10-28T17:44:08.901321] [INFO ] [MAIN ] BUR: Loaded 45425 existing records. [2025-10-28T17:44:09.111566] [WARN ] [MAIN ] BUR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:44:09.114981] [INFO ] [MAIN ] BUR: Wiping existing primary data before full refresh. [2025-10-28T17:44:09.115281] [INFO ] [LOCAL ] BUR: Starting deletion of primary data. [2025-10-28T17:44:09.117015] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-28T17:44:09.127803] [DEBUG] [LOCAL ] BUR: Deleted primary data file. [2025-10-28T17:44:09.128457] [INFO ] [MAIN ] BUR: Starting full primary refresh. [2025-10-28T17:44:09.528776] [INFO ] [REMOTE ] BUR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:44:09.537504] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-28T17:44:09.559313] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-02. [2025-10-28T17:44:09.663300] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-28T17:44:10.126356] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-28T17:44:10.359344] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-10. [2025-10-28T17:44:11.159306] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-07. [2025-10-28T17:44:11.959312] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-03. [2025-10-28T17:44:12.096450] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-28T17:44:12.107164] [INFO ] [REMOTE ] BTU: Full fetch complete (77304 records). [2025-10-28T17:44:12.107297] [DEBUG] [VALIDATOR ] BTU: Validating primary data. [2025-10-28T17:44:12.528597] [DEBUG] [VALIDATOR ] BTU: All expected trading days are present. [2025-10-28T17:44:12.529023] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-28T17:44:12.529154] [DEBUG] [VALIDATOR ] BTU: Primary data validation passed. [2025-10-28T17:44:12.530103] [INFO ] [MAIN ] BTU: Fetched primary data is valid. [2025-10-28T17:44:12.532706] [DEBUG] [LOCAL ] BTU: Saving primary data. [2025-10-28T17:44:12.534771] [DEBUG] [LOCAL ] BTU: Trimmed 77304 records to 53318 (keeping 200 days of data) [2025-10-28T17:44:12.773002] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-28T17:44:12.771132] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-04. [2025-10-28T17:44:12.894034] [DEBUG] [LOCAL ] BTU: Primary data saved (53318 records). [2025-10-28T17:44:12.894156] [INFO ] [MAIN ] BTU: Full history saved. [2025-10-28T17:44:12.894230] [INFO ] [MAIN ] Update Progress: 356/2366 symbols completed. BTU took 35.5s. Estimated remaining: 4h 9m 22s. Rate: 8.1 symbols/min [2025-10-28T17:44:13.065230] [INFO ] [MAIN ] BURL: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:44:13.108683] [DEBUG] [LOCAL ] BURL: Loaded 45188 existing records from primary storage. [2025-10-28T17:44:13.109007] [INFO ] [MAIN ] BURL: Loaded 45188 existing records. [2025-10-28T17:44:13.291888] [WARN ] [MAIN ] BURL: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:44:13.292275] [INFO ] [MAIN ] BURL: Wiping existing primary data before full refresh. [2025-10-28T17:44:13.292396] [INFO ] [LOCAL ] BURL: Starting deletion of primary data. [2025-10-28T17:44:13.292949] [DEBUG] [LOCAL ] BURL: Deleted primary data file. [2025-10-28T17:44:13.293008] [INFO ] [MAIN ] BURL: Starting full primary refresh. [2025-10-28T17:44:13.410171] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-28T17:44:13.564444] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-01. [2025-10-28T17:44:13.694692] [INFO ] [REMOTE ] BURL: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:44:14.359364] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-01. [2025-10-28T17:44:14.881434] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-28T17:44:15.159438] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-08. [2025-10-28T17:44:15.570612] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-28T17:44:15.959354] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-05. [2025-10-28T17:44:16.454524] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-28T17:44:16.663791] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-28T17:44:16.759396] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-06. [2025-10-28T17:44:17.297549] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-28T17:44:17.559376] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-09. [2025-10-28T17:44:18.359416] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-02. [2025-10-28T17:44:18.872744] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-28T17:44:19.159350] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-10. [2025-10-28T17:44:19.358585] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-28T17:44:19.959420] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-02. [2025-10-28T17:44:20.759339] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-03. [2025-10-28T17:44:20.953474] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-28T17:44:20.965147] [INFO ] [REMOTE ] BUD: Full fetch complete (76479 records). [2025-10-28T17:44:20.965271] [DEBUG] [VALIDATOR ] BUD: Validating primary data. [2025-10-28T17:44:21.402471] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-28T17:44:21.457515] [DEBUG] [VALIDATOR ] BUD: All expected trading days are present. [2025-10-28T17:44:21.457603] [DEBUG] [VALIDATOR ] BUD: Primary data validation passed. [2025-10-28T17:44:21.458506] [INFO ] [MAIN ] BUD: Fetched primary data is valid. [2025-10-28T17:44:21.458590] [DEBUG] [LOCAL ] BUD: Saving primary data. [2025-10-28T17:44:21.460033] [DEBUG] [LOCAL ] BUD: Trimmed 76479 records to 52576 (keeping 200 days of data) [2025-10-28T17:44:21.565855] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-03. [2025-10-28T17:44:21.769591] [DEBUG] [LOCAL ] BUD: Primary data saved (52576 records). [2025-10-28T17:44:21.769782] [INFO ] [MAIN ] BUD: Full history saved. [2025-10-28T17:44:21.769869] [INFO ] [MAIN ] Update Progress: 357/2366 symbols completed. BUD took 25.5s. Estimated remaining: 4h 9m 22s. Rate: 8.1 symbols/min [2025-10-28T17:44:21.892709] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-28T17:44:22.359430] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-04. [2025-10-28T17:44:22.906367] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-28T17:44:23.159461] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-07. [2025-10-28T17:44:23.323693] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-28T17:44:23.898234] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-28T17:44:23.959345] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-05. [2025-10-28T17:44:24.759305] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-04. [2025-10-28T17:44:25.276997] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-28T17:44:25.559411] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-08. [2025-10-28T17:44:26.162263] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-28T17:44:26.251746] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-28T17:44:26.359331] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-09. [2025-10-28T17:44:26.919454] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-28T17:44:27.159323] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-06. [2025-10-28T17:44:27.959389] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-05. [2025-10-28T17:44:28.556145] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-28T17:44:28.759374] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-07. [2025-10-28T17:44:29.235132] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-28T17:44:29.559395] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-10. [2025-10-28T17:44:30.016052] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-28T17:44:30.155246] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-28T17:44:30.158170] [INFO ] [REMOTE ] BUI: Full fetch complete (16461 records). [2025-10-28T17:44:30.158277] [DEBUG] [VALIDATOR ] BUI: Validating primary data. [2025-10-28T17:44:30.366866] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-08. [2025-10-28T17:44:30.521897] [DEBUG] [VALIDATOR ] BUI: All expected trading days are present. [2025-10-28T17:44:30.521977] [DEBUG] [VALIDATOR ] BUI: Primary data validation passed. [2025-10-28T17:44:30.522352] [INFO ] [MAIN ] BUI: Fetched primary data is valid. [2025-10-28T17:44:30.522391] [DEBUG] [LOCAL ] BUI: Saving primary data. [2025-10-28T17:44:30.522950] [DEBUG] [LOCAL ] BUI: Trimmed 16461 records to 11546 (keeping 200 days of data) [2025-10-28T17:44:30.593571] [DEBUG] [LOCAL ] BUI: Primary data saved (11546 records). [2025-10-28T17:44:30.593741] [INFO ] [MAIN ] BUI: Full history saved. [2025-10-28T17:44:30.593828] [INFO ] [MAIN ] Update Progress: 358/2366 symbols completed. BUI took 23.0s. Estimated remaining: 4h 9m 22s. Rate: 8.1 symbols/min [2025-10-28T17:44:31.159423] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-06. [2025-10-28T17:44:31.653873] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-28T17:44:31.959429] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-09. [2025-10-28T17:44:32.294281] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-28T17:44:32.759390] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-07. [2025-10-28T17:44:33.136359] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-28T17:44:33.559334] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-10. [2025-10-28T17:44:34.016829] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-28T17:44:34.359388] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-08. [2025-10-28T17:44:34.922105] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-28T17:44:34.933542] [INFO ] [REMOTE ] BUR: Full fetch complete (64767 records). [2025-10-28T17:44:34.933762] [DEBUG] [VALIDATOR ] BUR: Validating primary data. [2025-10-28T17:44:35.364913] [DEBUG] [VALIDATOR ] BUR: All expected trading days are present. [2025-10-28T17:44:35.364991] [DEBUG] [VALIDATOR ] BUR: Primary data validation passed. [2025-10-28T17:44:35.365759] [INFO ] [MAIN ] BUR: Fetched primary data is valid. [2025-10-28T17:44:35.365838] [DEBUG] [LOCAL ] BUR: Saving primary data. [2025-10-28T17:44:35.367099] [DEBUG] [LOCAL ] BUR: Trimmed 64767 records to 45403 (keeping 200 days of data) [2025-10-28T17:44:35.659460] [DEBUG] [LOCAL ] BUR: Primary data saved (45403 records). [2025-10-28T17:44:35.660947] [INFO ] [MAIN ] BUR: Full history saved. [2025-10-28T17:44:35.661111] [INFO ] [MAIN ] Update Progress: 359/2366 symbols completed. BUR took 27.3s. Estimated remaining: 4h 9m 2s. Rate: 8.1 symbols/min [2025-10-28T17:44:35.660824] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-28T17:44:35.671204] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-09. [2025-10-28T17:44:36.833588] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-28T17:44:36.844012] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-10. [2025-10-28T17:44:38.297756] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-28T17:44:38.306472] [INFO ] [REMOTE ] BURL: Full fetch complete (65623 records). [2025-10-28T17:44:38.306612] [DEBUG] [VALIDATOR ] BURL: Validating primary data. [2025-10-28T17:44:38.692991] [DEBUG] [VALIDATOR ] BURL: All expected trading days are present. [2025-10-28T17:44:38.693069] [DEBUG] [VALIDATOR ] BURL: Primary data validation passed. [2025-10-28T17:44:38.693783] [INFO ] [MAIN ] BURL: Fetched primary data is valid. [2025-10-28T17:44:38.693846] [DEBUG] [LOCAL ] BURL: Saving primary data. [2025-10-28T17:44:38.695072] [DEBUG] [LOCAL ] BURL: Trimmed 65623 records to 45055 (keeping 200 days of data) [2025-10-28T17:44:38.988608] [DEBUG] [LOCAL ] BURL: Primary data saved (45055 records). [2025-10-28T17:44:38.988771] [INFO ] [MAIN ] BURL: Full history saved. [2025-10-28T17:44:38.988858] [INFO ] [MAIN ] Update Progress: 360/2366 symbols completed. BURL took 26.1s. Estimated remaining: 4h 8m 31s. Rate: 8.1 symbols/min [2025-10-28T17:44:39.715801] [INFO ] [MAIN ] BW: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:44:39.728297] [INFO ] [MAIN ] BUXX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:44:39.734910] [DEBUG] [LOCAL ] BUXX: No existing data file found in primary storage. [2025-10-28T17:44:39.755871] [WARN ] [MAIN ] BUXX: No existing data found, performing full refresh instead. [2025-10-28T17:44:39.791544] [INFO ] [MAIN ] BUXX: Wiping existing primary data before full refresh. [2025-10-28T17:44:39.792602] [INFO ] [MAIN ] BVN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:44:39.808288] [DEBUG] [LOCAL ] BVN: No existing data file found in primary storage. [2025-10-28T17:44:39.808162] [INFO ] [LOCAL ] BUXX: Starting deletion of primary data. [2025-10-28T17:44:39.810310] [WARN ] [MAIN ] BVN: No existing data found, performing full refresh instead. [2025-10-28T17:44:39.810581] [DEBUG] [LOCAL ] BUXX: No primary data file found to delete. [2025-10-28T17:44:39.811757] [INFO ] [MAIN ] BUXX: Starting full primary refresh. [2025-10-28T17:44:39.811700] [INFO ] [MAIN ] BVN: Wiping existing primary data before full refresh. [2025-10-28T17:44:39.811907] [INFO ] [LOCAL ] BVN: Starting deletion of primary data. [2025-10-28T17:44:39.824726] [INFO ] [MAIN ] BV: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:44:39.824968] [DEBUG] [LOCAL ] BV: No existing data file found in primary storage. [2025-10-28T17:44:39.825071] [WARN ] [MAIN ] BV: No existing data found, performing full refresh instead. [2025-10-28T17:44:39.850754] [INFO ] [MAIN ] BV: Wiping existing primary data before full refresh. [2025-10-28T17:44:39.850410] [DEBUG] [LOCAL ] BVN: No primary data file found to delete. [2025-10-28T17:44:39.866544] [INFO ] [MAIN ] BVN: Starting full primary refresh. [2025-10-28T17:44:39.874556] [INFO ] [LOCAL ] BV: Starting deletion of primary data. [2025-10-28T17:44:39.975805] [DEBUG] [LOCAL ] BV: No primary data file found to delete. [2025-10-28T17:44:40.009487] [INFO ] [MAIN ] BV: Starting full primary refresh. [2025-10-28T17:44:40.214150] [DEBUG] [LOCAL ] BW: Loaded 40358 existing records from primary storage. [2025-10-28T17:44:40.279055] [INFO ] [MAIN ] BW: Loaded 40358 existing records. [2025-10-28T17:44:41.033385] [INFO ] [REMOTE ] BUXX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:44:41.024439] [WARN ] [MAIN ] BW: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:44:41.061622] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-01. [2025-10-28T17:44:41.061833] [INFO ] [MAIN ] BW: Wiping existing primary data before full refresh. [2025-10-28T17:44:41.080046] [INFO ] [LOCAL ] BW: Starting deletion of primary data. [2025-10-28T17:44:41.143236] [DEBUG] [LOCAL ] BW: Deleted primary data file. [2025-10-28T17:44:41.156920] [INFO ] [MAIN ] BW: Starting full primary refresh. [2025-10-28T17:44:41.244303] [INFO ] [REMOTE ] BV: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:44:41.300522] [INFO ] [REMOTE ] BVN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:44:41.321584] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-01. [2025-10-28T17:44:41.334015] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-01. [2025-10-28T17:44:41.606382] [INFO ] [REMOTE ] BW: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:44:41.606724] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-01. [2025-10-28T17:44:41.787622] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-28T17:44:41.790385] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-02. [2025-10-28T17:44:42.264887] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-28T17:44:42.267561] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-03. [2025-10-28T17:44:42.318585] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-28T17:44:42.324533] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-02. [2025-10-28T17:44:42.542694] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-28T17:44:42.551018] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-02. [2025-10-28T17:44:42.695909] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-28T17:44:42.812100] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-28T17:44:43.159337] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-02. [2025-10-28T17:44:43.396482] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-28T17:44:43.503497] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-28T17:44:43.959351] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-04. [2025-10-28T17:44:44.167053] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-28T17:44:44.675930] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-28T17:44:44.759332] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-03. [2025-10-28T17:44:45.559336] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-05. [2025-10-28T17:44:45.848260] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-28T17:44:46.163824] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-28T17:44:46.359347] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-04. [2025-10-28T17:44:47.159399] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-03. [2025-10-28T17:44:47.637269] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-28T17:44:47.959387] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-05. [2025-10-28T17:44:48.118124] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-28T17:44:48.759358] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-04. [2025-10-28T17:44:49.009256] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-28T17:44:49.559379] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-03. [2025-10-28T17:44:49.936458] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-28T17:44:50.359337] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-05. [2025-10-28T17:44:50.525224] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-28T17:44:51.159328] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-04. [2025-10-28T17:44:51.514210] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-28T17:44:51.959315] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-06. [2025-10-28T17:44:52.449153] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-28T17:44:52.759343] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-06. [2025-10-28T17:44:53.026875] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-28T17:44:53.448176] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-28T17:44:53.559293] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-07. [2025-10-28T17:44:54.208491] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-28T17:44:54.359341] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-07. [2025-10-28T17:44:55.159371] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-08. [2025-10-28T17:44:55.400029] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-28T17:44:55.565486] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-10-28T17:44:55.959347] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-08. [2025-10-28T17:44:56.759358] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-09. [2025-10-28T17:44:56.926679] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-28T17:44:57.341477] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-28T17:44:57.559334] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-10. [2025-10-28T17:44:58.366005] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-09. [2025-10-28T17:44:58.367771] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-28T17:44:58.371146] [INFO ] [REMOTE ] BUXX: Full fetch complete (20776 records). [2025-10-28T17:44:58.371215] [DEBUG] [VALIDATOR ] BUXX: Validating primary data. [2025-10-28T17:44:58.730396] [DEBUG] [VALIDATOR ] BUXX: All expected trading days are present. [2025-10-28T17:44:58.730465] [DEBUG] [VALIDATOR ] BUXX: Primary data validation passed. [2025-10-28T17:44:58.730795] [INFO ] [MAIN ] BUXX: Fetched primary data is valid. [2025-10-28T17:44:58.730855] [DEBUG] [LOCAL ] BUXX: Saving primary data. [2025-10-28T17:44:58.731407] [DEBUG] [LOCAL ] BUXX: Trimmed 20776 records to 15150 (keeping 200 days of data) [2025-10-28T17:44:58.818496] [DEBUG] [LOCAL ] BUXX: Primary data saved (15150 records). [2025-10-28T17:44:58.818616] [INFO ] [MAIN ] BUXX: Full history saved. [2025-10-28T17:44:58.818711] [INFO ] [MAIN ] Update Progress: 361/2366 symbols completed. BUXX took 19.8s. Estimated remaining: 4h 9m 33s. Rate: 8.0 symbols/min [2025-10-28T17:44:58.982463] [INFO ] [MAIN ] BWA: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:44:59.029009] [DEBUG] [LOCAL ] BWA: Loaded 52031 existing records from primary storage. [2025-10-28T17:44:59.029291] [INFO ] [MAIN ] BWA: Loaded 52031 existing records. [2025-10-28T17:44:59.166628] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-06. [2025-10-28T17:44:59.206211] [WARN ] [MAIN ] BWA: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:44:59.206360] [INFO ] [MAIN ] BWA: Wiping existing primary data before full refresh. [2025-10-28T17:44:59.206420] [INFO ] [LOCAL ] BWA: Starting deletion of primary data. [2025-10-28T17:44:59.206905] [DEBUG] [LOCAL ] BWA: Deleted primary data file. [2025-10-28T17:44:59.206965] [INFO ] [MAIN ] BWA: Starting full primary refresh. [2025-10-28T17:44:59.556929] [INFO ] [REMOTE ] BWA: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:44:59.700730] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-28T17:44:59.959302] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-01. [2025-10-28T17:45:00.131530] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-28T17:45:00.759387] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-10. [2025-10-28T17:45:01.559325] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-05. [2025-10-28T17:45:01.599257] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-28T17:45:02.359348] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-07. [2025-10-28T17:45:02.609698] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-28T17:45:02.619543] [INFO ] [REMOTE ] BVN: Full fetch complete (63798 records). [2025-10-28T17:45:02.619683] [DEBUG] [VALIDATOR ] BVN: Validating primary data. [2025-10-28T17:45:03.002113] [DEBUG] [VALIDATOR ] BVN: All expected trading days are present. [2025-10-28T17:45:03.002246] [DEBUG] [VALIDATOR ] BVN: Primary data validation passed. [2025-10-28T17:45:03.003002] [INFO ] [MAIN ] BVN: Fetched primary data is valid. [2025-10-28T17:45:03.003092] [DEBUG] [LOCAL ] BVN: Saving primary data. [2025-10-28T17:45:03.022077] [DEBUG] [LOCAL ] BVN: Trimmed 63798 records to 44573 (keeping 200 days of data) [2025-10-28T17:45:03.023581] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-28T17:45:03.189548] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-06. [2025-10-28T17:45:03.285027] [DEBUG] [LOCAL ] BVN: Primary data saved (44573 records). [2025-10-28T17:45:03.285141] [INFO ] [MAIN ] BVN: Full history saved. [2025-10-28T17:45:03.285206] [INFO ] [MAIN ] Update Progress: 362/2366 symbols completed. BVN took 24.3s. Estimated remaining: 4h 9m 9s. Rate: 8.0 symbols/min [2025-10-28T17:45:03.457679] [INFO ] [MAIN ] BWG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:45:03.480529] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-28T17:45:03.497753] [DEBUG] [LOCAL ] BWG: Loaded 12426 existing records from primary storage. [2025-10-28T17:45:03.497962] [INFO ] [MAIN ] BWG: Loaded 12426 existing records. [2025-10-28T17:45:03.674078] [WARN ] [MAIN ] BWG: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:45:03.674290] [INFO ] [MAIN ] BWG: Wiping existing primary data before full refresh. [2025-10-28T17:45:03.674341] [INFO ] [LOCAL ] BWG: Starting deletion of primary data. [2025-10-28T17:45:03.674481] [DEBUG] [LOCAL ] BWG: Deleted primary data file. [2025-10-28T17:45:03.674518] [INFO ] [MAIN ] BWG: Starting full primary refresh. [2025-10-28T17:45:03.964500] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-08. [2025-10-28T17:45:04.025544] [INFO ] [REMOTE ] BWG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:45:04.335812] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-28T17:45:04.759381] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-01. [2025-10-28T17:45:05.053481] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-28T17:45:05.514340] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-28T17:45:05.559296] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-07. [2025-10-28T17:45:06.359334] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-02. [2025-10-28T17:45:06.424248] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-28T17:45:06.970140] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-28T17:45:07.159445] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-03. [2025-10-28T17:45:07.775983] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-28T17:45:07.959378] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-08. [2025-10-28T17:45:08.759342] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-09. [2025-10-28T17:45:09.118529] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-28T17:45:09.559341] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-02. [2025-10-28T17:45:09.824399] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-28T17:45:10.359359] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-10. [2025-10-28T17:45:10.814722] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-28T17:45:11.159341] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-03. [2025-10-28T17:45:11.646564] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-28T17:45:11.655801] [INFO ] [REMOTE ] BV: Full fetch complete (55171 records). [2025-10-28T17:45:11.656006] [DEBUG] [VALIDATOR ] BV: Validating primary data. [2025-10-28T17:45:11.964488] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-04. [2025-10-28T17:45:12.094017] [DEBUG] [VALIDATOR ] BV: All expected trading days are present. [2025-10-28T17:45:12.094101] [DEBUG] [VALIDATOR ] BV: Primary data validation passed. [2025-10-28T17:45:12.094840] [INFO ] [MAIN ] BV: Fetched primary data is valid. [2025-10-28T17:45:12.094906] [DEBUG] [LOCAL ] BV: Saving primary data. [2025-10-28T17:45:12.096156] [DEBUG] [LOCAL ] BV: Trimmed 55171 records to 38278 (keeping 200 days of data) [2025-10-28T17:45:12.318730] [DEBUG] [LOCAL ] BV: Primary data saved (38278 records). [2025-10-28T17:45:12.318902] [INFO ] [MAIN ] BV: Full history saved. [2025-10-28T17:45:12.318983] [INFO ] [MAIN ] Update Progress: 363/2366 symbols completed. BV took 33.3s. Estimated remaining: 4h 9m 10s. Rate: 8.0 symbols/min [2025-10-28T17:45:12.495937] [INFO ] [MAIN ] BWLP: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:45:12.496123] [DEBUG] [LOCAL ] BWLP: No existing data file found in primary storage. [2025-10-28T17:45:12.496184] [WARN ] [MAIN ] BWLP: No existing data found, performing full refresh instead. [2025-10-28T17:45:12.496294] [INFO ] [MAIN ] BWLP: Wiping existing primary data before full refresh. [2025-10-28T17:45:12.496336] [INFO ] [LOCAL ] BWLP: Starting deletion of primary data. [2025-10-28T17:45:12.496378] [DEBUG] [LOCAL ] BWLP: No primary data file found to delete. [2025-10-28T17:45:12.496410] [INFO ] [MAIN ] BWLP: Starting full primary refresh. [2025-10-28T17:45:12.630063] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-28T17:45:12.762979] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-05. [2025-10-28T17:45:12.880870] [INFO ] [REMOTE ] BWLP: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:45:12.958840] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-28T17:45:13.373299] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-28T17:45:13.559312] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-09. [2025-10-28T17:45:14.359344] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-06. [2025-10-28T17:45:14.788580] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-10-28T17:45:14.978420] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-28T17:45:15.159421] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-07. [2025-10-28T17:45:15.903356] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-28T17:45:15.959357] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-01. [2025-10-28T17:45:16.759404] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-10. [2025-10-28T17:45:17.047331] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-28T17:45:17.560698] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-04. [2025-10-28T17:45:18.199076] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-28T17:45:18.209173] [INFO ] [REMOTE ] BW: Full fetch complete (59298 records). [2025-10-28T17:45:18.209345] [DEBUG] [VALIDATOR ] BW: Validating primary data. [2025-10-28T17:45:18.368296] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-08. [2025-10-28T17:45:18.608799] [DEBUG] [VALIDATOR ] BW: All expected trading days are present. [2025-10-28T17:45:18.608920] [DEBUG] [VALIDATOR ] BW: Primary data validation passed. [2025-10-28T17:45:18.609600] [INFO ] [MAIN ] BW: Fetched primary data is valid. [2025-10-28T17:45:18.609670] [DEBUG] [LOCAL ] BW: Saving primary data. [2025-10-28T17:45:18.610963] [DEBUG] [LOCAL ] BW: Trimmed 59298 records to 40394 (keeping 200 days of data) [2025-10-28T17:45:18.834738] [DEBUG] [LOCAL ] BW: Primary data saved (40394 records). [2025-10-28T17:45:18.835437] [INFO ] [MAIN ] BW: Full history saved. [2025-10-28T17:45:18.835621] [INFO ] [MAIN ] Update Progress: 364/2366 symbols completed. BW took 39.8s. Estimated remaining: 4h 8m 57s. Rate: 8.0 symbols/min [2025-10-28T17:45:18.978522] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-28T17:45:19.023826] [INFO ] [MAIN ] BWMX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:45:19.036448] [DEBUG] [LOCAL ] BWMX: Loaded 7931 existing records from primary storage. [2025-10-28T17:45:19.036614] [INFO ] [MAIN ] BWMX: Loaded 7931 existing records. [2025-10-28T17:45:19.172663] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-02. [2025-10-28T17:45:19.246979] [WARN ] [MAIN ] BWMX: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:45:19.247560] [INFO ] [MAIN ] BWMX: Wiping existing primary data before full refresh. [2025-10-28T17:45:19.247824] [INFO ] [LOCAL ] BWMX: Starting deletion of primary data. [2025-10-28T17:45:19.250739] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-28T17:45:19.261061] [DEBUG] [LOCAL ] BWMX: Deleted primary data file. [2025-10-28T17:45:19.261152] [INFO ] [MAIN ] BWMX: Starting full primary refresh. [2025-10-28T17:45:19.607243] [INFO ] [REMOTE ] BWMX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:45:19.959316] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-01. [2025-10-28T17:45:20.321897] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-28T17:45:20.431336] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-28T17:45:20.759356] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-03. [2025-10-28T17:45:21.559349] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-02. [2025-10-28T17:45:21.824741] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-28T17:45:21.954469] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-28T17:45:22.359369] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-04. [2025-10-28T17:45:23.159316] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-03. [2025-10-28T17:45:23.280404] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-28T17:45:23.520337] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-10-28T17:45:23.959412] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-04. [2025-10-28T17:45:24.435817] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-28T17:45:24.759424] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-09. [2025-10-28T17:45:25.463987] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-28T17:45:25.559353] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-05. [2025-10-28T17:45:25.964659] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-10-28T17:45:26.359366] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-10. [2025-10-28T17:45:27.022001] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-28T17:45:27.024323] [INFO ] [REMOTE ] BWG: Full fetch complete (17548 records). [2025-10-28T17:45:27.024415] [DEBUG] [VALIDATOR ] BWG: Validating primary data. [2025-10-28T17:45:27.164571] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-05. [2025-10-28T17:45:27.389394] [DEBUG] [VALIDATOR ] BWG: All expected trading days are present. [2025-10-28T17:45:27.389470] [DEBUG] [VALIDATOR ] BWG: Primary data validation passed. [2025-10-28T17:45:27.389847] [INFO ] [MAIN ] BWG: Fetched primary data is valid. [2025-10-28T17:45:27.389908] [DEBUG] [LOCAL ] BWG: Saving primary data. [2025-10-28T17:45:27.390487] [DEBUG] [LOCAL ] BWG: Trimmed 17548 records to 12358 (keeping 200 days of data) [2025-10-28T17:45:27.463595] [DEBUG] [LOCAL ] BWG: Primary data saved (12358 records). [2025-10-28T17:45:27.463753] [INFO ] [MAIN ] BWG: Full history saved. [2025-10-28T17:45:27.463840] [INFO ] [MAIN ] Update Progress: 365/2366 symbols completed. BWG took 24.2s. Estimated remaining: 4h 8m 56s. Rate: 8.0 symbols/min [2025-10-28T17:45:27.643192] [INFO ] [MAIN ] BWNB: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:45:27.649136] [DEBUG] [LOCAL ] BWNB: Loaded 4033 existing records from primary storage. [2025-10-28T17:45:27.649342] [INFO ] [MAIN ] BWNB: Loaded 4033 existing records. [2025-10-28T17:45:27.828700] [WARN ] [MAIN ] BWNB: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:45:27.828908] [INFO ] [MAIN ] BWNB: Wiping existing primary data before full refresh. [2025-10-28T17:45:27.828983] [INFO ] [LOCAL ] BWNB: Starting deletion of primary data. [2025-10-28T17:45:27.829219] [DEBUG] [LOCAL ] BWNB: Deleted primary data file. [2025-10-28T17:45:27.829285] [INFO ] [MAIN ] BWNB: Starting full primary refresh. [2025-10-28T17:45:27.970673] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-05. [2025-10-28T17:45:28.207832] [INFO ] [REMOTE ] BWNB: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:45:28.414955] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-28T17:45:28.759380] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-06. [2025-10-28T17:45:29.217226] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-28T17:45:29.234923] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-28T17:45:29.559351] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-06. [2025-10-28T17:45:30.359351] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-07. [2025-10-28T17:45:30.704004] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-28T17:45:31.159391] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-01. [2025-10-28T17:45:31.226180] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-28T17:45:31.803810] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-28T17:45:31.959310] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-02. [2025-10-28T17:45:32.313785] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-10-28T17:45:32.759335] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-06. [2025-10-28T17:45:33.559341] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-03. [2025-10-28T17:45:33.646267] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-28T17:45:33.883093] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-10-28T17:45:34.359348] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-08. [2025-10-28T17:45:34.848951] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-28T17:45:35.159374] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-09. [2025-10-28T17:45:35.614422] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-28T17:45:35.959370] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-10. [2025-10-28T17:45:36.512715] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-28T17:45:36.514680] [INFO ] [REMOTE ] BWMX: Full fetch complete (10084 records). [2025-10-28T17:45:36.514755] [DEBUG] [VALIDATOR ] BWMX: Validating primary data. [2025-10-28T17:45:36.764453] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-07. [2025-10-28T17:45:36.927572] [DEBUG] [VALIDATOR ] BWMX: All expected trading days are present. [2025-10-28T17:45:36.927676] [DEBUG] [VALIDATOR ] BWMX: Primary data validation passed. [2025-10-28T17:45:36.927954] [INFO ] [MAIN ] BWMX: Fetched primary data is valid. [2025-10-28T17:45:36.927996] [DEBUG] [LOCAL ] BWMX: Saving primary data. [2025-10-28T17:45:36.928501] [DEBUG] [LOCAL ] BWMX: Trimmed 10084 records to 8027 (keeping 200 days of data) [2025-10-28T17:45:36.977188] [DEBUG] [LOCAL ] BWMX: Primary data saved (8027 records). [2025-10-28T17:45:36.977324] [INFO ] [MAIN ] BWMX: Full history saved. [2025-10-28T17:45:36.977406] [INFO ] [MAIN ] Update Progress: 366/2366 symbols completed. BWMX took 18.1s. Estimated remaining: 4h 8m 60s. Rate: 8.0 symbols/min [2025-10-28T17:45:37.148958] [INFO ] [MAIN ] BWSN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:45:37.155114] [DEBUG] [LOCAL ] BWSN: Loaded 5047 existing records from primary storage. [2025-10-28T17:45:37.155333] [INFO ] [MAIN ] BWSN: Loaded 5047 existing records. [2025-10-28T17:45:37.337511] [WARN ] [MAIN ] BWSN: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:45:37.337741] [INFO ] [MAIN ] BWSN: Wiping existing primary data before full refresh. [2025-10-28T17:45:37.337793] [INFO ] [LOCAL ] BWSN: Starting deletion of primary data. [2025-10-28T17:45:37.338005] [DEBUG] [LOCAL ] BWSN: Deleted primary data file. [2025-10-28T17:45:37.338061] [INFO ] [MAIN ] BWSN: Starting full primary refresh. [2025-10-28T17:45:37.570371] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-04. [2025-10-28T17:45:37.699486] [INFO ] [REMOTE ] BWSN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:45:37.914244] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-10-28T17:45:38.216403] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-28T17:45:38.359393] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-08. [2025-10-28T17:45:39.159343] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-07. [2025-10-28T17:45:39.454234] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-28T17:45:39.959345] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-09. [2025-10-28T17:45:40.412306] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-28T17:45:40.759339] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-05. [2025-10-28T17:45:40.822520] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-28T17:45:41.289813] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-28T17:45:41.559357] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-08. [2025-10-28T17:45:42.359354] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-06. [2025-10-28T17:45:42.819635] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-28T17:45:43.011885] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-28T17:45:43.159330] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-10. [2025-10-28T17:45:43.959335] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-01. [2025-10-28T17:45:44.258631] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-28T17:45:44.265354] [INFO ] [REMOTE ] BWLP: Full fetch complete (47761 records). [2025-10-28T17:45:44.265459] [DEBUG] [VALIDATOR ] BWLP: Validating primary data. [2025-10-28T17:45:44.369964] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-10-28T17:45:44.644767] [DEBUG] [VALIDATOR ] BWLP: All expected trading days are present. [2025-10-28T17:45:44.644861] [DEBUG] [VALIDATOR ] BWLP: Primary data validation passed. [2025-10-28T17:45:44.645420] [INFO ] [MAIN ] BWLP: Fetched primary data is valid. [2025-10-28T17:45:44.645460] [DEBUG] [LOCAL ] BWLP: Saving primary data. [2025-10-28T17:45:44.646422] [DEBUG] [LOCAL ] BWLP: Trimmed 47761 records to 31688 (keeping 200 days of data) [2025-10-28T17:45:44.759898] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-02. [2025-10-28T17:45:44.832620] [DEBUG] [LOCAL ] BWLP: Primary data saved (31688 records). [2025-10-28T17:45:44.832771] [INFO ] [MAIN ] BWLP: Full history saved. [2025-10-28T17:45:44.832844] [INFO ] [MAIN ] Update Progress: 367/2366 symbols completed. BWLP took 32.5s. Estimated remaining: 4h 8m 54s. Rate: 8.0 symbols/min [2025-10-28T17:45:45.004283] [INFO ] [MAIN ] BWXT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:45:45.004457] [DEBUG] [LOCAL ] BWXT: No existing data file found in primary storage. [2025-10-28T17:45:45.004495] [WARN ] [MAIN ] BWXT: No existing data found, performing full refresh instead. [2025-10-28T17:45:45.004604] [INFO ] [MAIN ] BWXT: Wiping existing primary data before full refresh. [2025-10-28T17:45:45.004669] [INFO ] [LOCAL ] BWXT: Starting deletion of primary data. [2025-10-28T17:45:45.004740] [DEBUG] [LOCAL ] BWXT: No primary data file found to delete. [2025-10-28T17:45:45.004775] [INFO ] [MAIN ] BWXT: Starting full primary refresh. [2025-10-28T17:45:45.111536] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-10-28T17:45:45.372676] [INFO ] [REMOTE ] BWXT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:45:45.559334] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-01. [2025-10-28T17:45:46.359314] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-09. [2025-10-28T17:45:46.925537] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-28T17:45:47.159326] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-02. [2025-10-28T17:45:47.469782] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-28T17:45:47.959364] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-07. [2025-10-28T17:45:48.245339] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-07 (0.29 seconds). [2025-10-28T17:45:48.561279] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-28T17:45:48.759338] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-08. [2025-10-28T17:45:49.193350] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-28T17:45:49.559341] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-03. [2025-10-28T17:45:50.359350] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-03. [2025-10-28T17:45:50.703895] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-10-28T17:45:51.078047] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-28T17:45:51.159337] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-04. [2025-10-28T17:45:51.959331] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-09. [2025-10-28T17:45:52.299636] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-10-28T17:45:52.383073] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-28T17:45:52.759335] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-04. [2025-10-28T17:45:53.248144] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-28T17:45:53.559348] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-05. [2025-10-28T17:45:54.105015] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-28T17:45:54.359348] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-10. [2025-10-28T17:45:55.159349] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-05. [2025-10-28T17:45:55.959352] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-06. [2025-10-28T17:45:56.011948] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-28T17:45:56.022244] [INFO ] [REMOTE ] BWA: Full fetch complete (75855 records). [2025-10-28T17:45:56.022368] [DEBUG] [VALIDATOR ] BWA: Validating primary data. [2025-10-28T17:45:56.416565] [DEBUG] [VALIDATOR ] BWA: All expected trading days are present. [2025-10-28T17:45:56.416718] [DEBUG] [VALIDATOR ] BWA: Primary data validation passed. [2025-10-28T17:45:56.417579] [INFO ] [MAIN ] BWA: Fetched primary data is valid. [2025-10-28T17:45:56.417667] [DEBUG] [LOCAL ] BWA: Saving primary data. [2025-10-28T17:45:56.419127] [DEBUG] [LOCAL ] BWA: Trimmed 75855 records to 52002 (keeping 200 days of data) [2025-10-28T17:45:56.650931] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-28T17:45:56.760469] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-07. [2025-10-28T17:45:56.769773] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-28T17:45:56.767367] [DEBUG] [LOCAL ] BWA: Primary data saved (52002 records). [2025-10-28T17:45:56.779565] [INFO ] [MAIN ] BWA: Full history saved. [2025-10-28T17:45:56.779708] [INFO ] [MAIN ] Update Progress: 368/2366 symbols completed. BWA took 58.0s. Estimated remaining: 4h 9m 11s. Rate: 8.0 symbols/min [2025-10-28T17:45:56.959222] [INFO ] [MAIN ] BX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:45:57.014521] [DEBUG] [LOCAL ] BX: Loaded 53483 existing records from primary storage. [2025-10-28T17:45:57.014881] [INFO ] [MAIN ] BX: Loaded 53483 existing records. [2025-10-28T17:45:57.106321] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-10-28T17:45:57.235274] [WARN ] [MAIN ] BX: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:45:57.235569] [INFO ] [MAIN ] BX: Wiping existing primary data before full refresh. [2025-10-28T17:45:57.235633] [INFO ] [LOCAL ] BX: Starting deletion of primary data. [2025-10-28T17:45:57.236163] [DEBUG] [LOCAL ] BX: Deleted primary data file. [2025-10-28T17:45:57.236223] [INFO ] [MAIN ] BX: Starting full primary refresh. [2025-10-28T17:45:57.565467] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-06. [2025-10-28T17:45:57.605761] [INFO ] [REMOTE ] BX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:45:58.359365] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-10. [2025-10-28T17:45:58.942810] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-28T17:45:58.944151] [INFO ] [REMOTE ] BWNB: Full fetch complete (5586 records). [2025-10-28T17:45:58.944286] [DEBUG] [VALIDATOR ] BWNB: Validating primary data. [2025-10-28T17:45:59.164515] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-01. [2025-10-28T17:45:59.358489] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-28T17:45:59.373990] [DEBUG] [VALIDATOR ] BWNB: All expected trading days are present. [2025-10-28T17:45:59.374489] [DEBUG] [VALIDATOR ] BWNB: Primary data validation passed. [2025-10-28T17:45:59.375160] [INFO ] [MAIN ] BWNB: Fetched primary data is valid. [2025-10-28T17:45:59.375226] [DEBUG] [LOCAL ] BWNB: Saving primary data. [2025-10-28T17:45:59.375838] [DEBUG] [LOCAL ] BWNB: Trimmed 5586 records to 4035 (keeping 200 days of data) [2025-10-28T17:45:59.401361] [DEBUG] [LOCAL ] BWNB: Primary data saved (4035 records). [2025-10-28T17:45:59.401499] [INFO ] [MAIN ] BWNB: Full history saved. [2025-10-28T17:45:59.401606] [INFO ] [MAIN ] Update Progress: 369/2366 symbols completed. BWNB took 31.9s. Estimated remaining: 4h 8m 37s. Rate: 8.0 symbols/min [2025-10-28T17:45:59.578701] [INFO ] [MAIN ] BXC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:45:59.578870] [DEBUG] [LOCAL ] BXC: No existing data file found in primary storage. [2025-10-28T17:45:59.578909] [WARN ] [MAIN ] BXC: No existing data found, performing full refresh instead. [2025-10-28T17:45:59.579020] [INFO ] [MAIN ] BXC: Wiping existing primary data before full refresh. [2025-10-28T17:45:59.579061] [INFO ] [LOCAL ] BXC: Starting deletion of primary data. [2025-10-28T17:45:59.579102] [DEBUG] [LOCAL ] BXC: No primary data file found to delete. [2025-10-28T17:45:59.579135] [INFO ] [MAIN ] BXC: Starting full primary refresh. [2025-10-28T17:45:59.944401] [INFO ] [REMOTE ] BXC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:45:59.959319] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-01. [2025-10-28T17:46:00.520326] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-28T17:46:00.759414] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-07. [2025-10-28T17:46:01.157670] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-10-28T17:46:01.559438] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-08. [2025-10-28T17:46:02.005774] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-28T17:46:02.364442] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-09. [2025-10-28T17:46:02.378300] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-28T17:46:02.704769] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-10-28T17:46:03.159344] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-10. [2025-10-28T17:46:03.674140] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-28T17:46:03.675594] [INFO ] [REMOTE ] BWSN: Full fetch complete (6409 records). [2025-10-28T17:46:03.675685] [DEBUG] [VALIDATOR ] BWSN: Validating primary data. [2025-10-28T17:46:03.676036] [FATAL] [VALIDATOR ] BWSN: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T17:46:03.676114] [FATAL] [MAIN ] BWSN: Fetched primary data is invalid. Refusing to save it. [2025-10-28T17:46:03.676176] [WARN ] [MAIN ] BWSN: Deleting existing primary and derivative data due to validation failure. [2025-10-28T17:46:03.676245] [INFO ] [LOCAL ] BWSN: Starting deletion of primary data. [2025-10-28T17:46:03.676307] [DEBUG] [LOCAL ] BWSN: No primary data file found to delete. [2025-10-28T17:46:03.676342] [INFO ] [LOCAL ] BWSN: Starting deletion of derivative data. [2025-10-28T17:46:03.676526] [DEBUG] [LOCAL ] BWSN: Deleted derivative data file. [2025-10-28T17:46:03.676609] [INFO ] [MAIN ] Update Progress: 370/2366 symbols completed. BWSN took 26.7s. Estimated remaining: 4h 8m 13s. Rate: 8.0 symbols/min [2025-10-28T17:46:03.841902] [INFO ] [MAIN ] BXMT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:46:03.884542] [DEBUG] [LOCAL ] BXMT: Loaded 47144 existing records from primary storage. [2025-10-28T17:46:03.884895] [INFO ] [MAIN ] BXMT: Loaded 47144 existing records. [2025-10-28T17:46:03.964465] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-08. [2025-10-28T17:46:04.063700] [WARN ] [MAIN ] BXMT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:46:04.063887] [INFO ] [MAIN ] BXMT: Wiping existing primary data before full refresh. [2025-10-28T17:46:04.063932] [INFO ] [LOCAL ] BXMT: Starting deletion of primary data. [2025-10-28T17:46:04.064291] [DEBUG] [LOCAL ] BXMT: Deleted primary data file. [2025-10-28T17:46:04.064330] [INFO ] [MAIN ] BXMT: Starting full primary refresh. [2025-10-28T17:46:04.419174] [INFO ] [REMOTE ] BXMT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:46:04.759333] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-01. [2025-10-28T17:46:05.559308] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-02. [2025-10-28T17:46:05.739194] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-28T17:46:06.002359] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-28T17:46:06.161779] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-28T17:46:06.359349] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-09. [2025-10-28T17:46:07.159377] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-02. [2025-10-28T17:46:07.820997] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-28T17:46:07.959336] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-03. [2025-10-28T17:46:08.316323] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-28T17:46:08.682098] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-28T17:46:08.759406] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-03. [2025-10-28T17:46:09.559352] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-04. [2025-10-28T17:46:09.904486] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-28T17:46:10.359671] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-04. [2025-10-28T17:46:10.417231] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-28T17:46:11.159352] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-02. [2025-10-28T17:46:11.594850] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-28T17:46:11.959332] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-05. [2025-10-28T17:46:12.537382] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-28T17:46:12.663476] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-28T17:46:12.759420] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-06. [2025-10-28T17:46:13.339052] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-28T17:46:13.559320] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-07. [2025-10-28T17:46:14.158612] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-28T17:46:14.359343] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-08. [2025-10-28T17:46:14.891630] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-28T17:46:15.159358] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-05. [2025-10-28T17:46:15.959353] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-03. [2025-10-28T17:46:16.436882] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-28T17:46:16.759366] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-09. [2025-10-28T17:46:17.368307] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-28T17:46:17.509244] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-28T17:46:17.559389] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-10. [2025-10-28T17:46:18.359402] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-06. [2025-10-28T17:46:19.159355] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-04. [2025-10-28T17:46:19.212380] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-28T17:46:19.223100] [INFO ] [REMOTE ] BWXT: Full fetch complete (68098 records). [2025-10-28T17:46:19.223300] [DEBUG] [VALIDATOR ] BWXT: Validating primary data. [2025-10-28T17:46:19.679351] [DEBUG] [VALIDATOR ] BWXT: All expected trading days are present. [2025-10-28T17:46:19.679524] [DEBUG] [VALIDATOR ] BWXT: Primary data validation passed. [2025-10-28T17:46:19.680843] [INFO ] [MAIN ] BWXT: Fetched primary data is valid. [2025-10-28T17:46:19.680940] [DEBUG] [LOCAL ] BWXT: Saving primary data. [2025-10-28T17:46:19.718289] [DEBUG] [LOCAL ] BWXT: Trimmed 68098 records to 47089 (keeping 200 days of data) [2025-10-28T17:46:19.721815] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-28T17:46:19.979946] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-10. [2025-10-28T17:46:20.078348] [DEBUG] [LOCAL ] BWXT: Primary data saved (47089 records). [2025-10-28T17:46:20.078567] [INFO ] [MAIN ] BWXT: Full history saved. [2025-10-28T17:46:20.078689] [INFO ] [MAIN ] Update Progress: 371/2366 symbols completed. BWXT took 35.2s. Estimated remaining: 4h 8m 53s. Rate: 8.0 symbols/min [2025-10-28T17:46:20.272388] [INFO ] [MAIN ] BXMX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:46:20.295049] [DEBUG] [LOCAL ] BXMX: Loaded 18764 existing records from primary storage. [2025-10-28T17:46:20.295580] [INFO ] [MAIN ] BXMX: Loaded 18764 existing records. [2025-10-28T17:46:20.495493] [WARN ] [MAIN ] BXMX: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:46:20.495844] [INFO ] [MAIN ] BXMX: Wiping existing primary data before full refresh. [2025-10-28T17:46:20.495910] [INFO ] [LOCAL ] BXMX: Starting deletion of primary data. [2025-10-28T17:46:20.496339] [DEBUG] [LOCAL ] BXMX: Deleted primary data file. [2025-10-28T17:46:20.496405] [INFO ] [MAIN ] BXMX: Starting full primary refresh. [2025-10-28T17:46:20.762559] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-07. [2025-10-28T17:46:20.855902] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-28T17:46:20.880306] [INFO ] [REMOTE ] BXC: Full fetch complete (18304 records). [2025-10-28T17:46:20.911572] [DEBUG] [VALIDATOR ] BXC: Validating primary data. [2025-10-28T17:46:20.958198] [INFO ] [REMOTE ] BXMX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:46:21.331455] [DEBUG] [VALIDATOR ] BXC: All expected trading days are present. [2025-10-28T17:46:21.331627] [DEBUG] [VALIDATOR ] BXC: Primary data validation passed. [2025-10-28T17:46:21.332047] [INFO ] [MAIN ] BXC: Fetched primary data is valid. [2025-10-28T17:46:21.332123] [DEBUG] [LOCAL ] BXC: Saving primary data. [2025-10-28T17:46:21.358783] [DEBUG] [LOCAL ] BXC: Trimmed 18304 records to 13065 (keeping 200 days of data) [2025-10-28T17:46:21.363824] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-10-28T17:46:21.451805] [DEBUG] [LOCAL ] BXC: Primary data saved (13065 records). [2025-10-28T17:46:21.451938] [INFO ] [MAIN ] BXC: Full history saved. [2025-10-28T17:46:21.452008] [INFO ] [MAIN ] Update Progress: 372/2366 symbols completed. BXC took 22.1s. Estimated remaining: 4h 8m 13s. Rate: 8.0 symbols/min [2025-10-28T17:46:21.564465] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-01. [2025-10-28T17:46:21.618270] [INFO ] [MAIN ] BXP: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:46:21.618748] [DEBUG] [LOCAL ] BXP: No existing data file found in primary storage. [2025-10-28T17:46:21.618800] [WARN ] [MAIN ] BXP: No existing data found, performing full refresh instead. [2025-10-28T17:46:21.618921] [INFO ] [MAIN ] BXP: Wiping existing primary data before full refresh. [2025-10-28T17:46:21.618984] [INFO ] [LOCAL ] BXP: Starting deletion of primary data. [2025-10-28T17:46:21.619043] [DEBUG] [LOCAL ] BXP: No primary data file found to delete. [2025-10-28T17:46:21.619089] [INFO ] [MAIN ] BXP: Starting full primary refresh. [2025-10-28T17:46:21.970423] [INFO ] [REMOTE ] BXP: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:46:22.279226] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-28T17:46:22.312140] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-28T17:46:22.359293] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-08. [2025-10-28T17:46:23.159342] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-01. [2025-10-28T17:46:23.640480] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-28T17:46:23.959323] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-09. [2025-10-28T17:46:24.644109] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-28T17:46:24.759381] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-05. [2025-10-28T17:46:25.337535] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-28T17:46:25.559372] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-02. [2025-10-28T17:46:26.359305] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-02. [2025-10-28T17:46:26.446739] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-28T17:46:26.463523] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-28T17:46:27.159388] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-06. [2025-10-28T17:46:27.772580] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-28T17:46:27.959344] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-03. [2025-10-28T17:46:28.708214] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-28T17:46:28.761537] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-10. [2025-10-28T17:46:28.770224] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-28T17:46:29.559382] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-03. [2025-10-28T17:46:30.359375] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-07. [2025-10-28T17:46:30.542588] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-28T17:46:30.552682] [INFO ] [REMOTE ] BXMT: Full fetch complete (69465 records). [2025-10-28T17:46:30.552822] [DEBUG] [VALIDATOR ] BXMT: Validating primary data. [2025-10-28T17:46:30.553591] [FATAL] [VALIDATOR ] BXMT: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T17:46:30.553711] [FATAL] [MAIN ] BXMT: Fetched primary data is invalid. Refusing to save it. [2025-10-28T17:46:30.553757] [WARN ] [MAIN ] BXMT: Deleting existing primary and derivative data due to validation failure. [2025-10-28T17:46:30.553798] [INFO ] [LOCAL ] BXMT: Starting deletion of primary data. [2025-10-28T17:46:30.553855] [DEBUG] [LOCAL ] BXMT: No primary data file found to delete. [2025-10-28T17:46:30.553890] [INFO ] [LOCAL ] BXMT: Starting deletion of derivative data. [2025-10-28T17:46:30.554077] [DEBUG] [LOCAL ] BXMT: Deleted derivative data file. [2025-10-28T17:46:30.554175] [INFO ] [MAIN ] Update Progress: 373/2366 symbols completed. BXMT took 26.9s. Estimated remaining: 4h 8m 14s. Rate: 8.0 symbols/min [2025-10-28T17:46:30.732828] [INFO ] [MAIN ] BXSL: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:46:30.733072] [DEBUG] [LOCAL ] BXSL: No existing data file found in primary storage. [2025-10-28T17:46:30.733142] [WARN ] [MAIN ] BXSL: No existing data found, performing full refresh instead. [2025-10-28T17:46:30.733527] [INFO ] [MAIN ] BXSL: Wiping existing primary data before full refresh. [2025-10-28T17:46:30.733858] [INFO ] [LOCAL ] BXSL: Starting deletion of primary data. [2025-10-28T17:46:30.733946] [DEBUG] [LOCAL ] BXSL: No primary data file found to delete. [2025-10-28T17:46:30.733994] [INFO ] [MAIN ] BXSL: Starting full primary refresh. [2025-10-28T17:46:31.104900] [INFO ] [REMOTE ] BXSL: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:46:31.136225] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-28T17:46:31.159319] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-04. [2025-10-28T17:46:31.791047] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-28T17:46:31.959396] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-04. [2025-10-28T17:46:32.516270] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-28T17:46:32.759376] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-05. [2025-10-28T17:46:32.836909] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-28T17:46:33.559347] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-01. [2025-10-28T17:46:33.978503] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-28T17:46:34.359341] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-08. [2025-10-28T17:46:34.888820] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-28T17:46:35.159369] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-02. [2025-10-28T17:46:35.742942] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-28T17:46:35.959432] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-06. [2025-10-28T17:46:36.417715] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-28T17:46:36.759360] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-05. [2025-10-28T17:46:37.328700] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-28T17:46:37.559373] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-03. [2025-10-28T17:46:37.796497] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-28T17:46:38.359411] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-09. [2025-10-28T17:46:38.776026] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-28T17:46:39.159317] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-04. [2025-10-28T17:46:39.959348] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-06. [2025-10-28T17:46:40.134992] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-28T17:46:40.515375] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-28T17:46:40.635193] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-28T17:46:40.759378] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-05. [2025-10-28T17:46:41.559340] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-07. [2025-10-28T17:46:41.872870] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-28T17:46:42.359352] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-06. [2025-10-28T17:46:42.434492] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-28T17:46:43.159353] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-08. [2025-10-28T17:46:43.470353] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-28T17:46:43.873932] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-28T17:46:43.959364] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-09. [2025-10-28T17:46:44.533387] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-28T17:46:44.759362] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-10. [2025-10-28T17:46:45.559354] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-10. [2025-10-28T17:46:46.359334] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-07. [2025-10-28T17:46:46.560733] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-28T17:46:46.561489] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-28T17:46:46.579247] [INFO ] [REMOTE ] BXMX: Full fetch complete (28465 records). [2025-10-28T17:46:46.579665] [DEBUG] [VALIDATOR ] BXMX: Validating primary data. [2025-10-28T17:46:46.606291] [INFO ] [REMOTE ] BX: Full fetch complete (77613 records). [2025-10-28T17:46:46.648581] [DEBUG] [VALIDATOR ] BX: Validating primary data. [2025-10-28T17:46:47.169702] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-07. [2025-10-28T17:46:47.432976] [DEBUG] [VALIDATOR ] BXMX: All expected trading days are present. [2025-10-28T17:46:47.437476] [DEBUG] [VALIDATOR ] BXMX: Primary data validation passed. [2025-10-28T17:46:47.453244] [INFO ] [MAIN ] BXMX: Fetched primary data is valid. [2025-10-28T17:46:47.457127] [DEBUG] [LOCAL ] BXMX: Saving primary data. [2025-10-28T17:46:47.457478] [DEBUG] [VALIDATOR ] BX: All expected trading days are present. [2025-10-28T17:46:47.457949] [DEBUG] [VALIDATOR ] BX: Primary data validation passed. [2025-10-28T17:46:47.458797] [INFO ] [MAIN ] BX: Fetched primary data is valid. [2025-10-28T17:46:47.458881] [DEBUG] [LOCAL ] BX: Saving primary data. [2025-10-28T17:46:47.459383] [DEBUG] [LOCAL ] BXMX: Trimmed 28465 records to 18686 (keeping 200 days of data) [2025-10-28T17:46:47.506425] [DEBUG] [LOCAL ] BX: Trimmed 77613 records to 53483 (keeping 200 days of data) [2025-10-28T17:46:47.663468] [DEBUG] [LOCAL ] BXMX: Primary data saved (18686 records). [2025-10-28T17:46:47.664296] [INFO ] [MAIN ] BXMX: Full history saved. [2025-10-28T17:46:47.676332] [INFO ] [MAIN ] Update Progress: 374/2366 symbols completed. BXMX took 27.6s. Estimated remaining: 4h 8m 58s. Rate: 8.0 symbols/min [2025-10-28T17:46:47.975604] [INFO ] [MAIN ] BY: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:46:47.979798] [DEBUG] [LOCAL ] BY: No existing data file found in primary storage. [2025-10-28T17:46:47.982713] [WARN ] [MAIN ] BY: No existing data found, performing full refresh instead. [2025-10-28T17:46:47.987387] [INFO ] [MAIN ] BY: Wiping existing primary data before full refresh. [2025-10-28T17:46:47.987605] [INFO ] [LOCAL ] BY: Starting deletion of primary data. [2025-10-28T17:46:48.016789] [DEBUG] [LOCAL ] BY: No primary data file found to delete. [2025-10-28T17:46:48.017246] [INFO ] [MAIN ] BY: Starting full primary refresh. [2025-10-28T17:46:48.147553] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-28T17:46:48.242806] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-08. [2025-10-28T17:46:48.242436] [DEBUG] [LOCAL ] BX: Primary data saved (53483 records). [2025-10-28T17:46:48.247170] [INFO ] [MAIN ] BX: Full history saved. [2025-10-28T17:46:48.248235] [INFO ] [MAIN ] Update Progress: 375/2366 symbols completed. BX took 51.5s. Estimated remaining: 4h 8m 14s. Rate: 8.0 symbols/min [2025-10-28T17:46:48.523787] [INFO ] [MAIN ] BYD: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:46:48.576667] [DEBUG] [LOCAL ] BYD: No existing data file found in primary storage. [2025-10-28T17:46:48.588407] [WARN ] [MAIN ] BYD: No existing data found, performing full refresh instead. [2025-10-28T17:46:48.604786] [INFO ] [MAIN ] BYD: Wiping existing primary data before full refresh. [2025-10-28T17:46:48.615543] [INFO ] [LOCAL ] BYD: Starting deletion of primary data. [2025-10-28T17:46:48.615879] [DEBUG] [LOCAL ] BYD: No primary data file found to delete. [2025-10-28T17:46:48.626880] [INFO ] [MAIN ] BYD: Starting full primary refresh. [2025-10-28T17:46:48.759505] [INFO ] [REMOTE ] BY: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:46:48.787849] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-01. [2025-10-28T17:46:49.011321] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-10-28T17:46:49.097454] [INFO ] [REMOTE ] BYD: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:46:49.559332] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-08. [2025-10-28T17:46:49.649521] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-28T17:46:49.878846] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-28T17:46:50.359332] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-02. [2025-10-28T17:46:50.907412] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-28T17:46:50.927197] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-28T17:46:51.159334] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-09. [2025-10-28T17:46:51.959364] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-03. [2025-10-28T17:46:52.515239] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-28T17:46:52.759316] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-10. [2025-10-28T17:46:52.852197] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-28T17:46:53.559332] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-01. [2025-10-28T17:46:54.349158] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-28T17:46:54.359238] [INFO ] [REMOTE ] BXSL: Full fetch complete (69812 records). [2025-10-28T17:46:54.359315] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-04. [2025-10-28T17:46:54.360194] [DEBUG] [VALIDATOR ] BXSL: Validating primary data. [2025-10-28T17:46:54.361149] [FATAL] [VALIDATOR ] BXSL: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T17:46:54.361326] [FATAL] [MAIN ] BXSL: Fetched primary data is invalid. Refusing to save it. [2025-10-28T17:46:54.361407] [WARN ] [MAIN ] BXSL: Deleting existing primary and derivative data due to validation failure. [2025-10-28T17:46:54.361491] [INFO ] [LOCAL ] BXSL: Starting deletion of primary data. [2025-10-28T17:46:54.361566] [DEBUG] [LOCAL ] BXSL: No primary data file found to delete. [2025-10-28T17:46:54.361616] [INFO ] [LOCAL ] BXSL: Starting deletion of derivative data. [2025-10-28T17:46:54.361718] [DEBUG] [LOCAL ] BXSL: No derivative data file found to delete. [2025-10-28T17:46:54.361807] [INFO ] [MAIN ] Update Progress: 376/2366 symbols completed. BXSL took 23.8s. Estimated remaining: 4h 7m 59s. Rate: 8.0 symbols/min [2025-10-28T17:46:54.530488] [INFO ] [MAIN ] BYM: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:46:54.542425] [DEBUG] [LOCAL ] BYM: Loaded 11121 existing records from primary storage. [2025-10-28T17:46:54.542610] [INFO ] [MAIN ] BYM: Loaded 11121 existing records. [2025-10-28T17:46:54.717077] [WARN ] [MAIN ] BYM: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:46:54.717377] [INFO ] [MAIN ] BYM: Wiping existing primary data before full refresh. [2025-10-28T17:46:54.717466] [INFO ] [LOCAL ] BYM: Starting deletion of primary data. [2025-10-28T17:46:54.717800] [DEBUG] [LOCAL ] BYM: Deleted primary data file. [2025-10-28T17:46:54.717860] [INFO ] [MAIN ] BYM: Starting full primary refresh. [2025-10-28T17:46:55.083450] [INFO ] [REMOTE ] BYM: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:46:55.107072] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-28T17:46:55.160570] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-01. [2025-10-28T17:46:55.164392] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-28T17:46:55.830663] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-28T17:46:55.959361] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-09. [2025-10-28T17:46:56.759408] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-02. [2025-10-28T17:46:57.488853] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-28T17:46:57.559324] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-10. [2025-10-28T17:46:57.925094] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-28T17:46:58.359365] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-05. [2025-10-28T17:46:58.949219] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-28T17:46:59.159327] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-03. [2025-10-28T17:46:59.269010] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-28T17:46:59.280331] [INFO ] [REMOTE ] BXP: Full fetch complete (72213 records). [2025-10-28T17:46:59.280493] [DEBUG] [VALIDATOR ] BXP: Validating primary data. [2025-10-28T17:46:59.721062] [DEBUG] [VALIDATOR ] BXP: All expected trading days are present. [2025-10-28T17:46:59.721159] [DEBUG] [VALIDATOR ] BXP: Primary data validation passed. [2025-10-28T17:46:59.722014] [INFO ] [MAIN ] BXP: Fetched primary data is valid. [2025-10-28T17:46:59.722082] [DEBUG] [LOCAL ] BXP: Saving primary data. [2025-10-28T17:46:59.723544] [DEBUG] [LOCAL ] BXP: Trimmed 72213 records to 49707 (keeping 200 days of data) [2025-10-28T17:46:59.959443] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-02. [2025-10-28T17:47:00.052349] [DEBUG] [LOCAL ] BXP: Primary data saved (49707 records). [2025-10-28T17:47:00.052478] [INFO ] [MAIN ] BXP: Full history saved. [2025-10-28T17:47:00.052563] [INFO ] [MAIN ] Update Progress: 377/2366 symbols completed. BXP took 38.6s. Estimated remaining: 4h 7m 42s. Rate: 8.0 symbols/min [2025-10-28T17:47:00.235904] [INFO ] [MAIN ] BZH: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:47:00.265235] [DEBUG] [LOCAL ] BZH: Loaded 31712 existing records from primary storage. [2025-10-28T17:47:00.265493] [INFO ] [MAIN ] BZH: Loaded 31712 existing records. [2025-10-28T17:47:00.442968] [WARN ] [MAIN ] BZH: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:47:00.443278] [INFO ] [MAIN ] BZH: Wiping existing primary data before full refresh. [2025-10-28T17:47:00.443413] [INFO ] [LOCAL ] BZH: Starting deletion of primary data. [2025-10-28T17:47:00.443925] [DEBUG] [LOCAL ] BZH: Deleted primary data file. [2025-10-28T17:47:00.443993] [INFO ] [MAIN ] BZH: Starting full primary refresh. [2025-10-28T17:47:00.581118] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-28T17:47:00.582243] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-28T17:47:00.764479] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-06. [2025-10-28T17:47:00.846681] [INFO ] [REMOTE ] BZH: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:47:01.559381] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-03. [2025-10-28T17:47:01.848413] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-28T17:47:02.197230] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-28T17:47:02.359398] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-04. [2025-10-28T17:47:03.091534] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-28T17:47:03.159415] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-07. [2025-10-28T17:47:03.959318] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-05. [2025-10-28T17:47:04.243524] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-28T17:47:04.528296] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-28T17:47:04.759437] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-01. [2025-10-28T17:47:05.559406] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-06. [2025-10-28T17:47:05.796779] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-28T17:47:06.155249] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-28T17:47:06.359334] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-07. [2025-10-28T17:47:06.930617] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-28T17:47:07.159396] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-02. [2025-10-28T17:47:07.959328] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-08. [2025-10-28T17:47:08.325609] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-28T17:47:08.672285] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-28T17:47:08.759343] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-08. [2025-10-28T17:47:09.242191] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-28T17:47:09.559395] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-09. [2025-10-28T17:47:10.329471] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-28T17:47:10.359347] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-10. [2025-10-28T17:47:11.159394] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-03. [2025-10-28T17:47:11.399030] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-28T17:47:11.403334] [INFO ] [REMOTE ] BY: Full fetch complete (29740 records). [2025-10-28T17:47:11.403406] [DEBUG] [VALIDATOR ] BY: Validating primary data. [2025-10-28T17:47:11.779360] [DEBUG] [VALIDATOR ] BY: All expected trading days are present. [2025-10-28T17:47:11.779433] [DEBUG] [VALIDATOR ] BY: Primary data validation passed. [2025-10-28T17:47:11.779877] [INFO ] [MAIN ] BY: Fetched primary data is valid. [2025-10-28T17:47:11.779936] [DEBUG] [LOCAL ] BY: Saving primary data. [2025-10-28T17:47:11.780623] [DEBUG] [LOCAL ] BY: Trimmed 29740 records to 21442 (keeping 200 days of data) [2025-10-28T17:47:11.905566] [DEBUG] [LOCAL ] BY: Primary data saved (21442 records). [2025-10-28T17:47:11.905708] [INFO ] [MAIN ] BY: Full history saved. [2025-10-28T17:47:11.905786] [INFO ] [MAIN ] Update Progress: 378/2366 symbols completed. BY took 24.2s. Estimated remaining: 4h 7m 58s. Rate: 8.0 symbols/min [2025-10-28T17:47:11.966945] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-09. [2025-10-28T17:47:12.077301] [INFO ] [MAIN ] C: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:47:12.107343] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-28T17:47:12.150595] [DEBUG] [LOCAL ] C: Loaded 53741 existing records from primary storage. [2025-10-28T17:47:12.150908] [INFO ] [MAIN ] C: Loaded 53741 existing records. [2025-10-28T17:47:12.327830] [WARN ] [MAIN ] C: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:47:12.328038] [INFO ] [MAIN ] C: Wiping existing primary data before full refresh. [2025-10-28T17:47:12.328087] [INFO ] [LOCAL ] C: Starting deletion of primary data. [2025-10-28T17:47:12.328752] [DEBUG] [LOCAL ] C: Deleted primary data file. [2025-10-28T17:47:12.328808] [INFO ] [MAIN ] C: Starting full primary refresh. [2025-10-28T17:47:12.686499] [INFO ] [REMOTE ] C: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:47:12.746497] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-28T17:47:12.759293] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-10. [2025-10-28T17:47:13.372552] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-28T17:47:13.375315] [INFO ] [REMOTE ] BYM: Full fetch complete (17305 records). [2025-10-28T17:47:13.375385] [DEBUG] [VALIDATOR ] BYM: Validating primary data. [2025-10-28T17:47:13.564450] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-04. [2025-10-28T17:47:13.752509] [DEBUG] [VALIDATOR ] BYM: All expected trading days are present. [2025-10-28T17:47:13.752583] [DEBUG] [VALIDATOR ] BYM: Primary data validation passed. [2025-10-28T17:47:13.753013] [INFO ] [MAIN ] BYM: Fetched primary data is valid. [2025-10-28T17:47:13.753073] [DEBUG] [LOCAL ] BYM: Saving primary data. [2025-10-28T17:47:13.753672] [DEBUG] [LOCAL ] BYM: Trimmed 17305 records to 11239 (keeping 200 days of data) [2025-10-28T17:47:13.820477] [DEBUG] [LOCAL ] BYM: Primary data saved (11239 records). [2025-10-28T17:47:13.820603] [INFO ] [MAIN ] BYM: Full history saved. [2025-10-28T17:47:13.820717] [INFO ] [MAIN ] Update Progress: 379/2366 symbols completed. BYM took 19.5s. Estimated remaining: 4h 7m 21s. Rate: 8.0 symbols/min [2025-10-28T17:47:13.993547] [INFO ] [MAIN ] CAAP: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:47:13.993747] [DEBUG] [LOCAL ] CAAP: No existing data file found in primary storage. [2025-10-28T17:47:13.993791] [WARN ] [MAIN ] CAAP: No existing data found, performing full refresh instead. [2025-10-28T17:47:13.993896] [INFO ] [MAIN ] CAAP: Wiping existing primary data before full refresh. [2025-10-28T17:47:13.993936] [INFO ] [LOCAL ] CAAP: Starting deletion of primary data. [2025-10-28T17:47:13.993977] [DEBUG] [LOCAL ] CAAP: No primary data file found to delete. [2025-10-28T17:47:13.994007] [INFO ] [MAIN ] CAAP: Starting full primary refresh. [2025-10-28T17:47:14.348022] [INFO ] [REMOTE ] CAAP: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:47:14.359300] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-01. [2025-10-28T17:47:14.595073] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-28T17:47:15.101844] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-28T17:47:15.159314] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-05. [2025-10-28T17:47:15.959370] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-02. [2025-10-28T17:47:16.604855] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-28T17:47:16.621830] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-28T17:47:16.759336] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-06. [2025-10-28T17:47:17.561533] [INFO ] [REMOTE ] C: Fetching primary data for 2025-01. [2025-10-28T17:47:17.566563] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-28T17:47:18.359398] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-04. [2025-10-28T17:47:19.164494] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-07. [2025-10-28T17:47:19.182537] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-10-28T17:47:19.654316] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-28T17:47:19.959350] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-03. [2025-10-28T17:47:20.065638] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-28T17:47:20.677896] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-28T17:47:20.759342] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-05. [2025-10-28T17:47:21.559348] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-08. [2025-10-28T17:47:22.079088] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-28T17:47:22.359365] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-04. [2025-10-28T17:47:22.522797] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-28T17:47:23.101403] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-28T17:47:23.159331] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-05. [2025-10-28T17:47:23.862357] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-28T17:47:23.959382] [INFO ] [REMOTE ] C: Fetching primary data for 2025-02. [2025-10-28T17:47:24.759347] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-06. [2025-10-28T17:47:25.423146] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-28T17:47:25.559372] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-06. [2025-10-28T17:47:25.625031] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-28T17:47:26.359370] [INFO ] [REMOTE ] C: Fetching primary data for 2025-03. [2025-10-28T17:47:26.756001] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-28T17:47:27.159339] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-07. [2025-10-28T17:47:27.959335] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-09. [2025-10-28T17:47:28.094146] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-10-28T17:47:28.378929] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-28T17:47:28.759352] [INFO ] [REMOTE ] C: Fetching primary data for 2025-04. [2025-10-28T17:47:28.880016] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-28T17:47:29.559380] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-08. [2025-10-28T17:47:30.359325] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-10. [2025-10-28T17:47:30.415180] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-10-28T17:47:30.704389] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-28T17:47:31.159371] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-07. [2025-10-28T17:47:31.194834] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-28T17:47:31.201150] [INFO ] [REMOTE ] BZH: Full fetch complete (47054 records). [2025-10-28T17:47:31.201275] [DEBUG] [VALIDATOR ] BZH: Validating primary data. [2025-10-28T17:47:31.598943] [DEBUG] [VALIDATOR ] BZH: All expected trading days are present. [2025-10-28T17:47:31.599020] [DEBUG] [VALIDATOR ] BZH: Primary data validation passed. [2025-10-28T17:47:31.599581] [INFO ] [MAIN ] BZH: Fetched primary data is valid. [2025-10-28T17:47:31.599620] [DEBUG] [LOCAL ] BZH: Saving primary data. [2025-10-28T17:47:31.600526] [DEBUG] [LOCAL ] BZH: Trimmed 47054 records to 31574 (keeping 200 days of data) [2025-10-28T17:47:31.782461] [DEBUG] [LOCAL ] BZH: Primary data saved (31574 records). [2025-10-28T17:47:31.782734] [INFO ] [MAIN ] BZH: Full history saved. [2025-10-28T17:47:31.782845] [INFO ] [MAIN ] Update Progress: 380/2366 symbols completed. BZH took 31.7s. Estimated remaining: 4h 8m 9s. Rate: 8.0 symbols/min [2025-10-28T17:47:31.885094] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-28T17:47:31.969412] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-09. [2025-10-28T17:47:31.974053] [INFO ] [MAIN ] CABO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:47:31.993430] [DEBUG] [LOCAL ] CABO: Loaded 16486 existing records from primary storage. [2025-10-28T17:47:31.993675] [INFO ] [MAIN ] CABO: Loaded 16486 existing records. [2025-10-28T17:47:32.167622] [WARN ] [MAIN ] CABO: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:47:32.167835] [INFO ] [MAIN ] CABO: Wiping existing primary data before full refresh. [2025-10-28T17:47:32.167881] [INFO ] [LOCAL ] CABO: Starting deletion of primary data. [2025-10-28T17:47:32.168181] [DEBUG] [LOCAL ] CABO: Deleted primary data file. [2025-10-28T17:47:32.168237] [INFO ] [MAIN ] CABO: Starting full primary refresh. [2025-10-28T17:47:32.514508] [INFO ] [REMOTE ] CABO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:47:32.759338] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-01. [2025-10-28T17:47:32.921757] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-28T17:47:33.287397] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-28T17:47:33.559318] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-02. [2025-10-28T17:47:34.208631] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-28T17:47:34.359351] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-08. [2025-10-28T17:47:34.972914] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-28T17:47:35.159345] [INFO ] [REMOTE ] C: Fetching primary data for 2025-05. [2025-10-28T17:47:35.959361] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-09. [2025-10-28T17:47:36.764012] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-03. [2025-10-28T17:47:36.777468] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-28T17:47:37.092399] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-28T17:47:37.559332] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-10. [2025-10-28T17:47:37.731139] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-28T17:47:38.359346] [INFO ] [REMOTE ] C: Fetching primary data for 2025-06. [2025-10-28T17:47:39.129116] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-28T17:47:39.138408] [INFO ] [REMOTE ] BYD: Full fetch complete (65623 records). [2025-10-28T17:47:39.138527] [DEBUG] [VALIDATOR ] BYD: Validating primary data. [2025-10-28T17:47:39.170729] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-10. [2025-10-28T17:47:39.524272] [DEBUG] [VALIDATOR ] BYD: All expected trading days are present. [2025-10-28T17:47:39.524362] [DEBUG] [VALIDATOR ] BYD: Primary data validation passed. [2025-10-28T17:47:39.525209] [INFO ] [MAIN ] BYD: Fetched primary data is valid. [2025-10-28T17:47:39.525274] [DEBUG] [LOCAL ] BYD: Saving primary data. [2025-10-28T17:47:39.526619] [DEBUG] [LOCAL ] BYD: Trimmed 65623 records to 44940 (keeping 200 days of data) [2025-10-28T17:47:39.808438] [DEBUG] [LOCAL ] BYD: Primary data saved (44940 records). [2025-10-28T17:47:39.808742] [INFO ] [MAIN ] BYD: Full history saved. [2025-10-28T17:47:39.808903] [INFO ] [MAIN ] Update Progress: 381/2366 symbols completed. BYD took 51.6s. Estimated remaining: 4h 8m 4s. Rate: 8.0 symbols/min [2025-10-28T17:47:39.986160] [INFO ] [MAIN ] CACI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:47:39.962386] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-04. [2025-10-28T17:47:40.020292] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-28T17:47:40.044872] [DEBUG] [LOCAL ] CACI: Loaded 22047 existing records from primary storage. [2025-10-28T17:47:40.045102] [INFO ] [MAIN ] CACI: Loaded 22047 existing records. [2025-10-28T17:47:40.170061] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-28T17:47:40.220562] [INFO ] [REMOTE ] CAAP: Full fetch complete (28126 records). [2025-10-28T17:47:40.236428] [DEBUG] [VALIDATOR ] CAAP: Validating primary data. [2025-10-28T17:47:40.241006] [WARN ] [MAIN ] CACI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:47:40.272495] [INFO ] [MAIN ] CACI: Wiping existing primary data before full refresh. [2025-10-28T17:47:40.283963] [INFO ] [LOCAL ] CACI: Starting deletion of primary data. [2025-10-28T17:47:40.315983] [DEBUG] [LOCAL ] CACI: Deleted primary data file. [2025-10-28T17:47:40.332157] [INFO ] [MAIN ] CACI: Starting full primary refresh. [2025-10-28T17:47:40.776870] [INFO ] [REMOTE ] C: Fetching primary data for 2025-07. [2025-10-28T17:47:40.977940] [INFO ] [REMOTE ] CACI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:47:40.973770] [DEBUG] [VALIDATOR ] CAAP: All expected trading days are present. [2025-10-28T17:47:40.978418] [DEBUG] [VALIDATOR ] CAAP: Primary data validation passed. [2025-10-28T17:47:40.978924] [INFO ] [MAIN ] CAAP: Fetched primary data is valid. [2025-10-28T17:47:40.979013] [DEBUG] [LOCAL ] CAAP: Saving primary data. [2025-10-28T17:47:40.988201] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-28T17:47:40.991217] [DEBUG] [LOCAL ] CAAP: Trimmed 28126 records to 19752 (keeping 200 days of data) [2025-10-28T17:47:41.100542] [DEBUG] [LOCAL ] CAAP: Primary data saved (19752 records). [2025-10-28T17:47:41.100692] [INFO ] [MAIN ] CAAP: Full history saved. [2025-10-28T17:47:41.100774] [INFO ] [MAIN ] Update Progress: 382/2366 symbols completed. CAAP took 27.3s. Estimated remaining: 4h 7m 24s. Rate: 8.0 symbols/min [2025-10-28T17:47:41.268737] [INFO ] [MAIN ] CADE: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:47:41.311319] [DEBUG] [LOCAL ] CADE: Loaded 49705 existing records from primary storage. [2025-10-28T17:47:41.311596] [INFO ] [MAIN ] CADE: Loaded 49705 existing records. [2025-10-28T17:47:41.485165] [WARN ] [MAIN ] CADE: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:47:41.485358] [INFO ] [MAIN ] CADE: Wiping existing primary data before full refresh. [2025-10-28T17:47:41.485403] [INFO ] [LOCAL ] CADE: Starting deletion of primary data. [2025-10-28T17:47:41.485967] [DEBUG] [LOCAL ] CADE: Deleted primary data file. [2025-10-28T17:47:41.486026] [INFO ] [MAIN ] CADE: Starting full primary refresh. [2025-10-28T17:47:41.564504] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-01. [2025-10-28T17:47:41.837547] [INFO ] [REMOTE ] CADE: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:47:42.316246] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-28T17:47:42.359309] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-01. [2025-10-28T17:47:42.801099] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-28T17:47:43.159344] [INFO ] [REMOTE ] C: Fetching primary data for 2025-08. [2025-10-28T17:47:43.425784] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-28T17:47:43.959361] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-02. [2025-10-28T17:47:44.759336] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-05. [2025-10-28T17:47:44.973168] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-28T17:47:45.044871] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-28T17:47:45.559319] [INFO ] [REMOTE ] C: Fetching primary data for 2025-09. [2025-10-28T17:47:45.660376] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-28T17:47:46.359346] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-03. [2025-10-28T17:47:47.159302] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-02. [2025-10-28T17:47:47.226796] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-28T17:47:47.627486] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-28T17:47:47.959328] [INFO ] [REMOTE ] C: Fetching primary data for 2025-10. [2025-10-28T17:47:48.107056] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-28T17:47:48.759363] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-06. [2025-10-28T17:47:49.518197] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-28T17:47:49.559348] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-07. [2025-10-28T17:47:49.775228] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-28T17:47:49.786261] [INFO ] [REMOTE ] C: Full fetch complete (77919 records). [2025-10-28T17:47:49.786435] [DEBUG] [VALIDATOR ] C: Validating primary data. [2025-10-28T17:47:50.180523] [DEBUG] [VALIDATOR ] C: All expected trading days are present. [2025-10-28T17:47:50.180590] [DEBUG] [VALIDATOR ] C: Primary data validation passed. [2025-10-28T17:47:50.181402] [INFO ] [MAIN ] C: Fetched primary data is valid. [2025-10-28T17:47:50.181469] [DEBUG] [LOCAL ] C: Saving primary data. [2025-10-28T17:47:50.182995] [DEBUG] [LOCAL ] C: Trimmed 77919 records to 53741 (keeping 200 days of data) [2025-10-28T17:47:50.360221] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-04. [2025-10-28T17:47:50.422719] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-28T17:47:50.533800] [DEBUG] [LOCAL ] C: Primary data saved (53741 records). [2025-10-28T17:47:50.533942] [INFO ] [MAIN ] C: Full history saved. [2025-10-28T17:47:50.534551] [INFO ] [MAIN ] Update Progress: 383/2366 symbols completed. C took 38.6s. Estimated remaining: 4h 7m 27s. Rate: 8.0 symbols/min [2025-10-28T17:47:50.719595] [INFO ] [MAIN ] CAE: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:47:50.755752] [DEBUG] [LOCAL ] CAE: Loaded 38731 existing records from primary storage. [2025-10-28T17:47:50.756019] [INFO ] [MAIN ] CAE: Loaded 38731 existing records. [2025-10-28T17:47:50.930082] [WARN ] [MAIN ] CAE: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:47:50.930302] [INFO ] [MAIN ] CAE: Wiping existing primary data before full refresh. [2025-10-28T17:47:50.930361] [INFO ] [LOCAL ] CAE: Starting deletion of primary data. [2025-10-28T17:47:50.930704] [DEBUG] [LOCAL ] CAE: Deleted primary data file. [2025-10-28T17:47:50.930761] [INFO ] [MAIN ] CAE: Starting full primary refresh. [2025-10-28T17:47:51.167176] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-08. [2025-10-28T17:47:51.282918] [INFO ] [REMOTE ] CAE: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:47:51.482159] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-28T17:47:51.816872] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-28T17:47:51.959337] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-03. [2025-10-28T17:47:52.759352] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-01. [2025-10-28T17:47:53.029318] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-28T17:47:53.559351] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-09. [2025-10-28T17:47:53.792982] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-28T17:47:54.065273] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-28T17:47:54.359337] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-10. [2025-10-28T17:47:55.028291] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-28T17:47:55.032106] [INFO ] [REMOTE ] CABO: Full fetch complete (23141 records). [2025-10-28T17:47:55.032275] [DEBUG] [VALIDATOR ] CABO: Validating primary data. [2025-10-28T17:47:55.164746] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-04. [2025-10-28T17:47:55.587138] [DEBUG] [VALIDATOR ] CABO: All expected trading days are present. [2025-10-28T17:47:55.587240] [DEBUG] [VALIDATOR ] CABO: Primary data validation passed. [2025-10-28T17:47:55.587718] [INFO ] [MAIN ] CABO: Fetched primary data is valid. [2025-10-28T17:47:55.587783] [DEBUG] [LOCAL ] CABO: Saving primary data. [2025-10-28T17:47:55.588618] [DEBUG] [LOCAL ] CABO: Trimmed 23141 records to 16475 (keeping 200 days of data) [2025-10-28T17:47:55.692189] [DEBUG] [LOCAL ] CABO: Primary data saved (16475 records). [2025-10-28T17:47:55.692352] [INFO ] [MAIN ] CABO: Full history saved. [2025-10-28T17:47:55.692487] [INFO ] [MAIN ] Update Progress: 384/2366 symbols completed. CABO took 23.9s. Estimated remaining: 4h 7m 7s. Rate: 8.0 symbols/min [2025-10-28T17:47:55.897753] [INFO ] [MAIN ] CAF: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:47:55.904037] [DEBUG] [LOCAL ] CAF: Loaded 3393 existing records from primary storage. [2025-10-28T17:47:55.904256] [INFO ] [MAIN ] CAF: Loaded 3393 existing records. [2025-10-28T17:47:55.971242] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-05. [2025-10-28T17:47:56.116034] [WARN ] [MAIN ] CAF: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:47:56.116261] [INFO ] [MAIN ] CAF: Wiping existing primary data before full refresh. [2025-10-28T17:47:56.116311] [INFO ] [LOCAL ] CAF: Starting deletion of primary data. [2025-10-28T17:47:56.116449] [DEBUG] [LOCAL ] CAF: Deleted primary data file. [2025-10-28T17:47:56.116490] [INFO ] [MAIN ] CAF: Starting full primary refresh. [2025-10-28T17:47:56.500328] [INFO ] [REMOTE ] CAF: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:47:56.521028] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-28T17:47:56.759337] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-05. [2025-10-28T17:47:57.213358] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-28T17:47:57.463867] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-28T17:47:57.559393] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-06. [2025-10-28T17:47:58.359344] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-06. [2025-10-28T17:47:58.783038] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-28T17:47:59.083428] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-28T17:47:59.159328] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-07. [2025-10-28T17:47:59.959353] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-02. [2025-10-28T17:48:00.759332] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-07. [2025-10-28T17:48:01.161560] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-28T17:48:01.559362] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-03. [2025-10-28T17:48:02.080230] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-28T17:48:02.359355] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-08. [2025-10-28T17:48:03.159390] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-01. [2025-10-28T17:48:03.397468] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-07 (4.24 seconds). [2025-10-28T17:48:03.487789] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-28T17:48:03.565041] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-28T17:48:03.890177] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-28T17:48:03.959313] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-08. [2025-10-28T17:48:04.759341] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-09. [2025-10-28T17:48:04.796729] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-28T17:48:05.559353] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-09. [2025-10-28T17:48:06.252428] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-28T17:48:06.359319] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-02. [2025-10-28T17:48:06.419994] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-28T17:48:06.793157] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-28T17:48:07.159369] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-10. [2025-10-28T17:48:07.959346] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-04. [2025-10-28T17:48:08.664542] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-28T17:48:08.675734] [INFO ] [REMOTE ] CADE: Full fetch complete (70836 records). [2025-10-28T17:48:08.675854] [DEBUG] [VALIDATOR ] CADE: Validating primary data. [2025-10-28T17:48:08.764409] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-10. [2025-10-28T17:48:09.094638] [DEBUG] [VALIDATOR ] CADE: All expected trading days are present. [2025-10-28T17:48:09.094765] [DEBUG] [VALIDATOR ] CADE: Primary data validation passed. [2025-10-28T17:48:09.095510] [INFO ] [MAIN ] CADE: Fetched primary data is valid. [2025-10-28T17:48:09.095584] [DEBUG] [LOCAL ] CADE: Saving primary data. [2025-10-28T17:48:09.097273] [DEBUG] [LOCAL ] CADE: Trimmed 70836 records to 49726 (keeping 200 days of data) [2025-10-28T17:48:09.120107] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-28T17:48:09.421898] [DEBUG] [LOCAL ] CADE: Primary data saved (49726 records). [2025-10-28T17:48:09.422024] [INFO ] [MAIN ] CADE: Full history saved. [2025-10-28T17:48:09.422099] [INFO ] [MAIN ] Update Progress: 385/2366 symbols completed. CADE took 28.3s. Estimated remaining: 4h 7m 32s. Rate: 8.0 symbols/min [2025-10-28T17:48:09.564423] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-03. [2025-10-28T17:48:09.591613] [INFO ] [MAIN ] CAG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:48:09.591796] [DEBUG] [LOCAL ] CAG: No existing data file found in primary storage. [2025-10-28T17:48:09.591841] [WARN ] [MAIN ] CAG: No existing data found, performing full refresh instead. [2025-10-28T17:48:09.591971] [INFO ] [MAIN ] CAG: Wiping existing primary data before full refresh. [2025-10-28T17:48:09.592028] [INFO ] [LOCAL ] CAG: Starting deletion of primary data. [2025-10-28T17:48:09.592071] [DEBUG] [LOCAL ] CAG: No primary data file found to delete. [2025-10-28T17:48:09.592103] [INFO ] [MAIN ] CAG: Starting full primary refresh. [2025-10-28T17:48:09.940334] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-28T17:48:09.964803] [INFO ] [REMOTE ] CAG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:48:09.965875] [INFO ] [REMOTE ] CACI: Full fetch complete (38429 records). [2025-10-28T17:48:09.966037] [DEBUG] [VALIDATOR ] CACI: Validating primary data. [2025-10-28T17:48:10.071487] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-28T17:48:10.340752] [DEBUG] [VALIDATOR ] CACI: All expected trading days are present. [2025-10-28T17:48:10.340832] [DEBUG] [VALIDATOR ] CACI: Primary data validation passed. [2025-10-28T17:48:10.341363] [INFO ] [MAIN ] CACI: Fetched primary data is valid. [2025-10-28T17:48:10.341486] [DEBUG] [LOCAL ] CACI: Saving primary data. [2025-10-28T17:48:10.342509] [DEBUG] [LOCAL ] CACI: Trimmed 38429 records to 21921 (keeping 200 days of data) [2025-10-28T17:48:10.391828] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-04. [2025-10-28T17:48:10.473826] [DEBUG] [LOCAL ] CACI: Primary data saved (21921 records). [2025-10-28T17:48:10.473947] [INFO ] [MAIN ] CACI: Full history saved. [2025-10-28T17:48:10.474040] [INFO ] [MAIN ] Update Progress: 386/2366 symbols completed. CACI took 30.7s. Estimated remaining: 4h 6m 51s. Rate: 8.0 symbols/min [2025-10-28T17:48:10.640553] [INFO ] [MAIN ] CAH: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:48:10.692583] [DEBUG] [LOCAL ] CAH: Loaded 51367 existing records from primary storage. [2025-10-28T17:48:10.692934] [INFO ] [MAIN ] CAH: Loaded 51367 existing records. [2025-10-28T17:48:10.852422] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-10-28T17:48:10.878829] [WARN ] [MAIN ] CAH: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:48:10.881119] [INFO ] [MAIN ] CAH: Wiping existing primary data before full refresh. [2025-10-28T17:48:10.881174] [INFO ] [LOCAL ] CAH: Starting deletion of primary data. [2025-10-28T17:48:10.881789] [DEBUG] [LOCAL ] CAH: Deleted primary data file. [2025-10-28T17:48:10.881846] [INFO ] [MAIN ] CAH: Starting full primary refresh. [2025-10-28T17:48:11.162193] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-01. [2025-10-28T17:48:11.240436] [INFO ] [REMOTE ] CAH: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:48:11.959318] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-01. [2025-10-28T17:48:12.514659] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-28T17:48:12.759291] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-02. [2025-10-28T17:48:13.250295] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-28T17:48:13.559345] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-02. [2025-10-28T17:48:14.083301] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-28T17:48:14.359322] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-05. [2025-10-28T17:48:14.982524] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-28T17:48:15.077478] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-28T17:48:15.159346] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-03. [2025-10-28T17:48:15.959328] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-05. [2025-10-28T17:48:16.473671] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-28T17:48:16.759433] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-03. [2025-10-28T17:48:17.115774] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-28T17:48:17.559352] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-06. [2025-10-28T17:48:17.909114] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-28T17:48:18.270241] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-28T17:48:18.359327] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-04. [2025-10-28T17:48:19.159334] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-04. [2025-10-28T17:48:19.677787] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-28T17:48:19.959347] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-05. [2025-10-28T17:48:20.531293] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-28T17:48:20.759347] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-05. [2025-10-28T17:48:21.308369] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-28T17:48:21.559384] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-06. [2025-10-28T17:48:22.023810] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-28T17:48:22.359367] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-06. [2025-10-28T17:48:23.167277] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-07. [2025-10-28T17:48:23.172578] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-28T17:48:23.437573] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-07 (0.27 seconds). [2025-10-28T17:48:23.764413] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-28T17:48:23.959382] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-06. [2025-10-28T17:48:24.759367] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-07. [2025-10-28T17:48:25.184941] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-28T17:48:25.559354] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-07. [2025-10-28T17:48:26.172468] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-28T17:48:26.359355] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-08. [2025-10-28T17:48:26.775436] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-10-28T17:48:27.048494] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-28T17:48:27.159300] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-09. [2025-10-28T17:48:27.503460] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-10-28T17:48:27.959353] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-10. [2025-10-28T17:48:28.673726] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-28T17:48:28.675099] [INFO ] [REMOTE ] CAF: Full fetch complete (5570 records). [2025-10-28T17:48:28.675169] [DEBUG] [VALIDATOR ] CAF: Validating primary data. [2025-10-28T17:48:28.764475] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-07. [2025-10-28T17:48:29.036670] [DEBUG] [VALIDATOR ] CAF: All expected trading days are present. [2025-10-28T17:48:29.036770] [DEBUG] [VALIDATOR ] CAF: Primary data validation passed. [2025-10-28T17:48:29.036941] [INFO ] [MAIN ] CAF: Fetched primary data is valid. [2025-10-28T17:48:29.036980] [DEBUG] [LOCAL ] CAF: Saving primary data. [2025-10-28T17:48:29.037347] [DEBUG] [LOCAL ] CAF: Trimmed 5570 records to 3372 (keeping 200 days of data) [2025-10-28T17:48:29.056451] [DEBUG] [LOCAL ] CAF: Primary data saved (3372 records). [2025-10-28T17:48:29.056522] [INFO ] [MAIN ] CAF: Full history saved. [2025-10-28T17:48:29.056593] [INFO ] [MAIN ] Update Progress: 387/2366 symbols completed. CAF took 33.4s. Estimated remaining: 4h 7m 41s. Rate: 8.0 symbols/min [2025-10-28T17:48:29.224427] [INFO ] [MAIN ] CAL: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:48:29.264107] [DEBUG] [LOCAL ] CAL: Loaded 42457 existing records from primary storage. [2025-10-28T17:48:29.264373] [INFO ] [MAIN ] CAL: Loaded 42457 existing records. [2025-10-28T17:48:29.438135] [WARN ] [MAIN ] CAL: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:48:29.438344] [INFO ] [MAIN ] CAL: Wiping existing primary data before full refresh. [2025-10-28T17:48:29.438392] [INFO ] [LOCAL ] CAL: Starting deletion of primary data. [2025-10-28T17:48:29.438849] [DEBUG] [LOCAL ] CAL: Deleted primary data file. [2025-10-28T17:48:29.438905] [INFO ] [MAIN ] CAL: Starting full primary refresh. [2025-10-28T17:48:29.564408] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-08. [2025-10-28T17:48:29.794058] [INFO ] [REMOTE ] CAL: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:48:29.899537] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-28T17:48:30.359340] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-08. [2025-10-28T17:48:30.855148] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-28T17:48:31.159406] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-01. [2025-10-28T17:48:31.959315] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-08. [2025-10-28T17:48:32.020134] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-28T17:48:32.652936] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-28T17:48:32.759441] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-09. [2025-10-28T17:48:33.559308] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-09. [2025-10-28T17:48:33.689302] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-28T17:48:33.821965] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-28T17:48:34.359366] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-09. [2025-10-28T17:48:35.107851] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-28T17:48:35.159368] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-10. [2025-10-28T17:48:35.927211] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-28T17:48:35.959341] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-10. [2025-10-28T17:48:36.638987] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-28T17:48:36.647064] [INFO ] [REMOTE ] CAE: Full fetch complete (56551 records). [2025-10-28T17:48:36.647226] [DEBUG] [VALIDATOR ] CAE: Validating primary data. [2025-10-28T17:48:36.764499] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-02. [2025-10-28T17:48:37.034744] [DEBUG] [VALIDATOR ] CAE: All expected trading days are present. [2025-10-28T17:48:37.034819] [DEBUG] [VALIDATOR ] CAE: Primary data validation passed. [2025-10-28T17:48:37.035436] [INFO ] [MAIN ] CAE: Fetched primary data is valid. [2025-10-28T17:48:37.035474] [DEBUG] [LOCAL ] CAE: Saving primary data. [2025-10-28T17:48:37.036520] [DEBUG] [LOCAL ] CAE: Trimmed 56551 records to 38660 (keeping 200 days of data) [2025-10-28T17:48:37.252808] [DEBUG] [LOCAL ] CAE: Primary data saved (38660 records). [2025-10-28T17:48:37.252929] [INFO ] [MAIN ] CAE: Full history saved. [2025-10-28T17:48:37.253293] [INFO ] [MAIN ] Update Progress: 388/2366 symbols completed. CAE took 46.7s. Estimated remaining: 4h 7m 37s. Rate: 8.0 symbols/min [2025-10-28T17:48:37.422014] [INFO ] [MAIN ] CALX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:48:37.422172] [DEBUG] [LOCAL ] CALX: No existing data file found in primary storage. [2025-10-28T17:48:37.422208] [WARN ] [MAIN ] CALX: No existing data found, performing full refresh instead. [2025-10-28T17:48:37.422313] [INFO ] [MAIN ] CALX: Wiping existing primary data before full refresh. [2025-10-28T17:48:37.422353] [INFO ] [LOCAL ] CALX: Starting deletion of primary data. [2025-10-28T17:48:37.422393] [DEBUG] [LOCAL ] CALX: No primary data file found to delete. [2025-10-28T17:48:37.422424] [INFO ] [MAIN ] CALX: Starting full primary refresh. [2025-10-28T17:48:37.576123] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-10. [2025-10-28T17:48:37.796761] [INFO ] [REMOTE ] CALX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:48:37.828274] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-28T17:48:37.838888] [INFO ] [REMOTE ] CAH: Full fetch complete (74849 records). [2025-10-28T17:48:37.839068] [DEBUG] [VALIDATOR ] CAH: Validating primary data. [2025-10-28T17:48:38.227881] [DEBUG] [VALIDATOR ] CAH: All expected trading days are present. [2025-10-28T17:48:38.228004] [DEBUG] [VALIDATOR ] CAH: Primary data validation passed. [2025-10-28T17:48:38.229067] [INFO ] [MAIN ] CAH: Fetched primary data is valid. [2025-10-28T17:48:38.229144] [DEBUG] [LOCAL ] CAH: Saving primary data. [2025-10-28T17:48:38.230540] [DEBUG] [LOCAL ] CAH: Trimmed 74849 records to 51348 (keeping 200 days of data) [2025-10-28T17:48:38.359507] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-01. [2025-10-28T17:48:38.473457] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-10-28T17:48:38.586839] [DEBUG] [LOCAL ] CAH: Primary data saved (51348 records). [2025-10-28T17:48:38.586969] [INFO ] [MAIN ] CAH: Full history saved. [2025-10-28T17:48:38.588006] [INFO ] [MAIN ] Update Progress: 389/2366 symbols completed. CAH took 28.1s. Estimated remaining: 4h 6m 58s. Rate: 8.0 symbols/min [2025-10-28T17:48:38.756850] [INFO ] [MAIN ] CANG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:48:38.784309] [DEBUG] [LOCAL ] CANG: Loaded 26993 existing records from primary storage. [2025-10-28T17:48:38.784569] [INFO ] [MAIN ] CANG: Loaded 26993 existing records. [2025-10-28T17:48:38.962460] [WARN ] [MAIN ] CANG: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:48:38.962719] [INFO ] [MAIN ] CANG: Wiping existing primary data before full refresh. [2025-10-28T17:48:38.962774] [INFO ] [LOCAL ] CANG: Starting deletion of primary data. [2025-10-28T17:48:38.963196] [DEBUG] [LOCAL ] CANG: Deleted primary data file. [2025-10-28T17:48:38.963253] [INFO ] [MAIN ] CANG: Starting full primary refresh. [2025-10-28T17:48:39.165085] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-03. [2025-10-28T17:48:39.310917] [INFO ] [REMOTE ] CANG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:48:39.623516] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-10 (2.05 seconds). [2025-10-28T17:48:39.647517] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-28T17:48:39.656555] [INFO ] [REMOTE ] CAG: Full fetch complete (77827 records). [2025-10-28T17:48:39.657450] [DEBUG] [VALIDATOR ] CAG: Validating primary data. [2025-10-28T17:48:39.964461] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-02. [2025-10-28T17:48:40.047799] [DEBUG] [VALIDATOR ] CAG: All expected trading days are present. [2025-10-28T17:48:40.047895] [DEBUG] [VALIDATOR ] CAG: Primary data validation passed. [2025-10-28T17:48:40.048755] [INFO ] [MAIN ] CAG: Fetched primary data is valid. [2025-10-28T17:48:40.048816] [DEBUG] [LOCAL ] CAG: Saving primary data. [2025-10-28T17:48:40.050222] [DEBUG] [LOCAL ] CAG: Trimmed 77827 records to 53666 (keeping 200 days of data) [2025-10-28T17:48:40.396658] [DEBUG] [LOCAL ] CAG: Primary data saved (53666 records). [2025-10-28T17:48:40.408566] [INFO ] [MAIN ] CAG: Full history saved. [2025-10-28T17:48:40.408733] [INFO ] [MAIN ] Update Progress: 390/2366 symbols completed. CAG took 31.0s. Estimated remaining: 4h 6m 22s. Rate: 8.0 symbols/min [2025-10-28T17:48:40.421854] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-28T17:48:40.590940] [INFO ] [MAIN ] CAPL: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:48:40.591109] [DEBUG] [LOCAL ] CAPL: No existing data file found in primary storage. [2025-10-28T17:48:40.591147] [WARN ] [MAIN ] CAPL: No existing data found, performing full refresh instead. [2025-10-28T17:48:40.591258] [INFO ] [MAIN ] CAPL: Wiping existing primary data before full refresh. [2025-10-28T17:48:40.591298] [INFO ] [LOCAL ] CAPL: Starting deletion of primary data. [2025-10-28T17:48:40.591341] [DEBUG] [LOCAL ] CAPL: No primary data file found to delete. [2025-10-28T17:48:40.591373] [INFO ] [MAIN ] CAPL: Starting full primary refresh. [2025-10-28T17:48:40.762967] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-04. [2025-10-28T17:48:40.953460] [INFO ] [REMOTE ] CAPL: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:48:40.972056] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-28T17:48:41.559318] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-03. [2025-10-28T17:48:42.092256] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-28T17:48:42.359476] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-05. [2025-10-28T17:48:42.808321] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-28T17:48:43.159352] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-01. [2025-10-28T17:48:43.712461] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-28T17:48:43.769886] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-28T17:48:43.959339] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-02. [2025-10-28T17:48:44.442204] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-28T17:48:44.759337] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-03. [2025-10-28T17:48:45.392140] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-28T17:48:45.559334] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-06. [2025-10-28T17:48:46.359334] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-04. [2025-10-28T17:48:46.655427] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-28T17:48:47.159347] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-01. [2025-10-28T17:48:47.435391] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-28T17:48:47.959371] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-05. [2025-10-28T17:48:48.239707] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-28T17:48:48.759376] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-07. [2025-10-28T17:48:49.030237] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-28T17:48:49.559305] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-02. [2025-10-28T17:48:49.778504] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-28T17:48:50.343047] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-28T17:48:50.359305] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-03. [2025-10-28T17:48:51.159322] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-04. [2025-10-28T17:48:51.203799] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-28T17:48:51.514908] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-10-28T17:48:51.959351] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-05. [2025-10-28T17:48:52.376773] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-28T17:48:52.759349] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-06. [2025-10-28T17:48:53.559337] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-08. [2025-10-28T17:48:53.804621] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-28T17:48:54.359342] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-07. [2025-10-28T17:48:54.738712] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-28T17:48:55.159320] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-04. [2025-10-28T17:48:55.518755] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-28T17:48:55.902380] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-28T17:48:55.959342] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-09. [2025-10-28T17:48:56.759323] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-05. [2025-10-28T17:48:57.022102] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-28T17:48:57.459492] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-28T17:48:57.559305] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-06. [2025-10-28T17:48:58.359337] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-10. [2025-10-28T17:48:58.559821] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-28T17:48:59.159316] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-08. [2025-10-28T17:48:59.673583] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-28T17:48:59.682018] [INFO ] [REMOTE ] CAL: Full fetch complete (61918 records). [2025-10-28T17:48:59.682122] [DEBUG] [VALIDATOR ] CAL: Validating primary data. [2025-10-28T17:48:59.964575] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-06. [2025-10-28T17:49:00.072295] [DEBUG] [VALIDATOR ] CAL: All expected trading days are present. [2025-10-28T17:49:00.072369] [DEBUG] [VALIDATOR ] CAL: Primary data validation passed. [2025-10-28T17:49:00.073053] [INFO ] [MAIN ] CAL: Fetched primary data is valid. [2025-10-28T17:49:00.073114] [DEBUG] [LOCAL ] CAL: Saving primary data. [2025-10-28T17:49:00.074278] [DEBUG] [LOCAL ] CAL: Trimmed 61918 records to 42431 (keeping 200 days of data) [2025-10-28T17:49:00.305914] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-28T17:49:00.362627] [DEBUG] [LOCAL ] CAL: Primary data saved (42431 records). [2025-10-28T17:49:00.362778] [INFO ] [MAIN ] CAL: Full history saved. [2025-10-28T17:49:00.362856] [INFO ] [MAIN ] Update Progress: 391/2366 symbols completed. CAL took 31.3s. Estimated remaining: 4h 7m 17s. Rate: 8.0 symbols/min [2025-10-28T17:49:00.528909] [INFO ] [MAIN ] CARR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:49:00.529090] [DEBUG] [LOCAL ] CARR: No existing data file found in primary storage. [2025-10-28T17:49:00.529129] [WARN ] [MAIN ] CARR: No existing data found, performing full refresh instead. [2025-10-28T17:49:00.529260] [INFO ] [MAIN ] CARR: Wiping existing primary data before full refresh. [2025-10-28T17:49:00.529311] [INFO ] [LOCAL ] CARR: Starting deletion of primary data. [2025-10-28T17:49:00.529355] [DEBUG] [LOCAL ] CARR: No primary data file found to delete. [2025-10-28T17:49:00.529389] [INFO ] [MAIN ] CARR: Starting full primary refresh. [2025-10-28T17:49:00.764545] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-07. [2025-10-28T17:49:00.784016] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-28T17:49:00.900173] [INFO ] [REMOTE ] CARR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:49:01.559335] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-09. [2025-10-28T17:49:01.883062] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-28T17:49:02.359367] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-08. [2025-10-28T17:49:02.603351] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-28T17:49:03.159335] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-01. [2025-10-28T17:49:03.192922] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-28T17:49:03.959342] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-09. [2025-10-28T17:49:04.641433] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-28T17:49:04.759378] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-02. [2025-10-28T17:49:05.033174] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-28T17:49:05.559358] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-10. [2025-10-28T17:49:05.962215] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-28T17:49:06.359353] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-10. [2025-10-28T17:49:07.066839] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-28T17:49:07.073489] [INFO ] [REMOTE ] CALX: Full fetch complete (53979 records). [2025-10-28T17:49:07.073637] [DEBUG] [VALIDATOR ] CALX: Validating primary data. [2025-10-28T17:49:07.169464] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-03. [2025-10-28T17:49:07.465893] [DEBUG] [VALIDATOR ] CALX: All expected trading days are present. [2025-10-28T17:49:07.467812] [DEBUG] [VALIDATOR ] CALX: Primary data validation passed. [2025-10-28T17:49:07.468601] [INFO ] [MAIN ] CALX: Fetched primary data is valid. [2025-10-28T17:49:07.469043] [DEBUG] [LOCAL ] CALX: Saving primary data. [2025-10-28T17:49:07.469551] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-28T17:49:07.475616] [INFO ] [REMOTE ] CANG: Full fetch complete (39092 records). [2025-10-28T17:49:07.475894] [DEBUG] [VALIDATOR ] CANG: Validating primary data. [2025-10-28T17:49:07.476095] [DEBUG] [LOCAL ] CALX: Trimmed 53979 records to 36838 (keeping 200 days of data) [2025-10-28T17:49:07.962523] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-07. [2025-10-28T17:49:08.057341] [DEBUG] [VALIDATOR ] CANG: All expected trading days are present. [2025-10-28T17:49:08.058473] [DEBUG] [VALIDATOR ] CANG: Primary data validation passed. [2025-10-28T17:49:08.059462] [INFO ] [MAIN ] CANG: Fetched primary data is valid. [2025-10-28T17:49:08.059842] [DEBUG] [LOCAL ] CANG: Saving primary data. [2025-10-28T17:49:08.066319] [DEBUG] [LOCAL ] CANG: Trimmed 39092 records to 27056 (keeping 200 days of data) [2025-10-28T17:49:08.137012] [DEBUG] [LOCAL ] CALX: Primary data saved (36838 records). [2025-10-28T17:49:08.163027] [INFO ] [MAIN ] CALX: Full history saved. [2025-10-28T17:49:08.172035] [INFO ] [MAIN ] Update Progress: 392/2366 symbols completed. CALX took 30.9s. Estimated remaining: 4h 7m 11s. Rate: 8.0 symbols/min [2025-10-28T17:49:08.382031] [INFO ] [MAIN ] CARS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:49:08.413170] [DEBUG] [LOCAL ] CARS: No existing data file found in primary storage. [2025-10-28T17:49:08.414795] [WARN ] [MAIN ] CARS: No existing data found, performing full refresh instead. [2025-10-28T17:49:08.415216] [INFO ] [MAIN ] CARS: Wiping existing primary data before full refresh. [2025-10-28T17:49:08.415715] [INFO ] [LOCAL ] CARS: Starting deletion of primary data. [2025-10-28T17:49:08.418475] [DEBUG] [LOCAL ] CARS: No primary data file found to delete. [2025-10-28T17:49:08.429206] [DEBUG] [LOCAL ] CANG: Primary data saved (27056 records). [2025-10-28T17:49:08.429734] [INFO ] [MAIN ] CANG: Full history saved. [2025-10-28T17:49:08.429483] [INFO ] [MAIN ] CARS: Starting full primary refresh. [2025-10-28T17:49:08.430134] [INFO ] [MAIN ] Update Progress: 393/2366 symbols completed. CANG took 29.8s. Estimated remaining: 4h 6m 27s. Rate: 8.0 symbols/min [2025-10-28T17:49:08.582754] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-28T17:49:08.762673] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-08. [2025-10-28T17:49:08.835676] [INFO ] [MAIN ] CAT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:49:09.026705] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-28T17:49:09.031235] [INFO ] [REMOTE ] CARS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:49:09.079062] [DEBUG] [LOCAL ] CAT: Loaded 52903 existing records from primary storage. [2025-10-28T17:49:09.079378] [INFO ] [MAIN ] CAT: Loaded 52903 existing records. [2025-10-28T17:49:09.260143] [WARN ] [MAIN ] CAT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:49:09.260363] [INFO ] [MAIN ] CAT: Wiping existing primary data before full refresh. [2025-10-28T17:49:09.260410] [INFO ] [LOCAL ] CAT: Starting deletion of primary data. [2025-10-28T17:49:09.261547] [DEBUG] [LOCAL ] CAT: Deleted primary data file. [2025-10-28T17:49:09.261619] [INFO ] [MAIN ] CAT: Starting full primary refresh. [2025-10-28T17:49:09.369596] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-28T17:49:09.564501] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-01. [2025-10-28T17:49:09.627154] [INFO ] [REMOTE ] CAT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:49:10.359341] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-09. [2025-10-28T17:49:10.740015] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-10-28T17:49:11.110402] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-28T17:49:11.159337] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-10. [2025-10-28T17:49:11.959401] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-01. [2025-10-28T17:49:12.713553] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-28T17:49:12.715834] [INFO ] [REMOTE ] CAPL: Full fetch complete (8732 records). [2025-10-28T17:49:12.715919] [DEBUG] [VALIDATOR ] CAPL: Validating primary data. [2025-10-28T17:49:12.764465] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-04. [2025-10-28T17:49:13.095747] [DEBUG] [VALIDATOR ] CAPL: All expected trading days are present. [2025-10-28T17:49:13.095826] [DEBUG] [VALIDATOR ] CAPL: Primary data validation passed. [2025-10-28T17:49:13.096063] [INFO ] [MAIN ] CAPL: Fetched primary data is valid. [2025-10-28T17:49:13.096121] [DEBUG] [LOCAL ] CAPL: Saving primary data. [2025-10-28T17:49:13.096562] [DEBUG] [LOCAL ] CAPL: Trimmed 8732 records to 5245 (keeping 200 days of data) [2025-10-28T17:49:13.128236] [DEBUG] [LOCAL ] CAPL: Primary data saved (5245 records). [2025-10-28T17:49:13.128367] [INFO ] [MAIN ] CAPL: Full history saved. [2025-10-28T17:49:13.128494] [INFO ] [MAIN ] Update Progress: 394/2366 symbols completed. CAPL took 32.7s. Estimated remaining: 4h 6m 6s. Rate: 8.0 symbols/min [2025-10-28T17:49:13.300366] [INFO ] [MAIN ] CATO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:49:13.308568] [DEBUG] [LOCAL ] CATO: Loaded 6605 existing records from primary storage. [2025-10-28T17:49:13.308808] [INFO ] [MAIN ] CATO: Loaded 6605 existing records. [2025-10-28T17:49:13.488317] [WARN ] [MAIN ] CATO: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:49:13.488544] [INFO ] [MAIN ] CATO: Wiping existing primary data before full refresh. [2025-10-28T17:49:13.488591] [INFO ] [LOCAL ] CATO: Starting deletion of primary data. [2025-10-28T17:49:13.488737] [DEBUG] [LOCAL ] CATO: Deleted primary data file. [2025-10-28T17:49:13.488793] [INFO ] [MAIN ] CATO: Starting full primary refresh. [2025-10-28T17:49:13.565743] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-02. [2025-10-28T17:49:13.857246] [INFO ] [REMOTE ] CATO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:49:13.886739] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-28T17:49:14.359294] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-02. [2025-10-28T17:49:14.546981] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-10-28T17:49:14.559142] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-28T17:49:15.159347] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-03. [2025-10-28T17:49:15.802447] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-28T17:49:15.959328] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-03. [2025-10-28T17:49:16.340869] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-28T17:49:16.759403] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-01. [2025-10-28T17:49:17.560533] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-04. [2025-10-28T17:49:17.568701] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-28T17:49:17.580554] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-28T17:49:18.359464] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-02. [2025-10-28T17:49:18.597344] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-28T17:49:18.885177] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-28T17:49:19.159336] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-05. [2025-10-28T17:49:19.959339] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-03. [2025-10-28T17:49:20.491144] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-28T17:49:20.603538] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-28T17:49:20.759327] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-05. [2025-10-28T17:49:21.559342] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-04. [2025-10-28T17:49:22.080223] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-28T17:49:22.359332] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-06. [2025-10-28T17:49:23.126553] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-28T17:49:23.159320] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-04. [2025-10-28T17:49:23.565373] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-28T17:49:23.841388] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-28T17:49:23.959320] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-07. [2025-10-28T17:49:24.759318] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-06. [2025-10-28T17:49:24.960809] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-28T17:49:25.559369] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-08. [2025-10-28T17:49:26.337917] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-28T17:49:26.359293] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-07. [2025-10-28T17:49:26.537998] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-28T17:49:27.159332] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-05. [2025-10-28T17:49:27.760030] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-28T17:49:27.959336] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-09. [2025-10-28T17:49:28.699443] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-28T17:49:28.759349] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-05. [2025-10-28T17:49:29.159152] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-28T17:49:29.318174] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-28T17:49:29.559320] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-08. [2025-10-28T17:49:30.359384] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-06. [2025-10-28T17:49:30.828546] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-28T17:49:31.159333] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-06. [2025-10-28T17:49:31.570996] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-10-28T17:49:31.966381] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-07. [2025-10-28T17:49:31.972275] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-28T17:49:32.399047] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-28T17:49:32.759337] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-10. [2025-10-28T17:49:33.559347] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-08. [2025-10-28T17:49:34.074007] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-28T17:49:34.359295] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-09. [2025-10-28T17:49:34.397954] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-28T17:49:34.407538] [INFO ] [REMOTE ] CARS: Full fetch complete (56735 records). [2025-10-28T17:49:34.407666] [DEBUG] [VALIDATOR ] CARS: Validating primary data. [2025-10-28T17:49:34.855140] [DEBUG] [VALIDATOR ] CARS: All expected trading days are present. [2025-10-28T17:49:34.861757] [DEBUG] [VALIDATOR ] CARS: Primary data validation passed. [2025-10-28T17:49:34.862602] [INFO ] [MAIN ] CARS: Fetched primary data is valid. [2025-10-28T17:49:34.863184] [DEBUG] [LOCAL ] CARS: Saving primary data. [2025-10-28T17:49:34.863457] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-28T17:49:34.867285] [DEBUG] [LOCAL ] CARS: Trimmed 56735 records to 39539 (keeping 200 days of data) [2025-10-28T17:49:35.090941] [DEBUG] [LOCAL ] CARS: Primary data saved (39539 records). [2025-10-28T17:49:35.091090] [INFO ] [MAIN ] CARS: Full history saved. [2025-10-28T17:49:35.091163] [INFO ] [MAIN ] Update Progress: 395/2366 symbols completed. CARS took 26.9s. Estimated remaining: 4h 7m 10s. Rate: 8.0 symbols/min [2025-10-28T17:49:35.164489] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-09. [2025-10-28T17:49:35.272087] [INFO ] [MAIN ] CAVA: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:49:35.319236] [DEBUG] [LOCAL ] CAVA: Loaded 53539 existing records from primary storage. [2025-10-28T17:49:35.319562] [INFO ] [MAIN ] CAVA: Loaded 53539 existing records. [2025-10-28T17:49:35.497274] [WARN ] [MAIN ] CAVA: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:49:35.497555] [INFO ] [MAIN ] CAVA: Wiping existing primary data before full refresh. [2025-10-28T17:49:35.497607] [INFO ] [LOCAL ] CAVA: Starting deletion of primary data. [2025-10-28T17:49:35.498635] [DEBUG] [LOCAL ] CAVA: Deleted primary data file. [2025-10-28T17:49:35.498741] [INFO ] [MAIN ] CAVA: Starting full primary refresh. [2025-10-28T17:49:35.849979] [INFO ] [REMOTE ] CAVA: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:49:35.959350] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-10. [2025-10-28T17:49:36.383746] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-28T17:49:36.385496] [INFO ] [REMOTE ] CATO: Full fetch complete (10600 records). [2025-10-28T17:49:36.385564] [DEBUG] [VALIDATOR ] CATO: Validating primary data. [2025-10-28T17:49:36.759299] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-07. [2025-10-28T17:49:36.766326] [DEBUG] [VALIDATOR ] CATO: All expected trading days are present. [2025-10-28T17:49:36.766498] [DEBUG] [VALIDATOR ] CATO: Primary data validation passed. [2025-10-28T17:49:36.766836] [INFO ] [MAIN ] CATO: Fetched primary data is valid. [2025-10-28T17:49:36.766936] [DEBUG] [LOCAL ] CATO: Saving primary data. [2025-10-28T17:49:36.767695] [DEBUG] [LOCAL ] CATO: Trimmed 10600 records to 6662 (keeping 200 days of data) [2025-10-28T17:49:36.805881] [DEBUG] [LOCAL ] CATO: Primary data saved (6662 records). [2025-10-28T17:49:36.805988] [INFO ] [MAIN ] CATO: Full history saved. [2025-10-28T17:49:36.806063] [INFO ] [MAIN ] Update Progress: 396/2366 symbols completed. CATO took 23.7s. Estimated remaining: 4h 6m 34s. Rate: 8.0 symbols/min [2025-10-28T17:49:36.992472] [INFO ] [MAIN ] CB: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:49:37.028106] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-28T17:49:37.077900] [DEBUG] [LOCAL ] CB: Loaded 49917 existing records from primary storage. [2025-10-28T17:49:37.078196] [INFO ] [MAIN ] CB: Loaded 49917 existing records. [2025-10-28T17:49:37.248559] [WARN ] [MAIN ] CB: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:49:37.248775] [INFO ] [MAIN ] CB: Wiping existing primary data before full refresh. [2025-10-28T17:49:37.248823] [INFO ] [LOCAL ] CB: Starting deletion of primary data. [2025-10-28T17:49:37.249615] [DEBUG] [LOCAL ] CB: Deleted primary data file. [2025-10-28T17:49:37.249703] [INFO ] [MAIN ] CB: Starting full primary refresh. [2025-10-28T17:49:37.567674] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-10. [2025-10-28T17:49:37.596346] [INFO ] [REMOTE ] CB: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:49:38.359323] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-01. [2025-10-28T17:49:38.399813] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-28T17:49:39.148028] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-28T17:49:39.159307] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-01. [2025-10-28T17:49:39.159521] [INFO ] [REMOTE ] CARR: Full fetch complete (77770 records). [2025-10-28T17:49:39.160430] [DEBUG] [VALIDATOR ] CARR: Validating primary data. [2025-10-28T17:49:39.555378] [DEBUG] [VALIDATOR ] CARR: All expected trading days are present. [2025-10-28T17:49:39.555526] [DEBUG] [VALIDATOR ] CARR: Primary data validation passed. [2025-10-28T17:49:39.556354] [INFO ] [MAIN ] CARR: Fetched primary data is valid. [2025-10-28T17:49:39.556416] [DEBUG] [LOCAL ] CARR: Saving primary data. [2025-10-28T17:49:39.557891] [DEBUG] [LOCAL ] CARR: Trimmed 77770 records to 53601 (keeping 200 days of data) [2025-10-28T17:49:39.902245] [DEBUG] [LOCAL ] CARR: Primary data saved (53601 records). [2025-10-28T17:49:39.902589] [INFO ] [MAIN ] CARR: Full history saved. [2025-10-28T17:49:39.902732] [INFO ] [MAIN ] Update Progress: 397/2366 symbols completed. CARR took 39.5s. Estimated remaining: 4h 6m 5s. Rate: 8.0 symbols/min [2025-10-28T17:49:39.904253] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-28T17:49:39.959304] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-08. [2025-10-28T17:49:40.759485] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-02. [2025-10-28T17:49:40.988545] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-28T17:49:41.506332] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-28T17:49:41.559315] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-09. [2025-10-28T17:49:42.010238] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-28T17:49:42.359353] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-02. [2025-10-28T17:49:43.045894] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-10-28T17:49:43.159331] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-10. [2025-10-28T17:49:43.845989] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-28T17:49:43.959335] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-03. [2025-10-28T17:49:44.759370] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-03. [2025-10-28T17:49:45.236835] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-10 (2.08 seconds). [2025-10-28T17:49:45.247828] [INFO ] [REMOTE ] CAT: Full fetch complete (76857 records). [2025-10-28T17:49:45.247978] [DEBUG] [VALIDATOR ] CAT: Validating primary data. [2025-10-28T17:49:45.396784] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-28T17:49:45.573082] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-04. [2025-10-28T17:49:45.676476] [DEBUG] [VALIDATOR ] CAT: All expected trading days are present. [2025-10-28T17:49:45.676554] [DEBUG] [VALIDATOR ] CAT: Primary data validation passed. [2025-10-28T17:49:45.677412] [INFO ] [MAIN ] CAT: Fetched primary data is valid. [2025-10-28T17:49:45.677475] [DEBUG] [LOCAL ] CAT: Saving primary data. [2025-10-28T17:49:45.678966] [DEBUG] [LOCAL ] CAT: Trimmed 76857 records to 52900 (keeping 200 days of data) [2025-10-28T17:49:46.002831] [DEBUG] [LOCAL ] CAT: Primary data saved (52900 records). [2025-10-28T17:49:46.002962] [INFO ] [MAIN ] CAT: Full history saved. [2025-10-28T17:49:46.003733] [INFO ] [MAIN ] Update Progress: 398/2366 symbols completed. CAT took 37.5s. Estimated remaining: 4h 5m 50s. Rate: 8.0 symbols/min [2025-10-28T17:49:46.383429] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-28T17:49:46.395183] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-04. [2025-10-28T17:49:47.045481] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-28T17:49:47.159317] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-05. [2025-10-28T17:49:47.827199] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-28T17:49:47.959299] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-05. [2025-10-28T17:49:48.412060] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-28T17:49:48.759384] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-06. [2025-10-28T17:49:49.555220] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-28T17:49:49.567372] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-06. [2025-10-28T17:49:50.681785] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-28T17:49:50.697503] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-07. [2025-10-28T17:49:51.153749] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-28T17:49:51.169022] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-07. [2025-10-28T17:49:52.007714] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-28T17:49:52.018749] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-08. [2025-10-28T17:49:52.672584] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-28T17:49:52.759329] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-08. [2025-10-28T17:49:53.180300] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-28T17:49:53.559342] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-09. [2025-10-28T17:49:54.139622] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-28T17:49:54.359328] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-09. [2025-10-28T17:49:54.866037] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-28T17:49:55.159335] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-10. [2025-10-28T17:49:55.764381] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-28T17:49:55.959349] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-10. [2025-10-28T17:49:57.158240] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-10 (2.00 seconds). [2025-10-28T17:49:57.168399] [INFO ] [REMOTE ] CB: Full fetch complete (72843 records). [2025-10-28T17:49:57.168556] [DEBUG] [VALIDATOR ] CB: Validating primary data. [2025-10-28T17:49:57.552149] [DEBUG] [VALIDATOR ] CB: All expected trading days are present. [2025-10-28T17:49:57.552284] [DEBUG] [VALIDATOR ] CB: Primary data validation passed. [2025-10-28T17:49:57.553228] [INFO ] [MAIN ] CB: Fetched primary data is valid. [2025-10-28T17:49:57.553313] [DEBUG] [LOCAL ] CB: Saving primary data. [2025-10-28T17:49:57.554847] [DEBUG] [LOCAL ] CB: Trimmed 72843 records to 49912 (keeping 200 days of data) [2025-10-28T17:49:57.867639] [DEBUG] [LOCAL ] CB: Primary data saved (49912 records). [2025-10-28T17:49:57.867899] [INFO ] [MAIN ] CB: Full history saved. [2025-10-28T17:49:57.867991] [INFO ] [MAIN ] Update Progress: 399/2366 symbols completed. CB took 21.1s. Estimated remaining: 4h 6m 4s. Rate: 8.0 symbols/min [2025-10-28T17:49:57.898734] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-10 (1.94 seconds). [2025-10-28T17:49:57.909419] [INFO ] [REMOTE ] CAVA: Full fetch complete (77455 records). [2025-10-28T17:49:57.909558] [DEBUG] [VALIDATOR ] CAVA: Validating primary data. [2025-10-28T17:49:58.291832] [DEBUG] [VALIDATOR ] CAVA: All expected trading days are present. [2025-10-28T17:49:58.291909] [DEBUG] [VALIDATOR ] CAVA: Primary data validation passed. [2025-10-28T17:49:58.292717] [INFO ] [MAIN ] CAVA: Fetched primary data is valid. [2025-10-28T17:49:58.292776] [DEBUG] [LOCAL ] CAVA: Saving primary data. [2025-10-28T17:49:58.294137] [DEBUG] [LOCAL ] CAVA: Trimmed 77455 records to 53531 (keeping 200 days of data) [2025-10-28T17:49:58.601679] [DEBUG] [LOCAL ] CAVA: Primary data saved (53531 records). [2025-10-28T17:49:58.601801] [INFO ] [MAIN ] CAVA: Full history saved. [2025-10-28T17:49:58.602240] [INFO ] [MAIN ] Update Progress: 400/2366 symbols completed. CAVA took 23.5s. Estimated remaining: 4h 5m 23s. Rate: 8.0 symbols/min [2025-10-28T17:49:59.234498] [INFO ] [MAIN ] CBAN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:49:59.271476] [INFO ] [MAIN ] CBNA: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:49:59.269033] [INFO ] [MAIN ] CBO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:49:59.321127] [INFO ] [MAIN ] CBL: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:49:59.322948] [DEBUG] [LOCAL ] CBO: No existing data file found in primary storage. [2025-10-28T17:49:59.325934] [DEBUG] [LOCAL ] CBNA: Loaded 2817 existing records from primary storage. [2025-10-28T17:49:59.326451] [INFO ] [MAIN ] CBNA: Loaded 2817 existing records. [2025-10-28T17:49:59.326162] [WARN ] [MAIN ] CBO: No existing data found, performing full refresh instead. [2025-10-28T17:49:59.367832] [INFO ] [MAIN ] CBO: Wiping existing primary data before full refresh. [2025-10-28T17:49:59.410298] [INFO ] [LOCAL ] CBO: Starting deletion of primary data. [2025-10-28T17:49:59.438674] [DEBUG] [LOCAL ] CBO: No primary data file found to delete. [2025-10-28T17:49:59.455481] [INFO ] [MAIN ] CBO: Starting full primary refresh. [2025-10-28T17:49:59.474930] [DEBUG] [LOCAL ] CBL: Loaded 15649 existing records from primary storage. [2025-10-28T17:49:59.475187] [DEBUG] [LOCAL ] CBAN: Loaded 10025 existing records from primary storage. [2025-10-28T17:49:59.505677] [INFO ] [MAIN ] CBAN: Loaded 10025 existing records. [2025-10-28T17:49:59.554719] [INFO ] [MAIN ] CBL: Loaded 15649 existing records. [2025-10-28T17:49:59.643450] [WARN ] [MAIN ] CBNA: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:49:59.682040] [INFO ] [MAIN ] CBNA: Wiping existing primary data before full refresh. [2025-10-28T17:49:59.729460] [INFO ] [LOCAL ] CBNA: Starting deletion of primary data. [2025-10-28T17:49:59.763349] [DEBUG] [LOCAL ] CBNA: Deleted primary data file. [2025-10-28T17:49:59.789804] [INFO ] [MAIN ] CBNA: Starting full primary refresh. [2025-10-28T17:50:00.327102] [WARN ] [MAIN ] CBAN: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:50:00.369522] [INFO ] [MAIN ] CBAN: Wiping existing primary data before full refresh. [2025-10-28T17:50:00.395403] [INFO ] [LOCAL ] CBAN: Starting deletion of primary data. [2025-10-28T17:50:00.357986] [WARN ] [MAIN ] CBL: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:50:00.443246] [DEBUG] [LOCAL ] CBAN: Deleted primary data file. [2025-10-28T17:50:00.485779] [INFO ] [MAIN ] CBAN: Starting full primary refresh. [2025-10-28T17:50:00.509237] [INFO ] [MAIN ] CBL: Wiping existing primary data before full refresh. [2025-10-28T17:50:00.603380] [INFO ] [LOCAL ] CBL: Starting deletion of primary data. [2025-10-28T17:50:00.603247] [INFO ] [REMOTE ] CBO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:50:00.641465] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-01. [2025-10-28T17:50:00.621241] [DEBUG] [LOCAL ] CBL: Deleted primary data file. [2025-10-28T17:50:00.666244] [INFO ] [MAIN ] CBL: Starting full primary refresh. [2025-10-28T17:50:00.884908] [INFO ] [REMOTE ] CBNA: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:50:00.965458] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-01. [2025-10-28T17:50:01.345924] [INFO ] [REMOTE ] CBAN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:50:01.363318] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-01. [2025-10-28T17:50:01.426171] [INFO ] [REMOTE ] CBL: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:50:01.426637] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-01. [2025-10-28T17:50:01.443985] [DEBUG] [REMOTE ] CBO: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-28T17:50:01.444552] [WARN ] [REMOTE ] CBO: No data returned for month 2025-01 [2025-10-28T17:50:01.444708] [FATAL] [REMOTE ] CBO: API call failed - aborting fetch to avoid wasting further API calls [2025-10-28T17:50:01.444802] [FATAL] [MAIN ] CBO: Failed to fetch primary data. [2025-10-28T17:50:01.444883] [WARN ] [MAIN ] CBO: Deleting existing primary and derivative data due to fetch failure. [2025-10-28T17:50:01.444975] [INFO ] [LOCAL ] CBO: Starting deletion of primary data. [2025-10-28T17:50:01.445085] [DEBUG] [LOCAL ] CBO: No primary data file found to delete. [2025-10-28T17:50:01.445359] [INFO ] [LOCAL ] CBO: Starting deletion of derivative data. [2025-10-28T17:50:01.445449] [DEBUG] [LOCAL ] CBO: No derivative data file found to delete. [2025-10-28T17:50:01.445540] [INFO ] [MAIN ] Update Progress: 401/2366 symbols completed. CBO took 2.8s. Estimated remaining: 4h 4m 53s. Rate: 8.0 symbols/min [2025-10-28T17:50:01.643427] [INFO ] [MAIN ] CBRE: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:50:01.707212] [DEBUG] [LOCAL ] CBRE: Loaded 50256 existing records from primary storage. [2025-10-28T17:50:01.707875] [INFO ] [MAIN ] CBRE: Loaded 50256 existing records. [2025-10-28T17:50:01.907126] [WARN ] [MAIN ] CBRE: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:50:01.907358] [INFO ] [MAIN ] CBRE: Wiping existing primary data before full refresh. [2025-10-28T17:50:01.907405] [INFO ] [LOCAL ] CBRE: Starting deletion of primary data. [2025-10-28T17:50:01.908052] [DEBUG] [LOCAL ] CBRE: Deleted primary data file. [2025-10-28T17:50:01.908111] [INFO ] [MAIN ] CBRE: Starting full primary refresh. [2025-10-28T17:50:02.040022] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-28T17:50:02.053158] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-02. [2025-10-28T17:50:02.305804] [INFO ] [REMOTE ] CBRE: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:50:02.306176] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-01. [2025-10-28T17:50:02.316275] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-28T17:50:02.320183] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-02. [2025-10-28T17:50:02.695304] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-28T17:50:02.696589] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-03. [2025-10-28T17:50:02.854109] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-28T17:50:02.976307] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-03 (0.28 seconds). [2025-10-28T17:50:03.159316] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-04. [2025-10-28T17:50:03.359823] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-28T17:50:03.518637] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-10-28T17:50:03.959312] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-02. [2025-10-28T17:50:04.014634] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-28T17:50:04.658884] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-28T17:50:04.759362] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-03. [2025-10-28T17:50:05.350547] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-28T17:50:05.559350] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-04. [2025-10-28T17:50:06.110495] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-28T17:50:06.359365] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-05. [2025-10-28T17:50:06.951348] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-28T17:50:07.159341] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-05. [2025-10-28T17:50:07.427371] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-05 (0.27 seconds). [2025-10-28T17:50:07.959342] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-06. [2025-10-28T17:50:08.302142] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-28T17:50:08.759339] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-07. [2025-10-28T17:50:09.058168] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-07 (0.30 seconds). [2025-10-28T17:50:09.559352] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-08. [2025-10-28T17:50:09.945475] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-10-28T17:50:10.359377] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-02. [2025-10-28T17:50:11.159317] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-03. [2025-10-28T17:50:11.434582] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-28T17:50:11.839119] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-28T17:50:11.959359] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-06. [2025-10-28T17:50:12.759348] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-04. [2025-10-28T17:50:12.989114] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-28T17:50:13.559351] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-03. [2025-10-28T17:50:14.359345] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-09. [2025-10-28T17:50:14.450152] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-10-28T17:50:15.159350] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-05. [2025-10-28T17:50:15.284158] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-28T17:50:15.959449] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-07. [2025-10-28T17:50:16.489474] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-28T17:50:16.699084] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-09 (2.34 seconds). [2025-10-28T17:50:16.759311] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-10. [2025-10-28T17:50:17.208025] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-10-28T17:50:17.559354] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-06. [2025-10-28T17:50:18.062537] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-28T17:50:18.063447] [INFO ] [REMOTE ] CBNA: Full fetch complete (4183 records). [2025-10-28T17:50:18.063514] [DEBUG] [VALIDATOR ] CBNA: Validating primary data. [2025-10-28T17:50:18.361423] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-08. [2025-10-28T17:50:18.355956] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-28T17:50:18.440089] [DEBUG] [VALIDATOR ] CBNA: All expected trading days are present. [2025-10-28T17:50:18.440167] [DEBUG] [VALIDATOR ] CBNA: Primary data validation passed. [2025-10-28T17:50:18.440319] [INFO ] [MAIN ] CBNA: Fetched primary data is valid. [2025-10-28T17:50:18.440357] [DEBUG] [LOCAL ] CBNA: Saving primary data. [2025-10-28T17:50:18.440787] [DEBUG] [LOCAL ] CBNA: Trimmed 4183 records to 2806 (keeping 200 days of data) [2025-10-28T17:50:18.456591] [DEBUG] [LOCAL ] CBNA: Primary data saved (2806 records). [2025-10-28T17:50:18.456687] [INFO ] [MAIN ] CBNA: Full history saved. [2025-10-28T17:50:18.456770] [INFO ] [MAIN ] Update Progress: 402/2366 symbols completed. CBNA took 19.9s. Estimated remaining: 4h 5m 32s. Rate: 8.0 symbols/min [2025-10-28T17:50:18.619844] [INFO ] [MAIN ] CBT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:50:18.648938] [DEBUG] [LOCAL ] CBT: Loaded 30570 existing records from primary storage. [2025-10-28T17:50:18.649198] [INFO ] [MAIN ] CBT: Loaded 30570 existing records. [2025-10-28T17:50:18.824429] [WARN ] [MAIN ] CBT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:50:18.824711] [INFO ] [MAIN ] CBT: Wiping existing primary data before full refresh. [2025-10-28T17:50:18.824767] [INFO ] [LOCAL ] CBT: Starting deletion of primary data. [2025-10-28T17:50:18.825183] [DEBUG] [LOCAL ] CBT: Deleted primary data file. [2025-10-28T17:50:18.825240] [INFO ] [MAIN ] CBT: Starting full primary refresh. [2025-10-28T17:50:19.139325] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-28T17:50:19.164263] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-04. [2025-10-28T17:50:19.195044] [INFO ] [REMOTE ] CBT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:50:19.959346] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-01. [2025-10-28T17:50:20.764268] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-09. [2025-10-28T17:50:20.771779] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-28T17:50:20.935250] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-28T17:50:21.265940] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-28T17:50:21.559344] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-10. [2025-10-28T17:50:22.359355] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-05. [2025-10-28T17:50:22.797840] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-28T17:50:22.801171] [INFO ] [REMOTE ] CBAN: Full fetch complete (16376 records). [2025-10-28T17:50:22.801274] [DEBUG] [VALIDATOR ] CBAN: Validating primary data. [2025-10-28T17:50:23.164485] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-02. [2025-10-28T17:50:23.172625] [DEBUG] [VALIDATOR ] CBAN: All expected trading days are present. [2025-10-28T17:50:23.173390] [DEBUG] [VALIDATOR ] CBAN: Primary data validation passed. [2025-10-28T17:50:23.173761] [INFO ] [MAIN ] CBAN: Fetched primary data is valid. [2025-10-28T17:50:23.173822] [DEBUG] [LOCAL ] CBAN: Saving primary data. [2025-10-28T17:50:23.174416] [DEBUG] [LOCAL ] CBAN: Trimmed 16376 records to 10006 (keeping 200 days of data) [2025-10-28T17:50:23.233852] [DEBUG] [LOCAL ] CBAN: Primary data saved (10006 records). [2025-10-28T17:50:23.234074] [INFO ] [MAIN ] CBAN: Full history saved. [2025-10-28T17:50:23.234173] [INFO ] [MAIN ] Update Progress: 403/2366 symbols completed. CBAN took 24.6s. Estimated remaining: 4h 5m 11s. Rate: 8.0 symbols/min [2025-10-28T17:50:23.401826] [INFO ] [MAIN ] CBU: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:50:23.422786] [DEBUG] [LOCAL ] CBU: Loaded 22333 existing records from primary storage. [2025-10-28T17:50:23.423028] [INFO ] [MAIN ] CBU: Loaded 22333 existing records. [2025-10-28T17:50:23.607730] [WARN ] [MAIN ] CBU: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:50:23.608767] [INFO ] [MAIN ] CBU: Wiping existing primary data before full refresh. [2025-10-28T17:50:23.608928] [INFO ] [LOCAL ] CBU: Starting deletion of primary data. [2025-10-28T17:50:23.609798] [DEBUG] [LOCAL ] CBU: Deleted primary data file. [2025-10-28T17:50:23.609858] [INFO ] [MAIN ] CBU: Starting full primary refresh. [2025-10-28T17:50:23.779767] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-28T17:50:23.964422] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-07. [2025-10-28T17:50:24.015782] [INFO ] [REMOTE ] CBU: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:50:24.199626] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-28T17:50:24.759388] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-01. [2025-10-28T17:50:25.031755] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-28T17:50:25.559385] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-08. [2025-10-28T17:50:25.804066] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-28T17:50:26.131684] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-28T17:50:26.359340] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-09. [2025-10-28T17:50:27.159333] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-02. [2025-10-28T17:50:27.184871] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-28T17:50:27.861010] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-28T17:50:27.959323] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-03. [2025-10-28T17:50:28.667844] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-28T17:50:28.759326] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-03. [2025-10-28T17:50:29.559310] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-06. [2025-10-28T17:50:29.724736] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-28T17:50:30.359340] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-04. [2025-10-28T17:50:31.060596] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-28T17:50:31.087239] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-28T17:50:31.159334] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-07. [2025-10-28T17:50:31.959344] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-05. [2025-10-28T17:50:32.459415] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-28T17:50:32.729352] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-28T17:50:32.759350] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-04. [2025-10-28T17:50:33.559335] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-06. [2025-10-28T17:50:33.853801] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-28T17:50:34.354972] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-28T17:50:34.359375] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-07. [2025-10-28T17:50:35.166278] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-08. [2025-10-28T17:50:35.170374] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-28T17:50:35.959337] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-10. [2025-10-28T17:50:36.627305] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-28T17:50:36.759317] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-08. [2025-10-28T17:50:37.559402] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-05. [2025-10-28T17:50:37.992525] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-10 (2.03 seconds). [2025-10-28T17:50:37.997554] [INFO ] [REMOTE ] CBL: Full fetch complete (24518 records). [2025-10-28T17:50:37.997787] [DEBUG] [VALIDATOR ] CBL: Validating primary data. [2025-10-28T17:50:38.374081] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-09. [2025-10-28T17:50:38.429856] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-28T17:50:38.451547] [DEBUG] [VALIDATOR ] CBL: All expected trading days are present. [2025-10-28T17:50:38.452002] [DEBUG] [VALIDATOR ] CBL: Primary data validation passed. [2025-10-28T17:50:38.452737] [INFO ] [MAIN ] CBL: Fetched primary data is valid. [2025-10-28T17:50:38.452833] [DEBUG] [LOCAL ] CBL: Saving primary data. [2025-10-28T17:50:38.453837] [DEBUG] [LOCAL ] CBL: Trimmed 24518 records to 15582 (keeping 200 days of data) [2025-10-28T17:50:38.549300] [DEBUG] [LOCAL ] CBL: Primary data saved (15582 records). [2025-10-28T17:50:38.549477] [INFO ] [MAIN ] CBL: Full history saved. [2025-10-28T17:50:38.549604] [INFO ] [MAIN ] Update Progress: 404/2366 symbols completed. CBL took 39.9s. Estimated remaining: 4h 5m 42s. Rate: 8.0 symbols/min [2025-10-28T17:50:38.732697] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-28T17:50:38.749571] [INFO ] [MAIN ] CBX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:50:38.756504] [DEBUG] [LOCAL ] CBX: No existing data file found in primary storage. [2025-10-28T17:50:38.756564] [WARN ] [MAIN ] CBX: No existing data found, performing full refresh instead. [2025-10-28T17:50:38.757073] [INFO ] [MAIN ] CBX: Wiping existing primary data before full refresh. [2025-10-28T17:50:38.757168] [INFO ] [LOCAL ] CBX: Starting deletion of primary data. [2025-10-28T17:50:38.757479] [DEBUG] [LOCAL ] CBX: No primary data file found to delete. [2025-10-28T17:50:38.757529] [INFO ] [MAIN ] CBX: Starting full primary refresh. [2025-10-28T17:50:39.123136] [INFO ] [REMOTE ] CBX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:50:39.159302] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-06. [2025-10-28T17:50:39.959313] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-01. [2025-10-28T17:50:40.008360] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-28T17:50:40.036381] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-28T17:50:40.103245] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-28T17:50:40.103585] [WARN ] [REMOTE ] CBX: No data returned for month 2025-01 [2025-10-28T17:50:40.103710] [FATAL] [REMOTE ] CBX: API call failed - aborting fetch to avoid wasting further API calls [2025-10-28T17:50:40.103776] [FATAL] [MAIN ] CBX: Failed to fetch primary data. [2025-10-28T17:50:40.103840] [WARN ] [MAIN ] CBX: Deleting existing primary and derivative data due to fetch failure. [2025-10-28T17:50:40.103911] [INFO ] [LOCAL ] CBX: Starting deletion of primary data. [2025-10-28T17:50:40.103974] [DEBUG] [LOCAL ] CBX: No primary data file found to delete. [2025-10-28T17:50:40.104016] [INFO ] [LOCAL ] CBX: Starting deletion of derivative data. [2025-10-28T17:50:40.104096] [DEBUG] [LOCAL ] CBX: No derivative data file found to delete. [2025-10-28T17:50:40.104161] [INFO ] [MAIN ] Update Progress: 405/2366 symbols completed. CBX took 1.6s. Estimated remaining: 4h 5m 6s. Rate: 8.0 symbols/min [2025-10-28T17:50:40.276591] [INFO ] [MAIN ] CBZ: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:50:40.309682] [DEBUG] [LOCAL ] CBZ: Loaded 34157 existing records from primary storage. [2025-10-28T17:50:40.309963] [INFO ] [MAIN ] CBZ: Loaded 34157 existing records. [2025-10-28T17:50:40.488430] [WARN ] [MAIN ] CBZ: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:50:40.488639] [INFO ] [MAIN ] CBZ: Wiping existing primary data before full refresh. [2025-10-28T17:50:40.488737] [INFO ] [LOCAL ] CBZ: Starting deletion of primary data. [2025-10-28T17:50:40.489181] [DEBUG] [LOCAL ] CBZ: Deleted primary data file. [2025-10-28T17:50:40.489240] [INFO ] [MAIN ] CBZ: Starting full primary refresh. [2025-10-28T17:50:40.766811] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-07. [2025-10-28T17:50:40.850120] [INFO ] [REMOTE ] CBZ: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:50:41.559349] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-10. [2025-10-28T17:50:41.733501] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-28T17:50:42.359343] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-09. [2025-10-28T17:50:43.057317] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-28T17:50:43.139492] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-28T17:50:43.152204] [INFO ] [REMOTE ] CBRE: Full fetch complete (73731 records). [2025-10-28T17:50:43.152371] [DEBUG] [VALIDATOR ] CBRE: Validating primary data. [2025-10-28T17:50:43.164677] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-08. [2025-10-28T17:50:43.544402] [DEBUG] [VALIDATOR ] CBRE: All expected trading days are present. [2025-10-28T17:50:43.544481] [DEBUG] [VALIDATOR ] CBRE: Primary data validation passed. [2025-10-28T17:50:43.545274] [INFO ] [MAIN ] CBRE: Fetched primary data is valid. [2025-10-28T17:50:43.545366] [DEBUG] [LOCAL ] CBRE: Saving primary data. [2025-10-28T17:50:43.546731] [DEBUG] [LOCAL ] CBRE: Trimmed 73731 records to 50235 (keeping 200 days of data) [2025-10-28T17:50:43.837584] [DEBUG] [LOCAL ] CBRE: Primary data saved (50235 records). [2025-10-28T17:50:43.837737] [INFO ] [MAIN ] CBRE: Full history saved. [2025-10-28T17:50:43.838342] [INFO ] [MAIN ] Update Progress: 406/2366 symbols completed. CBRE took 42.4s. Estimated remaining: 4h 4m 40s. Rate: 8.0 symbols/min [2025-10-28T17:50:43.964435] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-10. [2025-10-28T17:50:44.008638] [INFO ] [MAIN ] CC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:50:44.065150] [DEBUG] [LOCAL ] CC: Loaded 52972 existing records from primary storage. [2025-10-28T17:50:44.065506] [INFO ] [MAIN ] CC: Loaded 52972 existing records. [2025-10-28T17:50:44.243844] [WARN ] [MAIN ] CC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:50:44.244051] [INFO ] [MAIN ] CC: Wiping existing primary data before full refresh. [2025-10-28T17:50:44.244097] [INFO ] [LOCAL ] CC: Starting deletion of primary data. [2025-10-28T17:50:44.244697] [DEBUG] [LOCAL ] CC: Deleted primary data file. [2025-10-28T17:50:44.244756] [INFO ] [MAIN ] CC: Starting full primary refresh. [2025-10-28T17:50:44.604586] [INFO ] [REMOTE ] CC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:50:44.623638] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-28T17:50:44.759339] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-09. [2025-10-28T17:50:45.340895] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-28T17:50:45.345682] [INFO ] [REMOTE ] CBU: Full fetch complete (32551 records). [2025-10-28T17:50:45.345805] [DEBUG] [VALIDATOR ] CBU: Validating primary data. [2025-10-28T17:50:45.564500] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-01. [2025-10-28T17:50:45.730767] [DEBUG] [VALIDATOR ] CBU: All expected trading days are present. [2025-10-28T17:50:45.730869] [DEBUG] [VALIDATOR ] CBU: Primary data validation passed. [2025-10-28T17:50:45.731558] [INFO ] [MAIN ] CBU: Fetched primary data is valid. [2025-10-28T17:50:45.731716] [DEBUG] [LOCAL ] CBU: Saving primary data. [2025-10-28T17:50:45.750369] [DEBUG] [LOCAL ] CBU: Trimmed 32551 records to 22252 (keeping 200 days of data) [2025-10-28T17:50:45.752094] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-28T17:50:45.887840] [DEBUG] [LOCAL ] CBU: Primary data saved (22252 records). [2025-10-28T17:50:45.887964] [INFO ] [MAIN ] CBU: Full history saved. [2025-10-28T17:50:45.888039] [INFO ] [MAIN ] Update Progress: 407/2366 symbols completed. CBU took 22.7s. Estimated remaining: 4h 4m 6s. Rate: 8.0 symbols/min [2025-10-28T17:50:46.055633] [INFO ] [MAIN ] CCI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:50:46.103947] [DEBUG] [LOCAL ] CCI: Loaded 53098 existing records from primary storage. [2025-10-28T17:50:46.104249] [INFO ] [MAIN ] CCI: Loaded 53098 existing records. [2025-10-28T17:50:46.277519] [WARN ] [MAIN ] CCI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:50:46.277710] [INFO ] [MAIN ] CCI: Wiping existing primary data before full refresh. [2025-10-28T17:50:46.277766] [INFO ] [LOCAL ] CCI: Starting deletion of primary data. [2025-10-28T17:50:46.278370] [DEBUG] [LOCAL ] CCI: Deleted primary data file. [2025-10-28T17:50:46.278428] [INFO ] [MAIN ] CCI: Starting full primary refresh. [2025-10-28T17:50:46.367297] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-01. [2025-10-28T17:50:46.631773] [INFO ] [REMOTE ] CCI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:50:46.719722] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-28T17:50:47.159325] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-02. [2025-10-28T17:50:47.921571] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-28T17:50:47.959323] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-03. [2025-10-28T17:50:48.114309] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-28T17:50:48.759363] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-10. [2025-10-28T17:50:48.864255] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-28T17:50:49.559361] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-02. [2025-10-28T17:50:50.005901] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-28T17:50:50.012191] [INFO ] [REMOTE ] CBT: Full fetch complete (45679 records). [2025-10-28T17:50:50.012292] [DEBUG] [VALIDATOR ] CBT: Validating primary data. [2025-10-28T17:50:50.374043] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-01. [2025-10-28T17:50:50.391334] [DEBUG] [VALIDATOR ] CBT: All expected trading days are present. [2025-10-28T17:50:50.391416] [DEBUG] [VALIDATOR ] CBT: Primary data validation passed. [2025-10-28T17:50:50.391996] [INFO ] [MAIN ] CBT: Fetched primary data is valid. [2025-10-28T17:50:50.392056] [DEBUG] [LOCAL ] CBT: Saving primary data. [2025-10-28T17:50:50.393328] [DEBUG] [LOCAL ] CBT: Trimmed 45679 records to 30466 (keeping 200 days of data) [2025-10-28T17:50:50.577731] [DEBUG] [LOCAL ] CBT: Primary data saved (30466 records). [2025-10-28T17:50:50.577888] [INFO ] [MAIN ] CBT: Full history saved. [2025-10-28T17:50:50.577988] [INFO ] [MAIN ] Update Progress: 408/2366 symbols completed. CBT took 32.1s. Estimated remaining: 4h 3m 45s. Rate: 8.0 symbols/min [2025-10-28T17:50:50.754994] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-28T17:50:50.787576] [INFO ] [MAIN ] CCIA: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:50:50.788422] [DEBUG] [LOCAL ] CCIA: No existing data file found in primary storage. [2025-10-28T17:50:50.788483] [WARN ] [MAIN ] CCIA: No existing data found, performing full refresh instead. [2025-10-28T17:50:50.788596] [INFO ] [MAIN ] CCIA: Wiping existing primary data before full refresh. [2025-10-28T17:50:50.788638] [INFO ] [LOCAL ] CCIA: Starting deletion of primary data. [2025-10-28T17:50:50.788730] [DEBUG] [LOCAL ] CCIA: No primary data file found to delete. [2025-10-28T17:50:50.788766] [INFO ] [MAIN ] CCIA: Starting full primary refresh. [2025-10-28T17:50:51.141032] [INFO ] [REMOTE ] CCIA: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:50:51.159334] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-03. [2025-10-28T17:50:51.944315] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-28T17:50:51.959306] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-02. [2025-10-28T17:50:52.405040] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-28T17:50:52.759394] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-04. [2025-10-28T17:50:53.260785] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-28T17:50:53.559326] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-04. [2025-10-28T17:50:53.787358] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-28T17:50:54.359371] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-05. [2025-10-28T17:50:54.736748] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-28T17:50:55.005819] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-28T17:50:55.159368] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-06. [2025-10-28T17:50:55.959312] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-03. [2025-10-28T17:50:56.041953] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-28T17:50:56.759360] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-05. [2025-10-28T17:50:57.299927] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-28T17:50:57.559320] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-01. [2025-10-28T17:50:58.040906] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-28T17:50:58.207309] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-28T17:50:58.359325] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-06. [2025-10-28T17:50:59.159325] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-04. [2025-10-28T17:50:59.847268] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-28T17:50:59.959365] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-07. [2025-10-28T17:51:00.759383] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-02. [2025-10-28T17:51:01.259054] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-10-28T17:51:01.282879] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-28T17:51:01.533258] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-28T17:51:01.559315] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-08. [2025-10-28T17:51:02.359382] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-03. [2025-10-28T17:51:02.616471] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-03 (0.26 seconds). [2025-10-28T17:51:03.022967] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-28T17:51:03.159354] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-07. [2025-10-28T17:51:03.959365] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-05. [2025-10-28T17:51:04.450616] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-28T17:51:04.759360] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-08. [2025-10-28T17:51:05.318236] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-28T17:51:05.559372] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-09. [2025-10-28T17:51:05.742083] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-28T17:51:06.359366] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-04. [2025-10-28T17:51:06.745458] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-10-28T17:51:06.804996] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-28T17:51:07.159338] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-09. [2025-10-28T17:51:07.959351] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-05. [2025-10-28T17:51:08.205075] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-05 (0.25 seconds). [2025-10-28T17:51:08.255293] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-28T17:51:08.759342] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-06. [2025-10-28T17:51:09.513068] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-28T17:51:09.559329] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-10. [2025-10-28T17:51:10.359339] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-07. [2025-10-28T17:51:10.587066] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-07 (0.23 seconds). [2025-10-28T17:51:11.159367] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-06. [2025-10-28T17:51:11.552757] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-10 (1.99 seconds). [2025-10-28T17:51:11.566765] [INFO ] [REMOTE ] CC: Full fetch complete (76206 records). [2025-10-28T17:51:11.566903] [DEBUG] [VALIDATOR ] CC: Validating primary data. [2025-10-28T17:51:11.965800] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-10. [2025-10-28T17:51:11.967385] [DEBUG] [VALIDATOR ] CC: All expected trading days are present. [2025-10-28T17:51:11.967442] [DEBUG] [VALIDATOR ] CC: Primary data validation passed. [2025-10-28T17:51:11.968332] [INFO ] [MAIN ] CC: Fetched primary data is valid. [2025-10-28T17:51:11.968486] [DEBUG] [LOCAL ] CC: Saving primary data. [2025-10-28T17:51:11.970016] [DEBUG] [LOCAL ] CC: Trimmed 76206 records to 52964 (keeping 200 days of data) [2025-10-28T17:51:12.280562] [DEBUG] [LOCAL ] CC: Primary data saved (52964 records). [2025-10-28T17:51:12.280719] [INFO ] [MAIN ] CC: Full history saved. [2025-10-28T17:51:12.281048] [INFO ] [MAIN ] Update Progress: 409/2366 symbols completed. CC took 28.4s. Estimated remaining: 4h 4m 46s. Rate: 8.0 symbols/min [2025-10-28T17:51:12.465093] [INFO ] [MAIN ] CCIF: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:51:12.495979] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-28T17:51:12.516547] [DEBUG] [LOCAL ] CCIF: Loaded 15071 existing records from primary storage. [2025-10-28T17:51:12.516797] [INFO ] [MAIN ] CCIF: Loaded 15071 existing records. [2025-10-28T17:51:12.693147] [WARN ] [MAIN ] CCIF: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:51:12.693333] [INFO ] [MAIN ] CCIF: Wiping existing primary data before full refresh. [2025-10-28T17:51:12.693381] [INFO ] [LOCAL ] CCIF: Starting deletion of primary data. [2025-10-28T17:51:12.693724] [DEBUG] [LOCAL ] CCIF: Deleted primary data file. [2025-10-28T17:51:12.693783] [INFO ] [MAIN ] CCIF: Starting full primary refresh. [2025-10-28T17:51:12.768122] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-08. [2025-10-28T17:51:13.050705] [INFO ] [REMOTE ] CCIF: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:51:13.124446] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-10-28T17:51:13.546750] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-28T17:51:13.554833] [INFO ] [REMOTE ] CBZ: Full fetch complete (46751 records). [2025-10-28T17:51:13.555035] [DEBUG] [VALIDATOR ] CBZ: Validating primary data. [2025-10-28T17:51:13.567218] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-07. [2025-10-28T17:51:13.946853] [DEBUG] [VALIDATOR ] CBZ: All expected trading days are present. [2025-10-28T17:51:13.946943] [DEBUG] [VALIDATOR ] CBZ: Primary data validation passed. [2025-10-28T17:51:13.947589] [INFO ] [MAIN ] CBZ: Fetched primary data is valid. [2025-10-28T17:51:13.947688] [DEBUG] [LOCAL ] CBZ: Saving primary data. [2025-10-28T17:51:13.948841] [DEBUG] [LOCAL ] CBZ: Trimmed 46751 records to 34214 (keeping 200 days of data) [2025-10-28T17:51:14.142925] [DEBUG] [LOCAL ] CBZ: Primary data saved (34214 records). [2025-10-28T17:51:14.143052] [INFO ] [MAIN ] CBZ: Full history saved. [2025-10-28T17:51:14.143127] [INFO ] [MAIN ] Update Progress: 410/2366 symbols completed. CBZ took 34.0s. Estimated remaining: 4h 4m 12s. Rate: 8.0 symbols/min [2025-10-28T17:51:14.315742] [INFO ] [MAIN ] CCJ: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:51:14.363259] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-09. [2025-10-28T17:51:14.365201] [DEBUG] [LOCAL ] CCJ: Loaded 53690 existing records from primary storage. [2025-10-28T17:51:14.365604] [INFO ] [MAIN ] CCJ: Loaded 53690 existing records. [2025-10-28T17:51:14.548425] [WARN ] [MAIN ] CCJ: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:51:14.548684] [INFO ] [MAIN ] CCJ: Wiping existing primary data before full refresh. [2025-10-28T17:51:14.548756] [INFO ] [LOCAL ] CCJ: Starting deletion of primary data. [2025-10-28T17:51:14.549229] [DEBUG] [LOCAL ] CCJ: Deleted primary data file. [2025-10-28T17:51:14.549288] [INFO ] [MAIN ] CCJ: Starting full primary refresh. [2025-10-28T17:51:14.758985] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-10-28T17:51:14.910597] [INFO ] [REMOTE ] CCJ: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:51:15.030235] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-28T17:51:15.159319] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-01. [2025-10-28T17:51:15.959380] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-08. [2025-10-28T17:51:16.759354] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-01. [2025-10-28T17:51:17.199877] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-10-28T17:51:17.559315] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-02. [2025-10-28T17:51:17.728893] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-28T17:51:17.866571] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-28T17:51:18.359345] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-10. [2025-10-28T17:51:18.948122] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-28T17:51:18.949580] [INFO ] [REMOTE ] CCIA: Full fetch complete (2191 records). [2025-10-28T17:51:18.949757] [DEBUG] [VALIDATOR ] CCIA: Validating primary data. [2025-10-28T17:51:19.139076] [WARN ] [VALIDATOR ] CCIA: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-28T17:51:19.139338] [FATAL] [MAIN ] CCIA: Fetched primary data is invalid. Refusing to save it. [2025-10-28T17:51:19.139500] [WARN ] [MAIN ] CCIA: Deleting existing primary and derivative data due to validation failure. [2025-10-28T17:51:19.139690] [INFO ] [LOCAL ] CCIA: Starting deletion of primary data. [2025-10-28T17:51:19.139793] [DEBUG] [LOCAL ] CCIA: No primary data file found to delete. [2025-10-28T17:51:19.139851] [INFO ] [LOCAL ] CCIA: Starting deletion of derivative data. [2025-10-28T17:51:19.139898] [DEBUG] [LOCAL ] CCIA: No derivative data file found to delete. [2025-10-28T17:51:19.139958] [INFO ] [MAIN ] Update Progress: 411/2366 symbols completed. CCIA took 28.6s. Estimated remaining: 4h 3m 52s. Rate: 8.0 symbols/min [2025-10-28T17:51:19.169049] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-02. [2025-10-28T17:51:19.313993] [INFO ] [MAIN ] CCK: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:51:19.314317] [DEBUG] [LOCAL ] CCK: No existing data file found in primary storage. [2025-10-28T17:51:19.314452] [WARN ] [MAIN ] CCK: No existing data found, performing full refresh instead. [2025-10-28T17:51:19.314588] [INFO ] [MAIN ] CCK: Wiping existing primary data before full refresh. [2025-10-28T17:51:19.314771] [INFO ] [LOCAL ] CCK: Starting deletion of primary data. [2025-10-28T17:51:19.314958] [DEBUG] [LOCAL ] CCK: No primary data file found to delete. [2025-10-28T17:51:19.315027] [INFO ] [MAIN ] CCK: Starting full primary refresh. [2025-10-28T17:51:19.498083] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-28T17:51:19.745499] [INFO ] [REMOTE ] CCK: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:51:19.854884] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-28T17:51:19.959378] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-03. [2025-10-28T17:51:20.675148] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-28T17:51:20.759326] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-04. [2025-10-28T17:51:21.559318] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-09. [2025-10-28T17:51:21.641566] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-28T17:51:22.359356] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-05. [2025-10-28T17:51:22.938152] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-28T17:51:23.078850] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-28T17:51:23.159323] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-06. [2025-10-28T17:51:23.763157] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-28T17:51:23.959386] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-01. [2025-10-28T17:51:24.759347] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-07. [2025-10-28T17:51:25.357228] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-28T17:51:25.559344] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-10. [2025-10-28T17:51:25.600469] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-28T17:51:26.359316] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-03. [2025-10-28T17:51:27.125722] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-28T17:51:27.136914] [INFO ] [REMOTE ] CCI: Full fetch complete (77093 records). [2025-10-28T17:51:27.137072] [DEBUG] [VALIDATOR ] CCI: Validating primary data. [2025-10-28T17:51:27.168348] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-02. [2025-10-28T17:51:27.539504] [DEBUG] [VALIDATOR ] CCI: All expected trading days are present. [2025-10-28T17:51:27.539594] [DEBUG] [VALIDATOR ] CCI: Primary data validation passed. [2025-10-28T17:51:27.540407] [INFO ] [MAIN ] CCI: Fetched primary data is valid. [2025-10-28T17:51:27.540469] [DEBUG] [LOCAL ] CCI: Saving primary data. [2025-10-28T17:51:27.541899] [DEBUG] [LOCAL ] CCI: Trimmed 77093 records to 53098 (keeping 200 days of data) [2025-10-28T17:51:27.878078] [DEBUG] [LOCAL ] CCI: Primary data saved (53098 records). [2025-10-28T17:51:27.878215] [INFO ] [MAIN ] CCI: Full history saved. [2025-10-28T17:51:27.878293] [INFO ] [MAIN ] Update Progress: 412/2366 symbols completed. CCI took 42.0s. Estimated remaining: 4h 3m 51s. Rate: 8.0 symbols/min [2025-10-28T17:51:27.972249] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-08. [2025-10-28T17:51:28.055174] [INFO ] [MAIN ] CCL: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:51:28.105729] [DEBUG] [LOCAL ] CCL: Loaded 53800 existing records from primary storage. [2025-10-28T17:51:28.106134] [INFO ] [MAIN ] CCL: Loaded 53800 existing records. [2025-10-28T17:51:28.305409] [WARN ] [MAIN ] CCL: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:51:28.306136] [INFO ] [MAIN ] CCL: Wiping existing primary data before full refresh. [2025-10-28T17:51:28.306310] [INFO ] [LOCAL ] CCL: Starting deletion of primary data. [2025-10-28T17:51:28.307044] [DEBUG] [LOCAL ] CCL: Deleted primary data file. [2025-10-28T17:51:28.307177] [INFO ] [MAIN ] CCL: Starting full primary refresh. [2025-10-28T17:51:28.427394] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-10-28T17:51:28.718756] [INFO ] [REMOTE ] CCL: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:51:28.753320] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-28T17:51:28.762688] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-28T17:51:28.762825] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-01. [2025-10-28T17:51:29.559334] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-03. [2025-10-28T17:51:30.359417] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-09. [2025-10-28T17:51:30.772565] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-28T17:51:30.841153] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-10-28T17:51:30.949605] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-28T17:51:31.159350] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-02. [2025-10-28T17:51:31.959364] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-04. [2025-10-28T17:51:32.688769] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-28T17:51:32.759355] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-03. [2025-10-28T17:51:33.165169] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-28T17:51:33.559353] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-04. [2025-10-28T17:51:34.359355] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-10. [2025-10-28T17:51:34.619845] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-10-28T17:51:34.970024] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-28T17:51:35.049738] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-28T17:51:35.052905] [INFO ] [REMOTE ] CCIF: Full fetch complete (21982 records). [2025-10-28T17:51:35.052975] [DEBUG] [VALIDATOR ] CCIF: Validating primary data. [2025-10-28T17:51:35.166033] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-05. [2025-10-28T17:51:35.436721] [DEBUG] [VALIDATOR ] CCIF: All expected trading days are present. [2025-10-28T17:51:35.436821] [DEBUG] [VALIDATOR ] CCIF: Primary data validation passed. [2025-10-28T17:51:35.437233] [INFO ] [MAIN ] CCIF: Fetched primary data is valid. [2025-10-28T17:51:35.437292] [DEBUG] [LOCAL ] CCIF: Saving primary data. [2025-10-28T17:51:35.437998] [DEBUG] [LOCAL ] CCIF: Trimmed 21982 records to 15075 (keeping 200 days of data) [2025-10-28T17:51:35.521084] [DEBUG] [LOCAL ] CCIF: Primary data saved (15075 records). [2025-10-28T17:51:35.521210] [INFO ] [MAIN ] CCIF: Full history saved. [2025-10-28T17:51:35.521288] [INFO ] [MAIN ] Update Progress: 413/2366 symbols completed. CCIF took 23.2s. Estimated remaining: 4h 3m 44s. Rate: 8.0 symbols/min [2025-10-28T17:51:35.685634] [INFO ] [MAIN ] CCO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:51:35.728182] [DEBUG] [LOCAL ] CCO: Loaded 48691 existing records from primary storage. [2025-10-28T17:51:35.728463] [INFO ] [MAIN ] CCO: Loaded 48691 existing records. [2025-10-28T17:51:35.901933] [WARN ] [MAIN ] CCO: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:51:35.902177] [INFO ] [MAIN ] CCO: Wiping existing primary data before full refresh. [2025-10-28T17:51:35.902223] [INFO ] [LOCAL ] CCO: Starting deletion of primary data. [2025-10-28T17:51:35.902722] [DEBUG] [LOCAL ] CCO: Deleted primary data file. [2025-10-28T17:51:35.902779] [INFO ] [MAIN ] CCO: Starting full primary refresh. [2025-10-28T17:51:35.964541] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-05. [2025-10-28T17:51:36.253019] [INFO ] [REMOTE ] CCO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:51:36.677200] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-28T17:51:36.759319] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-06. [2025-10-28T17:51:37.559355] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-01. [2025-10-28T17:51:37.937573] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-10-28T17:51:38.359331] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-06. [2025-10-28T17:51:38.684387] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-28T17:51:38.984574] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-28T17:51:39.159338] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-02. [2025-10-28T17:51:39.489242] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-28T17:51:39.959378] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-04. [2025-10-28T17:51:40.113972] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-28T17:51:40.759393] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-03. [2025-10-28T17:51:41.559335] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-07. [2025-10-28T17:51:41.763446] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-28T17:51:41.846812] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-28T17:51:42.359331] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-04. [2025-10-28T17:51:42.707879] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-28T17:51:43.159374] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-05. [2025-10-28T17:51:43.492472] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-28T17:51:43.959328] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-07. [2025-10-28T17:51:44.759302] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-05. [2025-10-28T17:51:44.875415] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-28T17:51:45.559322] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-06. [2025-10-28T17:51:45.883793] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-28T17:51:45.928115] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-28T17:51:46.359319] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-08. [2025-10-28T17:51:47.148589] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-28T17:51:47.159223] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-07. [2025-10-28T17:51:47.817773] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-28T17:51:47.959311] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-08. [2025-10-28T17:51:48.759376] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-06. [2025-10-28T17:51:49.149025] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-28T17:51:49.552431] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-28T17:51:49.561335] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-08. [2025-10-28T17:51:50.254089] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-28T17:51:50.359365] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-09. [2025-10-28T17:51:51.159318] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-09. [2025-10-28T17:51:51.339597] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-28T17:51:51.959388] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-09. [2025-10-28T17:51:52.295435] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-28T17:51:52.525406] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-10-28T17:51:52.759340] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-10. [2025-10-28T17:51:53.559346] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-07. [2025-10-28T17:51:53.963288] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-28T17:51:54.359315] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-10. [2025-10-28T17:51:54.470395] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-28T17:51:54.480130] [INFO ] [REMOTE ] CCK: Full fetch complete (68179 records). [2025-10-28T17:51:54.480293] [DEBUG] [VALIDATOR ] CCK: Validating primary data. [2025-10-28T17:51:54.889074] [DEBUG] [VALIDATOR ] CCK: All expected trading days are present. [2025-10-28T17:51:54.889369] [DEBUG] [VALIDATOR ] CCK: Primary data validation passed. [2025-10-28T17:51:54.890184] [INFO ] [MAIN ] CCK: Fetched primary data is valid. [2025-10-28T17:51:54.890262] [DEBUG] [LOCAL ] CCK: Saving primary data. [2025-10-28T17:51:54.926939] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-28T17:51:54.925153] [DEBUG] [LOCAL ] CCK: Trimmed 68179 records to 46444 (keeping 200 days of data) [2025-10-28T17:51:55.162677] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-08. [2025-10-28T17:51:55.216585] [DEBUG] [LOCAL ] CCK: Primary data saved (46444 records). [2025-10-28T17:51:55.216730] [INFO ] [MAIN ] CCK: Full history saved. [2025-10-28T17:51:55.216807] [INFO ] [MAIN ] Update Progress: 414/2366 symbols completed. CCK took 36.1s. Estimated remaining: 4h 4m 34s. Rate: 8.0 symbols/min [2025-10-28T17:51:55.384322] [INFO ] [MAIN ] CCRD: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:51:55.394893] [DEBUG] [LOCAL ] CCRD: Loaded 9616 existing records from primary storage. [2025-10-28T17:51:55.395076] [INFO ] [MAIN ] CCRD: Loaded 9616 existing records. [2025-10-28T17:51:55.586063] [WARN ] [MAIN ] CCRD: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:51:55.586236] [INFO ] [MAIN ] CCRD: Wiping existing primary data before full refresh. [2025-10-28T17:51:55.586282] [INFO ] [LOCAL ] CCRD: Starting deletion of primary data. [2025-10-28T17:51:55.586420] [DEBUG] [LOCAL ] CCRD: Deleted primary data file. [2025-10-28T17:51:55.586458] [INFO ] [MAIN ] CCRD: Starting full primary refresh. [2025-10-28T17:51:55.930364] [INFO ] [REMOTE ] CCRD: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:51:55.959297] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-01. [2025-10-28T17:51:56.269769] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-28T17:51:56.471863] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-28T17:51:56.546027] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-10 (2.19 seconds). [2025-10-28T17:51:56.556786] [INFO ] [REMOTE ] CCL: Full fetch complete (77980 records). [2025-10-28T17:51:56.556929] [DEBUG] [VALIDATOR ] CCL: Validating primary data. [2025-10-28T17:51:56.767498] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-10. [2025-10-28T17:51:56.965055] [DEBUG] [VALIDATOR ] CCL: All expected trading days are present. [2025-10-28T17:51:56.965146] [DEBUG] [VALIDATOR ] CCL: Primary data validation passed. [2025-10-28T17:51:56.966013] [INFO ] [MAIN ] CCL: Fetched primary data is valid. [2025-10-28T17:51:56.966080] [DEBUG] [LOCAL ] CCL: Saving primary data. [2025-10-28T17:51:56.967619] [DEBUG] [LOCAL ] CCL: Trimmed 77980 records to 53800 (keeping 200 days of data) [2025-10-28T17:51:57.278891] [DEBUG] [LOCAL ] CCL: Primary data saved (53800 records). [2025-10-28T17:51:57.279021] [INFO ] [MAIN ] CCL: Full history saved. [2025-10-28T17:51:57.279098] [INFO ] [MAIN ] Update Progress: 415/2366 symbols completed. CCL took 29.4s. Estimated remaining: 4h 4m 1s. Rate: 8.0 symbols/min [2025-10-28T17:51:57.444782] [INFO ] [MAIN ] CCS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:51:57.473378] [DEBUG] [LOCAL ] CCS: Loaded 29822 existing records from primary storage. [2025-10-28T17:51:57.473631] [INFO ] [MAIN ] CCS: Loaded 29822 existing records. [2025-10-28T17:51:57.564610] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-02. [2025-10-28T17:51:57.661024] [WARN ] [MAIN ] CCS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:51:57.661217] [INFO ] [MAIN ] CCS: Wiping existing primary data before full refresh. [2025-10-28T17:51:57.661262] [INFO ] [LOCAL ] CCS: Starting deletion of primary data. [2025-10-28T17:51:57.661635] [DEBUG] [LOCAL ] CCS: Deleted primary data file. [2025-10-28T17:51:57.661723] [INFO ] [MAIN ] CCS: Starting full primary refresh. [2025-10-28T17:51:58.027978] [INFO ] [REMOTE ] CCS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:51:58.032555] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-28T17:51:58.359383] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-03. [2025-10-28T17:51:58.685714] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-28T17:51:58.696699] [INFO ] [REMOTE ] CCJ: Full fetch complete (77840 records). [2025-10-28T17:51:58.696840] [DEBUG] [VALIDATOR ] CCJ: Validating primary data. [2025-10-28T17:51:58.844375] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-28T17:51:59.139517] [DEBUG] [VALIDATOR ] CCJ: All expected trading days are present. [2025-10-28T17:51:59.139591] [DEBUG] [VALIDATOR ] CCJ: Primary data validation passed. [2025-10-28T17:51:59.140405] [INFO ] [MAIN ] CCJ: Fetched primary data is valid. [2025-10-28T17:51:59.140466] [DEBUG] [LOCAL ] CCJ: Saving primary data. [2025-10-28T17:51:59.141872] [DEBUG] [LOCAL ] CCJ: Trimmed 77840 records to 53691 (keeping 200 days of data) [2025-10-28T17:51:59.190239] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-01. [2025-10-28T17:51:59.453318] [DEBUG] [LOCAL ] CCJ: Primary data saved (53691 records). [2025-10-28T17:51:59.453434] [INFO ] [MAIN ] CCJ: Full history saved. [2025-10-28T17:51:59.453507] [INFO ] [MAIN ] Update Progress: 416/2366 symbols completed. CCJ took 45.3s. Estimated remaining: 4h 3m 28s. Rate: 8.0 symbols/min [2025-10-28T17:51:59.632887] [INFO ] [MAIN ] CCU: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:51:59.653083] [DEBUG] [LOCAL ] CCU: Loaded 21160 existing records from primary storage. [2025-10-28T17:51:59.653331] [INFO ] [MAIN ] CCU: Loaded 21160 existing records. [2025-10-28T17:51:59.826826] [WARN ] [MAIN ] CCU: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:51:59.827045] [INFO ] [MAIN ] CCU: Wiping existing primary data before full refresh. [2025-10-28T17:51:59.827115] [INFO ] [LOCAL ] CCU: Starting deletion of primary data. [2025-10-28T17:51:59.827366] [DEBUG] [LOCAL ] CCU: Deleted primary data file. [2025-10-28T17:51:59.827422] [INFO ] [MAIN ] CCU: Starting full primary refresh. [2025-10-28T17:51:59.964548] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-09. [2025-10-28T17:52:00.183454] [INFO ] [REMOTE ] CCU: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:52:00.258318] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-28T17:52:00.759378] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-02. [2025-10-28T17:52:01.559314] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-01. [2025-10-28T17:52:01.702473] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-28T17:52:01.765578] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-28T17:52:02.359396] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-04. [2025-10-28T17:52:02.504484] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-28T17:52:02.762546] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-10-28T17:52:03.159350] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-10. [2025-10-28T17:52:03.959347] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-03. [2025-10-28T17:52:04.683075] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-28T17:52:04.692893] [INFO ] [REMOTE ] CCO: Full fetch complete (67529 records). [2025-10-28T17:52:04.693003] [DEBUG] [VALIDATOR ] CCO: Validating primary data. [2025-10-28T17:52:04.767248] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-02. [2025-10-28T17:52:05.089937] [DEBUG] [VALIDATOR ] CCO: All expected trading days are present. [2025-10-28T17:52:05.090122] [DEBUG] [VALIDATOR ] CCO: Primary data validation passed. [2025-10-28T17:52:05.090982] [INFO ] [MAIN ] CCO: Fetched primary data is valid. [2025-10-28T17:52:05.091151] [DEBUG] [LOCAL ] CCO: Saving primary data. [2025-10-28T17:52:05.092880] [DEBUG] [LOCAL ] CCO: Trimmed 67529 records to 48719 (keeping 200 days of data) [2025-10-28T17:52:05.202285] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-28T17:52:05.379064] [DEBUG] [LOCAL ] CCO: Primary data saved (48719 records). [2025-10-28T17:52:05.379220] [INFO ] [MAIN ] CCO: Full history saved. [2025-10-28T17:52:05.379572] [INFO ] [MAIN ] Update Progress: 417/2366 symbols completed. CCO took 29.9s. Estimated remaining: 4h 3m 14s. Rate: 8.0 symbols/min [2025-10-28T17:52:05.546809] [INFO ] [MAIN ] CCZ: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:52:05.546935] [DEBUG] [LOCAL ] CCZ: No existing data file found in primary storage. [2025-10-28T17:52:05.546971] [WARN ] [MAIN ] CCZ: No existing data found, performing full refresh instead. [2025-10-28T17:52:05.547098] [INFO ] [MAIN ] CCZ: Wiping existing primary data before full refresh. [2025-10-28T17:52:05.547154] [INFO ] [LOCAL ] CCZ: Starting deletion of primary data. [2025-10-28T17:52:05.547199] [DEBUG] [LOCAL ] CCZ: No primary data file found to delete. [2025-10-28T17:52:05.547231] [INFO ] [MAIN ] CCZ: Starting full primary refresh. [2025-10-28T17:52:05.567189] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-05. [2025-10-28T17:52:05.678075] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-28T17:52:05.919077] [INFO ] [REMOTE ] CCZ: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:52:06.283592] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-28T17:52:06.359343] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-06. [2025-10-28T17:52:07.145965] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-28T17:52:07.159343] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-01. [2025-10-28T17:52:07.793476] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-28T17:52:07.959337] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-07. [2025-10-28T17:52:08.492956] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-28T17:52:08.759398] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-02. [2025-10-28T17:52:08.948131] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-02 (0.19 seconds). [2025-10-28T17:52:09.559375] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-03. [2025-10-28T17:52:10.359329] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-03. [2025-10-28T17:52:10.405191] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-28T17:52:10.595806] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-03 (0.24 seconds). [2025-10-28T17:52:11.159405] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-04. [2025-10-28T17:52:11.384542] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-04 (0.23 seconds). [2025-10-28T17:52:11.959321] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-05. [2025-10-28T17:52:12.176015] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-05 (0.22 seconds). [2025-10-28T17:52:12.759366] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-08. [2025-10-28T17:52:13.247924] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-28T17:52:13.559364] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-04. [2025-10-28T17:52:14.359379] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-06. [2025-10-28T17:52:14.545728] [DEBUG] [REMOTE ] CCZ: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-28T17:52:14.545973] [WARN ] [REMOTE ] CCZ: No data returned for month 2025-06 [2025-10-28T17:52:14.546059] [FATAL] [REMOTE ] CCZ: API call failed - aborting fetch to avoid wasting further API calls [2025-10-28T17:52:14.546180] [FATAL] [MAIN ] CCZ: Failed to fetch primary data. [2025-10-28T17:52:14.546259] [WARN ] [MAIN ] CCZ: Deleting existing primary and derivative data due to fetch failure. [2025-10-28T17:52:14.546331] [INFO ] [LOCAL ] CCZ: Starting deletion of primary data. [2025-10-28T17:52:14.546394] [DEBUG] [LOCAL ] CCZ: No primary data file found to delete. [2025-10-28T17:52:14.546429] [INFO ] [LOCAL ] CCZ: Starting deletion of derivative data. [2025-10-28T17:52:14.546467] [DEBUG] [LOCAL ] CCZ: No derivative data file found to delete. [2025-10-28T17:52:14.546511] [INFO ] [MAIN ] Update Progress: 418/2366 symbols completed. CCZ took 9.2s. Estimated remaining: 4h 3m 14s. Rate: 8.0 symbols/min [2025-10-28T17:52:14.730261] [INFO ] [MAIN ] CDE: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:52:14.751724] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-28T17:52:14.810832] [DEBUG] [LOCAL ] CDE: Loaded 53644 existing records from primary storage. [2025-10-28T17:52:14.811173] [INFO ] [MAIN ] CDE: Loaded 53644 existing records. [2025-10-28T17:52:14.985303] [WARN ] [MAIN ] CDE: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:52:14.985525] [INFO ] [MAIN ] CDE: Wiping existing primary data before full refresh. [2025-10-28T17:52:14.985581] [INFO ] [LOCAL ] CDE: Starting deletion of primary data. [2025-10-28T17:52:14.986376] [DEBUG] [LOCAL ] CDE: Deleted primary data file. [2025-10-28T17:52:14.986433] [INFO ] [MAIN ] CDE: Starting full primary refresh. [2025-10-28T17:52:15.168137] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-04. [2025-10-28T17:52:15.343155] [INFO ] [REMOTE ] CDE: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:52:15.959349] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-01. [2025-10-28T17:52:16.213601] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-28T17:52:16.759342] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-05. [2025-10-28T17:52:17.264985] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-28T17:52:17.559352] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-02. [2025-10-28T17:52:17.706898] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-28T17:52:18.359356] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-06. [2025-10-28T17:52:18.799461] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-28T17:52:19.159314] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-05. [2025-10-28T17:52:19.506602] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-28T17:52:19.959312] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-09. [2025-10-28T17:52:20.099929] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-28T17:52:20.584156] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-28T17:52:20.759343] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-03. [2025-10-28T17:52:21.559338] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-07. [2025-10-28T17:52:22.104699] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-28T17:52:22.359345] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-04. [2025-10-28T17:52:22.672203] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-28T17:52:23.159339] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-06. [2025-10-28T17:52:23.849805] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-28T17:52:23.959312] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-08. [2025-10-28T17:52:24.098558] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-28T17:52:24.759361] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-07. [2025-10-28T17:52:24.912037] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-28T17:52:25.486174] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-28T17:52:25.559327] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-08. [2025-10-28T17:52:26.294139] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-28T17:52:26.359394] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-09. [2025-10-28T17:52:27.010587] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-28T17:52:27.159327] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-09. [2025-10-28T17:52:27.952154] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-28T17:52:27.959308] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-10. [2025-10-28T17:52:28.759335] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-10. [2025-10-28T17:52:29.530614] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-28T17:52:29.534516] [INFO ] [REMOTE ] CCU: Full fetch complete (32150 records). [2025-10-28T17:52:29.534594] [DEBUG] [VALIDATOR ] CCU: Validating primary data. [2025-10-28T17:52:29.569059] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-10. [2025-10-28T17:52:29.703808] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-28T17:52:29.759994] [INFO ] [REMOTE ] CCS: Full fetch complete (44763 records). [2025-10-28T17:52:29.792816] [DEBUG] [VALIDATOR ] CCS: Validating primary data. [2025-10-28T17:52:30.122319] [DEBUG] [VALIDATOR ] CCU: All expected trading days are present. [2025-10-28T17:52:30.127935] [DEBUG] [VALIDATOR ] CCU: Primary data validation passed. [2025-10-28T17:52:30.136957] [INFO ] [MAIN ] CCU: Fetched primary data is valid. [2025-10-28T17:52:30.142350] [DEBUG] [LOCAL ] CCU: Saving primary data. [2025-10-28T17:52:30.221445] [DEBUG] [LOCAL ] CCU: Trimmed 32150 records to 20968 (keeping 200 days of data) [2025-10-28T17:52:30.251017] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-28T17:52:30.323020] [INFO ] [REMOTE ] CCRD: Full fetch complete (11718 records). [2025-10-28T17:52:30.373871] [DEBUG] [VALIDATOR ] CCRD: Validating primary data. [2025-10-28T17:52:30.374341] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-05. [2025-10-28T17:52:30.484059] [DEBUG] [VALIDATOR ] CCS: All expected trading days are present. [2025-10-28T17:52:30.484172] [DEBUG] [VALIDATOR ] CCS: Primary data validation passed. [2025-10-28T17:52:30.499049] [INFO ] [MAIN ] CCS: Fetched primary data is valid. [2025-10-28T17:52:30.507692] [DEBUG] [LOCAL ] CCS: Saving primary data. [2025-10-28T17:52:30.554362] [DEBUG] [LOCAL ] CCU: Primary data saved (20968 records). [2025-10-28T17:52:30.569715] [INFO ] [MAIN ] CCU: Full history saved. [2025-10-28T17:52:30.575134] [INFO ] [MAIN ] Update Progress: 419/2366 symbols completed. CCU took 31.1s. Estimated remaining: 4h 3m 46s. Rate: 8.0 symbols/min [2025-10-28T17:52:30.584769] [DEBUG] [LOCAL ] CCS: Trimmed 44763 records to 29790 (keeping 200 days of data) [2025-10-28T17:52:31.124329] [INFO ] [MAIN ] CDLR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:52:31.177986] [DEBUG] [LOCAL ] CCS: Primary data saved (29790 records). [2025-10-28T17:52:31.182711] [INFO ] [MAIN ] CCS: Full history saved. [2025-10-28T17:52:31.182874] [INFO ] [MAIN ] Update Progress: 420/2366 symbols completed. CCS took 33.9s. Estimated remaining: 4h 3m 7s. Rate: 8.0 symbols/min [2025-10-28T17:52:31.364399] [DEBUG] [VALIDATOR ] CCRD: All expected trading days are present. [2025-10-28T17:52:31.383055] [DEBUG] [LOCAL ] CDLR: Loaded 10141 existing records from primary storage. [2025-10-28T17:52:31.388390] [DEBUG] [VALIDATOR ] CCRD: Primary data validation passed. [2025-10-28T17:52:31.406135] [INFO ] [MAIN ] CDLR: Loaded 10141 existing records. [2025-10-28T17:52:31.402806] [INFO ] [MAIN ] CCRD: Fetched primary data is valid. [2025-10-28T17:52:31.406693] [DEBUG] [LOCAL ] CCRD: Saving primary data. [2025-10-28T17:52:31.522350] [DEBUG] [LOCAL ] CCRD: Trimmed 11718 records to 9635 (keeping 200 days of data) [2025-10-28T17:52:31.553699] [INFO ] [MAIN ] CDP: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:52:31.726736] [WARN ] [MAIN ] CDLR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:52:31.730236] [DEBUG] [LOCAL ] CCRD: Primary data saved (9635 records). [2025-10-28T17:52:31.730515] [INFO ] [MAIN ] CDLR: Wiping existing primary data before full refresh. [2025-10-28T17:52:31.731352] [INFO ] [MAIN ] CCRD: Full history saved. [2025-10-28T17:52:31.731450] [INFO ] [LOCAL ] CDLR: Starting deletion of primary data. [2025-10-28T17:52:31.731614] [INFO ] [MAIN ] Update Progress: 421/2366 symbols completed. CCRD took 36.5s. Estimated remaining: 4h 2m 27s. Rate: 8.0 symbols/min [2025-10-28T17:52:31.731890] [DEBUG] [LOCAL ] CDLR: Deleted primary data file. [2025-10-28T17:52:31.743593] [INFO ] [MAIN ] CDLR: Starting full primary refresh. [2025-10-28T17:52:32.022999] [DEBUG] [LOCAL ] CDP: Loaded 42185 existing records from primary storage. [2025-10-28T17:52:32.060976] [INFO ] [MAIN ] CDP: Loaded 42185 existing records. [2025-10-28T17:52:32.060825] [INFO ] [MAIN ] CDRE: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:52:32.514850] [DEBUG] [LOCAL ] CDRE: Loaded 24420 existing records from primary storage. [2025-10-28T17:52:32.512477] [INFO ] [REMOTE ] CDLR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:52:32.515175] [INFO ] [MAIN ] CDRE: Loaded 24420 existing records. [2025-10-28T17:52:32.516308] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-01. [2025-10-28T17:52:32.519449] [WARN ] [MAIN ] CDP: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:52:32.519812] [INFO ] [MAIN ] CDP: Wiping existing primary data before full refresh. [2025-10-28T17:52:32.520808] [INFO ] [LOCAL ] CDP: Starting deletion of primary data. [2025-10-28T17:52:32.565832] [DEBUG] [LOCAL ] CDP: Deleted primary data file. [2025-10-28T17:52:32.615080] [INFO ] [MAIN ] CDP: Starting full primary refresh. [2025-10-28T17:52:32.747212] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-05 (2.37 seconds). [2025-10-28T17:52:32.849059] [WARN ] [MAIN ] CDRE: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:52:32.860625] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-06. [2025-10-28T17:52:32.867418] [INFO ] [MAIN ] CDRE: Wiping existing primary data before full refresh. [2025-10-28T17:52:32.872731] [INFO ] [LOCAL ] CDRE: Starting deletion of primary data. [2025-10-28T17:52:32.901222] [DEBUG] [LOCAL ] CDRE: Deleted primary data file. [2025-10-28T17:52:32.937006] [INFO ] [MAIN ] CDRE: Starting full primary refresh. [2025-10-28T17:52:33.330928] [INFO ] [REMOTE ] CDP: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:52:33.343712] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-28T17:52:33.366399] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-02. [2025-10-28T17:52:33.482135] [INFO ] [REMOTE ] CDRE: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:52:33.559300] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-01. [2025-10-28T17:52:33.802116] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-28T17:52:34.359354] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-01. [2025-10-28T17:52:34.549037] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-28T17:52:34.763576] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-28T17:52:35.159369] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-07. [2025-10-28T17:52:35.185321] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-28T17:52:35.959400] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-02. [2025-10-28T17:52:36.397602] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-28T17:52:36.759398] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-02. [2025-10-28T17:52:37.120277] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-28T17:52:37.413942] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-28T17:52:37.559332] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-03. [2025-10-28T17:52:38.362233] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-03. [2025-10-28T17:52:38.369793] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-28T17:52:39.027157] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-28T17:52:39.159362] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-04. [2025-10-28T17:52:39.591462] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-28T17:52:39.959356] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-05. [2025-10-28T17:52:40.567508] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-28T17:52:40.759341] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-06. [2025-10-28T17:52:41.286973] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-28T17:52:41.559335] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-08. [2025-10-28T17:52:42.359352] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-07. [2025-10-28T17:52:42.912331] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-28T17:52:43.037013] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-28T17:52:43.159329] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-03. [2025-10-28T17:52:43.959342] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-09. [2025-10-28T17:52:44.264031] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-28T17:52:44.759311] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-04. [2025-10-28T17:52:45.559411] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-08. [2025-10-28T17:52:45.702289] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-28T17:52:46.051333] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-28T17:52:46.158890] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-28T17:52:46.359316] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-10. [2025-10-28T17:52:47.159388] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-09. [2025-10-28T17:52:47.653588] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-28T17:52:47.959338] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-10. [2025-10-28T17:52:48.154817] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-28T17:52:48.166234] [INFO ] [REMOTE ] CDE: Full fetch complete (77796 records). [2025-10-28T17:52:48.166376] [DEBUG] [VALIDATOR ] CDE: Validating primary data. [2025-10-28T17:52:48.557428] [DEBUG] [VALIDATOR ] CDE: All expected trading days are present. [2025-10-28T17:52:48.557520] [DEBUG] [VALIDATOR ] CDE: Primary data validation passed. [2025-10-28T17:52:48.558447] [INFO ] [MAIN ] CDE: Fetched primary data is valid. [2025-10-28T17:52:48.558514] [DEBUG] [LOCAL ] CDE: Saving primary data. [2025-10-28T17:52:48.559990] [DEBUG] [LOCAL ] CDE: Trimmed 77796 records to 53644 (keeping 200 days of data) [2025-10-28T17:52:48.742597] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-28T17:52:48.771525] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-04. [2025-10-28T17:52:48.772212] [INFO ] [REMOTE ] CDLR: Full fetch complete (14306 records). [2025-10-28T17:52:48.773454] [DEBUG] [VALIDATOR ] CDLR: Validating primary data. [2025-10-28T17:52:48.776008] [FATAL] [VALIDATOR ] CDLR: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T17:52:48.778491] [FATAL] [MAIN ] CDLR: Fetched primary data is invalid. Refusing to save it. [2025-10-28T17:52:48.806677] [WARN ] [MAIN ] CDLR: Deleting existing primary and derivative data due to validation failure. [2025-10-28T17:52:48.809443] [INFO ] [LOCAL ] CDLR: Starting deletion of primary data. [2025-10-28T17:52:48.809513] [DEBUG] [LOCAL ] CDLR: No primary data file found to delete. [2025-10-28T17:52:48.809551] [INFO ] [LOCAL ] CDLR: Starting deletion of derivative data. [2025-10-28T17:52:48.809757] [DEBUG] [LOCAL ] CDLR: Deleted derivative data file. [2025-10-28T17:52:48.809855] [INFO ] [MAIN ] Update Progress: 422/2366 symbols completed. CDLR took 18.2s. Estimated remaining: 4h 3m 4s. Rate: 8.0 symbols/min [2025-10-28T17:52:49.009888] [DEBUG] [LOCAL ] CDE: Primary data saved (53644 records). [2025-10-28T17:52:49.020307] [INFO ] [MAIN ] CDE: Full history saved. [2025-10-28T17:52:49.033012] [INFO ] [MAIN ] Update Progress: 423/2366 symbols completed. CDE took 34.5s. Estimated remaining: 4h 2m 23s. Rate: 8.0 symbols/min [2025-10-28T17:52:49.130291] [INFO ] [MAIN ] CE: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:52:49.241285] [INFO ] [MAIN ] CEE: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:52:49.247532] [DEBUG] [LOCAL ] CEE: Loaded 4934 existing records from primary storage. [2025-10-28T17:52:49.247922] [INFO ] [MAIN ] CEE: Loaded 4934 existing records. [2025-10-28T17:52:49.423217] [DEBUG] [LOCAL ] CE: Loaded 51167 existing records from primary storage. [2025-10-28T17:52:49.445358] [INFO ] [MAIN ] CE: Loaded 51167 existing records. [2025-10-28T17:52:49.477784] [WARN ] [MAIN ] CEE: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:52:49.504267] [INFO ] [MAIN ] CEE: Wiping existing primary data before full refresh. [2025-10-28T17:52:49.516427] [INFO ] [LOCAL ] CEE: Starting deletion of primary data. [2025-10-28T17:52:49.539007] [DEBUG] [LOCAL ] CEE: Deleted primary data file. [2025-10-28T17:52:49.556734] [INFO ] [MAIN ] CEE: Starting full primary refresh. [2025-10-28T17:52:49.573957] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-05. [2025-10-28T17:52:49.770631] [WARN ] [MAIN ] CE: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:52:49.781711] [INFO ] [MAIN ] CE: Wiping existing primary data before full refresh. [2025-10-28T17:52:49.800383] [INFO ] [LOCAL ] CE: Starting deletion of primary data. [2025-10-28T17:52:49.845430] [DEBUG] [LOCAL ] CE: Deleted primary data file. [2025-10-28T17:52:49.861787] [INFO ] [MAIN ] CE: Starting full primary refresh. [2025-10-28T17:52:50.052472] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-28T17:52:50.232464] [INFO ] [REMOTE ] CEE: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:52:50.364439] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-05. [2025-10-28T17:52:50.434316] [INFO ] [REMOTE ] CE: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:52:51.076883] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-28T17:52:51.159335] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-01. [2025-10-28T17:52:51.268840] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-28T17:52:51.628460] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-28T17:52:51.959345] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-01. [2025-10-28T17:52:52.759425] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-06. [2025-10-28T17:52:53.102744] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-28T17:52:53.559315] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-06. [2025-10-28T17:52:53.740369] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-28T17:52:54.359318] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-02. [2025-10-28T17:52:54.588676] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-28T17:52:54.920497] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-28T17:52:55.159403] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-02. [2025-10-28T17:52:55.959343] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-07. [2025-10-28T17:52:56.480287] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-28T17:52:56.647557] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-28T17:52:56.759306] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-08. [2025-10-28T17:52:57.552636] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-28T17:52:57.559283] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-09. [2025-10-28T17:52:58.273972] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-28T17:52:58.359313] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-03. [2025-10-28T17:52:59.159392] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-07. [2025-10-28T17:52:59.686173] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-28T17:52:59.959377] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-03. [2025-10-28T17:53:00.386359] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-28T17:53:00.558065] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-28T17:53:00.759312] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-10. [2025-10-28T17:53:01.559390] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-04. [2025-10-28T17:53:01.822082] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-28T17:53:01.826740] [INFO ] [REMOTE ] CDRE: Full fetch complete (34793 records). [2025-10-28T17:53:01.826820] [DEBUG] [VALIDATOR ] CDRE: Validating primary data. [2025-10-28T17:53:01.827338] [FATAL] [VALIDATOR ] CDRE: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T17:53:01.827419] [FATAL] [MAIN ] CDRE: Fetched primary data is invalid. Refusing to save it. [2025-10-28T17:53:01.827480] [WARN ] [MAIN ] CDRE: Deleting existing primary and derivative data due to validation failure. [2025-10-28T17:53:01.827518] [INFO ] [LOCAL ] CDRE: Starting deletion of primary data. [2025-10-28T17:53:01.827571] [DEBUG] [LOCAL ] CDRE: No primary data file found to delete. [2025-10-28T17:53:01.827612] [INFO ] [LOCAL ] CDRE: Starting deletion of derivative data. [2025-10-28T17:53:01.827814] [DEBUG] [LOCAL ] CDRE: Deleted derivative data file. [2025-10-28T17:53:01.827906] [INFO ] [MAIN ] Update Progress: 424/2366 symbols completed. CDRE took 30.1s. Estimated remaining: 4h 2m 40s. Rate: 8.0 symbols/min [2025-10-28T17:53:01.997676] [INFO ] [MAIN ] CEPU: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:53:02.022207] [DEBUG] [LOCAL ] CEPU: Loaded 27156 existing records from primary storage. [2025-10-28T17:53:02.022446] [INFO ] [MAIN ] CEPU: Loaded 27156 existing records. [2025-10-28T17:53:02.217461] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-28T17:53:02.242088] [WARN ] [MAIN ] CEPU: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:53:02.244208] [INFO ] [MAIN ] CEPU: Wiping existing primary data before full refresh. [2025-10-28T17:53:02.244518] [INFO ] [LOCAL ] CEPU: Starting deletion of primary data. [2025-10-28T17:53:02.245047] [DEBUG] [LOCAL ] CEPU: Deleted primary data file. [2025-10-28T17:53:02.245105] [INFO ] [MAIN ] CEPU: Starting full primary refresh. [2025-10-28T17:53:02.364494] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-04. [2025-10-28T17:53:02.639553] [INFO ] [REMOTE ] CEPU: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:53:03.159347] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-08. [2025-10-28T17:53:03.863904] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-28T17:53:03.959363] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-05. [2025-10-28T17:53:04.258441] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-28T17:53:04.759371] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-09. [2025-10-28T17:53:05.221945] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-28T17:53:05.559342] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-06. [2025-10-28T17:53:05.904184] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-28T17:53:06.359358] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-05. [2025-10-28T17:53:06.628623] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-28T17:53:06.696783] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-10-28T17:53:07.159341] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-06. [2025-10-28T17:53:07.591180] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-10-28T17:53:07.959336] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-10. [2025-10-28T17:53:08.759357] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-07. [2025-10-28T17:53:09.138369] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-10-28T17:53:09.162325] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-28T17:53:09.171016] [INFO ] [REMOTE ] CDP: Full fetch complete (62136 records). [2025-10-28T17:53:09.171124] [DEBUG] [VALIDATOR ] CDP: Validating primary data. [2025-10-28T17:53:09.544983] [DEBUG] [VALIDATOR ] CDP: All expected trading days are present. [2025-10-28T17:53:09.545066] [DEBUG] [VALIDATOR ] CDP: Primary data validation passed. [2025-10-28T17:53:09.545759] [INFO ] [MAIN ] CDP: Fetched primary data is valid. [2025-10-28T17:53:09.545839] [DEBUG] [LOCAL ] CDP: Saving primary data. [2025-10-28T17:53:09.546948] [DEBUG] [LOCAL ] CDP: Trimmed 62136 records to 42091 (keeping 200 days of data) [2025-10-28T17:53:09.598565] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-01. [2025-10-28T17:53:09.802926] [DEBUG] [LOCAL ] CDP: Primary data saved (42091 records). [2025-10-28T17:53:09.803061] [INFO ] [MAIN ] CDP: Full history saved. [2025-10-28T17:53:09.803141] [INFO ] [MAIN ] Update Progress: 425/2366 symbols completed. CDP took 38.6s. Estimated remaining: 4h 2m 34s. Rate: 8.0 symbols/min [2025-10-28T17:53:09.969762] [INFO ] [MAIN ] CF: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:53:10.015526] [DEBUG] [LOCAL ] CF: Loaded 52070 existing records from primary storage. [2025-10-28T17:53:10.015893] [INFO ] [MAIN ] CF: Loaded 52070 existing records. [2025-10-28T17:53:10.189092] [WARN ] [MAIN ] CF: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:53:10.189283] [INFO ] [MAIN ] CF: Wiping existing primary data before full refresh. [2025-10-28T17:53:10.189330] [INFO ] [LOCAL ] CF: Starting deletion of primary data. [2025-10-28T17:53:10.190165] [DEBUG] [LOCAL ] CF: Deleted primary data file. [2025-10-28T17:53:10.190221] [INFO ] [MAIN ] CF: Starting full primary refresh. [2025-10-28T17:53:10.359376] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-07. [2025-10-28T17:53:10.566619] [INFO ] [REMOTE ] CF: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:53:10.586102] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-28T17:53:11.159393] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-08. [2025-10-28T17:53:11.573352] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-28T17:53:11.582114] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-10-28T17:53:11.959322] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-02. [2025-10-28T17:53:12.685612] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-28T17:53:12.759350] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-01. [2025-10-28T17:53:13.559337] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-03. [2025-10-28T17:53:14.040911] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-28T17:53:14.361979] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-08. [2025-10-28T17:53:14.363098] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-28T17:53:15.159337] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-04. [2025-10-28T17:53:15.959319] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-09. [2025-10-28T17:53:16.015506] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-28T17:53:16.101520] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-10-28T17:53:16.312507] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-10-28T17:53:16.759376] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-02. [2025-10-28T17:53:17.559346] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-10. [2025-10-28T17:53:17.884595] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-28T17:53:18.017150] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-28T17:53:18.018334] [INFO ] [REMOTE ] CEE: Full fetch complete (9883 records). [2025-10-28T17:53:18.018401] [DEBUG] [VALIDATOR ] CEE: Validating primary data. [2025-10-28T17:53:18.369524] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-09. [2025-10-28T17:53:18.369904] [DEBUG] [VALIDATOR ] CEE: All expected trading days are present. [2025-10-28T17:53:18.370637] [DEBUG] [VALIDATOR ] CEE: Primary data validation passed. [2025-10-28T17:53:18.370897] [INFO ] [MAIN ] CEE: Fetched primary data is valid. [2025-10-28T17:53:18.370939] [DEBUG] [LOCAL ] CEE: Saving primary data. [2025-10-28T17:53:18.371351] [DEBUG] [LOCAL ] CEE: Trimmed 9883 records to 4853 (keeping 200 days of data) [2025-10-28T17:53:18.398951] [DEBUG] [LOCAL ] CEE: Primary data saved (4853 records). [2025-10-28T17:53:18.399026] [INFO ] [MAIN ] CEE: Full history saved. [2025-10-28T17:53:18.399096] [INFO ] [MAIN ] Update Progress: 426/2366 symbols completed. CEE took 29.4s. Estimated remaining: 4h 2m 32s. Rate: 8.0 symbols/min [2025-10-28T17:53:18.565267] [INFO ] [MAIN ] CFG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:53:18.614290] [DEBUG] [LOCAL ] CFG: Loaded 53622 existing records from primary storage. [2025-10-28T17:53:18.614595] [INFO ] [MAIN ] CFG: Loaded 53622 existing records. [2025-10-28T17:53:18.789120] [WARN ] [MAIN ] CFG: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:53:18.789321] [INFO ] [MAIN ] CFG: Wiping existing primary data before full refresh. [2025-10-28T17:53:18.789365] [INFO ] [LOCAL ] CFG: Starting deletion of primary data. [2025-10-28T17:53:18.790353] [DEBUG] [LOCAL ] CFG: Deleted primary data file. [2025-10-28T17:53:18.790410] [INFO ] [MAIN ] CFG: Starting full primary refresh. [2025-10-28T17:53:19.136209] [INFO ] [REMOTE ] CFG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:53:19.159301] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-03. [2025-10-28T17:53:19.661376] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-28T17:53:19.959331] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-01. [2025-10-28T17:53:20.492147] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-28T17:53:20.759375] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-04. [2025-10-28T17:53:21.181287] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-28T17:53:21.559396] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-02. [2025-10-28T17:53:21.972264] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-28T17:53:22.359344] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-10. [2025-10-28T17:53:22.729622] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-28T17:53:23.159377] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-05. [2025-10-28T17:53:23.847611] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-28T17:53:23.857638] [INFO ] [REMOTE ] CE: Full fetch complete (74737 records). [2025-10-28T17:53:23.857809] [DEBUG] [VALIDATOR ] CE: Validating primary data. [2025-10-28T17:53:23.960795] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-03. [2025-10-28T17:53:24.283674] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-28T17:53:24.283818] [DEBUG] [VALIDATOR ] CE: All expected trading days are present. [2025-10-28T17:53:24.289944] [DEBUG] [VALIDATOR ] CE: Primary data validation passed. [2025-10-28T17:53:24.290888] [INFO ] [MAIN ] CE: Fetched primary data is valid. [2025-10-28T17:53:24.291239] [DEBUG] [LOCAL ] CE: Saving primary data. [2025-10-28T17:53:24.292608] [DEBUG] [LOCAL ] CE: Trimmed 74737 records to 51149 (keeping 200 days of data) [2025-10-28T17:53:24.587265] [DEBUG] [LOCAL ] CE: Primary data saved (51149 records). [2025-10-28T17:53:24.587403] [INFO ] [MAIN ] CE: Full history saved. [2025-10-28T17:53:24.587480] [INFO ] [MAIN ] Update Progress: 427/2366 symbols completed. CE took 35.8s. Estimated remaining: 4h 2m 18s. Rate: 8.0 symbols/min [2025-10-28T17:53:24.758180] [INFO ] [MAIN ] CFND: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:53:24.758378] [DEBUG] [LOCAL ] CFND: No existing data file found in primary storage. [2025-10-28T17:53:24.758417] [WARN ] [MAIN ] CFND: No existing data found, performing full refresh instead. [2025-10-28T17:53:24.758532] [INFO ] [MAIN ] CFND: Wiping existing primary data before full refresh. [2025-10-28T17:53:24.758574] [INFO ] [LOCAL ] CFND: Starting deletion of primary data. [2025-10-28T17:53:24.758614] [DEBUG] [LOCAL ] CFND: No primary data file found to delete. [2025-10-28T17:53:24.758672] [INFO ] [MAIN ] CFND: Starting full primary refresh. [2025-10-28T17:53:24.770414] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-06. [2025-10-28T17:53:25.184157] [INFO ] [REMOTE ] CFND: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:53:25.431985] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-28T17:53:25.560508] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-05. [2025-10-28T17:53:25.564025] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-28T17:53:26.359333] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-07. [2025-10-28T17:53:26.901714] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-28T17:53:27.021966] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-28T17:53:27.159329] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-06. [2025-10-28T17:53:27.959393] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-01. [2025-10-28T17:53:28.118478] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-28T17:53:28.118751] [WARN ] [REMOTE ] CFND: No data returned for month 2025-01 [2025-10-28T17:53:28.118841] [FATAL] [REMOTE ] CFND: API call failed - aborting fetch to avoid wasting further API calls [2025-10-28T17:53:28.118907] [FATAL] [MAIN ] CFND: Failed to fetch primary data. [2025-10-28T17:53:28.118968] [WARN ] [MAIN ] CFND: Deleting existing primary and derivative data due to fetch failure. [2025-10-28T17:53:28.119033] [INFO ] [LOCAL ] CFND: Starting deletion of primary data. [2025-10-28T17:53:28.119095] [DEBUG] [LOCAL ] CFND: No primary data file found to delete. [2025-10-28T17:53:28.119131] [INFO ] [LOCAL ] CFND: Starting deletion of derivative data. [2025-10-28T17:53:28.119171] [DEBUG] [LOCAL ] CFND: No derivative data file found to delete. [2025-10-28T17:53:28.119215] [INFO ] [MAIN ] Update Progress: 428/2366 symbols completed. CFND took 3.5s. Estimated remaining: 4h 1m 53s. Rate: 8.0 symbols/min [2025-10-28T17:53:28.288332] [INFO ] [MAIN ] CFR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:53:28.288506] [DEBUG] [LOCAL ] CFR: No existing data file found in primary storage. [2025-10-28T17:53:28.288543] [WARN ] [MAIN ] CFR: No existing data found, performing full refresh instead. [2025-10-28T17:53:28.288675] [INFO ] [MAIN ] CFR: Wiping existing primary data before full refresh. [2025-10-28T17:53:28.288737] [INFO ] [LOCAL ] CFR: Starting deletion of primary data. [2025-10-28T17:53:28.288795] [DEBUG] [LOCAL ] CFR: No primary data file found to delete. [2025-10-28T17:53:28.288837] [INFO ] [MAIN ] CFR: Starting full primary refresh. [2025-10-28T17:53:28.659733] [INFO ] [REMOTE ] CFR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:53:28.702262] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-28T17:53:28.759321] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-07. [2025-10-28T17:53:29.559353] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-01. [2025-10-28T17:53:30.207695] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-28T17:53:30.359331] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-08. [2025-10-28T17:53:30.657928] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-28T17:53:31.062926] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-28T17:53:31.159325] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-04. [2025-10-28T17:53:31.959340] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-08. [2025-10-28T17:53:32.432024] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-28T17:53:32.759327] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-02. [2025-10-28T17:53:33.100826] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-28T17:53:33.559478] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-09. [2025-10-28T17:53:33.793293] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-28T17:53:34.359346] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-03. [2025-10-28T17:53:34.535631] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-28T17:53:35.159382] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-05. [2025-10-28T17:53:35.246735] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-28T17:53:35.959375] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-10. [2025-10-28T17:53:36.643366] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-28T17:53:36.759335] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-06. [2025-10-28T17:53:37.221944] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-28T17:53:37.229494] [INFO ] [REMOTE ] CEPU: Full fetch complete (39776 records). [2025-10-28T17:53:37.229725] [DEBUG] [VALIDATOR ] CEPU: Validating primary data. [2025-10-28T17:53:37.567923] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-04. [2025-10-28T17:53:37.606260] [DEBUG] [VALIDATOR ] CEPU: All expected trading days are present. [2025-10-28T17:53:37.606327] [DEBUG] [VALIDATOR ] CEPU: Primary data validation passed. [2025-10-28T17:53:37.606903] [INFO ] [MAIN ] CEPU: Fetched primary data is valid. [2025-10-28T17:53:37.606963] [DEBUG] [LOCAL ] CEPU: Saving primary data. [2025-10-28T17:53:37.607868] [DEBUG] [LOCAL ] CEPU: Trimmed 39776 records to 27302 (keeping 200 days of data) [2025-10-28T17:53:37.761065] [DEBUG] [LOCAL ] CEPU: Primary data saved (27302 records). [2025-10-28T17:53:37.761178] [INFO ] [MAIN ] CEPU: Full history saved. [2025-10-28T17:53:37.761257] [INFO ] [MAIN ] Update Progress: 429/2366 symbols completed. CEPU took 35.9s. Estimated remaining: 4h 1m 55s. Rate: 8.0 symbols/min [2025-10-28T17:53:37.926113] [INFO ] [MAIN ] CGAU: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:53:37.962942] [DEBUG] [LOCAL ] CGAU: Loaded 43897 existing records from primary storage. [2025-10-28T17:53:37.963263] [INFO ] [MAIN ] CGAU: Loaded 43897 existing records. [2025-10-28T17:53:38.135465] [WARN ] [MAIN ] CGAU: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:53:38.135673] [INFO ] [MAIN ] CGAU: Wiping existing primary data before full refresh. [2025-10-28T17:53:38.135731] [INFO ] [LOCAL ] CGAU: Starting deletion of primary data. [2025-10-28T17:53:38.136363] [DEBUG] [LOCAL ] CGAU: Deleted primary data file. [2025-10-28T17:53:38.136421] [INFO ] [MAIN ] CGAU: Starting full primary refresh. [2025-10-28T17:53:38.373761] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-09. [2025-10-28T17:53:38.489016] [INFO ] [REMOTE ] CGAU: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:53:38.953035] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-06 (2.19 seconds). [2025-10-28T17:53:39.169693] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-07. [2025-10-28T17:53:39.174749] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-28T17:53:39.762363] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-28T17:53:39.959329] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-01. [2025-10-28T17:53:40.314268] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-28T17:53:40.759311] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-05. [2025-10-28T17:53:40.993441] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-28T17:53:41.559338] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-02. [2025-10-28T17:53:41.840079] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-28T17:53:42.359335] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-08. [2025-10-28T17:53:42.596771] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-28T17:53:43.159346] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-03. [2025-10-28T17:53:43.649111] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-28T17:53:43.959392] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-10. [2025-10-28T17:53:44.066869] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-28T17:53:44.759435] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-09. [2025-10-28T17:53:45.244925] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-28T17:53:45.255349] [INFO ] [REMOTE ] CF: Full fetch complete (75585 records). [2025-10-28T17:53:45.255519] [DEBUG] [VALIDATOR ] CF: Validating primary data. [2025-10-28T17:53:45.562463] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-04. [2025-10-28T17:53:45.658866] [DEBUG] [VALIDATOR ] CF: All expected trading days are present. [2025-10-28T17:53:45.658945] [DEBUG] [VALIDATOR ] CF: Primary data validation passed. [2025-10-28T17:53:45.659883] [INFO ] [MAIN ] CF: Fetched primary data is valid. [2025-10-28T17:53:45.659948] [DEBUG] [LOCAL ] CF: Saving primary data. [2025-10-28T17:53:45.661361] [DEBUG] [LOCAL ] CF: Trimmed 75585 records to 52048 (keeping 200 days of data) [2025-10-28T17:53:45.976338] [DEBUG] [LOCAL ] CF: Primary data saved (52048 records). [2025-10-28T17:53:45.976469] [INFO ] [MAIN ] CF: Full history saved. [2025-10-28T17:53:45.976545] [INFO ] [MAIN ] Update Progress: 430/2366 symbols completed. CF took 36.2s. Estimated remaining: 4h 1m 51s. Rate: 8.0 symbols/min [2025-10-28T17:53:46.150157] [INFO ] [MAIN ] CGV: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:53:46.180032] [DEBUG] [LOCAL ] CGV: Loaded 1306 existing records from primary storage. [2025-10-28T17:53:46.181993] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-28T17:53:46.180736] [INFO ] [MAIN ] CGV: Loaded 1306 existing records. [2025-10-28T17:53:46.368307] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-10. [2025-10-28T17:53:46.374256] [WARN ] [MAIN ] CGV: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:53:46.375247] [INFO ] [MAIN ] CGV: Wiping existing primary data before full refresh. [2025-10-28T17:53:46.375299] [INFO ] [LOCAL ] CGV: Starting deletion of primary data. [2025-10-28T17:53:46.375443] [DEBUG] [LOCAL ] CGV: Deleted primary data file. [2025-10-28T17:53:46.375487] [INFO ] [MAIN ] CGV: Starting full primary refresh. [2025-10-28T17:53:46.743494] [INFO ] [REMOTE ] CGV: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:53:46.768220] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-28T17:53:47.159394] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-05. [2025-10-28T17:53:47.804893] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-28T17:53:47.815763] [INFO ] [REMOTE ] CFG: Full fetch complete (77781 records). [2025-10-28T17:53:47.815945] [DEBUG] [VALIDATOR ] CFG: Validating primary data. [2025-10-28T17:53:47.966075] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-01. [2025-10-28T17:53:48.240021] [DEBUG] [VALIDATOR ] CFG: All expected trading days are present. [2025-10-28T17:53:48.240320] [DEBUG] [VALIDATOR ] CFG: Primary data validation passed. [2025-10-28T17:53:48.241588] [INFO ] [MAIN ] CFG: Fetched primary data is valid. [2025-10-28T17:53:48.241721] [DEBUG] [LOCAL ] CFG: Saving primary data. [2025-10-28T17:53:48.243421] [DEBUG] [LOCAL ] CFG: Trimmed 77781 records to 53622 (keeping 200 days of data) [2025-10-28T17:53:48.394060] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-28T17:53:48.602948] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-28T17:53:48.603100] [DEBUG] [LOCAL ] CFG: Primary data saved (53622 records). [2025-10-28T17:53:48.604522] [INFO ] [MAIN ] CFG: Full history saved. [2025-10-28T17:53:48.604962] [INFO ] [MAIN ] Update Progress: 431/2366 symbols completed. CFG took 30.2s. Estimated remaining: 4h 1m 22s. Rate: 8.0 symbols/min [2025-10-28T17:53:48.771088] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-02. [2025-10-28T17:53:48.774249] [INFO ] [MAIN ] CHCT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:53:48.774630] [DEBUG] [LOCAL ] CHCT: No existing data file found in primary storage. [2025-10-28T17:53:48.775575] [WARN ] [MAIN ] CHCT: No existing data found, performing full refresh instead. [2025-10-28T17:53:48.775734] [INFO ] [MAIN ] CHCT: Wiping existing primary data before full refresh. [2025-10-28T17:53:48.775782] [INFO ] [LOCAL ] CHCT: Starting deletion of primary data. [2025-10-28T17:53:48.775825] [DEBUG] [LOCAL ] CHCT: No primary data file found to delete. [2025-10-28T17:53:48.775857] [INFO ] [MAIN ] CHCT: Starting full primary refresh. [2025-10-28T17:53:49.129632] [INFO ] [REMOTE ] CHCT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:53:49.129805] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-10-28T17:53:49.559340] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-01. [2025-10-28T17:53:50.359352] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-03. [2025-10-28T17:53:50.473499] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-28T17:53:50.589611] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-03 (0.23 seconds). [2025-10-28T17:53:51.159359] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-04. [2025-10-28T17:53:51.426424] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-04 (0.27 seconds). [2025-10-28T17:53:51.959345] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-06. [2025-10-28T17:53:52.759309] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-02. [2025-10-28T17:53:52.956009] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-28T17:53:53.455026] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-28T17:53:53.559349] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-03. [2025-10-28T17:53:54.304685] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-28T17:53:54.359361] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-04. [2025-10-28T17:53:55.159315] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-07. [2025-10-28T17:53:55.203310] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-28T17:53:55.959315] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-06. [2025-10-28T17:53:55.999119] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-28T17:53:56.759340] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-05. [2025-10-28T17:53:57.000906] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-05 (0.24 seconds). [2025-10-28T17:53:57.078676] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-28T17:53:57.559337] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-05. [2025-10-28T17:53:58.339303] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-28T17:53:58.359298] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-06. [2025-10-28T17:53:59.125554] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-28T17:53:59.159379] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-08. [2025-10-28T17:53:59.959385] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-06. [2025-10-28T17:54:00.174581] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-28T17:54:00.318271] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-10-28T17:54:00.759333] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-07. [2025-10-28T17:54:01.040624] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-07 (0.28 seconds). [2025-10-28T17:54:01.559347] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-08. [2025-10-28T17:54:01.799481] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-08 (0.24 seconds). [2025-10-28T17:54:02.359342] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-09. [2025-10-28T17:54:03.159368] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-09. [2025-10-28T17:54:03.383281] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-28T17:54:03.415711] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-09 (0.26 seconds). [2025-10-28T17:54:03.959344] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-07. [2025-10-28T17:54:04.759399] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-10. [2025-10-28T17:54:05.076948] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-28T17:54:05.153205] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-10-28T17:54:05.154149] [INFO ] [REMOTE ] CGV: Full fetch complete (2169 records). [2025-10-28T17:54:05.154217] [DEBUG] [VALIDATOR ] CGV: Validating primary data. [2025-10-28T17:54:05.547855] [DEBUG] [VALIDATOR ] CGV: All expected trading days are present. [2025-10-28T17:54:05.547972] [DEBUG] [VALIDATOR ] CGV: Primary data validation passed. [2025-10-28T17:54:05.548116] [INFO ] [MAIN ] CGV: Fetched primary data is valid. [2025-10-28T17:54:05.548172] [DEBUG] [LOCAL ] CGV: Saving primary data. [2025-10-28T17:54:05.548625] [DEBUG] [LOCAL ] CGV: Trimmed 2169 records to 1299 (keeping 200 days of data) [2025-10-28T17:54:05.557469] [DEBUG] [LOCAL ] CGV: Primary data saved (1299 records). [2025-10-28T17:54:05.557558] [INFO ] [MAIN ] CGV: Full history saved. [2025-10-28T17:54:05.557682] [INFO ] [MAIN ] Update Progress: 432/2366 symbols completed. CGV took 19.6s. Estimated remaining: 4h 1m 56s. Rate: 8.0 symbols/min [2025-10-28T17:54:05.567775] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-10. [2025-10-28T17:54:05.727336] [INFO ] [MAIN ] CHD: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:54:05.727535] [DEBUG] [LOCAL ] CHD: No existing data file found in primary storage. [2025-10-28T17:54:05.727571] [WARN ] [MAIN ] CHD: No existing data found, performing full refresh instead. [2025-10-28T17:54:05.727713] [INFO ] [MAIN ] CHD: Wiping existing primary data before full refresh. [2025-10-28T17:54:05.727785] [INFO ] [LOCAL ] CHD: Starting deletion of primary data. [2025-10-28T17:54:05.727828] [DEBUG] [LOCAL ] CHD: No primary data file found to delete. [2025-10-28T17:54:05.727860] [INFO ] [MAIN ] CHD: Starting full primary refresh. [2025-10-28T17:54:06.111149] [INFO ] [REMOTE ] CHD: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:54:06.359366] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-08. [2025-10-28T17:54:06.680344] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-28T17:54:06.686867] [INFO ] [REMOTE ] CFR: Full fetch complete (48680 records). [2025-10-28T17:54:06.686987] [DEBUG] [VALIDATOR ] CFR: Validating primary data. [2025-10-28T17:54:07.080707] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-28T17:54:07.080828] [DEBUG] [VALIDATOR ] CFR: All expected trading days are present. [2025-10-28T17:54:07.085881] [DEBUG] [VALIDATOR ] CFR: Primary data validation passed. [2025-10-28T17:54:07.086723] [INFO ] [MAIN ] CFR: Fetched primary data is valid. [2025-10-28T17:54:07.086895] [DEBUG] [LOCAL ] CFR: Saving primary data. [2025-10-28T17:54:07.087980] [DEBUG] [LOCAL ] CFR: Trimmed 48680 records to 32148 (keeping 200 days of data) [2025-10-28T17:54:07.175634] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-09. [2025-10-28T17:54:07.286625] [DEBUG] [LOCAL ] CFR: Primary data saved (32148 records). [2025-10-28T17:54:07.286791] [INFO ] [MAIN ] CFR: Full history saved. [2025-10-28T17:54:07.286867] [INFO ] [MAIN ] Update Progress: 433/2366 symbols completed. CFR took 39.2s. Estimated remaining: 4h 1m 23s. Rate: 8.0 symbols/min [2025-10-28T17:54:07.461978] [INFO ] [MAIN ] CHE: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:54:07.478539] [DEBUG] [LOCAL ] CHE: Loaded 15307 existing records from primary storage. [2025-10-28T17:54:07.478811] [INFO ] [MAIN ] CHE: Loaded 15307 existing records. [2025-10-28T17:54:07.658506] [WARN ] [MAIN ] CHE: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:54:07.658722] [INFO ] [MAIN ] CHE: Wiping existing primary data before full refresh. [2025-10-28T17:54:07.658780] [INFO ] [LOCAL ] CHE: Starting deletion of primary data. [2025-10-28T17:54:07.659002] [DEBUG] [LOCAL ] CHE: Deleted primary data file. [2025-10-28T17:54:07.659043] [INFO ] [MAIN ] CHE: Starting full primary refresh. [2025-10-28T17:54:07.960873] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-01. [2025-10-28T17:54:08.039901] [INFO ] [REMOTE ] CHE: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:54:08.049953] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-28T17:54:08.759368] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-01. [2025-10-28T17:54:09.554734] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-28T17:54:09.564416] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-10. [2025-10-28T17:54:09.595881] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-28T17:54:10.359324] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-07. [2025-10-28T17:54:10.519910] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-28T17:54:10.524802] [INFO ] [REMOTE ] CHCT: Full fetch complete (34709 records). [2025-10-28T17:54:10.524875] [DEBUG] [VALIDATOR ] CHCT: Validating primary data. [2025-10-28T17:54:10.913255] [DEBUG] [VALIDATOR ] CHCT: All expected trading days are present. [2025-10-28T17:54:10.913326] [DEBUG] [VALIDATOR ] CHCT: Primary data validation passed. [2025-10-28T17:54:10.913817] [INFO ] [MAIN ] CHCT: Fetched primary data is valid. [2025-10-28T17:54:10.913897] [DEBUG] [LOCAL ] CHCT: Saving primary data. [2025-10-28T17:54:10.914609] [DEBUG] [LOCAL ] CHCT: Trimmed 34709 records to 23917 (keeping 200 days of data) [2025-10-28T17:54:11.053138] [DEBUG] [LOCAL ] CHCT: Primary data saved (23917 records). [2025-10-28T17:54:11.053300] [INFO ] [MAIN ] CHCT: Full history saved. [2025-10-28T17:54:11.053380] [INFO ] [MAIN ] Update Progress: 434/2366 symbols completed. CHCT took 22.4s. Estimated remaining: 4h 0m 59s. Rate: 8.0 symbols/min [2025-10-28T17:54:11.164465] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-02. [2025-10-28T17:54:11.220112] [INFO ] [MAIN ] CHGG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:54:11.260453] [DEBUG] [LOCAL ] CHGG: Loaded 47346 existing records from primary storage. [2025-10-28T17:54:11.260751] [INFO ] [MAIN ] CHGG: Loaded 47346 existing records. [2025-10-28T17:54:11.446504] [WARN ] [MAIN ] CHGG: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:54:11.446869] [INFO ] [MAIN ] CHGG: Wiping existing primary data before full refresh. [2025-10-28T17:54:11.446976] [INFO ] [LOCAL ] CHGG: Starting deletion of primary data. [2025-10-28T17:54:11.455585] [DEBUG] [LOCAL ] CHGG: Deleted primary data file. [2025-10-28T17:54:11.469261] [INFO ] [MAIN ] CHGG: Starting full primary refresh. [2025-10-28T17:54:11.502164] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-28T17:54:11.826353] [INFO ] [REMOTE ] CHGG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:54:11.959353] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-01. [2025-10-28T17:54:12.240909] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-28T17:54:12.759562] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-08. [2025-10-28T17:54:13.339850] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-28T17:54:13.559364] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-02. [2025-10-28T17:54:14.054989] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-28T17:54:14.075466] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-28T17:54:14.359358] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-03. [2025-10-28T17:54:14.988279] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-28T17:54:15.159364] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-02. [2025-10-28T17:54:15.959343] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-04. [2025-10-28T17:54:16.536148] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-28T17:54:16.649496] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-28T17:54:16.759397] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-03. [2025-10-28T17:54:17.559336] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-05. [2025-10-28T17:54:18.231586] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-28T17:54:18.251597] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-28T17:54:18.359365] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-06. [2025-10-28T17:54:19.159341] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-04. [2025-10-28T17:54:19.287204] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-28T17:54:19.959338] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-03. [2025-10-28T17:54:20.193782] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-28T17:54:20.759333] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-07. [2025-10-28T17:54:21.347400] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-28T17:54:21.559302] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-05. [2025-10-28T17:54:21.797836] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-28T17:54:22.359331] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-09. [2025-10-28T17:54:22.727574] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-28T17:54:23.159379] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-04. [2025-10-28T17:54:23.916565] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-28T17:54:23.959392] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-10. [2025-10-28T17:54:24.759355] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-06. [2025-10-28T17:54:24.908905] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-28T17:54:25.559307] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-08. [2025-10-28T17:54:25.658454] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-28T17:54:25.668518] [INFO ] [REMOTE ] CGAU: Full fetch complete (62368 records). [2025-10-28T17:54:25.668627] [DEBUG] [VALIDATOR ] CGAU: Validating primary data. [2025-10-28T17:54:26.058918] [DEBUG] [VALIDATOR ] CGAU: All expected trading days are present. [2025-10-28T17:54:26.058999] [DEBUG] [VALIDATOR ] CGAU: Primary data validation passed. [2025-10-28T17:54:26.059721] [INFO ] [MAIN ] CGAU: Fetched primary data is valid. [2025-10-28T17:54:26.059784] [DEBUG] [LOCAL ] CGAU: Saving primary data. [2025-10-28T17:54:26.060938] [DEBUG] [LOCAL ] CGAU: Trimmed 62368 records to 43880 (keeping 200 days of data) [2025-10-28T17:54:26.320104] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-28T17:54:26.330670] [DEBUG] [LOCAL ] CGAU: Primary data saved (43880 records). [2025-10-28T17:54:26.330814] [INFO ] [MAIN ] CGAU: Full history saved. [2025-10-28T17:54:26.330911] [INFO ] [MAIN ] Update Progress: 435/2366 symbols completed. CGAU took 48.6s. Estimated remaining: 4h 1m 26s. Rate: 8.0 symbols/min [2025-10-28T17:54:26.362755] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-09. [2025-10-28T17:54:26.506537] [INFO ] [MAIN ] CHH: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:54:26.550463] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-10-28T17:54:26.571917] [DEBUG] [LOCAL ] CHH: Loaded 32110 existing records from primary storage. [2025-10-28T17:54:26.572196] [INFO ] [MAIN ] CHH: Loaded 32110 existing records. [2025-10-28T17:54:26.758052] [WARN ] [MAIN ] CHH: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:54:26.758283] [INFO ] [MAIN ] CHH: Wiping existing primary data before full refresh. [2025-10-28T17:54:26.758337] [INFO ] [LOCAL ] CHH: Starting deletion of primary data. [2025-10-28T17:54:26.759085] [DEBUG] [LOCAL ] CHH: Deleted primary data file. [2025-10-28T17:54:26.759146] [INFO ] [MAIN ] CHH: Starting full primary refresh. [2025-10-28T17:54:27.138126] [INFO ] [REMOTE ] CHH: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:54:27.149951] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-28T17:54:27.159289] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-10. [2025-10-28T17:54:27.935092] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-28T17:54:27.940136] [INFO ] [REMOTE ] CHE: Full fetch complete (20684 records). [2025-10-28T17:54:27.940235] [DEBUG] [VALIDATOR ] CHE: Validating primary data. [2025-10-28T17:54:27.967422] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-07. [2025-10-28T17:54:28.401306] [DEBUG] [VALIDATOR ] CHE: All expected trading days are present. [2025-10-28T17:54:28.401462] [DEBUG] [VALIDATOR ] CHE: Primary data validation passed. [2025-10-28T17:54:28.401884] [INFO ] [MAIN ] CHE: Fetched primary data is valid. [2025-10-28T17:54:28.401944] [DEBUG] [LOCAL ] CHE: Saving primary data. [2025-10-28T17:54:28.402534] [DEBUG] [LOCAL ] CHE: Trimmed 20684 records to 15358 (keeping 200 days of data) [2025-10-28T17:54:28.501974] [DEBUG] [LOCAL ] CHE: Primary data saved (15358 records). [2025-10-28T17:54:28.502388] [INFO ] [MAIN ] CHE: Full history saved. [2025-10-28T17:54:28.502472] [INFO ] [MAIN ] Update Progress: 436/2366 symbols completed. CHE took 21.2s. Estimated remaining: 4h 0m 55s. Rate: 8.0 symbols/min [2025-10-28T17:54:28.668609] [INFO ] [MAIN ] CHMI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:54:28.668872] [DEBUG] [LOCAL ] CHMI: No existing data file found in primary storage. [2025-10-28T17:54:28.668914] [WARN ] [MAIN ] CHMI: No existing data found, performing full refresh instead. [2025-10-28T17:54:28.669059] [INFO ] [MAIN ] CHMI: Wiping existing primary data before full refresh. [2025-10-28T17:54:28.669099] [INFO ] [LOCAL ] CHMI: Starting deletion of primary data. [2025-10-28T17:54:28.669139] [DEBUG] [LOCAL ] CHMI: No primary data file found to delete. [2025-10-28T17:54:28.669170] [INFO ] [MAIN ] CHMI: Starting full primary refresh. [2025-10-28T17:54:28.764611] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-05. [2025-10-28T17:54:29.023702] [INFO ] [REMOTE ] CHMI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:54:29.421547] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-28T17:54:29.559354] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-01. [2025-10-28T17:54:30.245916] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-28T17:54:30.359350] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-06. [2025-10-28T17:54:30.630928] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-28T17:54:31.159336] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-02. [2025-10-28T17:54:31.868980] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-28T17:54:31.959368] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-07. [2025-10-28T17:54:32.434381] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-28T17:54:32.759366] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-08. [2025-10-28T17:54:32.815949] [DEBUG] [REMOTE ] CHGG: Error fetching primary data for 2025-08: 'API call returned an empty response.' [2025-10-28T17:54:32.816286] [WARN ] [REMOTE ] CHGG: No data returned for month 2025-08 [2025-10-28T17:54:32.816381] [FATAL] [REMOTE ] CHGG: API call failed - aborting fetch to avoid wasting further API calls [2025-10-28T17:54:32.816459] [FATAL] [MAIN ] CHGG: Failed to fetch primary data. [2025-10-28T17:54:32.816495] [WARN ] [MAIN ] CHGG: Deleting existing primary and derivative data due to fetch failure. [2025-10-28T17:54:32.816531] [INFO ] [LOCAL ] CHGG: Starting deletion of primary data. [2025-10-28T17:54:32.816585] [DEBUG] [LOCAL ] CHGG: No primary data file found to delete. [2025-10-28T17:54:32.816620] [INFO ] [LOCAL ] CHGG: Starting deletion of derivative data. [2025-10-28T17:54:32.817009] [DEBUG] [LOCAL ] CHGG: Deleted derivative data file. [2025-10-28T17:54:32.817459] [INFO ] [MAIN ] Update Progress: 437/2366 symbols completed. CHGG took 21.8s. Estimated remaining: 4h 0m 34s. Rate: 8.0 symbols/min [2025-10-28T17:54:33.246713] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-28T17:54:33.559350] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-01. [2025-10-28T17:54:34.359335] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-03. [2025-10-28T17:54:34.413886] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-28T17:54:35.159361] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-02. [2025-10-28T17:54:35.442916] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-28T17:54:35.787555] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-28T17:54:35.959342] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-03. [2025-10-28T17:54:36.747540] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-28T17:54:36.759301] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-04. [2025-10-28T17:54:37.559338] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-04. [2025-10-28T17:54:37.743701] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-28T17:54:38.359346] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-05. [2025-10-28T17:54:38.668625] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-28T17:54:39.041965] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-28T17:54:39.159309] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-06. [2025-10-28T17:54:39.898612] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-28T17:54:39.959304] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-08. [2025-10-28T17:54:40.759338] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-05. [2025-10-28T17:54:41.559364] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-07. [2025-10-28T17:54:41.665763] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-28T17:54:41.894193] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-28T17:54:42.253212] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-28T17:54:42.359301] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-09. [2025-10-28T17:54:43.159342] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-06. [2025-10-28T17:54:43.946517] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-28T17:54:43.964467] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-07. [2025-10-28T17:54:43.983530] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-28T17:54:44.759344] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-08. [2025-10-28T17:54:44.921795] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-28T17:54:45.559318] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-08. [2025-10-28T17:54:45.575097] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-28T17:54:46.359307] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-09. [2025-10-28T17:54:46.440491] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-28T17:54:47.081354] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-28T17:54:47.159330] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-10. [2025-10-28T17:54:47.959387] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-09. [2025-10-28T17:54:48.533514] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-28T17:54:48.543911] [INFO ] [REMOTE ] CHD: Full fetch complete (75012 records). [2025-10-28T17:54:48.544062] [DEBUG] [VALIDATOR ] CHD: Validating primary data. [2025-10-28T17:54:48.774501] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-10. [2025-10-28T17:54:48.943629] [DEBUG] [VALIDATOR ] CHD: All expected trading days are present. [2025-10-28T17:54:48.943810] [DEBUG] [VALIDATOR ] CHD: Primary data validation passed. [2025-10-28T17:54:48.944692] [INFO ] [MAIN ] CHD: Fetched primary data is valid. [2025-10-28T17:54:48.944901] [DEBUG] [LOCAL ] CHD: Saving primary data. [2025-10-28T17:54:48.946466] [DEBUG] [LOCAL ] CHD: Trimmed 75012 records to 52297 (keeping 200 days of data) [2025-10-28T17:54:49.079985] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-28T17:54:49.292819] [DEBUG] [LOCAL ] CHD: Primary data saved (52297 records). [2025-10-28T17:54:49.292966] [INFO ] [MAIN ] CHD: Full history saved. [2025-10-28T17:54:49.293040] [INFO ] [MAIN ] Update Progress: 438/2366 symbols completed. CHD took 43.7s. Estimated remaining: 4h 1m 6s. Rate: 8.0 symbols/min [2025-10-28T17:54:49.559378] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-10. [2025-10-28T17:54:49.622375] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-28T17:54:49.626543] [INFO ] [REMOTE ] CHMI: Full fetch complete (31181 records). [2025-10-28T17:54:49.626617] [DEBUG] [VALIDATOR ] CHMI: Validating primary data. [2025-10-28T17:54:50.004697] [DEBUG] [VALIDATOR ] CHMI: All expected trading days are present. [2025-10-28T17:54:50.004787] [DEBUG] [VALIDATOR ] CHMI: Primary data validation passed. [2025-10-28T17:54:50.005272] [INFO ] [MAIN ] CHMI: Fetched primary data is valid. [2025-10-28T17:54:50.005310] [DEBUG] [LOCAL ] CHMI: Saving primary data. [2025-10-28T17:54:50.006099] [DEBUG] [LOCAL ] CHMI: Trimmed 31181 records to 20680 (keeping 200 days of data) [2025-10-28T17:54:50.122395] [DEBUG] [LOCAL ] CHMI: Primary data saved (20680 records). [2025-10-28T17:54:50.122512] [INFO ] [MAIN ] CHMI: Full history saved. [2025-10-28T17:54:50.122577] [INFO ] [MAIN ] Update Progress: 439/2366 symbols completed. CHMI took 21.6s. Estimated remaining: 4h 0m 29s. Rate: 8.0 symbols/min [2025-10-28T17:54:50.849595] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-28T17:54:50.857179] [INFO ] [REMOTE ] CHH: Full fetch complete (47682 records). [2025-10-28T17:54:50.857379] [DEBUG] [VALIDATOR ] CHH: Validating primary data. [2025-10-28T17:54:51.237172] [DEBUG] [VALIDATOR ] CHH: All expected trading days are present. [2025-10-28T17:54:51.237249] [DEBUG] [VALIDATOR ] CHH: Primary data validation passed. [2025-10-28T17:54:51.237878] [INFO ] [MAIN ] CHH: Fetched primary data is valid. [2025-10-28T17:54:51.237940] [DEBUG] [LOCAL ] CHH: Saving primary data. [2025-10-28T17:54:51.238991] [DEBUG] [LOCAL ] CHH: Trimmed 47682 records to 32029 (keeping 200 days of data) [2025-10-28T17:54:51.431772] [DEBUG] [LOCAL ] CHH: Primary data saved (32029 records). [2025-10-28T17:54:51.431907] [INFO ] [MAIN ] CHH: Full history saved. [2025-10-28T17:54:51.431980] [INFO ] [MAIN ] Update Progress: 440/2366 symbols completed. CHH took 25.1s. Estimated remaining: 3h 59m 54s. Rate: 8.0 symbols/min [2025-10-28T17:54:52.084702] [INFO ] [MAIN ] CHT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:54:52.090918] [INFO ] [MAIN ] CHPT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:54:52.098147] [INFO ] [MAIN ] CHN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:54:52.121067] [DEBUG] [LOCAL ] CHN: No existing data file found in primary storage. [2025-10-28T17:54:52.127664] [WARN ] [MAIN ] CHN: No existing data found, performing full refresh instead. [2025-10-28T17:54:52.130947] [INFO ] [MAIN ] CHN: Wiping existing primary data before full refresh. [2025-10-28T17:54:52.135703] [INFO ] [LOCAL ] CHN: Starting deletion of primary data. [2025-10-28T17:54:52.153723] [DEBUG] [LOCAL ] CHN: No primary data file found to delete. [2025-10-28T17:54:52.158737] [INFO ] [MAIN ] CHN: Starting full primary refresh. [2025-10-28T17:54:52.163105] [INFO ] [MAIN ] CHWY: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:54:52.251631] [DEBUG] [LOCAL ] CHT: Loaded 19042 existing records from primary storage. [2025-10-28T17:54:52.276560] [INFO ] [MAIN ] CHT: Loaded 19042 existing records. [2025-10-28T17:54:52.472713] [DEBUG] [LOCAL ] CHPT: Loaded 46484 existing records from primary storage. [2025-10-28T17:54:52.515872] [INFO ] [MAIN ] CHPT: Loaded 46484 existing records. [2025-10-28T17:54:52.786667] [WARN ] [MAIN ] CHT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:54:52.961718] [INFO ] [MAIN ] CHT: Wiping existing primary data before full refresh. [2025-10-28T17:54:52.961887] [INFO ] [LOCAL ] CHT: Starting deletion of primary data. [2025-10-28T17:54:52.966540] [WARN ] [MAIN ] CHPT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:54:52.968039] [DEBUG] [LOCAL ] CHWY: Loaded 53654 existing records from primary storage. [2025-10-28T17:54:52.961572] [INFO ] [REMOTE ] CHN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:54:52.968403] [INFO ] [MAIN ] CHPT: Wiping existing primary data before full refresh. [2025-10-28T17:54:52.968570] [INFO ] [LOCAL ] CHPT: Starting deletion of primary data. [2025-10-28T17:54:52.968773] [INFO ] [MAIN ] CHWY: Loaded 53654 existing records. [2025-10-28T17:54:52.968626] [DEBUG] [LOCAL ] CHT: Deleted primary data file. [2025-10-28T17:54:52.989262] [INFO ] [MAIN ] CHT: Starting full primary refresh. [2025-10-28T17:54:52.989199] [DEBUG] [LOCAL ] CHPT: Deleted primary data file. [2025-10-28T17:54:53.003377] [INFO ] [MAIN ] CHPT: Starting full primary refresh. [2025-10-28T17:54:52.969100] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-01. [2025-10-28T17:54:53.462962] [WARN ] [MAIN ] CHWY: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:54:53.527875] [INFO ] [MAIN ] CHWY: Wiping existing primary data before full refresh. [2025-10-28T17:54:53.547558] [INFO ] [LOCAL ] CHWY: Starting deletion of primary data. [2025-10-28T17:54:53.605175] [DEBUG] [LOCAL ] CHWY: Deleted primary data file. [2025-10-28T17:54:53.620927] [INFO ] [MAIN ] CHWY: Starting full primary refresh. [2025-10-28T17:54:53.884496] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-28T17:54:53.895748] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-02. [2025-10-28T17:54:53.951917] [INFO ] [REMOTE ] CHT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:54:54.032732] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-01. [2025-10-28T17:54:54.090961] [INFO ] [REMOTE ] CHPT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:54:54.142924] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-01. [2025-10-28T17:54:54.264891] [INFO ] [REMOTE ] CHWY: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:54:54.265151] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-01. [2025-10-28T17:54:54.339302] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-28T17:54:54.359356] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-03. [2025-10-28T17:54:54.707260] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-28T17:54:54.716686] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-10-28T17:54:55.159353] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-02. [2025-10-28T17:54:55.803867] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-28T17:54:55.848620] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-28T17:54:55.959316] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-02. [2025-10-28T17:54:56.231538] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-10-28T17:54:56.759399] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-03. [2025-10-28T17:54:57.426630] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-28T17:54:57.448822] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-28T17:54:57.559311] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-04. [2025-10-28T17:54:58.314312] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-28T17:54:58.359294] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-02. [2025-10-28T17:54:59.159315] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-05. [2025-10-28T17:54:59.964435] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-04. [2025-10-28T17:54:59.988701] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-28T17:55:00.014220] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-28T17:55:00.539326] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-28T17:55:00.759314] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-06. [2025-10-28T17:55:01.559354] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-03. [2025-10-28T17:55:01.924540] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-28T17:55:02.359387] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-05. [2025-10-28T17:55:03.159351] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-03. [2025-10-28T17:55:03.173628] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-28T17:55:03.592780] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-28T17:55:03.959360] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-04. [2025-10-28T17:55:04.759413] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-06. [2025-10-28T17:55:04.915988] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-28T17:55:05.314362] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-10-28T17:55:05.559291] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-07. [2025-10-28T17:55:05.705333] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-28T17:55:05.953169] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-10-28T17:55:06.359348] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-08. [2025-10-28T17:55:06.836906] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-28T17:55:07.159342] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-09. [2025-10-28T17:55:07.552793] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-10-28T17:55:07.959366] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-05. [2025-10-28T17:55:08.759348] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-04. [2025-10-28T17:55:09.559361] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-10. [2025-10-28T17:55:09.624353] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-28T17:55:10.251176] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-28T17:55:10.252854] [INFO ] [REMOTE ] CHN: Full fetch complete (7608 records). [2025-10-28T17:55:10.252921] [DEBUG] [VALIDATOR ] CHN: Validating primary data. [2025-10-28T17:55:10.364540] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-07. [2025-10-28T17:55:10.628192] [DEBUG] [VALIDATOR ] CHN: All expected trading days are present. [2025-10-28T17:55:10.628309] [DEBUG] [VALIDATOR ] CHN: Primary data validation passed. [2025-10-28T17:55:10.628734] [INFO ] [MAIN ] CHN: Fetched primary data is valid. [2025-10-28T17:55:10.628849] [DEBUG] [LOCAL ] CHN: Saving primary data. [2025-10-28T17:55:10.629513] [DEBUG] [LOCAL ] CHN: Trimmed 7608 records to 4981 (keeping 200 days of data) [2025-10-28T17:55:10.660367] [DEBUG] [LOCAL ] CHN: Primary data saved (4981 records). [2025-10-28T17:55:10.660618] [INFO ] [MAIN ] CHN: Full history saved. [2025-10-28T17:55:10.660746] [INFO ] [MAIN ] Update Progress: 441/2366 symbols completed. CHN took 19.2s. Estimated remaining: 4h 0m 38s. Rate: 8.0 symbols/min [2025-10-28T17:55:10.869415] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-10-28T17:55:10.873241] [INFO ] [MAIN ] CI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:55:10.934843] [DEBUG] [LOCAL ] CI: Loaded 49475 existing records from primary storage. [2025-10-28T17:55:10.935177] [INFO ] [MAIN ] CI: Loaded 49475 existing records. [2025-10-28T17:55:11.113215] [WARN ] [MAIN ] CI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:55:11.113410] [INFO ] [MAIN ] CI: Wiping existing primary data before full refresh. [2025-10-28T17:55:11.113456] [INFO ] [LOCAL ] CI: Starting deletion of primary data. [2025-10-28T17:55:11.113792] [DEBUG] [LOCAL ] CI: Deleted primary data file. [2025-10-28T17:55:11.113848] [INFO ] [MAIN ] CI: Starting full primary refresh. [2025-10-28T17:55:11.170852] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-06. [2025-10-28T17:55:11.478730] [INFO ] [REMOTE ] CI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:55:11.521060] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-28T17:55:11.959365] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-08. [2025-10-28T17:55:12.745823] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-28T17:55:12.759299] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-05. [2025-10-28T17:55:12.793854] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-28T17:55:13.559349] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-01. [2025-10-28T17:55:14.359321] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-09. [2025-10-28T17:55:14.398412] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-28T17:55:15.025982] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-28T17:55:15.058168] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-28T17:55:15.159355] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-02. [2025-10-28T17:55:15.959357] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-10. [2025-10-28T17:55:16.499243] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-28T17:55:16.759359] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-06. [2025-10-28T17:55:16.772951] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-28T17:55:16.777008] [INFO ] [REMOTE ] CHT: Full fetch complete (27563 records). [2025-10-28T17:55:16.777169] [DEBUG] [VALIDATOR ] CHT: Validating primary data. [2025-10-28T17:55:16.777721] [FATAL] [VALIDATOR ] CHT: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T17:55:16.777817] [FATAL] [MAIN ] CHT: Fetched primary data is invalid. Refusing to save it. [2025-10-28T17:55:16.777898] [WARN ] [MAIN ] CHT: Deleting existing primary and derivative data due to validation failure. [2025-10-28T17:55:16.777983] [INFO ] [LOCAL ] CHT: Starting deletion of primary data. [2025-10-28T17:55:16.778060] [DEBUG] [LOCAL ] CHT: No primary data file found to delete. [2025-10-28T17:55:16.778337] [INFO ] [LOCAL ] CHT: Starting deletion of derivative data. [2025-10-28T17:55:16.778716] [DEBUG] [LOCAL ] CHT: Deleted derivative data file. [2025-10-28T17:55:16.778821] [INFO ] [MAIN ] Update Progress: 442/2366 symbols completed. CHT took 25.3s. Estimated remaining: 4h 0m 25s. Rate: 8.0 symbols/min [2025-10-28T17:55:16.951198] [INFO ] [MAIN ] CIA: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:55:16.965575] [DEBUG] [LOCAL ] CIA: Loaded 16250 existing records from primary storage. [2025-10-28T17:55:16.965833] [INFO ] [MAIN ] CIA: Loaded 16250 existing records. [2025-10-28T17:55:17.146203] [WARN ] [MAIN ] CIA: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:55:17.146411] [INFO ] [MAIN ] CIA: Wiping existing primary data before full refresh. [2025-10-28T17:55:17.146459] [INFO ] [LOCAL ] CIA: Starting deletion of primary data. [2025-10-28T17:55:17.146821] [DEBUG] [LOCAL ] CIA: Deleted primary data file. [2025-10-28T17:55:17.146880] [INFO ] [MAIN ] CIA: Starting full primary refresh. [2025-10-28T17:55:17.514401] [INFO ] [REMOTE ] CIA: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:55:17.559351] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-01. [2025-10-28T17:55:18.274750] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-28T17:55:18.334330] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-28T17:55:18.359307] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-07. [2025-10-28T17:55:19.159318] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-03. [2025-10-28T17:55:19.737870] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-28T17:55:19.959351] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-08. [2025-10-28T17:55:20.642021] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-28T17:55:20.759357] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-02. [2025-10-28T17:55:21.365270] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-28T17:55:21.386779] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-28T17:55:21.559355] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-04. [2025-10-28T17:55:22.359338] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-09. [2025-10-28T17:55:22.922814] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-28T17:55:23.159335] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-07. [2025-10-28T17:55:23.835788] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-28T17:55:23.959351] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-10. [2025-10-28T17:55:24.759365] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-05. [2025-10-28T17:55:25.138811] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-28T17:55:25.539136] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-28T17:55:25.551745] [INFO ] [REMOTE ] CHWY: Full fetch complete (77779 records). [2025-10-28T17:55:25.551923] [DEBUG] [VALIDATOR ] CHWY: Validating primary data. [2025-10-28T17:55:25.564552] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-08. [2025-10-28T17:55:26.016119] [DEBUG] [VALIDATOR ] CHWY: All expected trading days are present. [2025-10-28T17:55:26.016218] [DEBUG] [VALIDATOR ] CHWY: Primary data validation passed. [2025-10-28T17:55:26.017193] [INFO ] [MAIN ] CHWY: Fetched primary data is valid. [2025-10-28T17:55:26.017288] [DEBUG] [LOCAL ] CHWY: Saving primary data. [2025-10-28T17:55:26.018824] [DEBUG] [LOCAL ] CHWY: Trimmed 77779 records to 53654 (keeping 200 days of data) [2025-10-28T17:55:26.334128] [DEBUG] [LOCAL ] CHWY: Primary data saved (53654 records). [2025-10-28T17:55:26.334386] [INFO ] [MAIN ] CHWY: Full history saved. [2025-10-28T17:55:26.334497] [INFO ] [MAIN ] Update Progress: 443/2366 symbols completed. CHWY took 34.9s. Estimated remaining: 4h 0m 26s. Rate: 8.0 symbols/min [2025-10-28T17:55:26.365455] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-03. [2025-10-28T17:55:26.513044] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-28T17:55:26.546286] [INFO ] [MAIN ] CIB: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:55:26.546898] [DEBUG] [LOCAL ] CIB: No existing data file found in primary storage. [2025-10-28T17:55:26.546947] [WARN ] [MAIN ] CIB: No existing data found, performing full refresh instead. [2025-10-28T17:55:26.547106] [INFO ] [MAIN ] CIB: Wiping existing primary data before full refresh. [2025-10-28T17:55:26.547524] [INFO ] [LOCAL ] CIB: Starting deletion of primary data. [2025-10-28T17:55:26.547587] [DEBUG] [LOCAL ] CIB: No primary data file found to delete. [2025-10-28T17:55:26.547622] [INFO ] [MAIN ] CIB: Starting full primary refresh. [2025-10-28T17:55:26.924426] [INFO ] [REMOTE ] CIB: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:55:26.948597] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-28T17:55:27.060636] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-28T17:55:27.159358] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-06. [2025-10-28T17:55:27.959306] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-01. [2025-10-28T17:55:28.281812] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-28T17:55:28.759335] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-07. [2025-10-28T17:55:28.914435] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-28T17:55:29.559345] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-04. [2025-10-28T17:55:30.141161] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-28T17:55:30.364421] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-08. [2025-10-28T17:55:30.374071] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-28T17:55:31.159359] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-02. [2025-10-28T17:55:31.715147] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-28T17:55:31.959330] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-09. [2025-10-28T17:55:32.018037] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-28T17:55:32.759361] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-09. [2025-10-28T17:55:33.358866] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-28T17:55:33.559371] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-05. [2025-10-28T17:55:33.823834] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-28T17:55:34.151034] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-28T17:55:34.359335] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-10. [2025-10-28T17:55:35.159395] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-03. [2025-10-28T17:55:35.959385] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-10. [2025-10-28T17:55:36.021205] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-28T17:55:36.030297] [INFO ] [REMOTE ] CHPT: Full fetch complete (70405 records). [2025-10-28T17:55:36.030503] [DEBUG] [VALIDATOR ] CHPT: Validating primary data. [2025-10-28T17:55:36.427726] [DEBUG] [VALIDATOR ] CHPT: All expected trading days are present. [2025-10-28T17:55:36.427958] [DEBUG] [VALIDATOR ] CHPT: Primary data validation passed. [2025-10-28T17:55:36.428876] [INFO ] [MAIN ] CHPT: Fetched primary data is valid. [2025-10-28T17:55:36.429176] [DEBUG] [LOCAL ] CHPT: Saving primary data. [2025-10-28T17:55:36.449058] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-28T17:55:36.451837] [DEBUG] [LOCAL ] CHPT: Trimmed 70405 records to 46294 (keeping 200 days of data) [2025-10-28T17:55:36.577889] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-28T17:55:36.603678] [INFO ] [REMOTE ] CI: Full fetch complete (72001 records). [2025-10-28T17:55:36.605951] [DEBUG] [VALIDATOR ] CI: Validating primary data. [2025-10-28T17:55:36.771094] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-04. [2025-10-28T17:55:37.068626] [DEBUG] [LOCAL ] CHPT: Primary data saved (46294 records). [2025-10-28T17:55:37.074556] [INFO ] [MAIN ] CHPT: Full history saved. [2025-10-28T17:55:37.079885] [INFO ] [MAIN ] Update Progress: 444/2366 symbols completed. CHPT took 45.6s. Estimated remaining: 4h 0m 33s. Rate: 8.0 symbols/min [2025-10-28T17:55:37.311180] [DEBUG] [VALIDATOR ] CI: All expected trading days are present. [2025-10-28T17:55:37.323523] [DEBUG] [VALIDATOR ] CI: Primary data validation passed. [2025-10-28T17:55:37.339939] [INFO ] [MAIN ] CI: Fetched primary data is valid. [2025-10-28T17:55:37.341113] [DEBUG] [LOCAL ] CI: Saving primary data. [2025-10-28T17:55:37.342622] [INFO ] [MAIN ] CICB: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:55:37.342931] [DEBUG] [LOCAL ] CICB: No existing data file found in primary storage. [2025-10-28T17:55:37.343058] [WARN ] [MAIN ] CICB: No existing data found, performing full refresh instead. [2025-10-28T17:55:37.343295] [INFO ] [MAIN ] CICB: Wiping existing primary data before full refresh. [2025-10-28T17:55:37.343407] [INFO ] [LOCAL ] CICB: Starting deletion of primary data. [2025-10-28T17:55:37.343598] [DEBUG] [LOCAL ] CICB: No primary data file found to delete. [2025-10-28T17:55:37.343688] [INFO ] [MAIN ] CICB: Starting full primary refresh. [2025-10-28T17:55:37.375227] [DEBUG] [LOCAL ] CI: Trimmed 72001 records to 49430 (keeping 200 days of data) [2025-10-28T17:55:37.562773] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-06. [2025-10-28T17:55:37.839302] [INFO ] [REMOTE ] CICB: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:55:38.020367] [DEBUG] [LOCAL ] CI: Primary data saved (49430 records). [2025-10-28T17:55:38.020491] [INFO ] [MAIN ] CI: Full history saved. [2025-10-28T17:55:38.021006] [INFO ] [MAIN ] Update Progress: 445/2366 symbols completed. CI took 27.4s. Estimated remaining: 3h 59m 57s. Rate: 8.0 symbols/min [2025-10-28T17:55:38.188367] [INFO ] [MAIN ] CIEN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:55:38.210785] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-28T17:55:38.261706] [DEBUG] [LOCAL ] CIEN: Loaded 52090 existing records from primary storage. [2025-10-28T17:55:38.262005] [INFO ] [MAIN ] CIEN: Loaded 52090 existing records. [2025-10-28T17:55:38.360402] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-01. [2025-10-28T17:55:38.441180] [WARN ] [MAIN ] CIEN: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:55:38.441585] [INFO ] [MAIN ] CIEN: Wiping existing primary data before full refresh. [2025-10-28T17:55:38.441693] [INFO ] [LOCAL ] CIEN: Starting deletion of primary data. [2025-10-28T17:55:38.447681] [DEBUG] [LOCAL ] CIEN: Deleted primary data file. [2025-10-28T17:55:38.456700] [INFO ] [MAIN ] CIEN: Starting full primary refresh. [2025-10-28T17:55:38.472299] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-28T17:55:38.835814] [INFO ] [REMOTE ] CIEN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:55:38.830819] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-28T17:55:39.159370] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-01. [2025-10-28T17:55:39.959366] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-02. [2025-10-28T17:55:40.216491] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-02 (0.26 seconds). [2025-10-28T17:55:40.554901] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-28T17:55:40.759334] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-03. [2025-10-28T17:55:40.961921] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-03 (0.20 seconds). [2025-10-28T17:55:41.559373] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-04. [2025-10-28T17:55:41.823191] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-04 (0.26 seconds). [2025-10-28T17:55:42.359334] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-05. [2025-10-28T17:55:43.159380] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-07. [2025-10-28T17:55:43.300079] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-28T17:55:43.959373] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-05. [2025-10-28T17:55:43.994984] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-28T17:55:44.224826] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-05 (0.27 seconds). [2025-10-28T17:55:44.759356] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-02. [2025-10-28T17:55:45.559338] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-06. [2025-10-28T17:55:45.865556] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-06 (0.31 seconds). [2025-10-28T17:55:45.948550] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-28T17:55:46.359356] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-08. [2025-10-28T17:55:47.014818] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-28T17:55:47.159339] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-09. [2025-10-28T17:55:47.714392] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-28T17:55:47.959337] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-07. [2025-10-28T17:55:48.214727] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-07 (0.26 seconds). [2025-10-28T17:55:48.759334] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-06. [2025-10-28T17:55:49.559317] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-10. [2025-10-28T17:55:49.646446] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-28T17:55:50.328308] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-28T17:55:50.331192] [INFO ] [REMOTE ] CIA: Full fetch complete (23145 records). [2025-10-28T17:55:50.331290] [DEBUG] [VALIDATOR ] CIA: Validating primary data. [2025-10-28T17:55:50.364454] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-03. [2025-10-28T17:55:50.726262] [DEBUG] [VALIDATOR ] CIA: All expected trading days are present. [2025-10-28T17:55:50.726384] [DEBUG] [VALIDATOR ] CIA: Primary data validation passed. [2025-10-28T17:55:50.727316] [INFO ] [MAIN ] CIA: Fetched primary data is valid. [2025-10-28T17:55:50.727393] [DEBUG] [LOCAL ] CIA: Saving primary data. [2025-10-28T17:55:50.728427] [DEBUG] [LOCAL ] CIA: Trimmed 23145 records to 16202 (keeping 200 days of data) [2025-10-28T17:55:50.843958] [DEBUG] [LOCAL ] CIA: Primary data saved (16202 records). [2025-10-28T17:55:50.844093] [INFO ] [MAIN ] CIA: Full history saved. [2025-10-28T17:55:50.844172] [INFO ] [MAIN ] Update Progress: 446/2366 symbols completed. CIA took 34.1s. Estimated remaining: 4h 0m 12s. Rate: 8.0 symbols/min [2025-10-28T17:55:51.014160] [INFO ] [MAIN ] CIF: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:55:51.019585] [DEBUG] [LOCAL ] CIF: Loaded 3862 existing records from primary storage. [2025-10-28T17:55:51.019829] [INFO ] [MAIN ] CIF: Loaded 3862 existing records. [2025-10-28T17:55:51.165743] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-08. [2025-10-28T17:55:51.196749] [WARN ] [MAIN ] CIF: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:55:51.197246] [INFO ] [MAIN ] CIF: Wiping existing primary data before full refresh. [2025-10-28T17:55:51.197303] [INFO ] [LOCAL ] CIF: Starting deletion of primary data. [2025-10-28T17:55:51.197482] [DEBUG] [LOCAL ] CIF: Deleted primary data file. [2025-10-28T17:55:51.197524] [INFO ] [MAIN ] CIF: Starting full primary refresh. [2025-10-28T17:55:51.544867] [INFO ] [REMOTE ] CIF: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:55:51.548185] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-10-28T17:55:51.771796] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-28T17:55:51.959345] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-09. [2025-10-28T17:55:52.199301] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-09 (0.24 seconds). [2025-10-28T17:55:52.759390] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-10. [2025-10-28T17:55:53.065658] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-10 (0.31 seconds). [2025-10-28T17:55:53.066495] [INFO ] [REMOTE ] CICB: Full fetch complete (1919 records). [2025-10-28T17:55:53.066565] [DEBUG] [VALIDATOR ] CICB: Validating primary data. [2025-10-28T17:55:53.241292] [WARN ] [VALIDATOR ] CICB: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-10-28T17:55:53.241463] [FATAL] [MAIN ] CICB: Fetched primary data is invalid. Refusing to save it. [2025-10-28T17:55:53.241508] [WARN ] [MAIN ] CICB: Deleting existing primary and derivative data due to validation failure. [2025-10-28T17:55:53.241571] [INFO ] [LOCAL ] CICB: Starting deletion of primary data. [2025-10-28T17:55:53.241630] [DEBUG] [LOCAL ] CICB: No primary data file found to delete. [2025-10-28T17:55:53.241701] [INFO ] [LOCAL ] CICB: Starting deletion of derivative data. [2025-10-28T17:55:53.241753] [DEBUG] [LOCAL ] CICB: No derivative data file found to delete. [2025-10-28T17:55:53.241807] [INFO ] [MAIN ] Update Progress: 447/2366 symbols completed. CICB took 16.2s. Estimated remaining: 3h 59m 43s. Rate: 8.0 symbols/min [2025-10-28T17:55:53.403881] [INFO ] [MAIN ] CIG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:55:53.441171] [DEBUG] [LOCAL ] CIG: Loaded 44462 existing records from primary storage. [2025-10-28T17:55:53.441439] [INFO ] [MAIN ] CIG: Loaded 44462 existing records. [2025-10-28T17:55:53.564572] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-07. [2025-10-28T17:55:53.617583] [WARN ] [MAIN ] CIG: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:55:53.617778] [INFO ] [MAIN ] CIG: Wiping existing primary data before full refresh. [2025-10-28T17:55:53.617823] [INFO ] [LOCAL ] CIG: Starting deletion of primary data. [2025-10-28T17:55:53.618562] [DEBUG] [LOCAL ] CIG: Deleted primary data file. [2025-10-28T17:55:53.618618] [INFO ] [MAIN ] CIG: Starting full primary refresh. [2025-10-28T17:55:53.962924] [INFO ] [REMOTE ] CIG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:55:54.359331] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-01. [2025-10-28T17:55:54.542503] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-28T17:55:55.159352] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-04. [2025-10-28T17:55:55.412943] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-28T17:55:55.959385] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-08. [2025-10-28T17:55:56.493464] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-28T17:55:56.751441] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-28T17:55:56.759291] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-09. [2025-10-28T17:55:57.559339] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-02. [2025-10-28T17:55:57.611511] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-28T17:55:58.359380] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-01. [2025-10-28T17:55:58.464400] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-28T17:55:58.761004] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-10-28T17:55:59.159323] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-10. [2025-10-28T17:55:59.959390] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-03. [2025-10-28T17:56:00.136173] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-28T17:56:00.142355] [INFO ] [REMOTE ] CIB: Full fetch complete (45424 records). [2025-10-28T17:56:00.142497] [DEBUG] [VALIDATOR ] CIB: Validating primary data. [2025-10-28T17:56:00.518556] [DEBUG] [VALIDATOR ] CIB: All expected trading days are present. [2025-10-28T17:56:00.518677] [DEBUG] [VALIDATOR ] CIB: Primary data validation passed. [2025-10-28T17:56:00.519290] [INFO ] [MAIN ] CIB: Fetched primary data is valid. [2025-10-28T17:56:00.519354] [DEBUG] [LOCAL ] CIB: Saving primary data. [2025-10-28T17:56:00.520448] [DEBUG] [LOCAL ] CIB: Trimmed 45424 records to 29643 (keeping 200 days of data) [2025-10-28T17:56:00.688360] [DEBUG] [LOCAL ] CIB: Primary data saved (29643 records). [2025-10-28T17:56:00.688500] [INFO ] [MAIN ] CIB: Full history saved. [2025-10-28T17:56:00.688570] [INFO ] [MAIN ] Update Progress: 448/2366 symbols completed. CIB took 34.4s. Estimated remaining: 3h 59m 35s. Rate: 8.0 symbols/min [2025-10-28T17:56:00.765014] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-05. [2025-10-28T17:56:00.864952] [INFO ] [MAIN ] CII: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:56:00.881481] [DEBUG] [LOCAL ] CII: Loaded 14625 existing records from primary storage. [2025-10-28T17:56:00.881782] [INFO ] [MAIN ] CII: Loaded 14625 existing records. [2025-10-28T17:56:01.059944] [WARN ] [MAIN ] CII: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:56:01.060139] [INFO ] [MAIN ] CII: Wiping existing primary data before full refresh. [2025-10-28T17:56:01.060186] [INFO ] [LOCAL ] CII: Starting deletion of primary data. [2025-10-28T17:56:01.060521] [DEBUG] [LOCAL ] CII: Deleted primary data file. [2025-10-28T17:56:01.060579] [INFO ] [MAIN ] CII: Starting full primary refresh. [2025-10-28T17:56:01.413099] [INFO ] [REMOTE ] CII: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:56:01.564382] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-02. [2025-10-28T17:56:01.581555] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-28T17:56:02.359381] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-01. [2025-10-28T17:56:02.945632] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-10-28T17:56:03.115106] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-28T17:56:03.159354] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-06. [2025-10-28T17:56:03.580716] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-28T17:56:03.959390] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-04. [2025-10-28T17:56:04.455431] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-28T17:56:04.759330] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-07. [2025-10-28T17:56:05.060238] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-28T17:56:05.559342] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-02. [2025-10-28T17:56:06.094952] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-28T17:56:06.161546] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-28T17:56:06.359343] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-03. [2025-10-28T17:56:06.973469] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-28T17:56:07.159386] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-08. [2025-10-28T17:56:07.959397] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-05. [2025-10-28T17:56:08.413108] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-28T17:56:08.759355] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-04. [2025-10-28T17:56:09.143457] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-28T17:56:09.449310] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-28T17:56:09.559332] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-05. [2025-10-28T17:56:10.097830] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-28T17:56:10.359366] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-06. [2025-10-28T17:56:11.159323] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-03. [2025-10-28T17:56:11.473268] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-28T17:56:11.692903] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-28T17:56:11.959408] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-06. [2025-10-28T17:56:12.456817] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-28T17:56:12.759371] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-07. [2025-10-28T17:56:13.270155] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-28T17:56:13.559332] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-07. [2025-10-28T17:56:14.359378] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-08. [2025-10-28T17:56:14.783740] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-28T17:56:14.879117] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-28T17:56:15.159325] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-04. [2025-10-28T17:56:15.574097] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-10-28T17:56:15.959398] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-09. [2025-10-28T17:56:16.759372] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-09. [2025-10-28T17:56:17.277228] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-28T17:56:17.459935] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-28T17:56:17.559362] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-10. [2025-10-28T17:56:18.333018] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-28T17:56:18.336758] [INFO ] [REMOTE ] CII: Full fetch complete (22800 records). [2025-10-28T17:56:18.336835] [DEBUG] [VALIDATOR ] CII: Validating primary data. [2025-10-28T17:56:18.366154] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-10. [2025-10-28T17:56:18.704879] [DEBUG] [VALIDATOR ] CII: All expected trading days are present. [2025-10-28T17:56:18.704976] [DEBUG] [VALIDATOR ] CII: Primary data validation passed. [2025-10-28T17:56:18.705305] [INFO ] [MAIN ] CII: Fetched primary data is valid. [2025-10-28T17:56:18.705343] [DEBUG] [LOCAL ] CII: Saving primary data. [2025-10-28T17:56:18.705939] [DEBUG] [LOCAL ] CII: Trimmed 22800 records to 14584 (keeping 200 days of data) [2025-10-28T17:56:18.790105] [DEBUG] [LOCAL ] CII: Primary data saved (14584 records). [2025-10-28T17:56:18.790228] [INFO ] [MAIN ] CII: Full history saved. [2025-10-28T17:56:18.790305] [INFO ] [MAIN ] Update Progress: 449/2366 symbols completed. CII took 18.1s. Estimated remaining: 4h 0m 13s. Rate: 8.0 symbols/min [2025-10-28T17:56:18.955591] [INFO ] [MAIN ] CIM: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:56:18.989870] [DEBUG] [LOCAL ] CIM: Loaded 37039 existing records from primary storage. [2025-10-28T17:56:18.990128] [INFO ] [MAIN ] CIM: Loaded 37039 existing records. [2025-10-28T17:56:19.164517] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-05. [2025-10-28T17:56:19.168704] [WARN ] [MAIN ] CIM: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:56:19.169956] [INFO ] [MAIN ] CIM: Wiping existing primary data before full refresh. [2025-10-28T17:56:19.170005] [INFO ] [LOCAL ] CIM: Starting deletion of primary data. [2025-10-28T17:56:19.170445] [DEBUG] [LOCAL ] CIM: Deleted primary data file. [2025-10-28T17:56:19.170502] [INFO ] [MAIN ] CIM: Starting full primary refresh. [2025-10-28T17:56:19.515586] [INFO ] [REMOTE ] CIM: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:56:19.570734] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-10-28T17:56:19.952479] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-28T17:56:19.962160] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-06. [2025-10-28T17:56:19.963972] [INFO ] [REMOTE ] CIEN: Full fetch complete (75838 records). [2025-10-28T17:56:19.964055] [DEBUG] [VALIDATOR ] CIEN: Validating primary data. [2025-10-28T17:56:20.344918] [DEBUG] [VALIDATOR ] CIEN: All expected trading days are present. [2025-10-28T17:56:20.344999] [DEBUG] [VALIDATOR ] CIEN: Primary data validation passed. [2025-10-28T17:56:20.345825] [INFO ] [MAIN ] CIEN: Fetched primary data is valid. [2025-10-28T17:56:20.345886] [DEBUG] [LOCAL ] CIEN: Saving primary data. [2025-10-28T17:56:20.347281] [DEBUG] [LOCAL ] CIEN: Trimmed 75838 records to 52075 (keeping 200 days of data) [2025-10-28T17:56:20.435732] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-28T17:56:20.656303] [DEBUG] [LOCAL ] CIEN: Primary data saved (52075 records). [2025-10-28T17:56:20.656434] [INFO ] [MAIN ] CIEN: Full history saved. [2025-10-28T17:56:20.656859] [INFO ] [MAIN ] Update Progress: 450/2366 symbols completed. CIEN took 42.6s. Estimated remaining: 3h 59m 41s. Rate: 8.0 symbols/min [2025-10-28T17:56:20.764452] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-08. [2025-10-28T17:56:20.824034] [INFO ] [MAIN ] CIMN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:56:20.824189] [DEBUG] [LOCAL ] CIMN: No existing data file found in primary storage. [2025-10-28T17:56:20.824225] [WARN ] [MAIN ] CIMN: No existing data found, performing full refresh instead. [2025-10-28T17:56:20.824331] [INFO ] [MAIN ] CIMN: Wiping existing primary data before full refresh. [2025-10-28T17:56:20.824371] [INFO ] [LOCAL ] CIMN: Starting deletion of primary data. [2025-10-28T17:56:20.824411] [DEBUG] [LOCAL ] CIMN: No primary data file found to delete. [2025-10-28T17:56:20.824441] [INFO ] [MAIN ] CIMN: Starting full primary refresh. [2025-10-28T17:56:21.186567] [INFO ] [REMOTE ] CIMN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:56:21.559339] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-01. [2025-10-28T17:56:22.051009] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-28T17:56:22.359310] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-09. [2025-10-28T17:56:22.486245] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-28T17:56:23.159341] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-07. [2025-10-28T17:56:23.373583] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-28T17:56:23.620400] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-28T17:56:23.959337] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-10. [2025-10-28T17:56:24.759359] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-02. [2025-10-28T17:56:25.414286] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-28T17:56:25.423873] [INFO ] [REMOTE ] CIG: Full fetch complete (62968 records). [2025-10-28T17:56:25.423995] [DEBUG] [VALIDATOR ] CIG: Validating primary data. [2025-10-28T17:56:25.559532] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-08. [2025-10-28T17:56:25.849013] [DEBUG] [VALIDATOR ] CIG: All expected trading days are present. [2025-10-28T17:56:25.849227] [DEBUG] [VALIDATOR ] CIG: Primary data validation passed. [2025-10-28T17:56:25.850221] [INFO ] [MAIN ] CIG: Fetched primary data is valid. [2025-10-28T17:56:25.850305] [DEBUG] [LOCAL ] CIG: Saving primary data. [2025-10-28T17:56:25.872944] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-28T17:56:25.880666] [DEBUG] [LOCAL ] CIG: Trimmed 62968 records to 44535 (keeping 200 days of data) [2025-10-28T17:56:26.054574] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-28T17:56:26.139925] [DEBUG] [LOCAL ] CIG: Primary data saved (44535 records). [2025-10-28T17:56:26.140054] [INFO ] [MAIN ] CIG: Full history saved. [2025-10-28T17:56:26.140156] [INFO ] [MAIN ] Update Progress: 451/2366 symbols completed. CIG took 32.9s. Estimated remaining: 3h 59m 25s. Rate: 8.0 symbols/min [2025-10-28T17:56:26.315588] [INFO ] [MAIN ] CIMO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:56:26.315790] [DEBUG] [LOCAL ] CIMO: No existing data file found in primary storage. [2025-10-28T17:56:26.315837] [WARN ] [MAIN ] CIMO: No existing data found, performing full refresh instead. [2025-10-28T17:56:26.315955] [INFO ] [MAIN ] CIMO: Wiping existing primary data before full refresh. [2025-10-28T17:56:26.315997] [INFO ] [LOCAL ] CIMO: Starting deletion of primary data. [2025-10-28T17:56:26.316038] [DEBUG] [LOCAL ] CIMO: No primary data file found to delete. [2025-10-28T17:56:26.316071] [INFO ] [MAIN ] CIMO: Starting full primary refresh. [2025-10-28T17:56:26.364560] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-09. [2025-10-28T17:56:26.675825] [INFO ] [REMOTE ] CIMO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:56:26.783875] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-10-28T17:56:27.159337] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-10. [2025-10-28T17:56:27.624586] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-28T17:56:27.625795] [INFO ] [REMOTE ] CIF: Full fetch complete (6536 records). [2025-10-28T17:56:27.625863] [DEBUG] [VALIDATOR ] CIF: Validating primary data. [2025-10-28T17:56:27.966552] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-01. [2025-10-28T17:56:27.974782] [DEBUG] [VALIDATOR ] CIF: All expected trading days are present. [2025-10-28T17:56:27.974899] [DEBUG] [VALIDATOR ] CIF: Primary data validation passed. [2025-10-28T17:56:27.975108] [INFO ] [MAIN ] CIF: Fetched primary data is valid. [2025-10-28T17:56:27.975148] [DEBUG] [LOCAL ] CIF: Saving primary data. [2025-10-28T17:56:27.975532] [DEBUG] [LOCAL ] CIF: Trimmed 6536 records to 3832 (keeping 200 days of data) [2025-10-28T17:56:27.998542] [DEBUG] [LOCAL ] CIF: Primary data saved (3832 records). [2025-10-28T17:56:27.998712] [INFO ] [MAIN ] CIF: Full history saved. [2025-10-28T17:56:27.999197] [INFO ] [MAIN ] Update Progress: 452/2366 symbols completed. CIF took 37.2s. Estimated remaining: 3h 58m 54s. Rate: 8.0 symbols/min [2025-10-28T17:56:28.168631] [INFO ] [MAIN ] CIMP: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:56:28.168946] [DEBUG] [LOCAL ] CIMP: No existing data file found in primary storage. [2025-10-28T17:56:28.168998] [WARN ] [MAIN ] CIMP: No existing data found, performing full refresh instead. [2025-10-28T17:56:28.169121] [INFO ] [MAIN ] CIMP: Wiping existing primary data before full refresh. [2025-10-28T17:56:28.169161] [INFO ] [LOCAL ] CIMP: Starting deletion of primary data. [2025-10-28T17:56:28.169201] [DEBUG] [LOCAL ] CIMP: No primary data file found to delete. [2025-10-28T17:56:28.169233] [INFO ] [MAIN ] CIMP: Starting full primary refresh. [2025-10-28T17:56:28.518178] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-28T17:56:28.523197] [INFO ] [REMOTE ] CIMP: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:56:28.759306] [INFO ] [REMOTE ] CIMP: Fetching primary data for 2025-01. [2025-10-28T17:56:28.899038] [DEBUG] [REMOTE ] CIMP: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-28T17:56:28.899269] [WARN ] [REMOTE ] CIMP: No data returned for month 2025-01 [2025-10-28T17:56:28.899352] [FATAL] [REMOTE ] CIMP: API call failed - aborting fetch to avoid wasting further API calls [2025-10-28T17:56:28.899423] [FATAL] [MAIN ] CIMP: Failed to fetch primary data. [2025-10-28T17:56:28.899486] [WARN ] [MAIN ] CIMP: Deleting existing primary and derivative data due to fetch failure. [2025-10-28T17:56:28.899556] [INFO ] [LOCAL ] CIMP: Starting deletion of primary data. [2025-10-28T17:56:28.899616] [DEBUG] [LOCAL ] CIMP: No primary data file found to delete. [2025-10-28T17:56:28.899687] [INFO ] [LOCAL ] CIMP: Starting deletion of derivative data. [2025-10-28T17:56:28.899746] [DEBUG] [LOCAL ] CIMP: No derivative data file found to delete. [2025-10-28T17:56:28.899793] [INFO ] [MAIN ] Update Progress: 453/2366 symbols completed. CIMP took 0.9s. Estimated remaining: 3h 58m 19s. Rate: 8.0 symbols/min [2025-10-28T17:56:29.065169] [INFO ] [MAIN ] CINT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:56:29.084267] [DEBUG] [LOCAL ] CINT: Loaded 20484 existing records from primary storage. [2025-10-28T17:56:29.084489] [INFO ] [MAIN ] CINT: Loaded 20484 existing records. [2025-10-28T17:56:29.257376] [WARN ] [MAIN ] CINT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:56:29.257560] [INFO ] [MAIN ] CINT: Wiping existing primary data before full refresh. [2025-10-28T17:56:29.257625] [INFO ] [LOCAL ] CINT: Starting deletion of primary data. [2025-10-28T17:56:29.258014] [DEBUG] [LOCAL ] CINT: Deleted primary data file. [2025-10-28T17:56:29.258087] [INFO ] [MAIN ] CINT: Starting full primary refresh. [2025-10-28T17:56:29.567260] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-02. [2025-10-28T17:56:29.607779] [INFO ] [REMOTE ] CINT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:56:29.878735] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-10-28T17:56:30.359340] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-03. [2025-10-28T17:56:31.159347] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-01. [2025-10-28T17:56:31.510096] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-28T17:56:31.870411] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-28T17:56:31.959329] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-02. [2025-10-28T17:56:32.585733] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-28T17:56:32.759333] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-03. [2025-10-28T17:56:33.043329] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-03 (0.28 seconds). [2025-10-28T17:56:33.559331] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-04. [2025-10-28T17:56:34.026613] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-28T17:56:34.359324] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-05. [2025-10-28T17:56:34.644845] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-05 (0.29 seconds). [2025-10-28T17:56:35.159352] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-01. [2025-10-28T17:56:35.569893] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-10-28T17:56:35.959334] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-02. [2025-10-28T17:56:36.299234] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-10-28T17:56:36.759331] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-03. [2025-10-28T17:56:37.331352] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-28T17:56:37.559337] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-06. [2025-10-28T17:56:37.977380] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-28T17:56:38.359380] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-04. [2025-10-28T17:56:39.027745] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-28T17:56:39.159364] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-07. [2025-10-28T17:56:39.521256] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-10-28T17:56:39.959374] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-05. [2025-10-28T17:56:40.617621] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-28T17:56:40.759343] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-03. [2025-10-28T17:56:41.043819] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-03 (0.28 seconds). [2025-10-28T17:56:41.559359] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-04. [2025-10-28T17:56:41.893508] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-04 (0.33 seconds). [2025-10-28T17:56:42.359364] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-04. [2025-10-28T17:56:43.159382] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-06. [2025-10-28T17:56:43.521807] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-28T17:56:43.863037] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-28T17:56:43.959352] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-05. [2025-10-28T17:56:44.296932] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-10-28T17:56:44.759328] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-06. [2025-10-28T17:56:45.051939] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-06 (0.29 seconds). [2025-10-28T17:56:45.559346] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-05. [2025-10-28T17:56:46.359316] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-08. [2025-10-28T17:56:46.560202] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-28T17:56:46.730751] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-10-28T17:56:47.159372] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-06. [2025-10-28T17:56:47.959477] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-09. [2025-10-28T17:56:48.085628] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-28T17:56:48.322919] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-10-28T17:56:48.759324] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-10. [2025-10-28T17:56:49.207262] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-28T17:56:49.208447] [INFO ] [REMOTE ] CIMO: Full fetch complete (4537 records). [2025-10-28T17:56:49.208518] [DEBUG] [VALIDATOR ] CIMO: Validating primary data. [2025-10-28T17:56:49.386611] [WARN ] [VALIDATOR ] CIMO: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-28T17:56:49.386818] [FATAL] [MAIN ] CIMO: Fetched primary data is invalid. Refusing to save it. [2025-10-28T17:56:49.386885] [WARN ] [MAIN ] CIMO: Deleting existing primary and derivative data due to validation failure. [2025-10-28T17:56:49.386952] [INFO ] [LOCAL ] CIMO: Starting deletion of primary data. [2025-10-28T17:56:49.387013] [DEBUG] [LOCAL ] CIMO: No primary data file found to delete. [2025-10-28T17:56:49.387057] [INFO ] [LOCAL ] CIMO: Starting deletion of derivative data. [2025-10-28T17:56:49.387136] [DEBUG] [LOCAL ] CIMO: No derivative data file found to delete. [2025-10-28T17:56:49.387196] [INFO ] [MAIN ] Update Progress: 454/2366 symbols completed. CIMO took 23.2s. Estimated remaining: 3h 59m 6s. Rate: 8.0 symbols/min [2025-10-28T17:56:49.552439] [INFO ] [MAIN ] CIO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:56:49.563118] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-07. [2025-10-28T17:56:49.572950] [DEBUG] [LOCAL ] CIO: Loaded 21195 existing records from primary storage. [2025-10-28T17:56:49.573152] [INFO ] [MAIN ] CIO: Loaded 21195 existing records. [2025-10-28T17:56:49.747532] [WARN ] [MAIN ] CIO: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:56:49.747825] [INFO ] [MAIN ] CIO: Wiping existing primary data before full refresh. [2025-10-28T17:56:49.747872] [INFO ] [LOCAL ] CIO: Starting deletion of primary data. [2025-10-28T17:56:49.748350] [DEBUG] [LOCAL ] CIO: Deleted primary data file. [2025-10-28T17:56:49.748407] [INFO ] [MAIN ] CIO: Starting full primary refresh. [2025-10-28T17:56:50.098833] [INFO ] [REMOTE ] CIO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:56:50.359292] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-01. [2025-10-28T17:56:50.534355] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-28T17:56:51.108463] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-28T17:56:51.159341] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-02. [2025-10-28T17:56:51.757391] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-28T17:56:51.959326] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-03. [2025-10-28T17:56:52.614239] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-28T17:56:52.759316] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-04. [2025-10-28T17:56:53.526695] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-28T17:56:53.559302] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-07. [2025-10-28T17:56:54.180741] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-28T17:56:54.359352] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-08. [2025-10-28T17:56:55.141233] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-28T17:56:55.159336] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-05. [2025-10-28T17:56:55.820370] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-28T17:56:55.959353] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-09. [2025-10-28T17:56:56.706154] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-28T17:56:56.759302] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-10. [2025-10-28T17:56:57.559342] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-07. [2025-10-28T17:56:57.809976] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-28T17:56:57.815939] [INFO ] [REMOTE ] CINT: Full fetch complete (28813 records). [2025-10-28T17:56:57.816017] [DEBUG] [VALIDATOR ] CINT: Validating primary data. [2025-10-28T17:56:57.992460] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-28T17:56:58.189778] [DEBUG] [VALIDATOR ] CINT: All expected trading days are present. [2025-10-28T17:56:58.189872] [DEBUG] [VALIDATOR ] CINT: Primary data validation passed. [2025-10-28T17:56:58.190387] [INFO ] [MAIN ] CINT: Fetched primary data is valid. [2025-10-28T17:56:58.190450] [DEBUG] [LOCAL ] CINT: Saving primary data. [2025-10-28T17:56:58.191224] [DEBUG] [LOCAL ] CINT: Trimmed 28813 records to 20423 (keeping 200 days of data) [2025-10-28T17:56:58.302222] [DEBUG] [LOCAL ] CINT: Primary data saved (20423 records). [2025-10-28T17:56:58.302349] [INFO ] [MAIN ] CINT: Full history saved. [2025-10-28T17:56:58.302426] [INFO ] [MAIN ] Update Progress: 455/2366 symbols completed. CINT took 29.4s. Estimated remaining: 3h 59m 4s. Rate: 8.0 symbols/min [2025-10-28T17:56:58.364550] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-08. [2025-10-28T17:56:58.506215] [INFO ] [MAIN ] CION: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:56:58.506396] [DEBUG] [LOCAL ] CION: No existing data file found in primary storage. [2025-10-28T17:56:58.506435] [WARN ] [MAIN ] CION: No existing data found, performing full refresh instead. [2025-10-28T17:56:58.506550] [INFO ] [MAIN ] CION: Wiping existing primary data before full refresh. [2025-10-28T17:56:58.506591] [INFO ] [LOCAL ] CION: Starting deletion of primary data. [2025-10-28T17:56:58.506634] [DEBUG] [LOCAL ] CION: No primary data file found to delete. [2025-10-28T17:56:58.506710] [INFO ] [MAIN ] CION: Starting full primary refresh. [2025-10-28T17:56:58.785767] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-10-28T17:56:58.861864] [INFO ] [REMOTE ] CION: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:56:59.159323] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-01. [2025-10-28T17:56:59.959319] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-09. [2025-10-28T17:57:00.010049] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-28T17:57:00.265049] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-09 (0.31 seconds). [2025-10-28T17:57:00.759419] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-08. [2025-10-28T17:57:01.559347] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-06. [2025-10-28T17:57:01.837861] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-28T17:57:02.359369] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-09. [2025-10-28T17:57:02.528390] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-28T17:57:03.159327] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-07. [2025-10-28T17:57:03.434194] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-28T17:57:03.959334] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-02. [2025-10-28T17:57:03.982105] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-28T17:57:04.669615] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-28T17:57:04.759306] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-10. [2025-10-28T17:57:05.231611] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-28T17:57:05.232724] [INFO ] [REMOTE ] CIMN: Full fetch complete (3883 records). [2025-10-28T17:57:05.232792] [DEBUG] [VALIDATOR ] CIMN: Validating primary data. [2025-10-28T17:57:05.564490] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-03. [2025-10-28T17:57:05.593439] [DEBUG] [VALIDATOR ] CIMN: All expected trading days are present. [2025-10-28T17:57:05.593508] [DEBUG] [VALIDATOR ] CIMN: Primary data validation passed. [2025-10-28T17:57:05.593624] [INFO ] [MAIN ] CIMN: Fetched primary data is valid. [2025-10-28T17:57:05.593694] [DEBUG] [LOCAL ] CIMN: Saving primary data. [2025-10-28T17:57:05.594045] [DEBUG] [LOCAL ] CIMN: Trimmed 3883 records to 2662 (keeping 200 days of data) [2025-10-28T17:57:05.610422] [DEBUG] [LOCAL ] CIMN: Primary data saved (2662 records). [2025-10-28T17:57:05.610627] [INFO ] [MAIN ] CIMN: Full history saved. [2025-10-28T17:57:05.610794] [INFO ] [MAIN ] Update Progress: 456/2366 symbols completed. CIMN took 45.0s. Estimated remaining: 3h 58m 56s. Rate: 8.0 symbols/min [2025-10-28T17:57:05.776736] [INFO ] [MAIN ] CIVI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:57:05.824670] [DEBUG] [LOCAL ] CIVI: Loaded 52668 existing records from primary storage. [2025-10-28T17:57:05.824972] [INFO ] [MAIN ] CIVI: Loaded 52668 existing records. [2025-10-28T17:57:05.997295] [WARN ] [MAIN ] CIVI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:57:05.997481] [INFO ] [MAIN ] CIVI: Wiping existing primary data before full refresh. [2025-10-28T17:57:05.997527] [INFO ] [LOCAL ] CIVI: Starting deletion of primary data. [2025-10-28T17:57:05.998042] [DEBUG] [LOCAL ] CIVI: Deleted primary data file. [2025-10-28T17:57:05.998099] [INFO ] [MAIN ] CIVI: Starting full primary refresh. [2025-10-28T17:57:06.347182] [INFO ] [REMOTE ] CIVI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:57:06.359299] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-10. [2025-10-28T17:57:06.406901] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-28T17:57:07.159346] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-01. [2025-10-28T17:57:07.621428] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-28T17:57:07.629347] [INFO ] [REMOTE ] CIM: Full fetch complete (54712 records). [2025-10-28T17:57:07.629474] [DEBUG] [VALIDATOR ] CIM: Validating primary data. [2025-10-28T17:57:07.969751] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-08. [2025-10-28T17:57:08.032367] [DEBUG] [VALIDATOR ] CIM: All expected trading days are present. [2025-10-28T17:57:08.032483] [DEBUG] [VALIDATOR ] CIM: Primary data validation passed. [2025-10-28T17:57:08.033376] [INFO ] [MAIN ] CIM: Fetched primary data is valid. [2025-10-28T17:57:08.033445] [DEBUG] [LOCAL ] CIM: Saving primary data. [2025-10-28T17:57:08.034747] [DEBUG] [LOCAL ] CIM: Trimmed 54712 records to 36901 (keeping 200 days of data) [2025-10-28T17:57:08.259591] [DEBUG] [LOCAL ] CIM: Primary data saved (36901 records). [2025-10-28T17:57:08.259761] [INFO ] [MAIN ] CIM: Full history saved. [2025-10-28T17:57:08.259867] [INFO ] [MAIN ] Update Progress: 457/2366 symbols completed. CIM took 49.5s. Estimated remaining: 3h 58m 28s. Rate: 8.0 symbols/min [2025-10-28T17:57:08.440417] [INFO ] [MAIN ] CL: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:57:08.472753] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-28T17:57:08.532850] [DEBUG] [LOCAL ] CL: Loaded 53649 existing records from primary storage. [2025-10-28T17:57:08.533197] [INFO ] [MAIN ] CL: Loaded 53649 existing records. [2025-10-28T17:57:08.717853] [WARN ] [MAIN ] CL: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:57:08.718259] [INFO ] [MAIN ] CL: Wiping existing primary data before full refresh. [2025-10-28T17:57:08.718314] [INFO ] [LOCAL ] CL: Starting deletion of primary data. [2025-10-28T17:57:08.718954] [DEBUG] [LOCAL ] CL: Deleted primary data file. [2025-10-28T17:57:08.719014] [INFO ] [MAIN ] CL: Starting full primary refresh. [2025-10-28T17:57:08.761723] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-02. [2025-10-28T17:57:08.851857] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-28T17:57:09.103554] [INFO ] [REMOTE ] CL: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:57:09.559371] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-04. [2025-10-28T17:57:10.036940] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-28T17:57:10.359398] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-03. [2025-10-28T17:57:10.696320] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-28T17:57:11.159414] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-09. [2025-10-28T17:57:11.628917] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-28T17:57:11.908898] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-28T17:57:11.959308] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-10. [2025-10-28T17:57:12.759337] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-05. [2025-10-28T17:57:13.127548] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-28T17:57:13.133464] [INFO ] [REMOTE ] CIO: Full fetch complete (29916 records). [2025-10-28T17:57:13.133550] [DEBUG] [VALIDATOR ] CIO: Validating primary data. [2025-10-28T17:57:13.513601] [DEBUG] [VALIDATOR ] CIO: All expected trading days are present. [2025-10-28T17:57:13.513765] [DEBUG] [VALIDATOR ] CIO: Primary data validation passed. [2025-10-28T17:57:13.514410] [INFO ] [MAIN ] CIO: Fetched primary data is valid. [2025-10-28T17:57:13.514592] [DEBUG] [LOCAL ] CIO: Saving primary data. [2025-10-28T17:57:13.515837] [DEBUG] [LOCAL ] CIO: Trimmed 29916 records to 21194 (keeping 200 days of data) [2025-10-28T17:57:13.573706] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-04. [2025-10-28T17:57:13.585334] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-28T17:57:13.658169] [DEBUG] [LOCAL ] CIO: Primary data saved (21194 records). [2025-10-28T17:57:13.658264] [INFO ] [MAIN ] CIO: Full history saved. [2025-10-28T17:57:13.658344] [INFO ] [MAIN ] Update Progress: 458/2366 symbols completed. CIO took 24.3s. Estimated remaining: 3h 58m 12s. Rate: 8.0 symbols/min [2025-10-28T17:57:13.829096] [INFO ] [MAIN ] CLB: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:57:13.862380] [DEBUG] [LOCAL ] CLB: Loaded 33471 existing records from primary storage. [2025-10-28T17:57:13.862672] [INFO ] [MAIN ] CLB: Loaded 33471 existing records. [2025-10-28T17:57:14.051980] [WARN ] [MAIN ] CLB: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:57:14.052204] [INFO ] [MAIN ] CLB: Wiping existing primary data before full refresh. [2025-10-28T17:57:14.052262] [INFO ] [LOCAL ] CLB: Starting deletion of primary data. [2025-10-28T17:57:14.052590] [DEBUG] [LOCAL ] CLB: Deleted primary data file. [2025-10-28T17:57:14.052632] [INFO ] [MAIN ] CLB: Starting full primary refresh. [2025-10-28T17:57:14.369751] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-06. [2025-10-28T17:57:14.410125] [INFO ] [REMOTE ] CLB: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:57:14.923851] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-28T17:57:15.159308] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-01. [2025-10-28T17:57:15.214282] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-28T17:57:15.959362] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-05. [2025-10-28T17:57:16.104268] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-28T17:57:16.759356] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-02. [2025-10-28T17:57:17.132493] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-28T17:57:17.559349] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-07. [2025-10-28T17:57:17.673492] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-28T17:57:18.293249] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-28T17:57:18.359302] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-08. [2025-10-28T17:57:19.159352] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-06. [2025-10-28T17:57:19.205111] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-28T17:57:19.959337] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-01. [2025-10-28T17:57:20.470270] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-28T17:57:20.759380] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-07. [2025-10-28T17:57:21.287889] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-28T17:57:21.559358] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-02. [2025-10-28T17:57:22.121483] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-28T17:57:22.359350] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-09. [2025-10-28T17:57:22.785279] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-28T17:57:23.157717] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-28T17:57:23.163197] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-03. [2025-10-28T17:57:23.942305] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-28T17:57:23.959326] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-03. [2025-10-28T17:57:24.759398] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-04. [2025-10-28T17:57:25.477682] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-28T17:57:25.559332] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-04. [2025-10-28T17:57:25.804109] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-28T17:57:26.359368] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-10. [2025-10-28T17:57:27.113752] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-28T17:57:27.159327] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-08. [2025-10-28T17:57:27.180972] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-28T17:57:27.187444] [INFO ] [REMOTE ] CION: Full fetch complete (40383 records). [2025-10-28T17:57:27.187775] [DEBUG] [VALIDATOR ] CION: Validating primary data. [2025-10-28T17:57:27.588254] [DEBUG] [VALIDATOR ] CION: All expected trading days are present. [2025-10-28T17:57:27.588363] [DEBUG] [VALIDATOR ] CION: Primary data validation passed. [2025-10-28T17:57:27.589067] [INFO ] [MAIN ] CION: Fetched primary data is valid. [2025-10-28T17:57:27.589131] [DEBUG] [LOCAL ] CION: Saving primary data. [2025-10-28T17:57:27.590131] [DEBUG] [LOCAL ] CION: Trimmed 40383 records to 27286 (keeping 200 days of data) [2025-10-28T17:57:27.747172] [DEBUG] [LOCAL ] CION: Primary data saved (27286 records). [2025-10-28T17:57:27.747299] [INFO ] [MAIN ] CION: Full history saved. [2025-10-28T17:57:27.747369] [INFO ] [MAIN ] Update Progress: 459/2366 symbols completed. CION took 29.4s. Estimated remaining: 3h 58m 32s. Rate: 8.0 symbols/min [2025-10-28T17:57:27.911957] [INFO ] [MAIN ] CLCO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:57:27.924016] [DEBUG] [LOCAL ] CLCO: Loaded 12926 existing records from primary storage. [2025-10-28T17:57:27.924214] [INFO ] [MAIN ] CLCO: Loaded 12926 existing records. [2025-10-28T17:57:27.965931] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-05. [2025-10-28T17:57:28.100748] [WARN ] [MAIN ] CLCO: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:57:28.100958] [INFO ] [MAIN ] CLCO: Wiping existing primary data before full refresh. [2025-10-28T17:57:28.101003] [INFO ] [LOCAL ] CLCO: Starting deletion of primary data. [2025-10-28T17:57:28.101381] [DEBUG] [LOCAL ] CLCO: Deleted primary data file. [2025-10-28T17:57:28.101439] [INFO ] [MAIN ] CLCO: Starting full primary refresh. [2025-10-28T17:57:28.460638] [INFO ] [REMOTE ] CLCO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:57:28.522203] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-28T17:57:28.759319] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-09. [2025-10-28T17:57:29.366268] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-28T17:57:29.559389] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-05. [2025-10-28T17:57:29.929811] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-28T17:57:30.359350] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-06. [2025-10-28T17:57:30.623903] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-28T17:57:31.159348] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-10. [2025-10-28T17:57:31.675513] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-28T17:57:31.959416] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-01. [2025-10-28T17:57:32.693548] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-28T17:57:32.704591] [INFO ] [REMOTE ] CIVI: Full fetch complete (76097 records). [2025-10-28T17:57:32.704794] [DEBUG] [VALIDATOR ] CIVI: Validating primary data. [2025-10-28T17:57:32.763907] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-07. [2025-10-28T17:57:32.860266] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-28T17:57:33.148810] [DEBUG] [VALIDATOR ] CIVI: All expected trading days are present. [2025-10-28T17:57:33.148895] [DEBUG] [VALIDATOR ] CIVI: Primary data validation passed. [2025-10-28T17:57:33.149850] [INFO ] [MAIN ] CIVI: Fetched primary data is valid. [2025-10-28T17:57:33.149913] [DEBUG] [LOCAL ] CIVI: Saving primary data. [2025-10-28T17:57:33.151278] [DEBUG] [LOCAL ] CIVI: Trimmed 76097 records to 52642 (keeping 200 days of data) [2025-10-28T17:57:33.469906] [DEBUG] [LOCAL ] CIVI: Primary data saved (52642 records). [2025-10-28T17:57:33.470035] [INFO ] [MAIN ] CIVI: Full history saved. [2025-10-28T17:57:33.470429] [INFO ] [MAIN ] Update Progress: 460/2366 symbols completed. CIVI took 27.9s. Estimated remaining: 3h 58m 17s. Rate: 8.0 symbols/min [2025-10-28T17:57:33.566918] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-06. [2025-10-28T17:57:33.641159] [INFO ] [MAIN ] CLDT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:57:33.667162] [DEBUG] [LOCAL ] CLDT: Loaded 24789 existing records from primary storage. [2025-10-28T17:57:33.667437] [INFO ] [MAIN ] CLDT: Loaded 24789 existing records. [2025-10-28T17:57:33.849384] [WARN ] [MAIN ] CLDT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:57:33.849661] [INFO ] [MAIN ] CLDT: Wiping existing primary data before full refresh. [2025-10-28T17:57:33.849724] [INFO ] [LOCAL ] CLDT: Starting deletion of primary data. [2025-10-28T17:57:33.850207] [DEBUG] [LOCAL ] CLDT: Deleted primary data file. [2025-10-28T17:57:33.850264] [INFO ] [MAIN ] CLDT: Starting full primary refresh. [2025-10-28T17:57:34.210523] [INFO ] [REMOTE ] CLDT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:57:34.242939] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-28T17:57:34.359300] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-01. [2025-10-28T17:57:34.414368] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-28T17:57:35.154961] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-28T17:57:35.159303] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-08. [2025-10-28T17:57:35.959387] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-02. [2025-10-28T17:57:36.759366] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-07. [2025-10-28T17:57:37.283294] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-10-28T17:57:37.362911] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-28T17:57:37.559400] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-09. [2025-10-28T17:57:38.247675] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-28T17:57:38.359389] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-08. [2025-10-28T17:57:39.018049] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-28T17:57:39.126480] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-28T17:57:39.159321] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-02. [2025-10-28T17:57:39.860974] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-28T17:57:39.959324] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-10. [2025-10-28T17:57:40.759355] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-03. [2025-10-28T17:57:41.559415] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-09. [2025-10-28T17:57:41.669537] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-28T17:57:41.670928] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-28T17:57:41.688912] [INFO ] [REMOTE ] CL: Full fetch complete (77818 records). [2025-10-28T17:57:41.689073] [DEBUG] [VALIDATOR ] CL: Validating primary data. [2025-10-28T17:57:42.095600] [DEBUG] [VALIDATOR ] CL: All expected trading days are present. [2025-10-28T17:57:42.095710] [DEBUG] [VALIDATOR ] CL: Primary data validation passed. [2025-10-28T17:57:42.096632] [INFO ] [MAIN ] CL: Fetched primary data is valid. [2025-10-28T17:57:42.096726] [DEBUG] [LOCAL ] CL: Saving primary data. [2025-10-28T17:57:42.098284] [DEBUG] [LOCAL ] CL: Trimmed 77818 records to 53649 (keeping 200 days of data) [2025-10-28T17:57:42.379110] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-04. [2025-10-28T17:57:42.426948] [DEBUG] [LOCAL ] CL: Primary data saved (53649 records). [2025-10-28T17:57:42.427118] [INFO ] [MAIN ] CL: Full history saved. [2025-10-28T17:57:42.427205] [INFO ] [MAIN ] Update Progress: 461/2366 symbols completed. CL took 34.2s. Estimated remaining: 3h 58m 15s. Rate: 8.0 symbols/min [2025-10-28T17:57:42.600806] [INFO ] [MAIN ] CLF: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:57:42.651452] [DEBUG] [LOCAL ] CLF: Loaded 53741 existing records from primary storage. [2025-10-28T17:57:42.669109] [INFO ] [MAIN ] CLF: Loaded 53741 existing records. [2025-10-28T17:57:42.741271] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-28T17:57:42.860954] [WARN ] [MAIN ] CLF: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:57:42.861275] [INFO ] [MAIN ] CLF: Wiping existing primary data before full refresh. [2025-10-28T17:57:42.861333] [INFO ] [LOCAL ] CLF: Starting deletion of primary data. [2025-10-28T17:57:42.861884] [DEBUG] [LOCAL ] CLF: Deleted primary data file. [2025-10-28T17:57:42.861941] [INFO ] [MAIN ] CLF: Starting full primary refresh. [2025-10-28T17:57:43.162357] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-03. [2025-10-28T17:57:43.221281] [INFO ] [REMOTE ] CLF: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:57:43.266474] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-28T17:57:43.959325] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-01. [2025-10-28T17:57:44.139758] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-28T17:57:44.759331] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-05. [2025-10-28T17:57:45.550287] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-28T17:57:45.560291] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-04. [2025-10-28T17:57:45.642847] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-28T17:57:46.165966] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-28T17:57:46.359413] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-02. [2025-10-28T17:57:47.159384] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-06. [2025-10-28T17:57:47.772537] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-28T17:57:47.911205] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-28T17:57:47.959410] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-03. [2025-10-28T17:57:48.759350] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-05. [2025-10-28T17:57:49.286475] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-28T17:57:49.559372] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-06. [2025-10-28T17:57:49.603950] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-28T17:57:50.075321] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-28T17:57:50.359335] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-07. [2025-10-28T17:57:50.829453] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-28T17:57:51.159359] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-04. [2025-10-28T17:57:51.959356] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-10. [2025-10-28T17:57:52.725420] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-28T17:57:52.759358] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-08. [2025-10-28T17:57:53.239557] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-28T17:57:53.247088] [INFO ] [REMOTE ] CLB: Full fetch complete (47868 records). [2025-10-28T17:57:53.247193] [DEBUG] [VALIDATOR ] CLB: Validating primary data. [2025-10-28T17:57:53.370774] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-10-28T17:57:53.564566] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-07. [2025-10-28T17:57:53.631833] [DEBUG] [VALIDATOR ] CLB: All expected trading days are present. [2025-10-28T17:57:53.631936] [DEBUG] [VALIDATOR ] CLB: Primary data validation passed. [2025-10-28T17:57:53.632595] [INFO ] [MAIN ] CLB: Fetched primary data is valid. [2025-10-28T17:57:53.632638] [DEBUG] [LOCAL ] CLB: Saving primary data. [2025-10-28T17:57:53.633854] [DEBUG] [LOCAL ] CLB: Trimmed 47868 records to 33443 (keeping 200 days of data) [2025-10-28T17:57:53.830545] [DEBUG] [LOCAL ] CLB: Primary data saved (33443 records). [2025-10-28T17:57:53.830736] [INFO ] [MAIN ] CLB: Full history saved. [2025-10-28T17:57:53.830838] [INFO ] [MAIN ] Update Progress: 462/2366 symbols completed. CLB took 40.2s. Estimated remaining: 3h 58m 24s. Rate: 8.0 symbols/min [2025-10-28T17:57:53.994197] [INFO ] [MAIN ] CLH: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:57:54.018863] [DEBUG] [LOCAL ] CLH: Loaded 27306 existing records from primary storage. [2025-10-28T17:57:54.019179] [INFO ] [MAIN ] CLH: Loaded 27306 existing records. [2025-10-28T17:57:54.194443] [WARN ] [MAIN ] CLH: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:57:54.194688] [INFO ] [MAIN ] CLH: Wiping existing primary data before full refresh. [2025-10-28T17:57:54.194746] [INFO ] [LOCAL ] CLH: Starting deletion of primary data. [2025-10-28T17:57:54.195380] [DEBUG] [LOCAL ] CLH: Deleted primary data file. [2025-10-28T17:57:54.195450] [INFO ] [MAIN ] CLH: Starting full primary refresh. [2025-10-28T17:57:54.367104] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-05. [2025-10-28T17:57:54.493133] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-28T17:57:54.573184] [INFO ] [REMOTE ] CLH: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:57:55.159344] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-08. [2025-10-28T17:57:55.959325] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-09. [2025-10-28T17:57:55.973819] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-28T17:57:56.104408] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-10-28T17:57:56.629204] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-28T17:57:56.759343] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-01. [2025-10-28T17:57:57.559344] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-06. [2025-10-28T17:57:57.734797] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-28T17:57:58.359342] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-09. [2025-10-28T17:57:58.989962] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-28T17:57:59.159312] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-07. [2025-10-28T17:57:59.203379] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-28T17:57:59.959429] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-10. [2025-10-28T17:58:00.759391] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-02. [2025-10-28T17:58:01.384941] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-28T17:58:01.391060] [INFO ] [REMOTE ] CLDT: Full fetch complete (37706 records). [2025-10-28T17:58:01.391216] [DEBUG] [VALIDATOR ] CLDT: Validating primary data. [2025-10-28T17:58:01.560370] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-10. [2025-10-28T17:58:01.806364] [DEBUG] [VALIDATOR ] CLDT: All expected trading days are present. [2025-10-28T17:58:01.806832] [DEBUG] [VALIDATOR ] CLDT: Primary data validation passed. [2025-10-28T17:58:01.807737] [INFO ] [MAIN ] CLDT: Fetched primary data is valid. [2025-10-28T17:58:01.807849] [DEBUG] [LOCAL ] CLDT: Saving primary data. [2025-10-28T17:58:01.840501] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-07 (2.68 seconds). [2025-10-28T17:58:01.852547] [DEBUG] [LOCAL ] CLDT: Trimmed 37706 records to 24678 (keeping 200 days of data) [2025-10-28T17:58:01.962329] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-28T17:58:02.027888] [DEBUG] [LOCAL ] CLDT: Primary data saved (24678 records). [2025-10-28T17:58:02.028012] [INFO ] [MAIN ] CLDT: Full history saved. [2025-10-28T17:58:02.028117] [INFO ] [MAIN ] Update Progress: 463/2366 symbols completed. CLDT took 28.6s. Estimated remaining: 3h 58m 19s. Rate: 8.0 symbols/min [2025-10-28T17:58:02.194270] [INFO ] [MAIN ] CLPR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:58:02.203197] [DEBUG] [LOCAL ] CLPR: Loaded 9660 existing records from primary storage. [2025-10-28T17:58:02.203355] [INFO ] [MAIN ] CLPR: Loaded 9660 existing records. [2025-10-28T17:58:02.363984] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-03. [2025-10-28T17:58:02.376830] [WARN ] [MAIN ] CLPR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:58:02.377043] [INFO ] [MAIN ] CLPR: Wiping existing primary data before full refresh. [2025-10-28T17:58:02.377976] [INFO ] [LOCAL ] CLPR: Starting deletion of primary data. [2025-10-28T17:58:02.378254] [DEBUG] [LOCAL ] CLPR: Deleted primary data file. [2025-10-28T17:58:02.378312] [INFO ] [MAIN ] CLPR: Starting full primary refresh. [2025-10-28T17:58:02.738597] [INFO ] [REMOTE ] CLPR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:58:02.750014] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-28T17:58:02.754364] [INFO ] [REMOTE ] CLCO: Full fetch complete (22662 records). [2025-10-28T17:58:02.754435] [DEBUG] [VALIDATOR ] CLCO: Validating primary data. [2025-10-28T17:58:03.126104] [DEBUG] [VALIDATOR ] CLCO: All expected trading days are present. [2025-10-28T17:58:03.126180] [DEBUG] [VALIDATOR ] CLCO: Primary data validation passed. [2025-10-28T17:58:03.126586] [INFO ] [MAIN ] CLCO: Fetched primary data is valid. [2025-10-28T17:58:03.126625] [DEBUG] [LOCAL ] CLCO: Saving primary data. [2025-10-28T17:58:03.127230] [DEBUG] [LOCAL ] CLCO: Trimmed 22662 records to 12886 (keeping 200 days of data) [2025-10-28T17:58:03.160425] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-08. [2025-10-28T17:58:03.198902] [DEBUG] [LOCAL ] CLCO: Primary data saved (12886 records). [2025-10-28T17:58:03.199205] [INFO ] [MAIN ] CLCO: Full history saved. [2025-10-28T17:58:03.199302] [INFO ] [MAIN ] Update Progress: 464/2366 symbols completed. CLCO took 35.5s. Estimated remaining: 3h 57m 46s. Rate: 8.0 symbols/min [2025-10-28T17:58:03.367049] [INFO ] [MAIN ] CLS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:58:03.417031] [DEBUG] [LOCAL ] CLS: Loaded 53546 existing records from primary storage. [2025-10-28T17:58:03.417452] [INFO ] [MAIN ] CLS: Loaded 53546 existing records. [2025-10-28T17:58:03.596221] [WARN ] [MAIN ] CLS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:58:03.596476] [INFO ] [MAIN ] CLS: Wiping existing primary data before full refresh. [2025-10-28T17:58:03.596597] [INFO ] [LOCAL ] CLS: Starting deletion of primary data. [2025-10-28T17:58:03.597092] [DEBUG] [LOCAL ] CLS: Deleted primary data file. [2025-10-28T17:58:03.614910] [INFO ] [MAIN ] CLS: Starting full primary refresh. [2025-10-28T17:58:03.697124] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-28T17:58:03.960054] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-04. [2025-10-28T17:58:03.980054] [INFO ] [REMOTE ] CLS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:58:04.767973] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-01. [2025-10-28T17:58:04.770387] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-28T17:58:05.048429] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-28T17:58:05.559334] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-09. [2025-10-28T17:58:06.359326] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-01. [2025-10-28T17:58:06.684412] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-28T17:58:06.960614] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-28T17:58:07.064967] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-28T17:58:07.159302] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-10. [2025-10-28T17:58:07.959371] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-02. [2025-10-28T17:58:08.435430] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-28T17:58:08.759355] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-03. [2025-10-28T17:58:08.953580] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-28T17:58:08.964344] [INFO ] [REMOTE ] CLF: Full fetch complete (77918 records). [2025-10-28T17:58:08.964500] [DEBUG] [VALIDATOR ] CLF: Validating primary data. [2025-10-28T17:58:09.374600] [DEBUG] [VALIDATOR ] CLF: All expected trading days are present. [2025-10-28T17:58:09.374867] [DEBUG] [VALIDATOR ] CLF: Primary data validation passed. [2025-10-28T17:58:09.375927] [INFO ] [MAIN ] CLF: Fetched primary data is valid. [2025-10-28T17:58:09.376092] [DEBUG] [LOCAL ] CLF: Saving primary data. [2025-10-28T17:58:09.386717] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-28T17:58:09.390672] [DEBUG] [LOCAL ] CLF: Trimmed 77918 records to 53741 (keeping 200 days of data) [2025-10-28T17:58:09.560348] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-02. [2025-10-28T17:58:09.700212] [DEBUG] [LOCAL ] CLF: Primary data saved (53741 records). [2025-10-28T17:58:09.700339] [INFO ] [MAIN ] CLF: Full history saved. [2025-10-28T17:58:09.700414] [INFO ] [MAIN ] Update Progress: 465/2366 symbols completed. CLF took 27.3s. Estimated remaining: 3h 57m 34s. Rate: 8.0 symbols/min [2025-10-28T17:58:09.869767] [INFO ] [MAIN ] CLVT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:58:09.913254] [DEBUG] [LOCAL ] CLVT: Loaded 51854 existing records from primary storage. [2025-10-28T17:58:09.913607] [INFO ] [MAIN ] CLVT: Loaded 51854 existing records. [2025-10-28T17:58:10.091410] [WARN ] [MAIN ] CLVT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:58:10.091606] [INFO ] [MAIN ] CLVT: Wiping existing primary data before full refresh. [2025-10-28T17:58:10.091678] [INFO ] [LOCAL ] CLVT: Starting deletion of primary data. [2025-10-28T17:58:10.092464] [DEBUG] [LOCAL ] CLVT: Deleted primary data file. [2025-10-28T17:58:10.092523] [INFO ] [MAIN ] CLVT: Starting full primary refresh. [2025-10-28T17:58:10.369606] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-05. [2025-10-28T17:58:10.451613] [INFO ] [REMOTE ] CLVT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:58:11.159350] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-04. [2025-10-28T17:58:11.197513] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-28T17:58:11.504730] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-28T17:58:11.819403] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-28T17:58:11.959417] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-03. [2025-10-28T17:58:12.759363] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-05. [2025-10-28T17:58:13.374360] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-28T17:58:13.559399] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-06. [2025-10-28T17:58:13.866832] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-28T17:58:14.359352] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-04. [2025-10-28T17:58:14.448869] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-28T17:58:15.159348] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-01. [2025-10-28T17:58:15.959550] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-06. [2025-10-28T17:58:16.121209] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-28T17:58:16.573047] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-28T17:58:16.668122] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-28T17:58:16.759355] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-07. [2025-10-28T17:58:17.446106] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-28T17:58:17.559332] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-05. [2025-10-28T17:58:18.359401] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-02. [2025-10-28T17:58:19.159321] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-08. [2025-10-28T17:58:19.381386] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-10-28T17:58:19.583824] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-28T17:58:19.623313] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-28T17:58:19.959368] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-09. [2025-10-28T17:58:20.399551] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-28T17:58:20.759396] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-03. [2025-10-28T17:58:21.559350] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-06. [2025-10-28T17:58:22.007187] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-28T17:58:22.359366] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-04. [2025-10-28T17:58:23.104336] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-28T17:58:23.159326] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-07. [2025-10-28T17:58:23.536864] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-28T17:58:23.959348] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-10. [2025-10-28T17:58:24.724223] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-28T17:58:24.726160] [INFO ] [REMOTE ] CLPR: Full fetch complete (15631 records). [2025-10-28T17:58:24.726231] [DEBUG] [VALIDATOR ] CLPR: Validating primary data. [2025-10-28T17:58:24.770153] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-05. [2025-10-28T17:58:25.096118] [DEBUG] [VALIDATOR ] CLPR: All expected trading days are present. [2025-10-28T17:58:25.096314] [DEBUG] [VALIDATOR ] CLPR: Primary data validation passed. [2025-10-28T17:58:25.096712] [INFO ] [MAIN ] CLPR: Fetched primary data is valid. [2025-10-28T17:58:25.096822] [DEBUG] [LOCAL ] CLPR: Saving primary data. [2025-10-28T17:58:25.097611] [DEBUG] [LOCAL ] CLPR: Trimmed 15631 records to 9592 (keeping 200 days of data) [2025-10-28T17:58:25.153011] [DEBUG] [LOCAL ] CLPR: Primary data saved (9592 records). [2025-10-28T17:58:25.153153] [INFO ] [MAIN ] CLPR: Full history saved. [2025-10-28T17:58:25.153280] [INFO ] [MAIN ] Update Progress: 466/2366 symbols completed. CLPR took 23.1s. Estimated remaining: 3h 57m 59s. Rate: 8.0 symbols/min [2025-10-28T17:58:25.290448] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-10-28T17:58:25.369274] [INFO ] [MAIN ] CLW: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:58:25.387716] [DEBUG] [LOCAL ] CLW: Loaded 20956 existing records from primary storage. [2025-10-28T17:58:25.387943] [INFO ] [MAIN ] CLW: Loaded 20956 existing records. [2025-10-28T17:58:25.562435] [WARN ] [MAIN ] CLW: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:58:25.562671] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-07. [2025-10-28T17:58:25.563756] [INFO ] [MAIN ] CLW: Wiping existing primary data before full refresh. [2025-10-28T17:58:25.563892] [INFO ] [LOCAL ] CLW: Starting deletion of primary data. [2025-10-28T17:58:25.564326] [DEBUG] [LOCAL ] CLW: Deleted primary data file. [2025-10-28T17:58:25.564386] [INFO ] [MAIN ] CLW: Starting full primary refresh. [2025-10-28T17:58:25.937121] [INFO ] [REMOTE ] CLW: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:58:26.065412] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-28T17:58:26.359345] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-01. [2025-10-28T17:58:26.749223] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-28T17:58:27.159340] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-08. [2025-10-28T17:58:27.600816] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-28T17:58:27.959352] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-08. [2025-10-28T17:58:28.759342] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-02. [2025-10-28T17:58:28.781099] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-28T17:58:28.969637] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-28T17:58:29.564877] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-09. [2025-10-28T17:58:29.573610] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-28T17:58:30.359353] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-09. [2025-10-28T17:58:30.394074] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-28T17:58:31.159339] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-03. [2025-10-28T17:58:31.948123] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-28T17:58:31.959297] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-06. [2025-10-28T17:58:32.131723] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-10-28T17:58:32.759340] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-04. [2025-10-28T17:58:33.458855] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-28T17:58:33.512564] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-28T17:58:33.559322] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-07. [2025-10-28T17:58:34.359344] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-10. [2025-10-28T17:58:34.849730] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-28T17:58:35.159351] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-10. [2025-10-28T17:58:35.325094] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-28T17:58:35.331259] [INFO ] [REMOTE ] CLH: Full fetch complete (42256 records). [2025-10-28T17:58:35.331339] [DEBUG] [VALIDATOR ] CLH: Validating primary data. [2025-10-28T17:58:35.698355] [DEBUG] [VALIDATOR ] CLH: All expected trading days are present. [2025-10-28T17:58:35.698425] [DEBUG] [VALIDATOR ] CLH: Primary data validation passed. [2025-10-28T17:58:35.698998] [INFO ] [MAIN ] CLH: Fetched primary data is valid. [2025-10-28T17:58:35.699062] [DEBUG] [LOCAL ] CLH: Saving primary data. [2025-10-28T17:58:35.699904] [DEBUG] [LOCAL ] CLH: Trimmed 42256 records to 27313 (keeping 200 days of data) [2025-10-28T17:58:35.856360] [DEBUG] [LOCAL ] CLH: Primary data saved (27313 records). [2025-10-28T17:58:35.856483] [INFO ] [MAIN ] CLH: Full history saved. [2025-10-28T17:58:35.856559] [INFO ] [MAIN ] Update Progress: 467/2366 symbols completed. CLH took 42.0s. Estimated remaining: 3h 58m 5s. Rate: 8.0 symbols/min [2025-10-28T17:58:35.964509] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-05. [2025-10-28T17:58:36.028519] [INFO ] [MAIN ] CLX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:58:36.028674] [DEBUG] [LOCAL ] CLX: No existing data file found in primary storage. [2025-10-28T17:58:36.028726] [WARN ] [MAIN ] CLX: No existing data found, performing full refresh instead. [2025-10-28T17:58:36.028891] [INFO ] [MAIN ] CLX: Wiping existing primary data before full refresh. [2025-10-28T17:58:36.028943] [INFO ] [LOCAL ] CLX: Starting deletion of primary data. [2025-10-28T17:58:36.028985] [DEBUG] [LOCAL ] CLX: No primary data file found to delete. [2025-10-28T17:58:36.029017] [INFO ] [MAIN ] CLX: Starting full primary refresh. [2025-10-28T17:58:36.378615] [INFO ] [REMOTE ] CLX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:58:36.759293] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-01. [2025-10-28T17:58:36.843989] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-28T17:58:37.071287] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-10 (1.91 seconds). [2025-10-28T17:58:37.081823] [INFO ] [REMOTE ] CLS: Full fetch complete (77704 records). [2025-10-28T17:58:37.081942] [DEBUG] [VALIDATOR ] CLS: Validating primary data. [2025-10-28T17:58:37.469379] [DEBUG] [VALIDATOR ] CLS: All expected trading days are present. [2025-10-28T17:58:37.469456] [DEBUG] [VALIDATOR ] CLS: Primary data validation passed. [2025-10-28T17:58:37.470280] [INFO ] [MAIN ] CLS: Fetched primary data is valid. [2025-10-28T17:58:37.470341] [DEBUG] [LOCAL ] CLS: Saving primary data. [2025-10-28T17:58:37.471804] [DEBUG] [LOCAL ] CLS: Trimmed 77704 records to 53546 (keeping 200 days of data) [2025-10-28T17:58:37.562725] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-06. [2025-10-28T17:58:37.785506] [DEBUG] [LOCAL ] CLS: Primary data saved (53546 records). [2025-10-28T17:58:37.785632] [INFO ] [MAIN ] CLS: Full history saved. [2025-10-28T17:58:37.785745] [INFO ] [MAIN ] Update Progress: 468/2366 symbols completed. CLS took 34.6s. Estimated remaining: 3h 57m 34s. Rate: 8.0 symbols/min [2025-10-28T17:58:37.968740] [INFO ] [MAIN ] CM: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:58:38.011709] [DEBUG] [LOCAL ] CM: Loaded 48138 existing records from primary storage. [2025-10-28T17:58:38.012059] [INFO ] [MAIN ] CM: Loaded 48138 existing records. [2025-10-28T17:58:38.205934] [WARN ] [MAIN ] CM: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:58:38.206161] [INFO ] [MAIN ] CM: Wiping existing primary data before full refresh. [2025-10-28T17:58:38.206303] [INFO ] [LOCAL ] CM: Starting deletion of primary data. [2025-10-28T17:58:38.206881] [DEBUG] [LOCAL ] CM: Deleted primary data file. [2025-10-28T17:58:38.207019] [INFO ] [MAIN ] CM: Starting full primary refresh. [2025-10-28T17:58:38.322790] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-28T17:58:38.363400] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-02. [2025-10-28T17:58:38.423125] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-28T17:58:38.655077] [INFO ] [REMOTE ] CM: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:58:39.159346] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-07. [2025-10-28T17:58:39.614446] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-28T17:58:39.899140] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-28T17:58:39.959400] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-08. [2025-10-28T17:58:40.653773] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-28T17:58:40.759338] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-01. [2025-10-28T17:58:41.559330] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-08. [2025-10-28T17:58:42.359323] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-03. [2025-10-28T17:58:42.399931] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-28T17:58:42.778824] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-28T17:58:43.159331] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-09. [2025-10-28T17:58:43.723331] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-28T17:58:43.860950] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-28T17:58:43.959303] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-10. [2025-10-28T17:58:44.664151] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-28T17:58:44.668688] [INFO ] [REMOTE ] CLW: Full fetch complete (33382 records). [2025-10-28T17:58:44.668777] [DEBUG] [VALIDATOR ] CLW: Validating primary data. [2025-10-28T17:58:44.768512] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-09. [2025-10-28T17:58:45.049218] [DEBUG] [VALIDATOR ] CLW: All expected trading days are present. [2025-10-28T17:58:45.049297] [DEBUG] [VALIDATOR ] CLW: Primary data validation passed. [2025-10-28T17:58:45.049844] [INFO ] [MAIN ] CLW: Fetched primary data is valid. [2025-10-28T17:58:45.049905] [DEBUG] [LOCAL ] CLW: Saving primary data. [2025-10-28T17:58:45.050663] [DEBUG] [LOCAL ] CLW: Trimmed 33382 records to 20961 (keeping 200 days of data) [2025-10-28T17:58:45.170913] [DEBUG] [LOCAL ] CLW: Primary data saved (20961 records). [2025-10-28T17:58:45.171028] [INFO ] [MAIN ] CLW: Full history saved. [2025-10-28T17:58:45.171100] [INFO ] [MAIN ] Update Progress: 469/2366 symbols completed. CLW took 20.0s. Estimated remaining: 3h 57m 26s. Rate: 8.0 symbols/min [2025-10-28T17:58:45.341826] [INFO ] [MAIN ] CMA: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:58:45.388578] [DEBUG] [LOCAL ] CMA: Loaded 50157 existing records from primary storage. [2025-10-28T17:58:45.388922] [INFO ] [MAIN ] CMA: Loaded 50157 existing records. [2025-10-28T17:58:45.566907] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-04. [2025-10-28T17:58:45.572987] [WARN ] [MAIN ] CMA: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:58:45.573966] [INFO ] [MAIN ] CMA: Wiping existing primary data before full refresh. [2025-10-28T17:58:45.574038] [INFO ] [LOCAL ] CMA: Starting deletion of primary data. [2025-10-28T17:58:45.574671] [DEBUG] [LOCAL ] CMA: Deleted primary data file. [2025-10-28T17:58:45.574770] [INFO ] [MAIN ] CMA: Starting full primary refresh. [2025-10-28T17:58:45.932487] [INFO ] [REMOTE ] CMA: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:58:46.168252] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-28T17:58:46.359389] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-01. [2025-10-28T17:58:46.895206] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-28T17:58:47.159335] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-05. [2025-10-28T17:58:47.587664] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-28T17:58:47.959358] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-02. [2025-10-28T17:58:48.764534] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-02. [2025-10-28T17:58:48.779397] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-28T17:58:49.191871] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-28T17:58:49.559335] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-06. [2025-10-28T17:58:49.729797] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-28T17:58:50.359375] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-03. [2025-10-28T17:58:50.855434] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-28T17:58:51.159355] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-07. [2025-10-28T17:58:51.598869] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-28T17:58:51.959383] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-10. [2025-10-28T17:58:52.571598] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-28T17:58:52.759336] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-03. [2025-10-28T17:58:53.147630] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-28T17:58:53.157888] [INFO ] [REMOTE ] CLVT: Full fetch complete (75389 records). [2025-10-28T17:58:53.158014] [DEBUG] [VALIDATOR ] CLVT: Validating primary data. [2025-10-28T17:58:53.557148] [DEBUG] [VALIDATOR ] CLVT: All expected trading days are present. [2025-10-28T17:58:53.557227] [DEBUG] [VALIDATOR ] CLVT: Primary data validation passed. [2025-10-28T17:58:53.558073] [INFO ] [MAIN ] CLVT: Fetched primary data is valid. [2025-10-28T17:58:53.558133] [DEBUG] [LOCAL ] CLVT: Saving primary data. [2025-10-28T17:58:53.559329] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-04. [2025-10-28T17:58:53.559543] [DEBUG] [LOCAL ] CLVT: Trimmed 75389 records to 51857 (keeping 200 days of data) [2025-10-28T17:58:53.840386] [DEBUG] [LOCAL ] CLVT: Primary data saved (51857 records). [2025-10-28T17:58:53.840511] [INFO ] [MAIN ] CLVT: Full history saved. [2025-10-28T17:58:53.840588] [INFO ] [MAIN ] Update Progress: 470/2366 symbols completed. CLVT took 44.1s. Estimated remaining: 3h 57m 24s. Rate: 8.0 symbols/min [2025-10-28T17:58:54.014084] [INFO ] [MAIN ] CMBT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:58:54.043684] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-28T17:58:54.072806] [DEBUG] [LOCAL ] CMBT: Loaded 28308 existing records from primary storage. [2025-10-28T17:58:54.073049] [INFO ] [MAIN ] CMBT: Loaded 28308 existing records. [2025-10-28T17:58:54.275988] [WARN ] [MAIN ] CMBT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:58:54.276179] [INFO ] [MAIN ] CMBT: Wiping existing primary data before full refresh. [2025-10-28T17:58:54.276225] [INFO ] [LOCAL ] CMBT: Starting deletion of primary data. [2025-10-28T17:58:54.276520] [DEBUG] [LOCAL ] CMBT: Deleted primary data file. [2025-10-28T17:58:54.276572] [INFO ] [MAIN ] CMBT: Starting full primary refresh. [2025-10-28T17:58:54.364455] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-08. [2025-10-28T17:58:54.668055] [INFO ] [REMOTE ] CMBT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:58:54.912812] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-28T17:58:55.159336] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-05. [2025-10-28T17:58:55.726830] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-28T17:58:55.959441] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-09. [2025-10-28T17:58:56.347404] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-28T17:58:56.759390] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-04. [2025-10-28T17:58:57.170890] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-28T17:58:57.559335] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-01. [2025-10-28T17:58:57.909183] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-28T17:58:58.176724] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-28T17:58:58.359399] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-02. [2025-10-28T17:58:58.910393] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-28T17:58:59.159350] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-03. [2025-10-28T17:58:59.855423] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-28T17:58:59.959340] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-05. [2025-10-28T17:59:00.759379] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-06. [2025-10-28T17:59:01.559336] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-04. [2025-10-28T17:59:01.761833] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-10-28T17:59:02.272574] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-28T17:59:02.359345] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-10. [2025-10-28T17:59:02.923502] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-06 (2.16 seconds). [2025-10-28T17:59:03.159355] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-05. [2025-10-28T17:59:03.268977] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-28T17:59:03.279333] [INFO ] [REMOTE ] CLX: Full fetch complete (73985 records). [2025-10-28T17:59:03.279518] [DEBUG] [VALIDATOR ] CLX: Validating primary data. [2025-10-28T17:59:03.659968] [DEBUG] [VALIDATOR ] CLX: All expected trading days are present. [2025-10-28T17:59:03.660046] [DEBUG] [VALIDATOR ] CLX: Primary data validation passed. [2025-10-28T17:59:03.660834] [INFO ] [MAIN ] CLX: Fetched primary data is valid. [2025-10-28T17:59:03.660896] [DEBUG] [LOCAL ] CLX: Saving primary data. [2025-10-28T17:59:03.662209] [DEBUG] [LOCAL ] CLX: Trimmed 73985 records to 51838 (keeping 200 days of data) [2025-10-28T17:59:03.911756] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-28T17:59:03.961198] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-06. [2025-10-28T17:59:03.996715] [DEBUG] [LOCAL ] CLX: Primary data saved (51838 records). [2025-10-28T17:59:03.996844] [INFO ] [MAIN ] CLX: Full history saved. [2025-10-28T17:59:03.996913] [INFO ] [MAIN ] Update Progress: 471/2366 symbols completed. CLX took 28.1s. Estimated remaining: 3h 57m 27s. Rate: 8.0 symbols/min [2025-10-28T17:59:04.167915] [INFO ] [MAIN ] CMC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:59:04.207762] [DEBUG] [LOCAL ] CMC: Loaded 45505 existing records from primary storage. [2025-10-28T17:59:04.208096] [INFO ] [MAIN ] CMC: Loaded 45505 existing records. [2025-10-28T17:59:04.395593] [WARN ] [MAIN ] CMC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:59:04.395888] [INFO ] [MAIN ] CMC: Wiping existing primary data before full refresh. [2025-10-28T17:59:04.395975] [INFO ] [LOCAL ] CMC: Starting deletion of primary data. [2025-10-28T17:59:04.396592] [DEBUG] [LOCAL ] CMC: Deleted primary data file. [2025-10-28T17:59:04.396699] [INFO ] [MAIN ] CMC: Starting full primary refresh. [2025-10-28T17:59:04.763078] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-06. [2025-10-28T17:59:04.763761] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-28T17:59:04.834087] [INFO ] [REMOTE ] CMC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:59:05.559337] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-07. [2025-10-28T17:59:05.981534] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-28T17:59:06.359358] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-01. [2025-10-28T17:59:06.837173] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-28T17:59:07.159345] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-08. [2025-10-28T17:59:07.560196] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-28T17:59:07.959349] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-07. [2025-10-28T17:59:08.350631] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-28T17:59:08.759419] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-02. [2025-10-28T17:59:09.399403] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-28T17:59:09.559326] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-08. [2025-10-28T17:59:09.906771] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-28T17:59:10.359353] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-03. [2025-10-28T17:59:10.755682] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-28T17:59:11.159374] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-09. [2025-10-28T17:59:11.620961] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-28T17:59:11.959380] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-09. [2025-10-28T17:59:12.759352] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-07. [2025-10-28T17:59:13.014412] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-10-28T17:59:13.375059] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-28T17:59:13.463607] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-28T17:59:13.559344] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-10. [2025-10-28T17:59:14.359359] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-10. [2025-10-28T17:59:14.908255] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-28T17:59:14.922191] [INFO ] [REMOTE ] CM: Full fetch complete (69667 records). [2025-10-28T17:59:14.922424] [DEBUG] [VALIDATOR ] CM: Validating primary data. [2025-10-28T17:59:15.168615] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-08. [2025-10-28T17:59:15.335418] [DEBUG] [VALIDATOR ] CM: All expected trading days are present. [2025-10-28T17:59:15.335494] [DEBUG] [VALIDATOR ] CM: Primary data validation passed. [2025-10-28T17:59:15.336577] [INFO ] [MAIN ] CM: Fetched primary data is valid. [2025-10-28T17:59:15.336680] [DEBUG] [LOCAL ] CM: Saving primary data. [2025-10-28T17:59:15.338139] [DEBUG] [LOCAL ] CM: Trimmed 69667 records to 48051 (keeping 200 days of data) [2025-10-28T17:59:15.620639] [DEBUG] [LOCAL ] CM: Primary data saved (48051 records). [2025-10-28T17:59:15.620822] [INFO ] [MAIN ] CM: Full history saved. [2025-10-28T17:59:15.620902] [INFO ] [MAIN ] Update Progress: 472/2366 symbols completed. CM took 37.8s. Estimated remaining: 3h 57m 36s. Rate: 8.0 symbols/min [2025-10-28T17:59:15.786381] [INFO ] [MAIN ] CMCM: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:59:15.792849] [DEBUG] [LOCAL ] CMCM: Loaded 4809 existing records from primary storage. [2025-10-28T17:59:15.793006] [INFO ] [MAIN ] CMCM: Loaded 4809 existing records. [2025-10-28T17:59:15.978431] [WARN ] [MAIN ] CMCM: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:59:15.973746] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-04. [2025-10-28T17:59:15.979738] [INFO ] [MAIN ] CMCM: Wiping existing primary data before full refresh. [2025-10-28T17:59:15.979884] [INFO ] [LOCAL ] CMCM: Starting deletion of primary data. [2025-10-28T17:59:15.980247] [DEBUG] [LOCAL ] CMCM: Deleted primary data file. [2025-10-28T17:59:15.980324] [INFO ] [MAIN ] CMCM: Starting full primary refresh. [2025-10-28T17:59:16.307586] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-28T17:59:16.393121] [INFO ] [REMOTE ] CMCM: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:59:16.394108] [INFO ] [REMOTE ] CMA: Full fetch complete (73481 records). [2025-10-28T17:59:16.394472] [DEBUG] [VALIDATOR ] CMA: Validating primary data. [2025-10-28T17:59:16.512455] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-28T17:59:16.764572] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-09. [2025-10-28T17:59:16.817824] [DEBUG] [VALIDATOR ] CMA: All expected trading days are present. [2025-10-28T17:59:16.817902] [DEBUG] [VALIDATOR ] CMA: Primary data validation passed. [2025-10-28T17:59:16.818769] [INFO ] [MAIN ] CMA: Fetched primary data is valid. [2025-10-28T17:59:16.818830] [DEBUG] [LOCAL ] CMA: Saving primary data. [2025-10-28T17:59:16.820169] [DEBUG] [LOCAL ] CMA: Trimmed 73481 records to 50115 (keeping 200 days of data) [2025-10-28T17:59:17.115826] [DEBUG] [LOCAL ] CMA: Primary data saved (50115 records). [2025-10-28T17:59:17.115950] [INFO ] [MAIN ] CMA: Full history saved. [2025-10-28T17:59:17.116400] [INFO ] [MAIN ] Update Progress: 473/2366 symbols completed. CMA took 31.9s. Estimated remaining: 3h 57m 4s. Rate: 8.0 symbols/min [2025-10-28T17:59:17.291383] [INFO ] [MAIN ] CMDB: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:59:17.291693] [DEBUG] [LOCAL ] CMDB: No existing data file found in primary storage. [2025-10-28T17:59:17.291747] [WARN ] [MAIN ] CMDB: No existing data found, performing full refresh instead. [2025-10-28T17:59:17.291854] [INFO ] [MAIN ] CMDB: Wiping existing primary data before full refresh. [2025-10-28T17:59:17.291895] [INFO ] [LOCAL ] CMDB: Starting deletion of primary data. [2025-10-28T17:59:17.291935] [DEBUG] [LOCAL ] CMDB: No primary data file found to delete. [2025-10-28T17:59:17.291966] [INFO ] [MAIN ] CMDB: Starting full primary refresh. [2025-10-28T17:59:17.573424] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-01. [2025-10-28T17:59:17.672181] [INFO ] [REMOTE ] CMDB: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:59:17.699025] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-28T17:59:18.067351] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-28T17:59:18.244015] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-28T17:59:18.359344] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-02. [2025-10-28T17:59:18.852357] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-28T17:59:19.159339] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-03. [2025-10-28T17:59:19.547593] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-10-28T17:59:19.959351] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-10. [2025-10-28T17:59:20.759380] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-04. [2025-10-28T17:59:21.130948] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-10-28T17:59:21.489035] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-28T17:59:21.498838] [INFO ] [REMOTE ] CMBT: Full fetch complete (35008 records). [2025-10-28T17:59:21.498923] [DEBUG] [VALIDATOR ] CMBT: Validating primary data. [2025-10-28T17:59:21.564573] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-05. [2025-10-28T17:59:21.869367] [DEBUG] [VALIDATOR ] CMBT: All expected trading days are present. [2025-10-28T17:59:21.869446] [DEBUG] [VALIDATOR ] CMBT: Primary data validation passed. [2025-10-28T17:59:21.870011] [INFO ] [MAIN ] CMBT: Fetched primary data is valid. [2025-10-28T17:59:21.870071] [DEBUG] [LOCAL ] CMBT: Saving primary data. [2025-10-28T17:59:21.870928] [DEBUG] [LOCAL ] CMBT: Trimmed 35008 records to 28622 (keeping 200 days of data) [2025-10-28T17:59:22.038431] [DEBUG] [LOCAL ] CMBT: Primary data saved (28622 records). [2025-10-28T17:59:22.038560] [INFO ] [MAIN ] CMBT: Full history saved. [2025-10-28T17:59:22.038637] [INFO ] [MAIN ] Update Progress: 474/2366 symbols completed. CMBT took 28.2s. Estimated remaining: 3h 56m 46s. Rate: 8.0 symbols/min [2025-10-28T17:59:22.207575] [INFO ] [MAIN ] CMG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:59:22.255873] [DEBUG] [LOCAL ] CMG: Loaded 53723 existing records from primary storage. [2025-10-28T17:59:22.256165] [INFO ] [MAIN ] CMG: Loaded 53723 existing records. [2025-10-28T17:59:22.364436] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-01. [2025-10-28T17:59:22.434325] [WARN ] [MAIN ] CMG: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:59:22.434512] [INFO ] [MAIN ] CMG: Wiping existing primary data before full refresh. [2025-10-28T17:59:22.434558] [INFO ] [LOCAL ] CMG: Starting deletion of primary data. [2025-10-28T17:59:22.435491] [DEBUG] [LOCAL ] CMG: Deleted primary data file. [2025-10-28T17:59:22.435548] [INFO ] [MAIN ] CMG: Starting full primary refresh. [2025-10-28T17:59:22.575340] [DEBUG] [REMOTE ] CMDB: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-28T17:59:22.635610] [WARN ] [REMOTE ] CMDB: No data returned for month 2025-01 [2025-10-28T17:59:22.651265] [FATAL] [REMOTE ] CMDB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-28T17:59:22.669594] [FATAL] [MAIN ] CMDB: Failed to fetch primary data. [2025-10-28T17:59:22.721418] [WARN ] [MAIN ] CMDB: Deleting existing primary and derivative data due to fetch failure. [2025-10-28T17:59:22.721866] [INFO ] [LOCAL ] CMDB: Starting deletion of primary data. [2025-10-28T17:59:22.803183] [INFO ] [REMOTE ] CMG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:59:22.748318] [DEBUG] [LOCAL ] CMDB: No primary data file found to delete. [2025-10-28T17:59:22.803471] [INFO ] [LOCAL ] CMDB: Starting deletion of derivative data. [2025-10-28T17:59:22.804014] [DEBUG] [LOCAL ] CMDB: No derivative data file found to delete. [2025-10-28T17:59:22.804095] [INFO ] [MAIN ] Update Progress: 475/2366 symbols completed. CMDB took 5.7s. Estimated remaining: 3h 56m 12s. Rate: 8.0 symbols/min [2025-10-28T17:59:22.999350] [INFO ] [MAIN ] CMI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:59:22.997600] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-28T17:59:23.046838] [DEBUG] [LOCAL ] CMI: Loaded 41324 existing records from primary storage. [2025-10-28T17:59:23.047158] [INFO ] [MAIN ] CMI: Loaded 41324 existing records. [2025-10-28T17:59:23.164466] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-06. [2025-10-28T17:59:23.227439] [WARN ] [MAIN ] CMI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:59:23.227611] [INFO ] [MAIN ] CMI: Wiping existing primary data before full refresh. [2025-10-28T17:59:23.227696] [INFO ] [LOCAL ] CMI: Starting deletion of primary data. [2025-10-28T17:59:23.228269] [DEBUG] [LOCAL ] CMI: Deleted primary data file. [2025-10-28T17:59:23.228327] [INFO ] [MAIN ] CMI: Starting full primary refresh. [2025-10-28T17:59:23.575458] [INFO ] [REMOTE ] CMI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:59:23.959344] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-01. [2025-10-28T17:59:24.351078] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-28T17:59:24.759332] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-05. [2025-10-28T17:59:24.979614] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-05 (0.22 seconds). [2025-10-28T17:59:25.373468] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-28T17:59:25.559339] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-02. [2025-10-28T17:59:26.359524] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-01. [2025-10-28T17:59:27.103706] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-28T17:59:27.159416] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-03. [2025-10-28T17:59:27.494190] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-28T17:59:27.959336] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-02. [2025-10-28T17:59:28.756799] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-28T17:59:28.766965] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-06. [2025-10-28T17:59:29.135393] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-28T17:59:29.196741] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-10-28T17:59:29.559339] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-04. [2025-10-28T17:59:30.359342] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-03. [2025-10-28T17:59:31.159330] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-07. [2025-10-28T17:59:31.583125] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-10-28T17:59:31.959322] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-05. [2025-10-28T17:59:31.993908] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-28T17:59:32.183804] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-28T17:59:32.759337] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-08. [2025-10-28T17:59:33.527969] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-28T17:59:33.559317] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-06. [2025-10-28T17:59:33.926557] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-28T17:59:34.359353] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-04. [2025-10-28T17:59:34.967755] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-28T17:59:35.159341] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-07. [2025-10-28T17:59:35.215436] [DEBUG] [REMOTE ] CMG: Error fetching primary data for 2025-07: 'API call returned an empty response.' [2025-10-28T17:59:35.215767] [WARN ] [REMOTE ] CMG: No data returned for month 2025-07 [2025-10-28T17:59:35.215852] [FATAL] [REMOTE ] CMG: API call failed - aborting fetch to avoid wasting further API calls [2025-10-28T17:59:35.215931] [FATAL] [MAIN ] CMG: Failed to fetch primary data. [2025-10-28T17:59:35.215992] [WARN ] [MAIN ] CMG: Deleting existing primary and derivative data due to fetch failure. [2025-10-28T17:59:35.216061] [INFO ] [LOCAL ] CMG: Starting deletion of primary data. [2025-10-28T17:59:35.216123] [DEBUG] [LOCAL ] CMG: No primary data file found to delete. [2025-10-28T17:59:35.216158] [INFO ] [LOCAL ] CMG: Starting deletion of derivative data. [2025-10-28T17:59:35.216320] [DEBUG] [LOCAL ] CMG: Deleted derivative data file. [2025-10-28T17:59:35.216406] [INFO ] [MAIN ] Update Progress: 476/2366 symbols completed. CMG took 13.2s. Estimated remaining: 3h 56m 24s. Rate: 8.0 symbols/min [2025-10-28T17:59:35.393706] [INFO ] [MAIN ] CMP: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:59:35.427017] [DEBUG] [LOCAL ] CMP: Loaded 35271 existing records from primary storage. [2025-10-28T17:59:35.427339] [INFO ] [MAIN ] CMP: Loaded 35271 existing records. [2025-10-28T17:59:35.612933] [WARN ] [MAIN ] CMP: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:59:35.613266] [INFO ] [MAIN ] CMP: Wiping existing primary data before full refresh. [2025-10-28T17:59:35.613329] [INFO ] [LOCAL ] CMP: Starting deletion of primary data. [2025-10-28T17:59:35.614100] [DEBUG] [LOCAL ] CMP: Deleted primary data file. [2025-10-28T17:59:35.614160] [INFO ] [MAIN ] CMP: Starting full primary refresh. [2025-10-28T17:59:35.939676] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-28T17:59:35.968422] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-05. [2025-10-28T17:59:36.035787] [INFO ] [REMOTE ] CMP: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:59:36.759354] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-01. [2025-10-28T17:59:37.161233] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-28T17:59:37.559315] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-06. [2025-10-28T17:59:37.748216] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-28T17:59:38.359361] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-07. [2025-10-28T17:59:38.738600] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-10-28T17:59:38.839735] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-28T17:59:39.159377] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-02. [2025-10-28T17:59:39.959391] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-08. [2025-10-28T17:59:40.118903] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-28T17:59:40.431889] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-28T17:59:40.759394] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-09. [2025-10-28T17:59:41.197029] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-28T17:59:41.559392] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-10. [2025-10-28T17:59:42.080449] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-28T17:59:42.082381] [INFO ] [REMOTE ] CMCM: Full fetch complete (7084 records). [2025-10-28T17:59:42.082481] [DEBUG] [VALIDATOR ] CMCM: Validating primary data. [2025-10-28T17:59:42.364621] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-09. [2025-10-28T17:59:42.463426] [DEBUG] [VALIDATOR ] CMCM: All expected trading days are present. [2025-10-28T17:59:42.463529] [DEBUG] [VALIDATOR ] CMCM: Primary data validation passed. [2025-10-28T17:59:42.463956] [INFO ] [MAIN ] CMCM: Fetched primary data is valid. [2025-10-28T17:59:42.464022] [DEBUG] [LOCAL ] CMCM: Saving primary data. [2025-10-28T17:59:42.464485] [DEBUG] [LOCAL ] CMCM: Trimmed 7084 records to 4794 (keeping 200 days of data) [2025-10-28T17:59:42.495625] [DEBUG] [LOCAL ] CMCM: Primary data saved (4794 records). [2025-10-28T17:59:42.495862] [INFO ] [MAIN ] CMCM: Full history saved. [2025-10-28T17:59:42.495975] [INFO ] [MAIN ] Update Progress: 477/2366 symbols completed. CMCM took 26.9s. Estimated remaining: 3h 56m 15s. Rate: 8.0 symbols/min [2025-10-28T17:59:43.159397] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-03. [2025-10-28T17:59:43.597319] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-28T17:59:43.959372] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-07. [2025-10-28T17:59:44.076743] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-28T17:59:44.759334] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-04. [2025-10-28T17:59:45.395463] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-28T17:59:45.559347] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-10. [2025-10-28T17:59:45.774341] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-28T17:59:46.359377] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-08. [2025-10-28T17:59:46.885730] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-28T17:59:46.896443] [INFO ] [REMOTE ] CMC: Full fetch complete (66857 records). [2025-10-28T17:59:46.896733] [DEBUG] [VALIDATOR ] CMC: Validating primary data. [2025-10-28T17:59:46.897999] [FATAL] [VALIDATOR ] CMC: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T17:59:46.898121] [FATAL] [MAIN ] CMC: Fetched primary data is invalid. Refusing to save it. [2025-10-28T17:59:46.898166] [WARN ] [MAIN ] CMC: Deleting existing primary and derivative data due to validation failure. [2025-10-28T17:59:46.898207] [INFO ] [LOCAL ] CMC: Starting deletion of primary data. [2025-10-28T17:59:46.898274] [DEBUG] [LOCAL ] CMC: No primary data file found to delete. [2025-10-28T17:59:46.898314] [INFO ] [LOCAL ] CMC: Starting deletion of derivative data. [2025-10-28T17:59:46.898517] [DEBUG] [LOCAL ] CMC: Deleted derivative data file. [2025-10-28T17:59:46.898612] [INFO ] [MAIN ] Update Progress: 478/2366 symbols completed. CMC took 42.9s. Estimated remaining: 3h 55m 56s. Rate: 8.0 symbols/min [2025-10-28T17:59:47.159482] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-05. [2025-10-28T17:59:47.577427] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-28T17:59:47.959491] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-09. [2025-10-28T17:59:48.342478] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-28T17:59:48.759463] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-06. [2025-10-28T17:59:49.029044] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-28T17:59:49.559398] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-10. [2025-10-28T17:59:49.769264] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-28T17:59:50.359374] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-07. [2025-10-28T17:59:50.783111] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-28T17:59:50.793976] [INFO ] [REMOTE ] CMI: Full fetch complete (61177 records). [2025-10-28T17:59:50.794272] [DEBUG] [VALIDATOR ] CMI: Validating primary data. [2025-10-28T17:59:51.223402] [DEBUG] [VALIDATOR ] CMI: All expected trading days are present. [2025-10-28T17:59:51.223514] [DEBUG] [VALIDATOR ] CMI: Primary data validation passed. [2025-10-28T17:59:51.224523] [INFO ] [MAIN ] CMI: Fetched primary data is valid. [2025-10-28T17:59:51.224594] [DEBUG] [LOCAL ] CMI: Saving primary data. [2025-10-28T17:59:51.226418] [DEBUG] [LOCAL ] CMI: Trimmed 61177 records to 41254 (keeping 200 days of data) [2025-10-28T17:59:51.518550] [DEBUG] [LOCAL ] CMI: Primary data saved (41254 records). [2025-10-28T17:59:51.533799] [INFO ] [MAIN ] CMI: Full history saved. [2025-10-28T17:59:51.534782] [INFO ] [MAIN ] Update Progress: 479/2366 symbols completed. CMI took 28.7s. Estimated remaining: 3h 55m 37s. Rate: 8.0 symbols/min [2025-10-28T17:59:51.535972] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-28T17:59:51.545548] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-08. [2025-10-28T17:59:52.391231] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-28T17:59:52.399373] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-09. [2025-10-28T17:59:53.265755] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-28T17:59:53.273504] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-10. [2025-10-28T17:59:54.320848] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-28T17:59:54.327323] [INFO ] [REMOTE ] CMP: Full fetch complete (51356 records). [2025-10-28T17:59:54.327456] [DEBUG] [VALIDATOR ] CMP: Validating primary data. [2025-10-28T17:59:54.716176] [DEBUG] [VALIDATOR ] CMP: All expected trading days are present. [2025-10-28T17:59:54.716297] [DEBUG] [VALIDATOR ] CMP: Primary data validation passed. [2025-10-28T17:59:54.717165] [INFO ] [MAIN ] CMP: Fetched primary data is valid. [2025-10-28T17:59:54.717235] [DEBUG] [LOCAL ] CMP: Saving primary data. [2025-10-28T17:59:54.718912] [DEBUG] [LOCAL ] CMP: Trimmed 51356 records to 35190 (keeping 200 days of data) [2025-10-28T17:59:54.950518] [DEBUG] [LOCAL ] CMP: Primary data saved (35190 records). [2025-10-28T17:59:54.950768] [INFO ] [MAIN ] CMP: Full history saved. [2025-10-28T17:59:54.950940] [INFO ] [MAIN ] Update Progress: 480/2366 symbols completed. CMP took 19.7s. Estimated remaining: 3h 55m 13s. Rate: 8.0 symbols/min [2025-10-28T17:59:55.736698] [INFO ] [MAIN ] CMRE: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:59:55.774054] [INFO ] [MAIN ] CMS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:59:55.817095] [INFO ] [MAIN ] CMPO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:59:55.824059] [INFO ] [MAIN ] CMSA: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T17:59:55.824852] [DEBUG] [LOCAL ] CMSA: No existing data file found in primary storage. [2025-10-28T17:59:55.825164] [WARN ] [MAIN ] CMSA: No existing data found, performing full refresh instead. [2025-10-28T17:59:55.825526] [INFO ] [MAIN ] CMSA: Wiping existing primary data before full refresh. [2025-10-28T17:59:55.825734] [INFO ] [LOCAL ] CMSA: Starting deletion of primary data. [2025-10-28T17:59:55.826058] [DEBUG] [LOCAL ] CMSA: No primary data file found to delete. [2025-10-28T17:59:55.826396] [INFO ] [MAIN ] CMSA: Starting full primary refresh. [2025-10-28T17:59:56.201833] [DEBUG] [LOCAL ] CMPO: Loaded 37974 existing records from primary storage. [2025-10-28T17:59:56.232703] [DEBUG] [LOCAL ] CMS: Loaded 52509 existing records from primary storage. [2025-10-28T17:59:56.233817] [DEBUG] [LOCAL ] CMRE: Loaded 35264 existing records from primary storage. [2025-10-28T17:59:56.234692] [INFO ] [MAIN ] CMPO: Loaded 37974 existing records. [2025-10-28T17:59:56.235076] [INFO ] [MAIN ] CMRE: Loaded 35264 existing records. [2025-10-28T17:59:56.234883] [INFO ] [MAIN ] CMS: Loaded 52509 existing records. [2025-10-28T17:59:56.558419] [INFO ] [REMOTE ] CMSA: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:59:56.679962] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-01. [2025-10-28T17:59:56.976090] [WARN ] [MAIN ] CMRE: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:59:57.001575] [WARN ] [MAIN ] CMS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:59:57.042436] [INFO ] [MAIN ] CMRE: Wiping existing primary data before full refresh. [2025-10-28T17:59:57.042192] [WARN ] [MAIN ] CMPO: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T17:59:57.042682] [INFO ] [MAIN ] CMS: Wiping existing primary data before full refresh. [2025-10-28T17:59:57.043017] [INFO ] [LOCAL ] CMS: Starting deletion of primary data. [2025-10-28T17:59:57.043072] [INFO ] [LOCAL ] CMRE: Starting deletion of primary data. [2025-10-28T17:59:57.042881] [INFO ] [MAIN ] CMPO: Wiping existing primary data before full refresh. [2025-10-28T17:59:57.043324] [INFO ] [LOCAL ] CMPO: Starting deletion of primary data. [2025-10-28T17:59:57.043691] [DEBUG] [LOCAL ] CMRE: Deleted primary data file. [2025-10-28T17:59:57.043767] [INFO ] [MAIN ] CMRE: Starting full primary refresh. [2025-10-28T17:59:57.049156] [DEBUG] [LOCAL ] CMPO: Deleted primary data file. [2025-10-28T17:59:57.049279] [DEBUG] [LOCAL ] CMS: Deleted primary data file. [2025-10-28T17:59:57.069019] [INFO ] [MAIN ] CMS: Starting full primary refresh. [2025-10-28T17:59:57.062205] [INFO ] [MAIN ] CMPO: Starting full primary refresh. [2025-10-28T17:59:57.408806] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-28T17:59:57.493778] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-02. [2025-10-28T17:59:58.311934] [INFO ] [REMOTE ] CMPO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:59:58.331751] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-01. [2025-10-28T17:59:58.333098] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-28T17:59:58.338133] [INFO ] [REMOTE ] CMRE: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:59:58.362219] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-03. [2025-10-28T17:59:58.368496] [INFO ] [REMOTE ] CMS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T17:59:58.362884] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-01. [2025-10-28T17:59:58.371733] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-01. [2025-10-28T17:59:58.674127] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-03 (0.31 seconds). [2025-10-28T17:59:58.675713] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-04. [2025-10-28T17:59:59.015449] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-10-28T17:59:59.159359] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-05. [2025-10-28T17:59:59.308413] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-28T17:59:59.417501] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-28T17:59:59.621836] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-28T17:59:59.706405] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-28T17:59:59.959634] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-02. [2025-10-28T18:00:00.759427] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-06. [2025-10-28T18:00:01.559349] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-02. [2025-10-28T18:00:01.613748] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-28T18:00:02.232426] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-28T18:00:02.359377] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-07. [2025-10-28T18:00:03.159482] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-02. [2025-10-28T18:00:03.556157] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-28T18:00:03.922596] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-02 (2.36 seconds). [2025-10-28T18:00:03.959347] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-03. [2025-10-28T18:00:04.759355] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-08. [2025-10-28T18:00:04.828157] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-10-28T18:00:05.559321] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-03. [2025-10-28T18:00:05.609708] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-28T18:00:05.957037] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-28T18:00:06.359345] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-09. [2025-10-28T18:00:06.900095] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-28T18:00:07.134128] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-28T18:00:07.159313] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-04. [2025-10-28T18:00:07.959350] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-03. [2025-10-28T18:00:08.309971] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-28T18:00:08.759384] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-05. [2025-10-28T18:00:09.383326] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-28T18:00:09.559356] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-04. [2025-10-28T18:00:09.993743] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-28T18:00:10.359343] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-06. [2025-10-28T18:00:11.045968] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-28T18:00:11.159330] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-05. [2025-10-28T18:00:11.594490] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-28T18:00:11.959358] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-07. [2025-10-28T18:00:12.584433] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-28T18:00:12.759340] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-06. [2025-10-28T18:00:13.022048] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-28T18:00:13.559355] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-10. [2025-10-28T18:00:14.137037] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-28T18:00:14.138752] [INFO ] [REMOTE ] CMSA: Full fetch complete (4785 records). [2025-10-28T18:00:14.138838] [DEBUG] [VALIDATOR ] CMSA: Validating primary data. [2025-10-28T18:00:14.360220] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-04. [2025-10-28T18:00:14.508835] [DEBUG] [VALIDATOR ] CMSA: All expected trading days are present. [2025-10-28T18:00:14.508917] [DEBUG] [VALIDATOR ] CMSA: Primary data validation passed. [2025-10-28T18:00:14.509078] [INFO ] [MAIN ] CMSA: Fetched primary data is valid. [2025-10-28T18:00:14.509117] [DEBUG] [LOCAL ] CMSA: Saving primary data. [2025-10-28T18:00:14.509496] [DEBUG] [LOCAL ] CMSA: Trimmed 4785 records to 3430 (keeping 200 days of data) [2025-10-28T18:00:14.529679] [DEBUG] [LOCAL ] CMSA: Primary data saved (3430 records). [2025-10-28T18:00:14.529765] [INFO ] [MAIN ] CMSA: Full history saved. [2025-10-28T18:00:14.529842] [INFO ] [MAIN ] Update Progress: 481/2366 symbols completed. CMSA took 19.6s. Estimated remaining: 3h 55m 53s. Rate: 8.0 symbols/min [2025-10-28T18:00:14.700012] [INFO ] [MAIN ] CMSC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:00:14.700810] [DEBUG] [LOCAL ] CMSC: No existing data file found in primary storage. [2025-10-28T18:00:14.700862] [WARN ] [MAIN ] CMSC: No existing data found, performing full refresh instead. [2025-10-28T18:00:14.701043] [INFO ] [MAIN ] CMSC: Wiping existing primary data before full refresh. [2025-10-28T18:00:14.701096] [INFO ] [LOCAL ] CMSC: Starting deletion of primary data. [2025-10-28T18:00:14.701138] [DEBUG] [LOCAL ] CMSC: No primary data file found to delete. [2025-10-28T18:00:14.701169] [INFO ] [MAIN ] CMSC: Starting full primary refresh. [2025-10-28T18:00:15.053573] [INFO ] [REMOTE ] CMSC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:00:15.159328] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-01. [2025-10-28T18:00:15.403611] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-06 (2.64 seconds). [2025-10-28T18:00:15.651991] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-28T18:00:15.652142] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-28T18:00:15.959353] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-08. [2025-10-28T18:00:16.759333] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-05. [2025-10-28T18:00:17.417109] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-28T18:00:17.559335] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-02. [2025-10-28T18:00:17.763909] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-28T18:00:17.864620] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-10-28T18:00:18.359333] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-07. [2025-10-28T18:00:19.159327] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-06. [2025-10-28T18:00:19.959306] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-03. [2025-10-28T18:00:20.176818] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-28T18:00:20.309046] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-10-28T18:00:20.404838] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-28T18:00:20.759337] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-08. [2025-10-28T18:00:21.559342] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-07. [2025-10-28T18:00:22.026324] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-28T18:00:22.359316] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-09. [2025-10-28T18:00:22.546928] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-28T18:00:23.159345] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-08. [2025-10-28T18:00:23.549710] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-28T18:00:23.959348] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-09. [2025-10-28T18:00:24.341044] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-28T18:00:24.759359] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-04. [2025-10-28T18:00:25.042032] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-28T18:00:25.338810] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-28T18:00:25.559321] [INFO ] [REMOTE ] CMPO: Fetching primary data for 2025-10. [2025-10-28T18:00:26.359335] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-09. [2025-10-28T18:00:26.625894] [INFO ] [REMOTE ] CMPO: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-28T18:00:26.632666] [INFO ] [REMOTE ] CMPO: Full fetch complete (57766 records). [2025-10-28T18:00:26.632798] [DEBUG] [VALIDATOR ] CMPO: Validating primary data. [2025-10-28T18:00:27.028706] [DEBUG] [VALIDATOR ] CMPO: All expected trading days are present. [2025-10-28T18:00:27.028798] [DEBUG] [VALIDATOR ] CMPO: Primary data validation passed. [2025-10-28T18:00:27.029470] [INFO ] [MAIN ] CMPO: Fetched primary data is valid. [2025-10-28T18:00:27.029512] [DEBUG] [LOCAL ] CMPO: Saving primary data. [2025-10-28T18:00:27.030907] [DEBUG] [LOCAL ] CMPO: Trimmed 57766 records to 37862 (keeping 200 days of data) [2025-10-28T18:00:27.192690] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-05. [2025-10-28T18:00:27.255986] [DEBUG] [LOCAL ] CMPO: Primary data saved (37862 records). [2025-10-28T18:00:27.256121] [INFO ] [MAIN ] CMPO: Full history saved. [2025-10-28T18:00:27.256200] [INFO ] [MAIN ] Update Progress: 482/2366 symbols completed. CMPO took 32.3s. Estimated remaining: 3h 56m 6s. Rate: 8.0 symbols/min [2025-10-28T18:00:27.441089] [INFO ] [MAIN ] CMSD: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:00:27.449075] [DEBUG] [LOCAL ] CMSD: Loaded 7446 existing records from primary storage. [2025-10-28T18:00:27.449248] [INFO ] [MAIN ] CMSD: Loaded 7446 existing records. [2025-10-28T18:00:27.602009] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-28T18:00:27.663889] [WARN ] [MAIN ] CMSD: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:00:27.664459] [INFO ] [MAIN ] CMSD: Wiping existing primary data before full refresh. [2025-10-28T18:00:27.664616] [INFO ] [LOCAL ] CMSD: Starting deletion of primary data. [2025-10-28T18:00:27.664959] [DEBUG] [LOCAL ] CMSD: Deleted primary data file. [2025-10-28T18:00:27.665016] [INFO ] [MAIN ] CMSD: Starting full primary refresh. [2025-10-28T18:00:27.768504] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-28T18:00:27.964445] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-10. [2025-10-28T18:00:28.032225] [INFO ] [REMOTE ] CMSD: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:00:28.759372] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-06. [2025-10-28T18:00:29.150488] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-10-28T18:00:29.458857] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-28T18:00:29.469980] [INFO ] [REMOTE ] CMS: Full fetch complete (75890 records). [2025-10-28T18:00:29.470181] [DEBUG] [VALIDATOR ] CMS: Validating primary data. [2025-10-28T18:00:29.471279] [FATAL] [VALIDATOR ] CMS: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T18:00:29.471388] [FATAL] [MAIN ] CMS: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:00:29.471437] [WARN ] [MAIN ] CMS: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:00:29.471480] [INFO ] [LOCAL ] CMS: Starting deletion of primary data. [2025-10-28T18:00:29.471547] [DEBUG] [LOCAL ] CMS: No primary data file found to delete. [2025-10-28T18:00:29.471586] [INFO ] [LOCAL ] CMS: Starting deletion of derivative data. [2025-10-28T18:00:29.471810] [DEBUG] [LOCAL ] CMS: Deleted derivative data file. [2025-10-28T18:00:29.472398] [INFO ] [MAIN ] Update Progress: 483/2366 symbols completed. CMS took 34.5s. Estimated remaining: 3h 55m 38s. Rate: 8.0 symbols/min [2025-10-28T18:00:29.564584] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-01. [2025-10-28T18:00:29.653618] [INFO ] [MAIN ] CMTG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:00:29.653922] [DEBUG] [LOCAL ] CMTG: No existing data file found in primary storage. [2025-10-28T18:00:29.653974] [WARN ] [MAIN ] CMTG: No existing data found, performing full refresh instead. [2025-10-28T18:00:29.654101] [INFO ] [MAIN ] CMTG: Wiping existing primary data before full refresh. [2025-10-28T18:00:29.654172] [INFO ] [LOCAL ] CMTG: Starting deletion of primary data. [2025-10-28T18:00:29.654243] [DEBUG] [LOCAL ] CMTG: No primary data file found to delete. [2025-10-28T18:00:29.654281] [INFO ] [MAIN ] CMTG: Starting full primary refresh. [2025-10-28T18:00:30.021167] [INFO ] [REMOTE ] CMTG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:00:30.195264] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-28T18:00:30.359368] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-07. [2025-10-28T18:00:30.734731] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-10-28T18:00:31.159403] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-02. [2025-10-28T18:00:31.560835] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-28T18:00:31.959371] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-03. [2025-10-28T18:00:32.486261] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-28T18:00:32.759413] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-08. [2025-10-28T18:00:33.140365] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-10-28T18:00:33.559345] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-10. [2025-10-28T18:00:34.359377] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-09. [2025-10-28T18:00:34.623684] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-28T18:00:34.631133] [INFO ] [REMOTE ] CMRE: Full fetch complete (51145 records). [2025-10-28T18:00:34.631269] [DEBUG] [VALIDATOR ] CMRE: Validating primary data. [2025-10-28T18:00:34.748372] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-10-28T18:00:35.016299] [DEBUG] [VALIDATOR ] CMRE: All expected trading days are present. [2025-10-28T18:00:35.016387] [DEBUG] [VALIDATOR ] CMRE: Primary data validation passed. [2025-10-28T18:00:35.017031] [INFO ] [MAIN ] CMRE: Fetched primary data is valid. [2025-10-28T18:00:35.017125] [DEBUG] [LOCAL ] CMRE: Saving primary data. [2025-10-28T18:00:35.018266] [DEBUG] [LOCAL ] CMRE: Trimmed 51145 records to 35169 (keeping 200 days of data) [2025-10-28T18:00:35.170915] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-10. [2025-10-28T18:00:35.224415] [DEBUG] [LOCAL ] CMRE: Primary data saved (35169 records). [2025-10-28T18:00:35.224531] [INFO ] [MAIN ] CMRE: Full history saved. [2025-10-28T18:00:35.224611] [INFO ] [MAIN ] Update Progress: 484/2366 symbols completed. CMRE took 40.3s. Estimated remaining: 3h 55m 24s. Rate: 8.0 symbols/min [2025-10-28T18:00:35.393537] [INFO ] [MAIN ] CMU: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:00:35.401103] [DEBUG] [LOCAL ] CMU: Loaded 6086 existing records from primary storage. [2025-10-28T18:00:35.401288] [INFO ] [MAIN ] CMU: Loaded 6086 existing records. [2025-10-28T18:00:35.573633] [WARN ] [MAIN ] CMU: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:00:35.573821] [INFO ] [MAIN ] CMU: Wiping existing primary data before full refresh. [2025-10-28T18:00:35.573918] [INFO ] [LOCAL ] CMU: Starting deletion of primary data. [2025-10-28T18:00:35.574080] [DEBUG] [LOCAL ] CMU: Deleted primary data file. [2025-10-28T18:00:35.574121] [INFO ] [MAIN ] CMU: Starting full primary refresh. [2025-10-28T18:00:35.678469] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-28T18:00:35.685448] [INFO ] [REMOTE ] CMSC: Full fetch complete (6831 records). [2025-10-28T18:00:35.695754] [DEBUG] [VALIDATOR ] CMSC: Validating primary data. [2025-10-28T18:00:35.718759] [FATAL] [VALIDATOR ] CMSC: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T18:00:35.728813] [FATAL] [MAIN ] CMSC: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:00:35.737477] [WARN ] [MAIN ] CMSC: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:00:35.752970] [INFO ] [LOCAL ] CMSC: Starting deletion of primary data. [2025-10-28T18:00:35.819056] [DEBUG] [LOCAL ] CMSC: No primary data file found to delete. [2025-10-28T18:00:35.824664] [INFO ] [LOCAL ] CMSC: Starting deletion of derivative data. [2025-10-28T18:00:35.846275] [DEBUG] [LOCAL ] CMSC: No derivative data file found to delete. [2025-10-28T18:00:35.854155] [INFO ] [MAIN ] Update Progress: 485/2366 symbols completed. CMSC took 21.3s. Estimated remaining: 3h 54m 50s. Rate: 8.0 symbols/min [2025-10-28T18:00:35.961071] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-04. [2025-10-28T18:00:36.032062] [INFO ] [REMOTE ] CMU: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:00:36.100292] [INFO ] [MAIN ] CNA: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:00:36.128349] [DEBUG] [LOCAL ] CNA: Loaded 32238 existing records from primary storage. [2025-10-28T18:00:36.128621] [INFO ] [MAIN ] CNA: Loaded 32238 existing records. [2025-10-28T18:00:36.322397] [WARN ] [MAIN ] CNA: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:00:36.322612] [INFO ] [MAIN ] CNA: Wiping existing primary data before full refresh. [2025-10-28T18:00:36.322687] [INFO ] [LOCAL ] CNA: Starting deletion of primary data. [2025-10-28T18:00:36.323307] [DEBUG] [LOCAL ] CNA: Deleted primary data file. [2025-10-28T18:00:36.323364] [INFO ] [MAIN ] CNA: Starting full primary refresh. [2025-10-28T18:00:36.702325] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-28T18:00:36.764554] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-01. [2025-10-28T18:00:36.864788] [INFO ] [REMOTE ] CNA: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:00:37.559353] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-05. [2025-10-28T18:00:38.107459] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-28T18:00:38.122543] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-28T18:00:38.359321] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-01. [2025-10-28T18:00:38.862902] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-10-28T18:00:39.159320] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-02. [2025-10-28T18:00:39.587029] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-28T18:00:39.959410] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-03. [2025-10-28T18:00:40.490011] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-28T18:00:40.759341] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-04. [2025-10-28T18:00:41.327597] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-28T18:00:41.559347] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-05. [2025-10-28T18:00:41.920500] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-10-28T18:00:42.359356] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-01. [2025-10-28T18:00:43.159397] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-06. [2025-10-28T18:00:43.619120] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-28T18:00:43.625296] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-28T18:00:43.959366] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-07. [2025-10-28T18:00:44.522477] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-28T18:00:44.759369] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-08. [2025-10-28T18:00:45.230022] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-28T18:00:45.559373] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-09. [2025-10-28T18:00:45.963519] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-10-28T18:00:46.359330] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-06. [2025-10-28T18:00:46.977994] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-28T18:00:47.159341] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-07. [2025-10-28T18:00:47.651291] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-28T18:00:47.959350] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-08. [2025-10-28T18:00:48.759388] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-02. [2025-10-28T18:00:48.802910] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-28T18:00:49.559340] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-10. [2025-10-28T18:00:50.148298] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-28T18:00:50.149585] [INFO ] [REMOTE ] CMU: Full fetch complete (9425 records). [2025-10-28T18:00:50.149688] [DEBUG] [VALIDATOR ] CMU: Validating primary data. [2025-10-28T18:00:50.150115] [FATAL] [VALIDATOR ] CMU: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T18:00:50.150207] [FATAL] [MAIN ] CMU: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:00:50.150276] [WARN ] [MAIN ] CMU: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:00:50.150358] [INFO ] [LOCAL ] CMU: Starting deletion of primary data. [2025-10-28T18:00:50.150434] [DEBUG] [LOCAL ] CMU: No primary data file found to delete. [2025-10-28T18:00:50.150485] [INFO ] [LOCAL ] CMU: Starting deletion of derivative data. [2025-10-28T18:00:50.150680] [DEBUG] [LOCAL ] CMU: Deleted derivative data file. [2025-10-28T18:00:50.150787] [INFO ] [MAIN ] Update Progress: 486/2366 symbols completed. CMU took 14.9s. Estimated remaining: 3h 55m 8s. Rate: 8.0 symbols/min [2025-10-28T18:00:50.330460] [INFO ] [MAIN ] CNC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:00:50.359312] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-09. [2025-10-28T18:00:50.381612] [DEBUG] [LOCAL ] CNC: Loaded 53779 existing records from primary storage. [2025-10-28T18:00:50.381979] [INFO ] [MAIN ] CNC: Loaded 53779 existing records. [2025-10-28T18:00:50.571525] [WARN ] [MAIN ] CNC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:00:50.571844] [INFO ] [MAIN ] CNC: Wiping existing primary data before full refresh. [2025-10-28T18:00:50.571895] [INFO ] [LOCAL ] CNC: Starting deletion of primary data. [2025-10-28T18:00:50.572398] [DEBUG] [LOCAL ] CNC: Deleted primary data file. [2025-10-28T18:00:50.572468] [INFO ] [MAIN ] CNC: Starting full primary refresh. [2025-10-28T18:00:50.820828] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-10-28T18:00:50.873145] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-28T18:00:50.972557] [INFO ] [REMOTE ] CNC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:00:51.159345] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-01. [2025-10-28T18:00:51.959340] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-02. [2025-10-28T18:00:52.394615] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-28T18:00:52.759306] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-02. [2025-10-28T18:00:52.864714] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-28T18:00:53.559339] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-10. [2025-10-28T18:00:54.010740] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-28T18:00:54.158337] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-28T18:00:54.160029] [INFO ] [REMOTE ] CMSD: Full fetch complete (11359 records). [2025-10-28T18:00:54.160098] [DEBUG] [VALIDATOR ] CMSD: Validating primary data. [2025-10-28T18:00:54.368691] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-03. [2025-10-28T18:00:54.521489] [DEBUG] [VALIDATOR ] CMSD: All expected trading days are present. [2025-10-28T18:00:54.521567] [DEBUG] [VALIDATOR ] CMSD: Primary data validation passed. [2025-10-28T18:00:54.521869] [INFO ] [MAIN ] CMSD: Fetched primary data is valid. [2025-10-28T18:00:54.521930] [DEBUG] [LOCAL ] CMSD: Saving primary data. [2025-10-28T18:00:54.522369] [DEBUG] [LOCAL ] CMSD: Trimmed 11359 records to 7410 (keeping 200 days of data) [2025-10-28T18:00:54.566297] [DEBUG] [LOCAL ] CMSD: Primary data saved (7410 records). [2025-10-28T18:00:54.566420] [INFO ] [MAIN ] CMSD: Full history saved. [2025-10-28T18:00:54.566494] [INFO ] [MAIN ] Update Progress: 487/2366 symbols completed. CMSD took 27.3s. Estimated remaining: 3h 54m 49s. Rate: 8.0 symbols/min [2025-10-28T18:00:54.733399] [INFO ] [MAIN ] CNF: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:00:54.743579] [DEBUG] [LOCAL ] CNF: Loaded 10606 existing records from primary storage. [2025-10-28T18:00:54.743819] [INFO ] [MAIN ] CNF: Loaded 10606 existing records. [2025-10-28T18:00:54.917639] [WARN ] [MAIN ] CNF: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:00:54.917881] [INFO ] [MAIN ] CNF: Wiping existing primary data before full refresh. [2025-10-28T18:00:54.917929] [INFO ] [LOCAL ] CNF: Starting deletion of primary data. [2025-10-28T18:00:54.918213] [DEBUG] [LOCAL ] CNF: Deleted primary data file. [2025-10-28T18:00:54.918272] [INFO ] [MAIN ] CNF: Starting full primary refresh. [2025-10-28T18:00:55.164500] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-03. [2025-10-28T18:00:55.298215] [INFO ] [REMOTE ] CNF: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:00:55.959400] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-01. [2025-10-28T18:00:55.969017] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-28T18:00:56.171589] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-28T18:00:56.489961] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-28T18:00:56.759344] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-04. [2025-10-28T18:00:57.559332] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-03. [2025-10-28T18:00:58.278962] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-28T18:00:58.359311] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-05. [2025-10-28T18:00:58.842318] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-28T18:00:59.159325] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-02. [2025-10-28T18:00:59.503393] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-10-28T18:00:59.959338] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-04. [2025-10-28T18:01:00.759326] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-03. [2025-10-28T18:01:01.559379] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-04. [2025-10-28T18:01:02.131066] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-28T18:01:02.359337] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-04. [2025-10-28T18:01:02.823576] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-05 (4.46 seconds). [2025-10-28T18:01:03.159314] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-06. [2025-10-28T18:01:03.271702] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-10-28T18:01:03.271506] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-28T18:01:03.959324] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-05. [2025-10-28T18:01:04.025532] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-04 (4.07 seconds). [2025-10-28T18:01:04.536197] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-28T18:01:04.759308] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-06. [2025-10-28T18:01:05.388580] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-28T18:01:05.559314] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-07. [2025-10-28T18:01:06.073400] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-28T18:01:06.371345] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-05. [2025-10-28T18:01:06.377827] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-06 (3.22 seconds). [2025-10-28T18:01:07.159341] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-08. [2025-10-28T18:01:07.472285] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-28T18:01:07.896832] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-28T18:01:07.959314] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-09. [2025-10-28T18:01:08.759306] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-06. [2025-10-28T18:01:09.009367] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-28T18:01:09.559349] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-05. [2025-10-28T18:01:09.794376] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-28T18:01:10.359407] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-10. [2025-10-28T18:01:10.963794] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-28T18:01:10.979173] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-28T18:01:10.981425] [INFO ] [REMOTE ] CNF: Full fetch complete (12903 records). [2025-10-28T18:01:10.981507] [DEBUG] [VALIDATOR ] CNF: Validating primary data. [2025-10-28T18:01:11.167554] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-06. [2025-10-28T18:01:11.348805] [DEBUG] [VALIDATOR ] CNF: All expected trading days are present. [2025-10-28T18:01:11.348886] [DEBUG] [VALIDATOR ] CNF: Primary data validation passed. [2025-10-28T18:01:11.349260] [INFO ] [MAIN ] CNF: Fetched primary data is valid. [2025-10-28T18:01:11.349299] [DEBUG] [LOCAL ] CNF: Saving primary data. [2025-10-28T18:01:11.349809] [DEBUG] [LOCAL ] CNF: Trimmed 12903 records to 10607 (keeping 200 days of data) [2025-10-28T18:01:11.406067] [DEBUG] [LOCAL ] CNF: Primary data saved (10607 records). [2025-10-28T18:01:11.406195] [INFO ] [MAIN ] CNF: Full history saved. [2025-10-28T18:01:11.406274] [INFO ] [MAIN ] Update Progress: 488/2366 symbols completed. CNF took 16.8s. Estimated remaining: 3h 55m 17s. Rate: 8.0 symbols/min [2025-10-28T18:01:11.574008] [INFO ] [MAIN ] CNH: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:01:11.574202] [DEBUG] [LOCAL ] CNH: No existing data file found in primary storage. [2025-10-28T18:01:11.574238] [WARN ] [MAIN ] CNH: No existing data found, performing full refresh instead. [2025-10-28T18:01:11.574344] [INFO ] [MAIN ] CNH: Wiping existing primary data before full refresh. [2025-10-28T18:01:11.574385] [INFO ] [LOCAL ] CNH: Starting deletion of primary data. [2025-10-28T18:01:11.574423] [DEBUG] [LOCAL ] CNH: No primary data file found to delete. [2025-10-28T18:01:11.574454] [INFO ] [MAIN ] CNH: Starting full primary refresh. [2025-10-28T18:01:11.919530] [INFO ] [REMOTE ] CNH: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:01:11.959323] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-01. [2025-10-28T18:01:12.759350] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-07. [2025-10-28T18:01:13.339640] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-06 (2.17 seconds). [2025-10-28T18:01:13.439933] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-28T18:01:13.559308] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-02. [2025-10-28T18:01:13.802975] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-28T18:01:14.359326] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-07. [2025-10-28T18:01:15.159320] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-07. [2025-10-28T18:01:15.648536] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-10-28T18:01:15.959389] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-03. [2025-10-28T18:01:16.192733] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-28T18:01:16.759322] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-08. [2025-10-28T18:01:17.204193] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-28T18:01:17.559399] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-08. [2025-10-28T18:01:18.356452] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-07 (4.00 seconds). [2025-10-28T18:01:18.367530] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-04. [2025-10-28T18:01:19.159348] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-08. [2025-10-28T18:01:19.339700] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-08 (2.58 seconds). [2025-10-28T18:01:19.574497] [DEBUG] [REMOTE ] CNA: Error fetching primary data for 2025-08: ("Connection broken: ConnectionResetError(104, 'Connection reset by peer')", ConnectionResetError(104, 'Connection reset by peer')) [2025-10-28T18:01:19.574620] [WARN ] [REMOTE ] CNA: No data returned for month 2025-08 [2025-10-28T18:01:19.574710] [FATAL] [REMOTE ] CNA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-28T18:01:19.574752] [FATAL] [MAIN ] CNA: Failed to fetch primary data. [2025-10-28T18:01:19.574815] [WARN ] [MAIN ] CNA: Deleting existing primary and derivative data due to fetch failure. [2025-10-28T18:01:19.574882] [INFO ] [LOCAL ] CNA: Starting deletion of primary data. [2025-10-28T18:01:19.574940] [DEBUG] [LOCAL ] CNA: No primary data file found to delete. [2025-10-28T18:01:19.574976] [INFO ] [LOCAL ] CNA: Starting deletion of derivative data. [2025-10-28T18:01:19.575148] [DEBUG] [LOCAL ] CNA: Deleted derivative data file. [2025-10-28T18:01:19.575215] [INFO ] [MAIN ] Update Progress: 489/2366 symbols completed. CNA took 43.7s. Estimated remaining: 3h 55m 12s. Rate: 8.0 symbols/min [2025-10-28T18:01:19.742859] [INFO ] [MAIN ] CNI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:01:19.788016] [DEBUG] [LOCAL ] CNI: Loaded 51583 existing records from primary storage. [2025-10-28T18:01:19.788448] [INFO ] [MAIN ] CNI: Loaded 51583 existing records. [2025-10-28T18:01:19.961533] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-09. [2025-10-28T18:01:19.967236] [WARN ] [MAIN ] CNI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:01:19.967693] [INFO ] [MAIN ] CNI: Wiping existing primary data before full refresh. [2025-10-28T18:01:19.967788] [INFO ] [LOCAL ] CNI: Starting deletion of primary data. [2025-10-28T18:01:19.969352] [DEBUG] [LOCAL ] CNI: Deleted primary data file. [2025-10-28T18:01:19.969416] [INFO ] [MAIN ] CNI: Starting full primary refresh. [2025-10-28T18:01:20.124969] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-28T18:01:20.380261] [INFO ] [REMOTE ] CNI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:01:20.759321] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-05. [2025-10-28T18:01:20.821044] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-28T18:01:20.902296] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-28T18:01:21.559321] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-10. [2025-10-28T18:01:22.197676] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-28T18:01:22.247412] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-28T18:01:22.252856] [INFO ] [REMOTE ] CMTG: Full fetch complete (52340 records). [2025-10-28T18:01:22.252955] [DEBUG] [VALIDATOR ] CMTG: Validating primary data. [2025-10-28T18:01:22.253564] [FATAL] [VALIDATOR ] CMTG: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T18:01:22.253691] [FATAL] [MAIN ] CMTG: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:01:22.253758] [WARN ] [MAIN ] CMTG: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:01:22.253836] [INFO ] [LOCAL ] CMTG: Starting deletion of primary data. [2025-10-28T18:01:22.253899] [DEBUG] [LOCAL ] CMTG: No primary data file found to delete. [2025-10-28T18:01:22.253936] [INFO ] [LOCAL ] CMTG: Starting deletion of derivative data. [2025-10-28T18:01:22.253976] [DEBUG] [LOCAL ] CMTG: No derivative data file found to delete. [2025-10-28T18:01:22.254029] [INFO ] [MAIN ] Update Progress: 490/2366 symbols completed. CMTG took 52.8s. Estimated remaining: 3h 54m 46s. Rate: 8.0 symbols/min [2025-10-28T18:01:22.364477] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-06. [2025-10-28T18:01:22.430805] [INFO ] [MAIN ] CNK: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:01:22.481410] [DEBUG] [LOCAL ] CNK: Loaded 52892 existing records from primary storage. [2025-10-28T18:01:22.481732] [INFO ] [MAIN ] CNK: Loaded 52892 existing records. [2025-10-28T18:01:22.661065] [WARN ] [MAIN ] CNK: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:01:22.661296] [INFO ] [MAIN ] CNK: Wiping existing primary data before full refresh. [2025-10-28T18:01:22.661343] [INFO ] [LOCAL ] CNK: Starting deletion of primary data. [2025-10-28T18:01:22.662300] [DEBUG] [LOCAL ] CNK: Deleted primary data file. [2025-10-28T18:01:22.662358] [INFO ] [MAIN ] CNK: Starting full primary refresh. [2025-10-28T18:01:23.015562] [INFO ] [REMOTE ] CNK: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:01:23.159306] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-01. [2025-10-28T18:01:23.894546] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-28T18:01:23.959426] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-09. [2025-10-28T18:01:24.420491] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-28T18:01:24.759328] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-02. [2025-10-28T18:01:25.559365] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-01. [2025-10-28T18:01:26.359349] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-07. [2025-10-28T18:01:26.456975] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-09 (2.50 seconds). [2025-10-28T18:01:27.152086] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-02 (2.39 seconds). [2025-10-28T18:01:27.163031] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-10. [2025-10-28T18:01:27.442029] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-28T18:01:27.721361] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-28T18:01:27.732569] [INFO ] [REMOTE ] CNC: Full fetch complete (77866 records). [2025-10-28T18:01:27.732759] [DEBUG] [VALIDATOR ] CNC: Validating primary data. [2025-10-28T18:01:27.964673] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-02. [2025-10-28T18:01:28.145424] [DEBUG] [VALIDATOR ] CNC: All expected trading days are present. [2025-10-28T18:01:28.145507] [DEBUG] [VALIDATOR ] CNC: Primary data validation passed. [2025-10-28T18:01:28.146371] [INFO ] [MAIN ] CNC: Fetched primary data is valid. [2025-10-28T18:01:28.146455] [DEBUG] [LOCAL ] CNC: Saving primary data. [2025-10-28T18:01:28.178234] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-28T18:01:28.190676] [DEBUG] [LOCAL ] CNC: Trimmed 77866 records to 53779 (keeping 200 days of data) [2025-10-28T18:01:28.496881] [DEBUG] [LOCAL ] CNC: Primary data saved (53779 records). [2025-10-28T18:01:28.497008] [INFO ] [MAIN ] CNC: Full history saved. [2025-10-28T18:01:28.497103] [INFO ] [MAIN ] Update Progress: 491/2366 symbols completed. CNC took 38.3s. Estimated remaining: 3h 54m 34s. Rate: 8.0 symbols/min [2025-10-28T18:01:28.665584] [INFO ] [MAIN ] CNM: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:01:28.712368] [DEBUG] [LOCAL ] CNM: Loaded 50952 existing records from primary storage. [2025-10-28T18:01:28.712889] [INFO ] [MAIN ] CNM: Loaded 50952 existing records. [2025-10-28T18:01:28.766328] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-03. [2025-10-28T18:01:28.889549] [WARN ] [MAIN ] CNM: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:01:28.889795] [INFO ] [MAIN ] CNM: Wiping existing primary data before full refresh. [2025-10-28T18:01:28.889843] [INFO ] [LOCAL ] CNM: Starting deletion of primary data. [2025-10-28T18:01:28.890248] [DEBUG] [LOCAL ] CNM: Deleted primary data file. [2025-10-28T18:01:28.890305] [INFO ] [MAIN ] CNM: Starting full primary refresh. [2025-10-28T18:01:29.249191] [INFO ] [REMOTE ] CNM: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:01:29.317751] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-28T18:01:29.559331] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-03. [2025-10-28T18:01:30.232227] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-28T18:01:30.359338] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-04. [2025-10-28T18:01:31.159348] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-08. [2025-10-28T18:01:31.489789] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-28T18:01:31.707815] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-28T18:01:31.959440] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-04. [2025-10-28T18:01:32.723330] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-28T18:01:32.759343] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-09. [2025-10-28T18:01:33.206510] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-28T18:01:33.559337] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-05. [2025-10-28T18:01:34.234951] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-28T18:01:34.359368] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-10. [2025-10-28T18:01:35.019844] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-28T18:01:35.159358] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-05. [2025-10-28T18:01:35.862698] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-28T18:01:35.873520] [INFO ] [REMOTE ] CNH: Full fetch complete (77702 records). [2025-10-28T18:01:35.873743] [DEBUG] [VALIDATOR ] CNH: Validating primary data. [2025-10-28T18:01:35.967363] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-01. [2025-10-28T18:01:36.274607] [DEBUG] [VALIDATOR ] CNH: All expected trading days are present. [2025-10-28T18:01:36.274753] [DEBUG] [VALIDATOR ] CNH: Primary data validation passed. [2025-10-28T18:01:36.275729] [INFO ] [MAIN ] CNH: Fetched primary data is valid. [2025-10-28T18:01:36.275795] [DEBUG] [LOCAL ] CNH: Saving primary data. [2025-10-28T18:01:36.277514] [DEBUG] [LOCAL ] CNH: Trimmed 77702 records to 53539 (keeping 200 days of data) [2025-10-28T18:01:36.593349] [DEBUG] [LOCAL ] CNH: Primary data saved (53539 records). [2025-10-28T18:01:36.593467] [INFO ] [MAIN ] CNH: Full history saved. [2025-10-28T18:01:36.593579] [INFO ] [MAIN ] Update Progress: 492/2366 symbols completed. CNH took 25.2s. Estimated remaining: 3h 54m 29s. Rate: 8.0 symbols/min [2025-10-28T18:01:36.768092] [INFO ] [MAIN ] CNMD: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:01:36.765476] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-06. [2025-10-28T18:01:36.800157] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-28T18:01:36.831969] [DEBUG] [LOCAL ] CNMD: Loaded 31736 existing records from primary storage. [2025-10-28T18:01:36.832221] [INFO ] [MAIN ] CNMD: Loaded 31736 existing records. [2025-10-28T18:01:37.007749] [WARN ] [MAIN ] CNMD: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:01:37.008097] [INFO ] [MAIN ] CNMD: Wiping existing primary data before full refresh. [2025-10-28T18:01:37.008158] [INFO ] [LOCAL ] CNMD: Starting deletion of primary data. [2025-10-28T18:01:37.008902] [DEBUG] [LOCAL ] CNMD: Deleted primary data file. [2025-10-28T18:01:37.008961] [INFO ] [MAIN ] CNMD: Starting full primary refresh. [2025-10-28T18:01:37.364970] [INFO ] [REMOTE ] CNMD: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:01:37.393721] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-28T18:01:37.559312] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-01. [2025-10-28T18:01:38.359341] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-02. [2025-10-28T18:01:39.159329] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-06. [2025-10-28T18:01:39.285046] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-28T18:01:39.450346] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-06 (2.68 seconds). [2025-10-28T18:01:39.568202] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-28T18:01:39.959359] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-07. [2025-10-28T18:01:40.759307] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-03. [2025-10-28T18:01:40.812890] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-28T18:01:41.357154] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-28T18:01:41.559335] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-08. [2025-10-28T18:01:41.884820] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-28T18:01:42.359336] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-04. [2025-10-28T18:01:42.826871] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-28T18:01:43.159348] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-09. [2025-10-28T18:01:43.959324] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-07. [2025-10-28T18:01:44.751121] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-04 (2.39 seconds). [2025-10-28T18:01:44.762719] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-02. [2025-10-28T18:01:44.827384] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-28T18:01:45.559355] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-05. [2025-10-28T18:01:45.921164] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-28T18:01:45.966676] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-28T18:01:46.359394] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-03. [2025-10-28T18:01:47.159356] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-08. [2025-10-28T18:01:47.270404] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-10-28T18:01:47.514213] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-28T18:01:47.959351] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-10. [2025-10-28T18:01:48.373363] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-28T18:01:48.759324] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-04. [2025-10-28T18:01:49.405327] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-28T18:01:49.415723] [INFO ] [REMOTE ] CNI: Full fetch complete (74801 records). [2025-10-28T18:01:49.415881] [DEBUG] [VALIDATOR ] CNI: Validating primary data. [2025-10-28T18:01:49.564427] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-09. [2025-10-28T18:01:49.825682] [DEBUG] [VALIDATOR ] CNI: All expected trading days are present. [2025-10-28T18:01:49.825913] [DEBUG] [VALIDATOR ] CNI: Primary data validation passed. [2025-10-28T18:01:49.826828] [INFO ] [MAIN ] CNI: Fetched primary data is valid. [2025-10-28T18:01:49.826911] [DEBUG] [LOCAL ] CNI: Saving primary data. [2025-10-28T18:01:49.828423] [DEBUG] [LOCAL ] CNI: Trimmed 74801 records to 51538 (keeping 200 days of data) [2025-10-28T18:01:50.074526] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-28T18:01:50.171629] [DEBUG] [LOCAL ] CNI: Primary data saved (51538 records). [2025-10-28T18:01:50.171803] [INFO ] [MAIN ] CNI: Full history saved. [2025-10-28T18:01:50.171884] [INFO ] [MAIN ] Update Progress: 493/2366 symbols completed. CNI took 30.6s. Estimated remaining: 3h 54m 44s. Rate: 8.0 symbols/min [2025-10-28T18:01:50.341409] [INFO ] [MAIN ] CNNE: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:01:50.341623] [DEBUG] [LOCAL ] CNNE: No existing data file found in primary storage. [2025-10-28T18:01:50.341700] [WARN ] [MAIN ] CNNE: No existing data found, performing full refresh instead. [2025-10-28T18:01:50.341812] [INFO ] [MAIN ] CNNE: Wiping existing primary data before full refresh. [2025-10-28T18:01:50.341872] [INFO ] [LOCAL ] CNNE: Starting deletion of primary data. [2025-10-28T18:01:50.341915] [DEBUG] [LOCAL ] CNNE: No primary data file found to delete. [2025-10-28T18:01:50.341946] [INFO ] [MAIN ] CNNE: Starting full primary refresh. [2025-10-28T18:01:50.364432] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-06. [2025-10-28T18:01:50.696848] [INFO ] [REMOTE ] CNNE: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:01:50.921320] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-28T18:01:51.159344] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-05. [2025-10-28T18:01:51.704983] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-28T18:01:51.959450] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-07. [2025-10-28T18:01:52.102222] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-28T18:01:52.759333] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-01. [2025-10-28T18:01:53.491304] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-28T18:01:53.559309] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-06. [2025-10-28T18:01:53.670522] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-28T18:01:54.359377] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-10. [2025-10-28T18:01:54.720171] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-28T18:01:55.159334] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-07. [2025-10-28T18:01:55.653100] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-28T18:01:55.663391] [INFO ] [REMOTE ] CNK: Full fetch complete (75990 records). [2025-10-28T18:01:55.663526] [DEBUG] [VALIDATOR ] CNK: Validating primary data. [2025-10-28T18:01:55.664359] [FATAL] [VALIDATOR ] CNK: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T18:01:55.664447] [FATAL] [MAIN ] CNK: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:01:55.664489] [WARN ] [MAIN ] CNK: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:01:55.664552] [INFO ] [LOCAL ] CNK: Starting deletion of primary data. [2025-10-28T18:01:55.664615] [DEBUG] [LOCAL ] CNK: No primary data file found to delete. [2025-10-28T18:01:55.664678] [INFO ] [LOCAL ] CNK: Starting deletion of derivative data. [2025-10-28T18:01:55.664872] [DEBUG] [LOCAL ] CNK: Deleted derivative data file. [2025-10-28T18:01:55.665175] [INFO ] [MAIN ] Update Progress: 494/2366 symbols completed. CNK took 33.4s. Estimated remaining: 3h 54m 29s. Rate: 8.0 symbols/min [2025-10-28T18:01:55.849516] [INFO ] [MAIN ] CNO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:01:55.849753] [DEBUG] [LOCAL ] CNO: No existing data file found in primary storage. [2025-10-28T18:01:55.849809] [WARN ] [MAIN ] CNO: No existing data found, performing full refresh instead. [2025-10-28T18:01:55.849916] [INFO ] [MAIN ] CNO: Wiping existing primary data before full refresh. [2025-10-28T18:01:55.849957] [INFO ] [LOCAL ] CNO: Starting deletion of primary data. [2025-10-28T18:01:55.849999] [DEBUG] [LOCAL ] CNO: No primary data file found to delete. [2025-10-28T18:01:55.850031] [INFO ] [MAIN ] CNO: Starting full primary refresh. [2025-10-28T18:01:55.961580] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-08. [2025-10-28T18:01:56.234145] [INFO ] [REMOTE ] CNO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:01:56.256174] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-28T18:01:56.759364] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-02. [2025-10-28T18:01:57.177089] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-28T18:01:57.532451] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-28T18:01:57.559342] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-08. [2025-10-28T18:01:58.359377] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-09. [2025-10-28T18:01:58.885853] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-28T18:01:59.159335] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-09. [2025-10-28T18:01:59.611104] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-28T18:01:59.959309] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-01. [2025-10-28T18:02:00.166067] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-28T18:02:00.759338] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-10. [2025-10-28T18:02:01.559375] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-03. [2025-10-28T18:02:01.699628] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-28T18:02:02.359512] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-02. [2025-10-28T18:02:03.065288] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-10 (2.31 seconds). [2025-10-28T18:02:03.075218] [INFO ] [REMOTE ] CNM: Full fetch complete (73378 records). [2025-10-28T18:02:03.075366] [DEBUG] [VALIDATOR ] CNM: Validating primary data. [2025-10-28T18:02:03.076226] [FATAL] [VALIDATOR ] CNM: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T18:02:03.076329] [FATAL] [MAIN ] CNM: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:02:03.076377] [WARN ] [MAIN ] CNM: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:02:03.076417] [INFO ] [LOCAL ] CNM: Starting deletion of primary data. [2025-10-28T18:02:03.076474] [DEBUG] [LOCAL ] CNM: No primary data file found to delete. [2025-10-28T18:02:03.076511] [INFO ] [LOCAL ] CNM: Starting deletion of derivative data. [2025-10-28T18:02:03.076703] [DEBUG] [LOCAL ] CNM: Deleted derivative data file. [2025-10-28T18:02:03.076809] [INFO ] [MAIN ] Update Progress: 495/2366 symbols completed. CNM took 34.6s. Estimated remaining: 3h 54m 21s. Rate: 8.0 symbols/min [2025-10-28T18:02:03.164490] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-10. [2025-10-28T18:02:03.270920] [INFO ] [MAIN ] CNP: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:02:03.330575] [DEBUG] [LOCAL ] CNP: Loaded 53474 existing records from primary storage. [2025-10-28T18:02:03.331023] [INFO ] [MAIN ] CNP: Loaded 53474 existing records. [2025-10-28T18:02:03.514477] [WARN ] [MAIN ] CNP: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:02:03.514712] [INFO ] [MAIN ] CNP: Wiping existing primary data before full refresh. [2025-10-28T18:02:03.514767] [INFO ] [LOCAL ] CNP: Starting deletion of primary data. [2025-10-28T18:02:03.515341] [DEBUG] [LOCAL ] CNP: Deleted primary data file. [2025-10-28T18:02:03.515398] [INFO ] [MAIN ] CNP: Starting full primary refresh. [2025-10-28T18:02:03.905377] [INFO ] [REMOTE ] CNP: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:02:03.959298] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-01. [2025-10-28T18:02:04.260721] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-28T18:02:04.267272] [INFO ] [REMOTE ] CNMD: Full fetch complete (47205 records). [2025-10-28T18:02:04.267389] [DEBUG] [VALIDATOR ] CNMD: Validating primary data. [2025-10-28T18:02:04.268100] [FATAL] [VALIDATOR ] CNMD: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T18:02:04.268184] [FATAL] [MAIN ] CNMD: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:02:04.268234] [WARN ] [MAIN ] CNMD: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:02:04.268312] [INFO ] [LOCAL ] CNMD: Starting deletion of primary data. [2025-10-28T18:02:04.268389] [DEBUG] [LOCAL ] CNMD: No primary data file found to delete. [2025-10-28T18:02:04.268443] [INFO ] [LOCAL ] CNMD: Starting deletion of derivative data. [2025-10-28T18:02:04.268622] [DEBUG] [LOCAL ] CNMD: Deleted derivative data file. [2025-10-28T18:02:04.268757] [INFO ] [MAIN ] Update Progress: 496/2366 symbols completed. CNMD took 27.7s. Estimated remaining: 3h 53m 50s. Rate: 8.0 symbols/min [2025-10-28T18:02:04.445940] [INFO ] [MAIN ] CNQ: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:02:04.446105] [DEBUG] [LOCAL ] CNQ: No existing data file found in primary storage. [2025-10-28T18:02:04.446141] [WARN ] [MAIN ] CNQ: No existing data found, performing full refresh instead. [2025-10-28T18:02:04.446251] [INFO ] [MAIN ] CNQ: Wiping existing primary data before full refresh. [2025-10-28T18:02:04.446291] [INFO ] [LOCAL ] CNQ: Starting deletion of primary data. [2025-10-28T18:02:04.446330] [DEBUG] [LOCAL ] CNQ: No primary data file found to delete. [2025-10-28T18:02:04.446359] [INFO ] [MAIN ] CNQ: Starting full primary refresh. [2025-10-28T18:02:04.812203] [INFO ] [REMOTE ] CNQ: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:02:04.821311] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-01. [2025-10-28T18:02:04.840727] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-02 (2.48 seconds). [2025-10-28T18:02:05.522861] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-10-28T18:02:05.559322] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-02. [2025-10-28T18:02:06.030864] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-03 (4.47 seconds). [2025-10-28T18:02:06.117460] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-28T18:02:06.359413] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-04. [2025-10-28T18:02:06.779434] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-28T18:02:07.159405] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-03. [2025-10-28T18:02:07.508053] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-28T18:02:07.959376] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-02. [2025-10-28T18:02:08.366876] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-28T18:02:08.759362] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-03. [2025-10-28T18:02:09.228731] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-28T18:02:09.559335] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-05. [2025-10-28T18:02:10.067168] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-28T18:02:10.359351] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-04. [2025-10-28T18:02:10.488684] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-28T18:02:11.159342] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-03. [2025-10-28T18:02:11.959388] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-06. [2025-10-28T18:02:12.759350] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-04. [2025-10-28T18:02:12.912061] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-28T18:02:12.952037] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-04 (2.59 seconds). [2025-10-28T18:02:13.559314] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-05. [2025-10-28T18:02:13.863232] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-03 (2.70 seconds). [2025-10-28T18:02:14.359327] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-04. [2025-10-28T18:02:14.913103] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-10-28T18:02:15.159335] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-07. [2025-10-28T18:02:15.919185] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-05 (2.36 seconds). [2025-10-28T18:02:15.959419] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-06. [2025-10-28T18:02:16.204622] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-28T18:02:16.759364] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-05. [2025-10-28T18:02:17.559339] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-08. [2025-10-28T18:02:17.947805] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-28T18:02:18.359332] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-06. [2025-10-28T18:02:18.572663] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-04 (4.21 seconds). [2025-10-28T18:02:18.732770] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-28T18:02:19.159327] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-05. [2025-10-28T18:02:19.390492] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-28T18:02:19.675998] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-06 (3.72 seconds). [2025-10-28T18:02:19.959339] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-07. [2025-10-28T18:02:20.586072] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-28T18:02:20.759327] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-07. [2025-10-28T18:02:21.466388] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-28T18:02:21.559305] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-08. [2025-10-28T18:02:21.941290] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-28T18:02:22.359345] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-09. [2025-10-28T18:02:22.777522] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-28T18:02:23.159313] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-08. [2025-10-28T18:02:23.361428] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-28T18:02:23.959348] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-09. [2025-10-28T18:02:24.362734] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-28T18:02:24.759340] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-10. [2025-10-28T18:02:25.305754] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-28T18:02:25.559314] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-09. [2025-10-28T18:02:26.359328] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-06. [2025-10-28T18:02:26.417632] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-28T18:02:26.424228] [INFO ] [REMOTE ] CNNE: Full fetch complete (50382 records). [2025-10-28T18:02:26.424330] [DEBUG] [VALIDATOR ] CNNE: Validating primary data. [2025-10-28T18:02:26.424989] [FATAL] [VALIDATOR ] CNNE: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T18:02:26.425075] [FATAL] [MAIN ] CNNE: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:02:26.425124] [WARN ] [MAIN ] CNNE: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:02:26.425210] [INFO ] [LOCAL ] CNNE: Starting deletion of primary data. [2025-10-28T18:02:26.425311] [DEBUG] [LOCAL ] CNNE: No primary data file found to delete. [2025-10-28T18:02:26.425360] [INFO ] [LOCAL ] CNNE: Starting deletion of derivative data. [2025-10-28T18:02:26.425415] [DEBUG] [LOCAL ] CNNE: No derivative data file found to delete. [2025-10-28T18:02:26.425498] [INFO ] [MAIN ] Update Progress: 497/2366 symbols completed. CNNE took 36.3s. Estimated remaining: 3h 54m 37s. Rate: 8.0 symbols/min [2025-10-28T18:02:26.597840] [INFO ] [MAIN ] CNR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:02:26.597995] [DEBUG] [LOCAL ] CNR: No existing data file found in primary storage. [2025-10-28T18:02:26.598031] [WARN ] [MAIN ] CNR: No existing data found, performing full refresh instead. [2025-10-28T18:02:26.598135] [INFO ] [MAIN ] CNR: Wiping existing primary data before full refresh. [2025-10-28T18:02:26.598180] [INFO ] [LOCAL ] CNR: Starting deletion of primary data. [2025-10-28T18:02:26.598256] [DEBUG] [LOCAL ] CNR: No primary data file found to delete. [2025-10-28T18:02:26.598303] [INFO ] [MAIN ] CNR: Starting full primary refresh. [2025-10-28T18:02:26.975586] [INFO ] [REMOTE ] CNR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:02:27.005348] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-28T18:02:27.159349] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-01. [2025-10-28T18:02:27.713470] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-28T18:02:27.964498] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-07. [2025-10-28T18:02:27.976276] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-28T18:02:28.759346] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-10. [2025-10-28T18:02:29.559398] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-02. [2025-10-28T18:02:30.359383] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-10. [2025-10-28T18:02:30.399047] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-28T18:02:30.407319] [INFO ] [REMOTE ] CNO: Full fetch complete (60635 records). [2025-10-28T18:02:30.407481] [DEBUG] [VALIDATOR ] CNO: Validating primary data. [2025-10-28T18:02:30.851324] [DEBUG] [VALIDATOR ] CNO: All expected trading days are present. [2025-10-28T18:02:30.851418] [DEBUG] [VALIDATOR ] CNO: Primary data validation passed. [2025-10-28T18:02:30.852385] [INFO ] [MAIN ] CNO: Fetched primary data is valid. [2025-10-28T18:02:30.852453] [DEBUG] [LOCAL ] CNO: Saving primary data. [2025-10-28T18:02:30.853940] [DEBUG] [LOCAL ] CNO: Trimmed 60635 records to 39874 (keeping 200 days of data) [2025-10-28T18:02:31.128271] [DEBUG] [LOCAL ] CNO: Primary data saved (39874 records). [2025-10-28T18:02:31.128479] [INFO ] [MAIN ] CNO: Full history saved. [2025-10-28T18:02:31.128607] [INFO ] [MAIN ] Update Progress: 498/2366 symbols completed. CNO took 35.5s. Estimated remaining: 3h 54m 19s. Rate: 8.0 symbols/min [2025-10-28T18:02:31.308946] [INFO ] [MAIN ] CNS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:02:31.330318] [DEBUG] [LOCAL ] CNS: Loaded 21224 existing records from primary storage. [2025-10-28T18:02:31.330590] [INFO ] [MAIN ] CNS: Loaded 21224 existing records. [2025-10-28T18:02:31.526931] [WARN ] [MAIN ] CNS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:02:31.527193] [INFO ] [MAIN ] CNS: Wiping existing primary data before full refresh. [2025-10-28T18:02:31.527244] [INFO ] [LOCAL ] CNS: Starting deletion of primary data. [2025-10-28T18:02:31.527554] [DEBUG] [LOCAL ] CNS: Deleted primary data file. [2025-10-28T18:02:31.527618] [INFO ] [MAIN ] CNS: Starting full primary refresh. [2025-10-28T18:02:31.720784] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-07 (3.76 seconds). [2025-10-28T18:02:31.817178] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-08. [2025-10-28T18:02:31.958995] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-02 (2.40 seconds). [2025-10-28T18:02:31.978674] [INFO ] [REMOTE ] CNS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:02:31.987977] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-01. [2025-10-28T18:02:32.194218] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-28T18:02:32.204834] [INFO ] [REMOTE ] CNP: Full fetch complete (77556 records). [2025-10-28T18:02:32.204950] [DEBUG] [VALIDATOR ] CNP: Validating primary data. [2025-10-28T18:02:32.593940] [DEBUG] [VALIDATOR ] CNP: All expected trading days are present. [2025-10-28T18:02:32.594042] [DEBUG] [VALIDATOR ] CNP: Primary data validation passed. [2025-10-28T18:02:32.595120] [INFO ] [MAIN ] CNP: Fetched primary data is valid. [2025-10-28T18:02:32.595230] [DEBUG] [LOCAL ] CNP: Saving primary data. [2025-10-28T18:02:32.597115] [DEBUG] [LOCAL ] CNP: Trimmed 77556 records to 53474 (keeping 200 days of data) [2025-10-28T18:02:32.792287] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-03. [2025-10-28T18:02:32.837637] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-28T18:02:32.961800] [DEBUG] [LOCAL ] CNP: Primary data saved (53474 records). [2025-10-28T18:02:32.962158] [INFO ] [MAIN ] CNP: Full history saved. [2025-10-28T18:02:32.962239] [INFO ] [MAIN ] Update Progress: 499/2366 symbols completed. CNP took 29.9s. Estimated remaining: 3h 53m 50s. Rate: 8.0 symbols/min [2025-10-28T18:02:33.134193] [INFO ] [MAIN ] CNX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:02:33.180129] [DEBUG] [LOCAL ] CNX: Loaded 51282 existing records from primary storage. [2025-10-28T18:02:33.180473] [INFO ] [MAIN ] CNX: Loaded 51282 existing records. [2025-10-28T18:02:33.363761] [WARN ] [MAIN ] CNX: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:02:33.364206] [INFO ] [MAIN ] CNX: Wiping existing primary data before full refresh. [2025-10-28T18:02:33.364279] [INFO ] [LOCAL ] CNX: Starting deletion of primary data. [2025-10-28T18:02:33.365331] [DEBUG] [LOCAL ] CNX: Deleted primary data file. [2025-10-28T18:02:33.365392] [INFO ] [MAIN ] CNX: Starting full primary refresh. [2025-10-28T18:02:33.560769] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-02. [2025-10-28T18:02:33.615383] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-10-28T18:02:33.802094] [INFO ] [REMOTE ] CNX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:02:34.359324] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-01. [2025-10-28T18:02:34.539496] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-28T18:02:35.025429] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-03 (2.23 seconds). [2025-10-28T18:02:35.159369] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-09. [2025-10-28T18:02:35.959379] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-03. [2025-10-28T18:02:36.677008] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-28T18:02:36.759411] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-10. [2025-10-28T18:02:36.796566] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-28T18:02:37.559336] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-04. [2025-10-28T18:02:37.780040] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-01 (3.42 seconds). [2025-10-28T18:02:38.268056] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-28T18:02:38.359312] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-05. [2025-10-28T18:02:38.889069] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-10 (2.13 seconds). [2025-10-28T18:02:38.899959] [INFO ] [REMOTE ] CNQ: Full fetch complete (77739 records). [2025-10-28T18:02:38.900118] [DEBUG] [VALIDATOR ] CNQ: Validating primary data. [2025-10-28T18:02:39.165581] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-02. [2025-10-28T18:02:39.227276] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-28T18:02:39.339262] [DEBUG] [VALIDATOR ] CNQ: All expected trading days are present. [2025-10-28T18:02:39.339343] [DEBUG] [VALIDATOR ] CNQ: Primary data validation passed. [2025-10-28T18:02:39.340329] [INFO ] [MAIN ] CNQ: Fetched primary data is valid. [2025-10-28T18:02:39.340398] [DEBUG] [LOCAL ] CNQ: Saving primary data. [2025-10-28T18:02:39.342023] [DEBUG] [LOCAL ] CNQ: Trimmed 77739 records to 53578 (keeping 200 days of data) [2025-10-28T18:02:39.699034] [DEBUG] [LOCAL ] CNQ: Primary data saved (53578 records). [2025-10-28T18:02:39.699168] [INFO ] [MAIN ] CNQ: Full history saved. [2025-10-28T18:02:39.699242] [INFO ] [MAIN ] Update Progress: 500/2366 symbols completed. CNQ took 35.4s. Estimated remaining: 3h 53m 40s. Rate: 8.0 symbols/min [2025-10-28T18:02:39.889156] [INFO ] [MAIN ] CODI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:02:39.929451] [DEBUG] [LOCAL ] CODI: Loaded 41978 existing records from primary storage. [2025-10-28T18:02:39.929797] [INFO ] [MAIN ] CODI: Loaded 41978 existing records. [2025-10-28T18:02:39.965218] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-04. [2025-10-28T18:02:40.120049] [WARN ] [MAIN ] CODI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:02:40.120242] [INFO ] [MAIN ] CODI: Wiping existing primary data before full refresh. [2025-10-28T18:02:40.120291] [INFO ] [LOCAL ] CODI: Starting deletion of primary data. [2025-10-28T18:02:40.120736] [DEBUG] [LOCAL ] CODI: Deleted primary data file. [2025-10-28T18:02:40.120793] [INFO ] [MAIN ] CODI: Starting full primary refresh. [2025-10-28T18:02:40.491744] [INFO ] [REMOTE ] CODI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:02:40.562922] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-28T18:02:40.759360] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-06. [2025-10-28T18:02:41.155522] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-28T18:02:41.389471] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-28T18:02:41.559348] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-07. [2025-10-28T18:02:42.339490] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-28T18:02:42.359307] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-08. [2025-10-28T18:02:43.143035] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-28T18:02:43.159317] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-09. [2025-10-28T18:02:43.847160] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-28T18:02:43.959374] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-05. [2025-10-28T18:02:44.759393] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-03. [2025-10-28T18:02:45.388825] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-28T18:02:45.559348] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-01. [2025-10-28T18:02:46.160905] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-28T18:02:46.359352] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-06. [2025-10-28T18:02:46.492139] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-28T18:02:47.159416] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-04. [2025-10-28T18:02:47.460197] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-28T18:02:47.959385] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-10. [2025-10-28T18:02:48.451743] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-28T18:02:48.759356] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-05. [2025-10-28T18:02:48.876568] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-28T18:02:48.882387] [INFO ] [REMOTE ] CNS: Full fetch complete (31518 records). [2025-10-28T18:02:48.882564] [DEBUG] [VALIDATOR ] CNS: Validating primary data. [2025-10-28T18:02:48.883218] [FATAL] [VALIDATOR ] CNS: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T18:02:48.883325] [FATAL] [MAIN ] CNS: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:02:48.883395] [WARN ] [MAIN ] CNS: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:02:48.883465] [INFO ] [LOCAL ] CNS: Starting deletion of primary data. [2025-10-28T18:02:48.883532] [DEBUG] [LOCAL ] CNS: No primary data file found to delete. [2025-10-28T18:02:48.883568] [INFO ] [LOCAL ] CNS: Starting deletion of derivative data. [2025-10-28T18:02:48.883759] [DEBUG] [LOCAL ] CNS: Deleted derivative data file. [2025-10-28T18:02:48.883849] [INFO ] [MAIN ] Update Progress: 501/2366 symbols completed. CNS took 17.8s. Estimated remaining: 3h 53m 39s. Rate: 8.0 symbols/min [2025-10-28T18:02:49.060133] [INFO ] [MAIN ] COF: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:02:49.117330] [DEBUG] [LOCAL ] COF: Loaded 53625 existing records from primary storage. [2025-10-28T18:02:49.117679] [INFO ] [MAIN ] COF: Loaded 53625 existing records. [2025-10-28T18:02:49.295557] [WARN ] [MAIN ] COF: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:02:49.295780] [INFO ] [MAIN ] COF: Wiping existing primary data before full refresh. [2025-10-28T18:02:49.295828] [INFO ] [LOCAL ] COF: Starting deletion of primary data. [2025-10-28T18:02:49.296813] [DEBUG] [LOCAL ] COF: Deleted primary data file. [2025-10-28T18:02:49.296870] [INFO ] [MAIN ] COF: Starting full primary refresh. [2025-10-28T18:02:49.567629] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-02. [2025-10-28T18:02:49.650884] [INFO ] [REMOTE ] COF: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:02:50.202871] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-28T18:02:50.316276] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-28T18:02:50.359327] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-03. [2025-10-28T18:02:51.159325] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-07. [2025-10-28T18:02:51.358820] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-10-28T18:02:51.959611] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-01. [2025-10-28T18:02:52.759321] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-04. [2025-10-28T18:02:53.455865] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-28T18:02:53.559309] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-02. [2025-10-28T18:02:53.781683] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-28T18:02:54.359355] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-05. [2025-10-28T18:02:54.481687] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-07 (3.32 seconds). [2025-10-28T18:02:54.947810] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-28T18:02:55.159360] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-03. [2025-10-28T18:02:55.959384] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-06. [2025-10-28T18:02:56.759328] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-08. [2025-10-28T18:02:57.286005] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-05 (2.93 seconds). [2025-10-28T18:02:57.559373] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-06. [2025-10-28T18:02:57.968436] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-28T18:02:58.359338] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-09. [2025-10-28T18:02:58.516032] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-03 (3.36 seconds). [2025-10-28T18:02:58.779707] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-28T18:02:59.159328] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-04. [2025-10-28T18:02:59.296859] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-06 (3.34 seconds). [2025-10-28T18:02:59.959586] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-07. [2025-10-28T18:03:00.447342] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-10-28T18:03:00.759360] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-07. [2025-10-28T18:03:01.559395] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-10. [2025-10-28T18:03:01.616317] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-28T18:03:01.662763] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-04 (2.50 seconds). [2025-10-28T18:03:02.359367] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-08. [2025-10-28T18:03:03.006722] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-07 (2.25 seconds). [2025-10-28T18:03:03.160284] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-08. [2025-10-28T18:03:03.609618] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-28T18:03:03.730600] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-10 (2.17 seconds). [2025-10-28T18:03:03.744153] [INFO ] [REMOTE ] CNR: Full fetch complete (63768 records). [2025-10-28T18:03:03.744348] [DEBUG] [VALIDATOR ] CNR: Validating primary data. [2025-10-28T18:03:03.745300] [FATAL] [VALIDATOR ] CNR: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T18:03:03.745400] [FATAL] [MAIN ] CNR: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:03:03.745469] [WARN ] [MAIN ] CNR: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:03:03.745540] [INFO ] [LOCAL ] CNR: Starting deletion of primary data. [2025-10-28T18:03:03.745607] [DEBUG] [LOCAL ] CNR: No primary data file found to delete. [2025-10-28T18:03:03.745673] [INFO ] [LOCAL ] CNR: Starting deletion of derivative data. [2025-10-28T18:03:03.745743] [DEBUG] [LOCAL ] CNR: No derivative data file found to delete. [2025-10-28T18:03:03.745806] [INFO ] [MAIN ] Update Progress: 502/2366 symbols completed. CNR took 37.3s. Estimated remaining: 3h 53m 58s. Rate: 8.0 symbols/min [2025-10-28T18:03:03.928340] [INFO ] [MAIN ] COHR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:03:03.959342] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-09. [2025-10-28T18:03:03.980010] [DEBUG] [LOCAL ] COHR: Loaded 53376 existing records from primary storage. [2025-10-28T18:03:03.980336] [INFO ] [MAIN ] COHR: Loaded 53376 existing records. [2025-10-28T18:03:04.165765] [WARN ] [MAIN ] COHR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:03:04.166004] [INFO ] [MAIN ] COHR: Wiping existing primary data before full refresh. [2025-10-28T18:03:04.166053] [INFO ] [LOCAL ] COHR: Starting deletion of primary data. [2025-10-28T18:03:04.166482] [DEBUG] [LOCAL ] COHR: Deleted primary data file. [2025-10-28T18:03:04.166540] [INFO ] [MAIN ] COHR: Starting full primary refresh. [2025-10-28T18:03:04.541516] [INFO ] [REMOTE ] COHR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:03:04.759315] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-01. [2025-10-28T18:03:04.930589] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-10-28T18:03:05.202530] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-28T18:03:05.559344] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-05. [2025-10-28T18:03:06.359317] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-10. [2025-10-28T18:03:07.105802] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-01 (2.35 seconds). [2025-10-28T18:03:07.159316] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-02. [2025-10-28T18:03:07.445196] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-28T18:03:07.869604] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-28T18:03:07.881440] [INFO ] [REMOTE ] CNX: Full fetch complete (74883 records). [2025-10-28T18:03:07.881630] [DEBUG] [VALIDATOR ] CNX: Validating primary data. [2025-10-28T18:03:07.964869] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-09. [2025-10-28T18:03:08.286304] [DEBUG] [VALIDATOR ] CNX: All expected trading days are present. [2025-10-28T18:03:08.286383] [DEBUG] [VALIDATOR ] CNX: Primary data validation passed. [2025-10-28T18:03:08.287211] [INFO ] [MAIN ] CNX: Fetched primary data is valid. [2025-10-28T18:03:08.287273] [DEBUG] [LOCAL ] CNX: Saving primary data. [2025-10-28T18:03:08.288561] [DEBUG] [LOCAL ] CNX: Trimmed 74883 records to 51279 (keeping 200 days of data) [2025-10-28T18:03:08.578570] [DEBUG] [LOCAL ] CNX: Primary data saved (51279 records). [2025-10-28T18:03:08.578719] [INFO ] [MAIN ] CNX: Full history saved. [2025-10-28T18:03:08.578805] [INFO ] [MAIN ] Update Progress: 503/2366 symbols completed. CNX took 35.6s. Estimated remaining: 3h 53m 41s. Rate: 8.0 symbols/min [2025-10-28T18:03:08.748844] [INFO ] [MAIN ] COLD: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:03:08.773277] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-06. [2025-10-28T18:03:08.779074] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-28T18:03:08.834622] [DEBUG] [LOCAL ] COLD: Loaded 52495 existing records from primary storage. [2025-10-28T18:03:08.834953] [INFO ] [MAIN ] COLD: Loaded 52495 existing records. [2025-10-28T18:03:09.007401] [WARN ] [MAIN ] COLD: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:03:09.007596] [INFO ] [MAIN ] COLD: Wiping existing primary data before full refresh. [2025-10-28T18:03:09.007664] [INFO ] [LOCAL ] COLD: Starting deletion of primary data. [2025-10-28T18:03:09.008204] [DEBUG] [LOCAL ] COLD: Deleted primary data file. [2025-10-28T18:03:09.008262] [INFO ] [MAIN ] COLD: Starting full primary refresh. [2025-10-28T18:03:09.371685] [INFO ] [REMOTE ] COLD: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:03:09.394560] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-28T18:03:09.559352] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-10. [2025-10-28T18:03:10.359304] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-03. [2025-10-28T18:03:11.067541] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-28T18:03:11.077031] [INFO ] [REMOTE ] CODI: Full fetch complete (54150 records). [2025-10-28T18:03:11.077206] [DEBUG] [VALIDATOR ] CODI: Validating primary data. [2025-10-28T18:03:11.078076] [FATAL] [VALIDATOR ] CODI: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T18:03:11.078178] [FATAL] [MAIN ] CODI: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:03:11.078223] [WARN ] [MAIN ] CODI: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:03:11.078303] [INFO ] [LOCAL ] CODI: Starting deletion of primary data. [2025-10-28T18:03:11.078372] [DEBUG] [LOCAL ] CODI: No primary data file found to delete. [2025-10-28T18:03:11.078409] [INFO ] [LOCAL ] CODI: Starting deletion of derivative data. [2025-10-28T18:03:11.078591] [DEBUG] [LOCAL ] CODI: Deleted derivative data file. [2025-10-28T18:03:11.078717] [INFO ] [MAIN ] Update Progress: 504/2366 symbols completed. CODI took 31.4s. Estimated remaining: 3h 53m 15s. Rate: 8.0 symbols/min [2025-10-28T18:03:11.165586] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-01. [2025-10-28T18:03:11.266633] [INFO ] [MAIN ] COMP: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:03:11.315155] [DEBUG] [LOCAL ] COMP: Loaded 53399 existing records from primary storage. [2025-10-28T18:03:11.315474] [INFO ] [MAIN ] COMP: Loaded 53399 existing records. [2025-10-28T18:03:11.491249] [WARN ] [MAIN ] COMP: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:03:11.491475] [INFO ] [MAIN ] COMP: Wiping existing primary data before full refresh. [2025-10-28T18:03:11.491585] [INFO ] [LOCAL ] COMP: Starting deletion of primary data. [2025-10-28T18:03:11.492023] [DEBUG] [LOCAL ] COMP: Deleted primary data file. [2025-10-28T18:03:11.492079] [INFO ] [MAIN ] COMP: Starting full primary refresh. [2025-10-28T18:03:11.899710] [INFO ] [REMOTE ] COMP: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:03:11.926829] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-06 (3.15 seconds). [2025-10-28T18:03:11.959299] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-07. [2025-10-28T18:03:12.759375] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-01. [2025-10-28T18:03:13.472795] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-01 (2.31 seconds). [2025-10-28T18:03:13.559337] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-02. [2025-10-28T18:03:14.153304] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-03 (3.79 seconds). [2025-10-28T18:03:14.359293] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-04. [2025-10-28T18:03:14.707625] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-28T18:03:15.159379] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-03. [2025-10-28T18:03:15.600613] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-07 (3.64 seconds). [2025-10-28T18:03:15.893031] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-28T18:03:15.959319] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-05. [2025-10-28T18:03:16.759361] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-08. [2025-10-28T18:03:17.787858] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-28T18:03:17.799192] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-06. [2025-10-28T18:03:18.011541] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-01 (5.25 seconds). [2025-10-28T18:03:18.230236] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-28T18:03:18.359368] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-09. [2025-10-28T18:03:19.159328] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-02. [2025-10-28T18:03:19.311161] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-28T18:03:19.586680] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-28T18:03:19.877618] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-03 (4.72 seconds). [2025-10-28T18:03:19.959341] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-04. [2025-10-28T18:03:20.613944] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-28T18:03:20.759317] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-03. [2025-10-28T18:03:21.161724] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-28T18:03:21.559323] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-07. [2025-10-28T18:03:22.021584] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-28T18:03:22.359337] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-05. [2025-10-28T18:03:23.110362] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-28T18:03:23.159302] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-04. [2025-10-28T18:03:23.876824] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-28T18:03:23.959361] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-08. [2025-10-28T18:03:24.759462] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-06. [2025-10-28T18:03:25.559352] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-10. [2025-10-28T18:03:25.928185] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-28T18:03:26.029492] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-04 (2.87 seconds). [2025-10-28T18:03:26.359324] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-07. [2025-10-28T18:03:26.547495] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-28T18:03:26.559189] [INFO ] [REMOTE ] COF: Full fetch complete (77719 records). [2025-10-28T18:03:26.559347] [DEBUG] [VALIDATOR ] COF: Validating primary data. [2025-10-28T18:03:27.029996] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-08 (3.07 seconds). [2025-10-28T18:03:27.082820] [DEBUG] [VALIDATOR ] COF: All expected trading days are present. [2025-10-28T18:03:27.083116] [DEBUG] [VALIDATOR ] COF: Primary data validation passed. [2025-10-28T18:03:27.084281] [INFO ] [MAIN ] COF: Fetched primary data is valid. [2025-10-28T18:03:27.084404] [DEBUG] [LOCAL ] COF: Saving primary data. [2025-10-28T18:03:27.086636] [DEBUG] [LOCAL ] COF: Trimmed 77719 records to 53625 (keeping 200 days of data) [2025-10-28T18:03:27.181394] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-09. [2025-10-28T18:03:27.451034] [DEBUG] [LOCAL ] COF: Primary data saved (53625 records). [2025-10-28T18:03:27.451316] [INFO ] [MAIN ] COF: Full history saved. [2025-10-28T18:03:27.452359] [INFO ] [MAIN ] Update Progress: 505/2366 symbols completed. COF took 38.6s. Estimated remaining: 3h 53m 40s. Rate: 8.0 symbols/min [2025-10-28T18:03:27.652835] [INFO ] [MAIN ] CON: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:03:27.691275] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-28T18:03:27.741432] [DEBUG] [LOCAL ] CON: Loaded 38586 existing records from primary storage. [2025-10-28T18:03:27.741849] [INFO ] [MAIN ] CON: Loaded 38586 existing records. [2025-10-28T18:03:27.932225] [WARN ] [MAIN ] CON: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:03:27.932520] [INFO ] [MAIN ] CON: Wiping existing primary data before full refresh. [2025-10-28T18:03:27.932615] [INFO ] [LOCAL ] CON: Starting deletion of primary data. [2025-10-28T18:03:27.932949] [DEBUG] [LOCAL ] CON: Deleted primary data file. [2025-10-28T18:03:27.933025] [INFO ] [MAIN ] CON: Starting full primary refresh. [2025-10-28T18:03:27.965565] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-05. [2025-10-28T18:03:28.305962] [INFO ] [REMOTE ] CON: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:03:28.759338] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-01. [2025-10-28T18:03:28.801996] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-28T18:03:29.412493] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-28T18:03:29.559338] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-06. [2025-10-28T18:03:30.224222] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-28T18:03:30.359374] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-02. [2025-10-28T18:03:31.168085] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-10. [2025-10-28T18:03:31.194587] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-28T18:03:31.304041] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-28T18:03:31.959451] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-08. [2025-10-28T18:03:32.759399] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-03. [2025-10-28T18:03:33.388523] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-10 (2.22 seconds). [2025-10-28T18:03:33.399693] [INFO ] [REMOTE ] COHR: Full fetch complete (77475 records). [2025-10-28T18:03:33.399894] [DEBUG] [VALIDATOR ] COHR: Validating primary data. [2025-10-28T18:03:33.575743] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-07. [2025-10-28T18:03:33.844744] [DEBUG] [VALIDATOR ] COHR: All expected trading days are present. [2025-10-28T18:03:33.847745] [DEBUG] [VALIDATOR ] COHR: Primary data validation passed. [2025-10-28T18:03:33.848847] [INFO ] [MAIN ] COHR: Fetched primary data is valid. [2025-10-28T18:03:33.848926] [DEBUG] [LOCAL ] COHR: Saving primary data. [2025-10-28T18:03:33.851029] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-28T18:03:33.862627] [DEBUG] [LOCAL ] COHR: Trimmed 77475 records to 53375 (keeping 200 days of data) [2025-10-28T18:03:34.179688] [DEBUG] [LOCAL ] COHR: Primary data saved (53375 records). [2025-10-28T18:03:34.179911] [INFO ] [MAIN ] COHR: Full history saved. [2025-10-28T18:03:34.180097] [INFO ] [MAIN ] Update Progress: 506/2366 symbols completed. COHR took 30.4s. Estimated remaining: 3h 53m 29s. Rate: 8.0 symbols/min [2025-10-28T18:03:34.322384] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-28T18:03:34.365486] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-09. [2025-10-28T18:03:34.392626] [INFO ] [MAIN ] COOK: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:03:34.392879] [DEBUG] [LOCAL ] COOK: No existing data file found in primary storage. [2025-10-28T18:03:34.392923] [WARN ] [MAIN ] COOK: No existing data found, performing full refresh instead. [2025-10-28T18:03:34.393030] [INFO ] [MAIN ] COOK: Wiping existing primary data before full refresh. [2025-10-28T18:03:34.393071] [INFO ] [LOCAL ] COOK: Starting deletion of primary data. [2025-10-28T18:03:34.393111] [DEBUG] [LOCAL ] COOK: No primary data file found to delete. [2025-10-28T18:03:34.393143] [INFO ] [MAIN ] COOK: Starting full primary refresh. [2025-10-28T18:03:34.740180] [INFO ] [REMOTE ] COOK: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:03:35.166292] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-04. [2025-10-28T18:03:35.174218] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-28T18:03:35.732041] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-28T18:03:35.959329] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-08. [2025-10-28T18:03:36.360709] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-28T18:03:36.759382] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-10. [2025-10-28T18:03:37.292732] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-28T18:03:37.559313] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-05. [2025-10-28T18:03:38.308758] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-28T18:03:38.319629] [INFO ] [REMOTE ] COLD: Full fetch complete (74652 records). [2025-10-28T18:03:38.319787] [DEBUG] [VALIDATOR ] COLD: Validating primary data. [2025-10-28T18:03:38.320524] [FATAL] [VALIDATOR ] COLD: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T18:03:38.320611] [FATAL] [MAIN ] COLD: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:03:38.320686] [WARN ] [MAIN ] COLD: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:03:38.320742] [INFO ] [LOCAL ] COLD: Starting deletion of primary data. [2025-10-28T18:03:38.320799] [DEBUG] [LOCAL ] COLD: No primary data file found to delete. [2025-10-28T18:03:38.320844] [INFO ] [LOCAL ] COLD: Starting deletion of derivative data. [2025-10-28T18:03:38.321024] [DEBUG] [LOCAL ] COLD: Deleted derivative data file. [2025-10-28T18:03:38.321116] [INFO ] [MAIN ] Update Progress: 507/2366 symbols completed. COLD took 29.7s. Estimated remaining: 3h 53m 10s. Rate: 8.0 symbols/min [2025-10-28T18:03:38.363863] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-01. [2025-10-28T18:03:38.494848] [INFO ] [MAIN ] COP: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:03:38.495178] [DEBUG] [LOCAL ] COP: No existing data file found in primary storage. [2025-10-28T18:03:38.495302] [WARN ] [MAIN ] COP: No existing data found, performing full refresh instead. [2025-10-28T18:03:38.495478] [INFO ] [MAIN ] COP: Wiping existing primary data before full refresh. [2025-10-28T18:03:38.495538] [INFO ] [LOCAL ] COP: Starting deletion of primary data. [2025-10-28T18:03:38.495707] [DEBUG] [LOCAL ] COP: No primary data file found to delete. [2025-10-28T18:03:38.495778] [INFO ] [MAIN ] COP: Starting full primary refresh. [2025-10-28T18:03:38.615264] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-28T18:03:38.877908] [INFO ] [REMOTE ] COP: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:03:39.159308] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-06. [2025-10-28T18:03:39.289299] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-28T18:03:39.959381] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-09. [2025-10-28T18:03:40.325219] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-28T18:03:40.759408] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-01. [2025-10-28T18:03:41.489630] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-28T18:03:41.559343] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-10. [2025-10-28T18:03:42.303107] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-28T18:03:42.359309] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-02. [2025-10-28T18:03:43.159328] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-02. [2025-10-28T18:03:43.196990] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-28T18:03:43.207956] [INFO ] [REMOTE ] COMP: Full fetch complete (77412 records). [2025-10-28T18:03:43.208082] [DEBUG] [VALIDATOR ] COMP: Validating primary data. [2025-10-28T18:03:43.606413] [DEBUG] [VALIDATOR ] COMP: All expected trading days are present. [2025-10-28T18:03:43.606501] [DEBUG] [VALIDATOR ] COMP: Primary data validation passed. [2025-10-28T18:03:43.607454] [INFO ] [MAIN ] COMP: Fetched primary data is valid. [2025-10-28T18:03:43.607519] [DEBUG] [LOCAL ] COMP: Saving primary data. [2025-10-28T18:03:43.609107] [DEBUG] [LOCAL ] COMP: Trimmed 77412 records to 53398 (keeping 200 days of data) [2025-10-28T18:03:43.717205] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-28T18:03:43.925902] [DEBUG] [LOCAL ] COMP: Primary data saved (53398 records). [2025-10-28T18:03:43.926064] [INFO ] [MAIN ] COMP: Full history saved. [2025-10-28T18:03:43.926146] [INFO ] [MAIN ] Update Progress: 508/2366 symbols completed. COMP took 32.8s. Estimated remaining: 3h 52m 55s. Rate: 8.0 symbols/min [2025-10-28T18:03:43.960612] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-03. [2025-10-28T18:03:44.113665] [INFO ] [MAIN ] COR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:03:44.157615] [DEBUG] [LOCAL ] COR: Loaded 45968 existing records from primary storage. [2025-10-28T18:03:44.157955] [INFO ] [MAIN ] COR: Loaded 45968 existing records. [2025-10-28T18:03:44.340669] [WARN ] [MAIN ] COR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:03:44.340938] [INFO ] [MAIN ] COR: Wiping existing primary data before full refresh. [2025-10-28T18:03:44.340991] [INFO ] [LOCAL ] COR: Starting deletion of primary data. [2025-10-28T18:03:44.341511] [DEBUG] [LOCAL ] COR: Deleted primary data file. [2025-10-28T18:03:44.341684] [INFO ] [MAIN ] COR: Starting full primary refresh. [2025-10-28T18:03:44.716449] [INFO ] [REMOTE ] COR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:03:44.753469] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-02 (2.39 seconds). [2025-10-28T18:03:44.763146] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-01. [2025-10-28T18:03:44.945535] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-28T18:03:45.559351] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-07. [2025-10-28T18:03:46.164521] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-28T18:03:46.359333] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-04. [2025-10-28T18:03:46.845020] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-28T18:03:47.109943] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-28T18:03:47.159302] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-05. [2025-10-28T18:03:47.959309] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-08. [2025-10-28T18:03:48.164637] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-28T18:03:48.759364] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-03. [2025-10-28T18:03:49.025283] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-28T18:03:49.559345] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-02. [2025-10-28T18:03:50.363306] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-06. [2025-10-28T18:03:50.366206] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-28T18:03:50.672013] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-28T18:03:51.159340] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-09. [2025-10-28T18:03:51.401457] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-28T18:03:51.959335] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-03. [2025-10-28T18:03:52.300925] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-28T18:03:52.759317] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-10. [2025-10-28T18:03:53.312700] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-28T18:03:53.559346] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-04. [2025-10-28T18:03:54.223533] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-28T18:03:54.230926] [INFO ] [REMOTE ] CON: Full fetch complete (56285 records). [2025-10-28T18:03:54.231024] [DEBUG] [VALIDATOR ] CON: Validating primary data. [2025-10-28T18:03:54.231721] [FATAL] [VALIDATOR ] CON: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T18:03:54.231808] [FATAL] [MAIN ] CON: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:03:54.231859] [WARN ] [MAIN ] CON: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:03:54.231923] [INFO ] [LOCAL ] CON: Starting deletion of primary data. [2025-10-28T18:03:54.231988] [DEBUG] [LOCAL ] CON: No primary data file found to delete. [2025-10-28T18:03:54.232026] [INFO ] [LOCAL ] CON: Starting deletion of derivative data. [2025-10-28T18:03:54.232198] [DEBUG] [LOCAL ] CON: Deleted derivative data file. [2025-10-28T18:03:54.232697] [INFO ] [MAIN ] Update Progress: 509/2366 symbols completed. CON took 26.8s. Estimated remaining: 3h 52m 58s. Rate: 8.0 symbols/min [2025-10-28T18:03:54.371373] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-04. [2025-10-28T18:03:54.403707] [INFO ] [MAIN ] COTY: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:03:54.452210] [DEBUG] [LOCAL ] COTY: Loaded 53247 existing records from primary storage. [2025-10-28T18:03:54.452512] [INFO ] [MAIN ] COTY: Loaded 53247 existing records. [2025-10-28T18:03:54.633917] [WARN ] [MAIN ] COTY: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:03:54.634237] [INFO ] [MAIN ] COTY: Wiping existing primary data before full refresh. [2025-10-28T18:03:54.634294] [INFO ] [LOCAL ] COTY: Starting deletion of primary data. [2025-10-28T18:03:54.635052] [DEBUG] [LOCAL ] COTY: Deleted primary data file. [2025-10-28T18:03:54.635110] [INFO ] [MAIN ] COTY: Starting full primary refresh. [2025-10-28T18:03:55.005021] [INFO ] [REMOTE ] COTY: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:03:55.035480] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-28T18:03:55.159305] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-01. [2025-10-28T18:03:55.882522] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-28T18:03:55.959344] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-05. [2025-10-28T18:03:56.759319] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-05. [2025-10-28T18:03:56.964060] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-28T18:03:57.559319] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-02. [2025-10-28T18:03:57.704402] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-28T18:03:58.359414] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-06. [2025-10-28T18:03:58.806082] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-10-28T18:03:59.159343] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-07. [2025-10-28T18:03:59.288488] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-28T18:03:59.867735] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-28T18:03:59.921141] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-28T18:03:59.959353] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-08. [2025-10-28T18:04:00.759338] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-07. [2025-10-28T18:04:01.144595] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-28T18:04:01.559338] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-09. [2025-10-28T18:04:02.359419] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-03. [2025-10-28T18:04:02.585064] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-28T18:04:03.159377] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-08. [2025-10-28T18:04:03.958365] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-09 (2.40 seconds). [2025-10-28T18:04:03.960340] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-06. [2025-10-28T18:04:04.249858] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-28T18:04:04.759317] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-04. [2025-10-28T18:04:05.010773] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-10-28T18:04:05.264710] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-28T18:04:05.559342] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-07. [2025-10-28T18:04:06.346826] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-28T18:04:06.359303] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-10. [2025-10-28T18:04:06.815741] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-28T18:04:07.159355] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-05. [2025-10-28T18:04:07.464698] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-28T18:04:07.469808] [INFO ] [REMOTE ] COOK: Full fetch complete (33151 records). [2025-10-28T18:04:07.469891] [DEBUG] [VALIDATOR ] COOK: Validating primary data. [2025-10-28T18:04:07.858191] [DEBUG] [VALIDATOR ] COOK: All expected trading days are present. [2025-10-28T18:04:07.858268] [DEBUG] [VALIDATOR ] COOK: Primary data validation passed. [2025-10-28T18:04:07.858810] [INFO ] [MAIN ] COOK: Fetched primary data is valid. [2025-10-28T18:04:07.858874] [DEBUG] [LOCAL ] COOK: Saving primary data. [2025-10-28T18:04:07.859612] [DEBUG] [LOCAL ] COOK: Trimmed 33151 records to 24632 (keeping 200 days of data) [2025-10-28T18:04:07.963687] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-08. [2025-10-28T18:04:07.994010] [DEBUG] [LOCAL ] COOK: Primary data saved (24632 records). [2025-10-28T18:04:07.994135] [INFO ] [MAIN ] COOK: Full history saved. [2025-10-28T18:04:07.994235] [INFO ] [MAIN ] Update Progress: 510/2366 symbols completed. COOK took 33.8s. Estimated remaining: 3h 53m 13s. Rate: 8.0 symbols/min [2025-10-28T18:04:08.164616] [INFO ] [MAIN ] COUR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:04:08.207917] [DEBUG] [LOCAL ] COUR: Loaded 49420 existing records from primary storage. [2025-10-28T18:04:08.208196] [INFO ] [MAIN ] COUR: Loaded 49420 existing records. [2025-10-28T18:04:08.384162] [WARN ] [MAIN ] COUR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:04:08.384366] [INFO ] [MAIN ] COUR: Wiping existing primary data before full refresh. [2025-10-28T18:04:08.384492] [INFO ] [LOCAL ] COUR: Starting deletion of primary data. [2025-10-28T18:04:08.385215] [DEBUG] [LOCAL ] COUR: Deleted primary data file. [2025-10-28T18:04:08.385274] [INFO ] [MAIN ] COUR: Starting full primary refresh. [2025-10-28T18:04:08.765561] [INFO ] [REMOTE ] COUR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:04:08.760513] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-09. [2025-10-28T18:04:08.768588] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-28T18:04:09.201306] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-28T18:04:09.559364] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-06. [2025-10-28T18:04:10.306265] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-28T18:04:10.359314] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-10. [2025-10-28T18:04:10.868246] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-28T18:04:10.936537] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-28T18:04:10.947027] [INFO ] [REMOTE ] COP: Full fetch complete (77516 records). [2025-10-28T18:04:10.947201] [DEBUG] [VALIDATOR ] COP: Validating primary data. [2025-10-28T18:04:10.948054] [FATAL] [VALIDATOR ] COP: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T18:04:10.948150] [FATAL] [MAIN ] COP: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:04:10.948225] [WARN ] [MAIN ] COP: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:04:10.948315] [INFO ] [LOCAL ] COP: Starting deletion of primary data. [2025-10-28T18:04:10.948396] [DEBUG] [LOCAL ] COP: No primary data file found to delete. [2025-10-28T18:04:10.948435] [INFO ] [LOCAL ] COP: Starting deletion of derivative data. [2025-10-28T18:04:10.948475] [DEBUG] [LOCAL ] COP: No derivative data file found to delete. [2025-10-28T18:04:10.948532] [INFO ] [MAIN ] Update Progress: 511/2366 symbols completed. COP took 32.6s. Estimated remaining: 3h 52m 49s. Rate: 8.0 symbols/min [2025-10-28T18:04:11.159043] [INFO ] [MAIN ] CP: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:04:11.159334] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-07. [2025-10-28T18:04:11.160433] [DEBUG] [LOCAL ] CP: No existing data file found in primary storage. [2025-10-28T18:04:11.160495] [WARN ] [MAIN ] CP: No existing data found, performing full refresh instead. [2025-10-28T18:04:11.160632] [INFO ] [MAIN ] CP: Wiping existing primary data before full refresh. [2025-10-28T18:04:11.160869] [INFO ] [LOCAL ] CP: Starting deletion of primary data. [2025-10-28T18:04:11.160929] [DEBUG] [LOCAL ] CP: No primary data file found to delete. [2025-10-28T18:04:11.160965] [INFO ] [MAIN ] CP: Starting full primary refresh. [2025-10-28T18:04:11.697156] [INFO ] [REMOTE ] CP: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:04:11.959409] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-01. [2025-10-28T18:04:12.608891] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-28T18:04:12.759297] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-08. [2025-10-28T18:04:13.236089] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-28T18:04:13.559320] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-09. [2025-10-28T18:04:14.359349] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-01. [2025-10-28T18:04:14.468676] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-28T18:04:14.915173] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-28T18:04:15.159317] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-09. [2025-10-28T18:04:15.716090] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-28T18:04:15.959339] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-02. [2025-10-28T18:04:16.759327] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-10. [2025-10-28T18:04:17.110160] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-28T18:04:17.428772] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-28T18:04:17.559316] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-03. [2025-10-28T18:04:18.079255] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-28T18:04:18.087394] [INFO ] [REMOTE ] COR: Full fetch complete (67867 records). [2025-10-28T18:04:18.087510] [DEBUG] [VALIDATOR ] COR: Validating primary data. [2025-10-28T18:04:18.088169] [FATAL] [VALIDATOR ] COR: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T18:04:18.088254] [FATAL] [MAIN ] COR: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:04:18.088296] [WARN ] [MAIN ] COR: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:04:18.088333] [INFO ] [LOCAL ] COR: Starting deletion of primary data. [2025-10-28T18:04:18.088388] [DEBUG] [LOCAL ] COR: No primary data file found to delete. [2025-10-28T18:04:18.088423] [INFO ] [LOCAL ] COR: Starting deletion of derivative data. [2025-10-28T18:04:18.088578] [DEBUG] [LOCAL ] COR: Deleted derivative data file. [2025-10-28T18:04:18.089615] [INFO ] [MAIN ] Update Progress: 512/2366 symbols completed. COR took 34.2s. Estimated remaining: 3h 52m 40s. Rate: 8.0 symbols/min [2025-10-28T18:04:18.257772] [INFO ] [MAIN ] CPA: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:04:18.284729] [DEBUG] [LOCAL ] CPA: Loaded 27383 existing records from primary storage. [2025-10-28T18:04:18.284976] [INFO ] [MAIN ] CPA: Loaded 27383 existing records. [2025-10-28T18:04:18.364526] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-10. [2025-10-28T18:04:18.462050] [WARN ] [MAIN ] CPA: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:04:18.462234] [INFO ] [MAIN ] CPA: Wiping existing primary data before full refresh. [2025-10-28T18:04:18.462278] [INFO ] [LOCAL ] CPA: Starting deletion of primary data. [2025-10-28T18:04:18.462804] [DEBUG] [LOCAL ] CPA: Deleted primary data file. [2025-10-28T18:04:18.462861] [INFO ] [MAIN ] CPA: Starting full primary refresh. [2025-10-28T18:04:18.820186] [INFO ] [REMOTE ] CPA: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:04:18.850089] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-28T18:04:19.159335] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-04. [2025-10-28T18:04:19.959312] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-02. [2025-10-28T18:04:20.086005] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-28T18:04:20.097907] [INFO ] [REMOTE ] COTY: Full fetch complete (77277 records). [2025-10-28T18:04:20.098107] [DEBUG] [VALIDATOR ] COTY: Validating primary data. [2025-10-28T18:04:20.545328] [DEBUG] [VALIDATOR ] COTY: All expected trading days are present. [2025-10-28T18:04:20.545433] [DEBUG] [VALIDATOR ] COTY: Primary data validation passed. [2025-10-28T18:04:20.546617] [INFO ] [MAIN ] COTY: Fetched primary data is valid. [2025-10-28T18:04:20.546714] [DEBUG] [LOCAL ] COTY: Saving primary data. [2025-10-28T18:04:20.579925] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-28T18:04:20.578078] [DEBUG] [LOCAL ] COTY: Trimmed 77277 records to 53246 (keeping 200 days of data) [2025-10-28T18:04:20.761189] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-01. [2025-10-28T18:04:20.891407] [DEBUG] [LOCAL ] COTY: Primary data saved (53246 records). [2025-10-28T18:04:20.891535] [INFO ] [MAIN ] COTY: Full history saved. [2025-10-28T18:04:20.892136] [INFO ] [MAIN ] Update Progress: 513/2366 symbols completed. COTY took 26.7s. Estimated remaining: 3h 52m 15s. Rate: 8.0 symbols/min [2025-10-28T18:04:21.061918] [INFO ] [MAIN ] CPAC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:04:21.062069] [DEBUG] [LOCAL ] CPAC: No existing data file found in primary storage. [2025-10-28T18:04:21.062106] [WARN ] [MAIN ] CPAC: No existing data found, performing full refresh instead. [2025-10-28T18:04:21.062209] [INFO ] [MAIN ] CPAC: Wiping existing primary data before full refresh. [2025-10-28T18:04:21.062249] [INFO ] [LOCAL ] CPAC: Starting deletion of primary data. [2025-10-28T18:04:21.062292] [DEBUG] [LOCAL ] CPAC: No primary data file found to delete. [2025-10-28T18:04:21.062323] [INFO ] [MAIN ] CPAC: Starting full primary refresh. [2025-10-28T18:04:21.418731] [INFO ] [REMOTE ] CPAC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:04:21.444968] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-28T18:04:21.559293] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-03. [2025-10-28T18:04:21.890004] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-28T18:04:22.359320] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-02. [2025-10-28T18:04:22.724815] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-28T18:04:23.135106] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-28T18:04:23.159347] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-05. [2025-10-28T18:04:23.959359] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-04. [2025-10-28T18:04:24.759336] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-01. [2025-10-28T18:04:24.998353] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-10-28T18:04:25.100737] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-10-28T18:04:25.559375] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-02. [2025-10-28T18:04:25.605434] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-28T18:04:25.800448] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-02 (0.24 seconds). [2025-10-28T18:04:26.359365] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-03. [2025-10-28T18:04:26.613133] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-03 (0.25 seconds). [2025-10-28T18:04:27.159409] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-04. [2025-10-28T18:04:27.372949] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-04 (0.21 seconds). [2025-10-28T18:04:27.959365] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-05. [2025-10-28T18:04:28.759351] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-06. [2025-10-28T18:04:29.261571] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-28T18:04:29.559328] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-03. [2025-10-28T18:04:29.957154] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-28T18:04:30.359392] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-07. [2025-10-28T18:04:30.629309] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-28T18:04:31.159375] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-05. [2025-10-28T18:04:31.416394] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-05 (0.26 seconds). [2025-10-28T18:04:31.633393] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-28T18:04:31.959359] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-06. [2025-10-28T18:04:32.221818] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-06 (0.26 seconds). [2025-10-28T18:04:32.759333] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-08. [2025-10-28T18:04:33.559347] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-06. [2025-10-28T18:04:34.359350] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-04. [2025-10-28T18:04:34.514092] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-28T18:04:35.159376] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-09. [2025-10-28T18:04:35.405505] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-28T18:04:35.616357] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-10-28T18:04:35.959433] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-07. [2025-10-28T18:04:36.410016] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-28T18:04:36.511209] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-28T18:04:36.759378] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-10. [2025-10-28T18:04:37.559357] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-07. [2025-10-28T18:04:38.359761] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-05. [2025-10-28T18:04:38.362367] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-28T18:04:38.372864] [INFO ] [REMOTE ] COUR: Full fetch complete (70994 records). [2025-10-28T18:04:38.373018] [DEBUG] [VALIDATOR ] COUR: Validating primary data. [2025-10-28T18:04:38.373796] [FATAL] [VALIDATOR ] COUR: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T18:04:38.373880] [FATAL] [MAIN ] COUR: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:04:38.373924] [WARN ] [MAIN ] COUR: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:04:38.373990] [INFO ] [LOCAL ] COUR: Starting deletion of primary data. [2025-10-28T18:04:38.374054] [DEBUG] [LOCAL ] COUR: No primary data file found to delete. [2025-10-28T18:04:38.374091] [INFO ] [LOCAL ] COUR: Starting deletion of derivative data. [2025-10-28T18:04:38.374256] [DEBUG] [LOCAL ] COUR: Deleted derivative data file. [2025-10-28T18:04:38.374331] [INFO ] [MAIN ] Update Progress: 514/2366 symbols completed. COUR took 30.4s. Estimated remaining: 3h 52m 43s. Rate: 8.0 symbols/min [2025-10-28T18:04:38.544420] [INFO ] [MAIN ] CPAY: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:04:38.571681] [DEBUG] [LOCAL ] CPAY: Loaded 29565 existing records from primary storage. [2025-10-28T18:04:38.571945] [INFO ] [MAIN ] CPAY: Loaded 29565 existing records. [2025-10-28T18:04:38.750694] [WARN ] [MAIN ] CPAY: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:04:38.751010] [INFO ] [MAIN ] CPAY: Wiping existing primary data before full refresh. [2025-10-28T18:04:38.751062] [INFO ] [LOCAL ] CPAY: Starting deletion of primary data. [2025-10-28T18:04:38.751618] [DEBUG] [LOCAL ] CPAY: Deleted primary data file. [2025-10-28T18:04:38.751717] [INFO ] [MAIN ] CPAY: Starting full primary refresh. [2025-10-28T18:04:39.126410] [INFO ] [REMOTE ] CPAY: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:04:39.156157] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-28T18:04:39.166966] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-01. [2025-10-28T18:04:39.415943] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-28T18:04:39.959381] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-06. [2025-10-28T18:04:40.759373] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-08. [2025-10-28T18:04:41.271728] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-10-28T18:04:41.559364] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-02. [2025-10-28T18:04:41.880405] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-10-28T18:04:41.922245] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-28T18:04:42.359318] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-07. [2025-10-28T18:04:42.684552] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-28T18:04:43.159311] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-08. [2025-10-28T18:04:43.264685] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-28T18:04:43.959318] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-09. [2025-10-28T18:04:44.342161] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-10-28T18:04:44.574052] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-28T18:04:44.759354] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-09. [2025-10-28T18:04:45.559349] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-03. [2025-10-28T18:04:46.187620] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-28T18:04:46.359352] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-10. [2025-10-28T18:04:46.667178] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-28T18:04:46.930807] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-28T18:04:46.931871] [INFO ] [REMOTE ] CPAC: Full fetch complete (1810 records). [2025-10-28T18:04:46.931939] [DEBUG] [VALIDATOR ] CPAC: Validating primary data. [2025-10-28T18:04:47.129543] [WARN ] [VALIDATOR ] CPAC: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-28T18:04:47.129810] [FATAL] [MAIN ] CPAC: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:04:47.129880] [WARN ] [MAIN ] CPAC: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:04:47.129962] [INFO ] [LOCAL ] CPAC: Starting deletion of primary data. [2025-10-28T18:04:47.130031] [DEBUG] [LOCAL ] CPAC: No primary data file found to delete. [2025-10-28T18:04:47.130068] [INFO ] [LOCAL ] CPAC: Starting deletion of derivative data. [2025-10-28T18:04:47.130133] [DEBUG] [LOCAL ] CPAC: No derivative data file found to delete. [2025-10-28T18:04:47.130201] [INFO ] [MAIN ] Update Progress: 515/2366 symbols completed. CPAC took 26.2s. Estimated remaining: 3h 52m 40s. Rate: 8.0 symbols/min [2025-10-28T18:04:47.164492] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-10. [2025-10-28T18:04:47.300129] [INFO ] [MAIN ] CPF: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:04:47.316575] [DEBUG] [LOCAL ] CPF: Loaded 14882 existing records from primary storage. [2025-10-28T18:04:47.316830] [INFO ] [MAIN ] CPF: Loaded 14882 existing records. [2025-10-28T18:04:47.489193] [WARN ] [MAIN ] CPF: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:04:47.489389] [INFO ] [MAIN ] CPF: Wiping existing primary data before full refresh. [2025-10-28T18:04:47.489434] [INFO ] [LOCAL ] CPF: Starting deletion of primary data. [2025-10-28T18:04:47.489828] [DEBUG] [LOCAL ] CPF: Deleted primary data file. [2025-10-28T18:04:47.489886] [INFO ] [MAIN ] CPF: Starting full primary refresh. [2025-10-28T18:04:47.856709] [INFO ] [REMOTE ] CPF: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:04:47.959313] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-01. [2025-10-28T18:04:48.764437] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-08. [2025-10-28T18:04:48.773456] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-28T18:04:49.208091] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-28T18:04:49.218301] [INFO ] [REMOTE ] CP: Full fetch complete (76900 records). [2025-10-28T18:04:49.218428] [DEBUG] [VALIDATOR ] CP: Validating primary data. [2025-10-28T18:04:49.219209] [FATAL] [VALIDATOR ] CP: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T18:04:49.219357] [FATAL] [MAIN ] CP: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:04:49.219443] [WARN ] [MAIN ] CP: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:04:49.219489] [INFO ] [LOCAL ] CP: Starting deletion of primary data. [2025-10-28T18:04:49.219546] [DEBUG] [LOCAL ] CP: No primary data file found to delete. [2025-10-28T18:04:49.219580] [INFO ] [LOCAL ] CP: Starting deletion of derivative data. [2025-10-28T18:04:49.219618] [DEBUG] [LOCAL ] CP: No derivative data file found to delete. [2025-10-28T18:04:49.219702] [INFO ] [MAIN ] Update Progress: 516/2366 symbols completed. CP took 38.3s. Estimated remaining: 3h 52m 13s. Rate: 8.0 symbols/min [2025-10-28T18:04:49.386969] [INFO ] [MAIN ] CPK: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:04:49.400874] [DEBUG] [LOCAL ] CPK: Loaded 13687 existing records from primary storage. [2025-10-28T18:04:49.401107] [INFO ] [MAIN ] CPK: Loaded 13687 existing records. [2025-10-28T18:04:49.570683] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-02. [2025-10-28T18:04:49.578943] [WARN ] [MAIN ] CPK: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:04:49.580253] [INFO ] [MAIN ] CPK: Wiping existing primary data before full refresh. [2025-10-28T18:04:49.580309] [INFO ] [LOCAL ] CPK: Starting deletion of primary data. [2025-10-28T18:04:49.580720] [DEBUG] [LOCAL ] CPK: Deleted primary data file. [2025-10-28T18:04:49.580777] [INFO ] [MAIN ] CPK: Starting full primary refresh. [2025-10-28T18:04:49.939274] [INFO ] [REMOTE ] CPK: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:04:49.966832] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-28T18:04:50.311929] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-28T18:04:50.359337] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-09. [2025-10-28T18:04:51.159312] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-01. [2025-10-28T18:04:51.398697] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-28T18:04:51.786374] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-28T18:04:51.959402] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-04. [2025-10-28T18:04:52.759342] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-10. [2025-10-28T18:04:53.047913] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-28T18:04:53.559313] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-02. [2025-10-28T18:04:53.697895] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-28T18:04:53.702760] [INFO ] [REMOTE ] CPA: Full fetch complete (40746 records). [2025-10-28T18:04:53.702881] [DEBUG] [VALIDATOR ] CPA: Validating primary data. [2025-10-28T18:04:53.703496] [FATAL] [VALIDATOR ] CPA: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T18:04:53.703611] [FATAL] [MAIN ] CPA: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:04:53.703702] [WARN ] [MAIN ] CPA: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:04:53.703774] [INFO ] [LOCAL ] CPA: Starting deletion of primary data. [2025-10-28T18:04:53.703837] [DEBUG] [LOCAL ] CPA: No primary data file found to delete. [2025-10-28T18:04:53.703871] [INFO ] [LOCAL ] CPA: Starting deletion of derivative data. [2025-10-28T18:04:53.704003] [DEBUG] [LOCAL ] CPA: Deleted derivative data file. [2025-10-28T18:04:53.704076] [INFO ] [MAIN ] Update Progress: 517/2366 symbols completed. CPA took 35.6s. Estimated remaining: 3h 51m 55s. Rate: 8.0 symbols/min [2025-10-28T18:04:54.150346] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-28T18:04:54.359365] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-05. [2025-10-28T18:04:55.159340] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-03. [2025-10-28T18:04:55.384770] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-28T18:04:55.730189] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-28T18:04:55.959355] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-04. [2025-10-28T18:04:56.731176] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-28T18:04:56.759320] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-05. [2025-10-28T18:04:57.463834] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-28T18:04:57.559309] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-03. [2025-10-28T18:04:58.292026] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-28T18:04:58.359325] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-06. [2025-10-28T18:04:59.069528] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-28T18:04:59.159358] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-04. [2025-10-28T18:04:59.887036] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-28T18:04:59.959366] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-05. [2025-10-28T18:05:00.759315] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-07. [2025-10-28T18:05:01.479701] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-28T18:05:01.559382] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-08. [2025-10-28T18:05:01.646724] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-28T18:05:02.307480] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-28T18:05:02.359422] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-06. [2025-10-28T18:05:03.159442] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-06. [2025-10-28T18:05:03.758016] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-28T18:05:03.959360] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-07. [2025-10-28T18:05:04.227324] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-28T18:05:04.759388] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-07. [2025-10-28T18:05:05.414560] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-28T18:05:05.452076] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-28T18:05:05.559309] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-08. [2025-10-28T18:05:06.359319] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-08. [2025-10-28T18:05:06.658314] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-28T18:05:07.104886] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-28T18:05:07.159335] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-09. [2025-10-28T18:05:07.835860] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-28T18:05:07.959311] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-10. [2025-10-28T18:05:08.759375] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-09. [2025-10-28T18:05:08.849435] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-28T18:05:08.852872] [INFO ] [REMOTE ] CPF: Full fetch complete (23107 records). [2025-10-28T18:05:08.852955] [DEBUG] [VALIDATOR ] CPF: Validating primary data. [2025-10-28T18:05:09.211673] [DEBUG] [VALIDATOR ] CPF: All expected trading days are present. [2025-10-28T18:05:09.211760] [DEBUG] [VALIDATOR ] CPF: Primary data validation passed. [2025-10-28T18:05:09.212185] [INFO ] [MAIN ] CPF: Fetched primary data is valid. [2025-10-28T18:05:09.212245] [DEBUG] [LOCAL ] CPF: Saving primary data. [2025-10-28T18:05:09.212890] [DEBUG] [LOCAL ] CPF: Trimmed 23107 records to 14819 (keeping 200 days of data) [2025-10-28T18:05:09.299274] [DEBUG] [LOCAL ] CPF: Primary data saved (14819 records). [2025-10-28T18:05:09.299407] [INFO ] [MAIN ] CPF: Full history saved. [2025-10-28T18:05:09.299486] [INFO ] [MAIN ] Update Progress: 518/2366 symbols completed. CPF took 22.2s. Estimated remaining: 3h 52m 16s. Rate: 8.0 symbols/min [2025-10-28T18:05:09.434720] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-28T18:05:09.559311] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-10. [2025-10-28T18:05:10.359417] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-09. [2025-10-28T18:05:10.465097] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-28T18:05:10.468916] [INFO ] [REMOTE ] CPK: Full fetch complete (18808 records). [2025-10-28T18:05:10.469027] [DEBUG] [VALIDATOR ] CPK: Validating primary data. [2025-10-28T18:05:10.469498] [FATAL] [VALIDATOR ] CPK: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T18:05:10.469587] [FATAL] [MAIN ] CPK: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:05:10.469632] [WARN ] [MAIN ] CPK: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:05:10.469729] [INFO ] [LOCAL ] CPK: Starting deletion of primary data. [2025-10-28T18:05:10.469802] [DEBUG] [LOCAL ] CPK: No primary data file found to delete. [2025-10-28T18:05:10.469844] [INFO ] [LOCAL ] CPK: Starting deletion of derivative data. [2025-10-28T18:05:10.469990] [DEBUG] [LOCAL ] CPK: Deleted derivative data file. [2025-10-28T18:05:10.470066] [INFO ] [MAIN ] Update Progress: 519/2366 symbols completed. CPK took 21.3s. Estimated remaining: 3h 51m 46s. Rate: 8.0 symbols/min [2025-10-28T18:05:11.189317] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-28T18:05:11.195685] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-10. [2025-10-28T18:05:12.237449] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-28T18:05:12.242908] [INFO ] [REMOTE ] CPAY: Full fetch complete (44356 records). [2025-10-28T18:05:12.242993] [DEBUG] [VALIDATOR ] CPAY: Validating primary data. [2025-10-28T18:05:12.629607] [DEBUG] [VALIDATOR ] CPAY: All expected trading days are present. [2025-10-28T18:05:12.629731] [DEBUG] [VALIDATOR ] CPAY: Primary data validation passed. [2025-10-28T18:05:12.630382] [INFO ] [MAIN ] CPAY: Fetched primary data is valid. [2025-10-28T18:05:12.630428] [DEBUG] [LOCAL ] CPAY: Saving primary data. [2025-10-28T18:05:12.631494] [DEBUG] [LOCAL ] CPAY: Trimmed 44356 records to 29462 (keeping 200 days of data) [2025-10-28T18:05:12.814159] [DEBUG] [LOCAL ] CPAY: Primary data saved (29462 records). [2025-10-28T18:05:12.814280] [INFO ] [MAIN ] CPAY: Full history saved. [2025-10-28T18:05:12.814357] [INFO ] [MAIN ] Update Progress: 520/2366 symbols completed. CPAY took 34.4s. Estimated remaining: 3h 51m 20s. Rate: 8.0 symbols/min [2025-10-28T18:05:13.404200] [INFO ] [MAIN ] CPNG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:05:13.429909] [DEBUG] [LOCAL ] CPNG: No existing data file found in primary storage. [2025-10-28T18:05:13.494591] [INFO ] [MAIN ] CPRI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:05:13.507058] [INFO ] [MAIN ] CPS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:05:13.526018] [WARN ] [MAIN ] CPNG: No existing data found, performing full refresh instead. [2025-10-28T18:05:13.527637] [INFO ] [MAIN ] CPT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:05:13.526812] [INFO ] [MAIN ] CPNG: Wiping existing primary data before full refresh. [2025-10-28T18:05:13.529458] [INFO ] [LOCAL ] CPNG: Starting deletion of primary data. [2025-10-28T18:05:13.529527] [DEBUG] [LOCAL ] CPNG: No primary data file found to delete. [2025-10-28T18:05:13.529562] [INFO ] [MAIN ] CPNG: Starting full primary refresh. [2025-10-28T18:05:13.760938] [DEBUG] [LOCAL ] CPS: Loaded 24342 existing records from primary storage. [2025-10-28T18:05:13.815973] [INFO ] [MAIN ] CPS: Loaded 24342 existing records. [2025-10-28T18:05:13.867730] [DEBUG] [LOCAL ] CPT: Loaded 44324 existing records from primary storage. [2025-10-28T18:05:13.958048] [INFO ] [MAIN ] CPT: Loaded 44324 existing records. [2025-10-28T18:05:13.972834] [DEBUG] [LOCAL ] CPRI: Loaded 52365 existing records from primary storage. [2025-10-28T18:05:14.048800] [INFO ] [MAIN ] CPRI: Loaded 52365 existing records. [2025-10-28T18:05:14.314987] [INFO ] [REMOTE ] CPNG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:05:14.382612] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-01. [2025-10-28T18:05:14.395212] [WARN ] [MAIN ] CPS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:05:14.420743] [INFO ] [MAIN ] CPS: Wiping existing primary data before full refresh. [2025-10-28T18:05:14.426293] [INFO ] [LOCAL ] CPS: Starting deletion of primary data. [2025-10-28T18:05:14.488167] [DEBUG] [LOCAL ] CPS: Deleted primary data file. [2025-10-28T18:05:14.535974] [WARN ] [MAIN ] CPRI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:05:14.539895] [INFO ] [MAIN ] CPS: Starting full primary refresh. [2025-10-28T18:05:14.539816] [WARN ] [MAIN ] CPT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:05:14.570871] [INFO ] [MAIN ] CPRI: Wiping existing primary data before full refresh. [2025-10-28T18:05:14.570818] [INFO ] [MAIN ] CPT: Wiping existing primary data before full refresh. [2025-10-28T18:05:14.576175] [INFO ] [LOCAL ] CPT: Starting deletion of primary data. [2025-10-28T18:05:14.570996] [INFO ] [LOCAL ] CPRI: Starting deletion of primary data. [2025-10-28T18:05:14.604734] [DEBUG] [LOCAL ] CPT: Deleted primary data file. [2025-10-28T18:05:14.631945] [DEBUG] [LOCAL ] CPRI: Deleted primary data file. [2025-10-28T18:05:14.639492] [INFO ] [MAIN ] CPT: Starting full primary refresh. [2025-10-28T18:05:14.653778] [INFO ] [MAIN ] CPRI: Starting full primary refresh. [2025-10-28T18:05:15.476639] [INFO ] [REMOTE ] CPS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:05:15.493261] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-01. [2025-10-28T18:05:15.635722] [INFO ] [REMOTE ] CPRI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:05:15.641770] [INFO ] [REMOTE ] CPT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:05:15.637830] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-01. [2025-10-28T18:05:15.642060] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-01. [2025-10-28T18:05:16.173731] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-28T18:05:16.183923] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-02. [2025-10-28T18:05:16.533587] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-28T18:05:16.538252] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-02. [2025-10-28T18:05:16.815129] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-28T18:05:16.824326] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-02. [2025-10-28T18:05:17.019016] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-28T18:05:17.433867] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-28T18:05:17.559335] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-03. [2025-10-28T18:05:17.937633] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-28T18:05:18.089449] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-10-28T18:05:18.359323] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-03. [2025-10-28T18:05:18.781683] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-28T18:05:19.159321] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-02. [2025-10-28T18:05:19.959396] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-04. [2025-10-28T18:05:20.249766] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-28T18:05:20.345748] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-28T18:05:20.759371] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-03. [2025-10-28T18:05:21.013934] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-28T18:05:21.559330] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-05. [2025-10-28T18:05:22.157094] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-28T18:05:22.359310] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-04. [2025-10-28T18:05:22.539518] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-28T18:05:23.159315] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-06. [2025-10-28T18:05:23.898670] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-28T18:05:23.959293] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-07. [2025-10-28T18:05:24.712177] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-28T18:05:24.759295] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-08. [2025-10-28T18:05:25.016935] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-04 (2.66 seconds). [2025-10-28T18:05:25.559313] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-05. [2025-10-28T18:05:25.724624] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-28T18:05:26.359318] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-03. [2025-10-28T18:05:27.159324] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-09. [2025-10-28T18:05:27.368823] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-28T18:05:27.776003] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-28T18:05:27.959309] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-28T18:05:27.959435] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-04. [2025-10-28T18:05:28.759340] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-10. [2025-10-28T18:05:29.250745] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-28T18:05:29.559352] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-05. [2025-10-28T18:05:29.732499] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-28T18:05:29.736920] [INFO ] [REMOTE ] CPS: Full fetch complete (36429 records). [2025-10-28T18:05:29.737001] [DEBUG] [VALIDATOR ] CPS: Validating primary data. [2025-10-28T18:05:30.097952] [DEBUG] [VALIDATOR ] CPS: All expected trading days are present. [2025-10-28T18:05:30.098031] [DEBUG] [VALIDATOR ] CPS: Primary data validation passed. [2025-10-28T18:05:30.098584] [INFO ] [MAIN ] CPS: Fetched primary data is valid. [2025-10-28T18:05:30.098632] [DEBUG] [LOCAL ] CPS: Saving primary data. [2025-10-28T18:05:30.099491] [DEBUG] [LOCAL ] CPS: Trimmed 36429 records to 24213 (keeping 200 days of data) [2025-10-28T18:05:30.233256] [DEBUG] [LOCAL ] CPS: Primary data saved (24213 records). [2025-10-28T18:05:30.233380] [INFO ] [MAIN ] CPS: Full history saved. [2025-10-28T18:05:30.233456] [INFO ] [MAIN ] Update Progress: 521/2366 symbols completed. CPS took 17.4s. Estimated remaining: 3h 51m 47s. Rate: 8.0 symbols/min [2025-10-28T18:05:30.370361] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-06. [2025-10-28T18:05:30.401542] [INFO ] [MAIN ] CQP: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:05:30.401731] [DEBUG] [LOCAL ] CQP: No existing data file found in primary storage. [2025-10-28T18:05:30.401786] [WARN ] [MAIN ] CQP: No existing data found, performing full refresh instead. [2025-10-28T18:05:30.401910] [INFO ] [MAIN ] CQP: Wiping existing primary data before full refresh. [2025-10-28T18:05:30.401950] [INFO ] [LOCAL ] CQP: Starting deletion of primary data. [2025-10-28T18:05:30.401991] [DEBUG] [LOCAL ] CQP: No primary data file found to delete. [2025-10-28T18:05:30.402022] [INFO ] [MAIN ] CQP: Starting full primary refresh. [2025-10-28T18:05:30.767506] [INFO ] [REMOTE ] CQP: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:05:30.821503] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-28T18:05:31.159329] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-06. [2025-10-28T18:05:31.959310] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-01. [2025-10-28T18:05:32.351853] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-10-28T18:05:32.619617] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-28T18:05:32.759341] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-07. [2025-10-28T18:05:32.855636] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-28T18:05:33.559330] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-07. [2025-10-28T18:05:34.359307] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-04. [2025-10-28T18:05:34.455591] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-28T18:05:34.815638] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-28T18:05:35.159356] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-02. [2025-10-28T18:05:35.926351] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-28T18:05:35.959322] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-08. [2025-10-28T18:05:36.072017] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-28T18:05:36.759334] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-05. [2025-10-28T18:05:37.554025] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-28T18:05:37.564501] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-03. [2025-10-28T18:05:38.004929] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-28T18:05:38.212726] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-28T18:05:38.359398] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-08. [2025-10-28T18:05:39.159343] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-09. [2025-10-28T18:05:39.498756] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-28T18:05:39.959385] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-04. [2025-10-28T18:05:40.614798] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-28T18:05:40.759404] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-06. [2025-10-28T18:05:41.094929] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-10-28T18:05:41.559338] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-09. [2025-10-28T18:05:41.930884] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-28T18:05:42.359365] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-07. [2025-10-28T18:05:42.703587] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-28T18:05:43.159335] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-10. [2025-10-28T18:05:43.830763] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-28T18:05:43.959354] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-08. [2025-10-28T18:05:44.759384] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-10. [2025-10-28T18:05:45.227513] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-28T18:05:45.269391] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-10 (2.11 seconds). [2025-10-28T18:05:45.281011] [INFO ] [REMOTE ] CPNG: Full fetch complete (77793 records). [2025-10-28T18:05:45.281201] [DEBUG] [VALIDATOR ] CPNG: Validating primary data. [2025-10-28T18:05:45.564546] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-09. [2025-10-28T18:05:45.679464] [DEBUG] [VALIDATOR ] CPNG: All expected trading days are present. [2025-10-28T18:05:45.679557] [DEBUG] [VALIDATOR ] CPNG: Primary data validation passed. [2025-10-28T18:05:45.680463] [INFO ] [MAIN ] CPNG: Fetched primary data is valid. [2025-10-28T18:05:45.680531] [DEBUG] [LOCAL ] CPNG: Saving primary data. [2025-10-28T18:05:45.682185] [DEBUG] [LOCAL ] CPNG: Trimmed 77793 records to 53679 (keeping 200 days of data) [2025-10-28T18:05:46.002256] [DEBUG] [LOCAL ] CPNG: Primary data saved (53679 records). [2025-10-28T18:05:46.002555] [INFO ] [MAIN ] CPNG: Full history saved. [2025-10-28T18:05:46.002715] [INFO ] [MAIN ] Update Progress: 522/2366 symbols completed. CPNG took 33.2s. Estimated remaining: 3h 52m 9s. Rate: 7.9 symbols/min [2025-10-28T18:05:46.197559] [INFO ] [MAIN ] CR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:05:46.201921] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-28T18:05:46.211745] [INFO ] [REMOTE ] CPT: Full fetch complete (64700 records). [2025-10-28T18:05:46.211905] [DEBUG] [VALIDATOR ] CPT: Validating primary data. [2025-10-28T18:05:46.386944] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-05. [2025-10-28T18:05:46.410624] [DEBUG] [LOCAL ] CR: Loaded 23894 existing records from primary storage. [2025-10-28T18:05:46.428923] [INFO ] [MAIN ] CR: Loaded 23894 existing records. [2025-10-28T18:05:46.843042] [DEBUG] [VALIDATOR ] CPT: All expected trading days are present. [2025-10-28T18:05:46.848307] [WARN ] [MAIN ] CR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:05:46.848552] [DEBUG] [VALIDATOR ] CPT: Primary data validation passed. [2025-10-28T18:05:46.848894] [INFO ] [MAIN ] CR: Wiping existing primary data before full refresh. [2025-10-28T18:05:46.848991] [INFO ] [LOCAL ] CR: Starting deletion of primary data. [2025-10-28T18:05:46.849946] [INFO ] [MAIN ] CPT: Fetched primary data is valid. [2025-10-28T18:05:46.850090] [DEBUG] [LOCAL ] CPT: Saving primary data. [2025-10-28T18:05:46.850476] [DEBUG] [LOCAL ] CR: Deleted primary data file. [2025-10-28T18:05:46.850583] [INFO ] [MAIN ] CR: Starting full primary refresh. [2025-10-28T18:05:46.922060] [DEBUG] [LOCAL ] CPT: Trimmed 64700 records to 44251 (keeping 200 days of data) [2025-10-28T18:05:47.431085] [DEBUG] [LOCAL ] CPT: Primary data saved (44251 records). [2025-10-28T18:05:47.457989] [INFO ] [MAIN ] CPT: Full history saved. [2025-10-28T18:05:47.484121] [INFO ] [MAIN ] Update Progress: 523/2366 symbols completed. CPT took 34.6s. Estimated remaining: 3h 51m 40s. Rate: 8.0 symbols/min [2025-10-28T18:05:47.569916] [INFO ] [REMOTE ] CR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:05:47.645431] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-01. [2025-10-28T18:05:47.676502] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-10-28T18:05:47.670526] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-28T18:05:47.763440] [INFO ] [MAIN ] CRBD: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:05:47.773494] [DEBUG] [LOCAL ] CRBD: Loaded 8602 existing records from primary storage. [2025-10-28T18:05:47.773720] [INFO ] [MAIN ] CRBD: Loaded 8602 existing records. [2025-10-28T18:05:47.946545] [WARN ] [MAIN ] CRBD: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:05:47.946762] [INFO ] [MAIN ] CRBD: Wiping existing primary data before full refresh. [2025-10-28T18:05:47.946812] [INFO ] [LOCAL ] CRBD: Starting deletion of primary data. [2025-10-28T18:05:47.947013] [DEBUG] [LOCAL ] CRBD: Deleted primary data file. [2025-10-28T18:05:47.947053] [INFO ] [MAIN ] CRBD: Starting full primary refresh. [2025-10-28T18:05:47.966946] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-10. [2025-10-28T18:05:48.307278] [INFO ] [REMOTE ] CRBD: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:05:48.574415] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-28T18:05:48.759344] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-06. [2025-10-28T18:05:49.319492] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-28T18:05:49.329302] [INFO ] [REMOTE ] CPRI: Full fetch complete (75808 records). [2025-10-28T18:05:49.329458] [DEBUG] [VALIDATOR ] CPRI: Validating primary data. [2025-10-28T18:05:49.330184] [FATAL] [VALIDATOR ] CPRI: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T18:05:49.330267] [FATAL] [MAIN ] CPRI: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:05:49.330334] [WARN ] [MAIN ] CPRI: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:05:49.330402] [INFO ] [LOCAL ] CPRI: Starting deletion of primary data. [2025-10-28T18:05:49.330465] [DEBUG] [LOCAL ] CPRI: No primary data file found to delete. [2025-10-28T18:05:49.330500] [INFO ] [LOCAL ] CPRI: Starting deletion of derivative data. [2025-10-28T18:05:49.330683] [DEBUG] [LOCAL ] CPRI: Deleted derivative data file. [2025-10-28T18:05:49.330774] [INFO ] [MAIN ] Update Progress: 524/2366 symbols completed. CPRI took 36.5s. Estimated remaining: 3h 51m 12s. Rate: 8.0 symbols/min [2025-10-28T18:05:49.494301] [INFO ] [MAIN ] CRBG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:05:49.542682] [DEBUG] [LOCAL ] CRBG: Loaded 52566 existing records from primary storage. [2025-10-28T18:05:49.542978] [INFO ] [MAIN ] CRBG: Loaded 52566 existing records. [2025-10-28T18:05:49.564402] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-02. [2025-10-28T18:05:49.723012] [WARN ] [MAIN ] CRBG: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:05:49.738195] [INFO ] [MAIN ] CRBG: Wiping existing primary data before full refresh. [2025-10-28T18:05:49.739281] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-28T18:05:49.738772] [INFO ] [LOCAL ] CRBG: Starting deletion of primary data. [2025-10-28T18:05:49.745618] [DEBUG] [LOCAL ] CRBG: Deleted primary data file. [2025-10-28T18:05:49.745706] [INFO ] [MAIN ] CRBG: Starting full primary refresh. [2025-10-28T18:05:50.101534] [INFO ] [REMOTE ] CRBG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:05:50.359677] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-01. [2025-10-28T18:05:50.359600] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-28T18:05:51.159398] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-01. [2025-10-28T18:05:51.789668] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-28T18:05:51.906373] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-28T18:05:51.959320] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-02. [2025-10-28T18:05:52.457534] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-28T18:05:52.759348] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-02. [2025-10-28T18:05:53.559326] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-07. [2025-10-28T18:05:53.883477] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-28T18:05:54.359421] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-03. [2025-10-28T18:05:54.426735] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-28T18:05:54.855886] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-28T18:05:55.159408] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-03. [2025-10-28T18:05:55.959401] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-04. [2025-10-28T18:05:56.449060] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-28T18:05:56.570626] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-28T18:05:56.759387] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-08. [2025-10-28T18:05:57.426829] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-28T18:05:57.559343] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-09. [2025-10-28T18:05:58.027831] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-28T18:05:58.359362] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-10. [2025-10-28T18:05:59.121025] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-28T18:05:59.124549] [INFO ] [REMOTE ] CQP: Full fetch complete (29427 records). [2025-10-28T18:05:59.124714] [DEBUG] [VALIDATOR ] CQP: Validating primary data. [2025-10-28T18:05:59.164437] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-04. [2025-10-28T18:05:59.526583] [DEBUG] [VALIDATOR ] CQP: All expected trading days are present. [2025-10-28T18:05:59.526693] [DEBUG] [VALIDATOR ] CQP: Primary data validation passed. [2025-10-28T18:05:59.527290] [INFO ] [MAIN ] CQP: Fetched primary data is valid. [2025-10-28T18:05:59.527355] [DEBUG] [LOCAL ] CQP: Saving primary data. [2025-10-28T18:05:59.528258] [DEBUG] [LOCAL ] CQP: Trimmed 29427 records to 18615 (keeping 200 days of data) [2025-10-28T18:05:59.639338] [DEBUG] [LOCAL ] CQP: Primary data saved (18615 records). [2025-10-28T18:05:59.639480] [INFO ] [MAIN ] CQP: Full history saved. [2025-10-28T18:05:59.639553] [INFO ] [MAIN ] Update Progress: 525/2366 symbols completed. CQP took 29.4s. Estimated remaining: 3h 51m 15s. Rate: 8.0 symbols/min [2025-10-28T18:05:59.815194] [INFO ] [MAIN ] CRC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:05:59.852198] [DEBUG] [LOCAL ] CRC: Loaded 43808 existing records from primary storage. [2025-10-28T18:05:59.852566] [INFO ] [MAIN ] CRC: Loaded 43808 existing records. [2025-10-28T18:05:59.960088] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-03. [2025-10-28T18:06:00.040547] [WARN ] [MAIN ] CRC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:06:00.040772] [INFO ] [MAIN ] CRC: Wiping existing primary data before full refresh. [2025-10-28T18:06:00.040822] [INFO ] [LOCAL ] CRC: Starting deletion of primary data. [2025-10-28T18:06:00.041507] [DEBUG] [LOCAL ] CRC: Deleted primary data file. [2025-10-28T18:06:00.041565] [INFO ] [MAIN ] CRC: Starting full primary refresh. [2025-10-28T18:06:00.425257] [INFO ] [REMOTE ] CRC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:06:00.571452] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-28T18:06:00.759367] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-05. [2025-10-28T18:06:01.065579] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-28T18:06:01.559349] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-04. [2025-10-28T18:06:02.359320] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-01. [2025-10-28T18:06:02.396952] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-28T18:06:02.515529] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-28T18:06:03.159360] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-05. [2025-10-28T18:06:03.475695] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-28T18:06:03.959321] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-02. [2025-10-28T18:06:04.183345] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-28T18:06:04.759397] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-06. [2025-10-28T18:06:05.056487] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-28T18:06:05.559325] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-05. [2025-10-28T18:06:05.911234] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-28T18:06:06.086405] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-28T18:06:06.359357] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-06. [2025-10-28T18:06:07.159366] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-06. [2025-10-28T18:06:07.215597] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-28T18:06:07.686193] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-28T18:06:07.959357] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-07. [2025-10-28T18:06:08.487384] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-28T18:06:08.759388] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-07. [2025-10-28T18:06:09.559350] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-03. [2025-10-28T18:06:10.224915] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-28T18:06:10.359345] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-08. [2025-10-28T18:06:10.801823] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-28T18:06:11.159352] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-07. [2025-10-28T18:06:11.741557] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-28T18:06:11.959342] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-09. [2025-10-28T18:06:12.033673] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-28T18:06:12.759358] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-08. [2025-10-28T18:06:13.241008] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-28T18:06:13.400844] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-28T18:06:13.559328] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-04. [2025-10-28T18:06:14.359345] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-09. [2025-10-28T18:06:14.710006] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-28T18:06:14.790774] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-10-28T18:06:15.159371] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-05. [2025-10-28T18:06:15.959350] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-10. [2025-10-28T18:06:16.284366] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-28T18:06:16.759376] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-10. [2025-10-28T18:06:17.328068] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-28T18:06:17.338578] [INFO ] [REMOTE ] CRBG: Full fetch complete (76044 records). [2025-10-28T18:06:17.338751] [DEBUG] [VALIDATOR ] CRBG: Validating primary data. [2025-10-28T18:06:17.468801] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-28T18:06:17.499525] [INFO ] [REMOTE ] CRBD: Full fetch complete (12725 records). [2025-10-28T18:06:17.510679] [DEBUG] [VALIDATOR ] CRBD: Validating primary data. [2025-10-28T18:06:17.567760] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-08. [2025-10-28T18:06:18.100730] [DEBUG] [VALIDATOR ] CRBG: All expected trading days are present. [2025-10-28T18:06:18.102281] [DEBUG] [VALIDATOR ] CRBG: Primary data validation passed. [2025-10-28T18:06:18.103239] [INFO ] [MAIN ] CRBG: Fetched primary data is valid. [2025-10-28T18:06:18.103633] [DEBUG] [LOCAL ] CRBG: Saving primary data. [2025-10-28T18:06:18.180827] [DEBUG] [LOCAL ] CRBG: Trimmed 76044 records to 52565 (keeping 200 days of data) [2025-10-28T18:06:18.188904] [DEBUG] [VALIDATOR ] CRBD: All expected trading days are present. [2025-10-28T18:06:18.189286] [DEBUG] [VALIDATOR ] CRBD: Primary data validation passed. [2025-10-28T18:06:18.189522] [INFO ] [MAIN ] CRBD: Fetched primary data is valid. [2025-10-28T18:06:18.189589] [DEBUG] [LOCAL ] CRBD: Saving primary data. [2025-10-28T18:06:18.190288] [DEBUG] [LOCAL ] CRBD: Trimmed 12725 records to 8602 (keeping 200 days of data) [2025-10-28T18:06:18.341797] [DEBUG] [LOCAL ] CRBD: Primary data saved (8602 records). [2025-10-28T18:06:18.353279] [INFO ] [MAIN ] CRBD: Full history saved. [2025-10-28T18:06:18.353409] [INFO ] [MAIN ] Update Progress: 526/2366 symbols completed. CRBD took 30.9s. Estimated remaining: 3h 51m 46s. Rate: 7.9 symbols/min [2025-10-28T18:06:18.372860] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-06. [2025-10-28T18:06:18.640008] [INFO ] [MAIN ] CRCL: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:06:18.648144] [DEBUG] [LOCAL ] CRCL: No existing data file found in primary storage. [2025-10-28T18:06:18.648925] [WARN ] [MAIN ] CRCL: No existing data found, performing full refresh instead. [2025-10-28T18:06:18.652904] [INFO ] [MAIN ] CRCL: Wiping existing primary data before full refresh. [2025-10-28T18:06:18.655815] [INFO ] [LOCAL ] CRCL: Starting deletion of primary data. [2025-10-28T18:06:18.672042] [DEBUG] [LOCAL ] CRCL: No primary data file found to delete. [2025-10-28T18:06:18.674517] [INFO ] [MAIN ] CRCL: Starting full primary refresh. [2025-10-28T18:06:18.673603] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-28T18:06:18.873823] [DEBUG] [LOCAL ] CRBG: Primary data saved (52565 records). [2025-10-28T18:06:18.884558] [INFO ] [MAIN ] CRBG: Full history saved. [2025-10-28T18:06:18.884708] [INFO ] [MAIN ] Update Progress: 527/2366 symbols completed. CRBG took 29.6s. Estimated remaining: 3h 51m 14s. Rate: 8.0 symbols/min [2025-10-28T18:06:19.166496] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-09. [2025-10-28T18:06:19.246153] [INFO ] [MAIN ] CRGY: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:06:19.331883] [INFO ] [REMOTE ] CRCL: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:06:19.371141] [DEBUG] [LOCAL ] CRGY: Loaded 52486 existing records from primary storage. [2025-10-28T18:06:19.371431] [INFO ] [MAIN ] CRGY: Loaded 52486 existing records. [2025-10-28T18:06:19.546524] [WARN ] [MAIN ] CRGY: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:06:19.546767] [INFO ] [MAIN ] CRGY: Wiping existing primary data before full refresh. [2025-10-28T18:06:19.546819] [INFO ] [LOCAL ] CRGY: Starting deletion of primary data. [2025-10-28T18:06:19.547348] [DEBUG] [LOCAL ] CRGY: Deleted primary data file. [2025-10-28T18:06:19.547405] [INFO ] [MAIN ] CRGY: Starting full primary refresh. [2025-10-28T18:06:19.917095] [INFO ] [REMOTE ] CRGY: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:06:19.940960] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-28T18:06:19.959301] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-07. [2025-10-28T18:06:20.213727] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-28T18:06:20.759345] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-01. [2025-10-28T18:06:20.919814] [DEBUG] [REMOTE ] CRCL: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-28T18:06:20.920168] [WARN ] [REMOTE ] CRCL: No data returned for month 2025-01 [2025-10-28T18:06:20.920254] [FATAL] [REMOTE ] CRCL: API call failed - aborting fetch to avoid wasting further API calls [2025-10-28T18:06:20.920299] [FATAL] [MAIN ] CRCL: Failed to fetch primary data. [2025-10-28T18:06:20.920360] [WARN ] [MAIN ] CRCL: Deleting existing primary and derivative data due to fetch failure. [2025-10-28T18:06:20.920429] [INFO ] [LOCAL ] CRCL: Starting deletion of primary data. [2025-10-28T18:06:20.920492] [DEBUG] [LOCAL ] CRCL: No primary data file found to delete. [2025-10-28T18:06:20.920527] [INFO ] [LOCAL ] CRCL: Starting deletion of derivative data. [2025-10-28T18:06:20.920565] [DEBUG] [LOCAL ] CRCL: No derivative data file found to delete. [2025-10-28T18:06:20.920610] [INFO ] [MAIN ] Update Progress: 528/2366 symbols completed. CRCL took 2.6s. Estimated remaining: 3h 50m 47s. Rate: 8.0 symbols/min [2025-10-28T18:06:21.090104] [INFO ] [MAIN ] CRH: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:06:21.137671] [DEBUG] [LOCAL ] CRH: Loaded 53392 existing records from primary storage. [2025-10-28T18:06:21.137974] [INFO ] [MAIN ] CRH: Loaded 53392 existing records. [2025-10-28T18:06:21.315021] [WARN ] [MAIN ] CRH: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:06:21.315381] [INFO ] [MAIN ] CRH: Wiping existing primary data before full refresh. [2025-10-28T18:06:21.315452] [INFO ] [LOCAL ] CRH: Starting deletion of primary data. [2025-10-28T18:06:21.316401] [DEBUG] [LOCAL ] CRH: Deleted primary data file. [2025-10-28T18:06:21.316461] [INFO ] [MAIN ] CRH: Starting full primary refresh. [2025-10-28T18:06:21.441529] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-28T18:06:21.564526] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-10. [2025-10-28T18:06:21.701911] [INFO ] [REMOTE ] CRH: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:06:22.359378] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-01. [2025-10-28T18:06:22.733635] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-28T18:06:22.738636] [INFO ] [REMOTE ] CR: Full fetch complete (35043 records). [2025-10-28T18:06:22.738743] [DEBUG] [VALIDATOR ] CR: Validating primary data. [2025-10-28T18:06:23.109897] [DEBUG] [VALIDATOR ] CR: All expected trading days are present. [2025-10-28T18:06:23.110196] [DEBUG] [VALIDATOR ] CR: Primary data validation passed. [2025-10-28T18:06:23.110702] [INFO ] [MAIN ] CR: Fetched primary data is valid. [2025-10-28T18:06:23.110762] [DEBUG] [LOCAL ] CR: Saving primary data. [2025-10-28T18:06:23.111527] [DEBUG] [LOCAL ] CR: Trimmed 35043 records to 23923 (keeping 200 days of data) [2025-10-28T18:06:23.164821] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-08. [2025-10-28T18:06:23.259568] [DEBUG] [LOCAL ] CR: Primary data saved (23923 records). [2025-10-28T18:06:23.259816] [INFO ] [MAIN ] CR: Full history saved. [2025-10-28T18:06:23.259905] [INFO ] [MAIN ] Update Progress: 529/2366 symbols completed. CR took 37.3s. Estimated remaining: 3h 50m 22s. Rate: 8.0 symbols/min [2025-10-28T18:06:23.426459] [INFO ] [MAIN ] CRI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:06:23.467824] [DEBUG] [LOCAL ] CRI: Loaded 49480 existing records from primary storage. [2025-10-28T18:06:23.468131] [INFO ] [MAIN ] CRI: Loaded 49480 existing records. [2025-10-28T18:06:23.651955] [WARN ] [MAIN ] CRI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:06:23.652538] [INFO ] [MAIN ] CRI: Wiping existing primary data before full refresh. [2025-10-28T18:06:23.652716] [INFO ] [LOCAL ] CRI: Starting deletion of primary data. [2025-10-28T18:06:23.653740] [DEBUG] [LOCAL ] CRI: Deleted primary data file. [2025-10-28T18:06:23.653800] [INFO ] [MAIN ] CRI: Starting full primary refresh. [2025-10-28T18:06:23.794794] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-28T18:06:23.969317] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-01. [2025-10-28T18:06:24.057588] [INFO ] [REMOTE ] CRI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:06:24.357770] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-28T18:06:24.759421] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-01. [2025-10-28T18:06:25.450372] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-28T18:06:25.559345] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-09. [2025-10-28T18:06:26.183970] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-28T18:06:26.359367] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-02. [2025-10-28T18:06:27.008115] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-28T18:06:27.159361] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-02. [2025-10-28T18:06:27.604110] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-28T18:06:27.959327] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-03. [2025-10-28T18:06:28.614214] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-28T18:06:28.759314] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-02. [2025-10-28T18:06:29.119239] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-28T18:06:29.559383] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-10. [2025-10-28T18:06:29.959574] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-28T18:06:30.359329] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-03. [2025-10-28T18:06:31.021767] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-28T18:06:31.030994] [INFO ] [REMOTE ] CRC: Full fetch complete (62837 records). [2025-10-28T18:06:31.031187] [DEBUG] [VALIDATOR ] CRC: Validating primary data. [2025-10-28T18:06:31.173513] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-04. [2025-10-28T18:06:31.417347] [DEBUG] [VALIDATOR ] CRC: All expected trading days are present. [2025-10-28T18:06:31.417502] [DEBUG] [VALIDATOR ] CRC: Primary data validation passed. [2025-10-28T18:06:31.418439] [INFO ] [MAIN ] CRC: Fetched primary data is valid. [2025-10-28T18:06:31.418509] [DEBUG] [LOCAL ] CRC: Saving primary data. [2025-10-28T18:06:31.420092] [DEBUG] [LOCAL ] CRC: Trimmed 62837 records to 43708 (keeping 200 days of data) [2025-10-28T18:06:31.703334] [DEBUG] [LOCAL ] CRC: Primary data saved (43708 records). [2025-10-28T18:06:31.703591] [INFO ] [MAIN ] CRC: Full history saved. [2025-10-28T18:06:31.703745] [INFO ] [MAIN ] Update Progress: 530/2366 symbols completed. CRC took 32.1s. Estimated remaining: 3h 50m 17s. Rate: 8.0 symbols/min [2025-10-28T18:06:31.929983] [INFO ] [MAIN ] CRK: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:06:31.933146] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-28T18:06:31.971441] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-04. [2025-10-28T18:06:31.995824] [DEBUG] [LOCAL ] CRK: Loaded 52167 existing records from primary storage. [2025-10-28T18:06:31.996137] [INFO ] [MAIN ] CRK: Loaded 52167 existing records. [2025-10-28T18:06:32.195832] [WARN ] [MAIN ] CRK: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:06:32.196057] [INFO ] [MAIN ] CRK: Wiping existing primary data before full refresh. [2025-10-28T18:06:32.196121] [INFO ] [LOCAL ] CRK: Starting deletion of primary data. [2025-10-28T18:06:32.196560] [DEBUG] [LOCAL ] CRK: Deleted primary data file. [2025-10-28T18:06:32.196602] [INFO ] [MAIN ] CRK: Starting full primary refresh. [2025-10-28T18:06:32.614834] [INFO ] [REMOTE ] CRK: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:06:32.647821] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-28T18:06:32.759326] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-01. [2025-10-28T18:06:33.179105] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-28T18:06:33.559388] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-03. [2025-10-28T18:06:33.994411] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-28T18:06:34.359425] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-05. [2025-10-28T18:06:35.006870] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-28T18:06:35.159370] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-04. [2025-10-28T18:06:35.651262] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-28T18:06:35.959379] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-05. [2025-10-28T18:06:36.771065] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-02. [2025-10-28T18:06:36.777452] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-28T18:06:37.418724] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-28T18:06:37.559342] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-06. [2025-10-28T18:06:37.918124] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-28T18:06:38.359366] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-03. [2025-10-28T18:06:38.903060] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-28T18:06:39.159403] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-05. [2025-10-28T18:06:39.619445] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-28T18:06:39.959327] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-07. [2025-10-28T18:06:40.627517] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-28T18:06:40.759318] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-06. [2025-10-28T18:06:41.414061] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-28T18:06:41.559353] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-08. [2025-10-28T18:06:42.158282] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-28T18:06:42.359401] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-07. [2025-10-28T18:06:42.994495] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-28T18:06:43.159355] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-06. [2025-10-28T18:06:43.579579] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-28T18:06:43.959398] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-04. [2025-10-28T18:06:44.633286] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-28T18:06:44.759314] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-07. [2025-10-28T18:06:45.189241] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-28T18:06:45.559376] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-08. [2025-10-28T18:06:46.359368] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-05. [2025-10-28T18:06:46.583013] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-10-28T18:06:46.793549] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-28T18:06:47.159358] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-08. [2025-10-28T18:06:47.583061] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-28T18:06:47.959382] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-09. [2025-10-28T18:06:48.759329] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-06. [2025-10-28T18:06:48.844382] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-28T18:06:49.507134] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-28T18:06:49.559345] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-09. [2025-10-28T18:06:49.946259] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-28T18:06:50.359345] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-10. [2025-10-28T18:06:50.814742] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-28T18:06:51.159380] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-09. [2025-10-28T18:06:51.944590] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-28T18:06:51.955154] [INFO ] [REMOTE ] CRGY: Full fetch complete (76169 records). [2025-10-28T18:06:51.955291] [DEBUG] [VALIDATOR ] CRGY: Validating primary data. [2025-10-28T18:06:51.966900] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-10. [2025-10-28T18:06:52.345524] [DEBUG] [VALIDATOR ] CRGY: All expected trading days are present. [2025-10-28T18:06:52.345704] [DEBUG] [VALIDATOR ] CRGY: Primary data validation passed. [2025-10-28T18:06:52.346609] [INFO ] [MAIN ] CRGY: Fetched primary data is valid. [2025-10-28T18:06:52.346694] [DEBUG] [LOCAL ] CRGY: Saving primary data. [2025-10-28T18:06:52.348153] [DEBUG] [LOCAL ] CRGY: Trimmed 76169 records to 52484 (keeping 200 days of data) [2025-10-28T18:06:52.625790] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-28T18:06:52.718734] [DEBUG] [LOCAL ] CRGY: Primary data saved (52484 records). [2025-10-28T18:06:52.718857] [INFO ] [MAIN ] CRGY: Full history saved. [2025-10-28T18:06:52.718933] [INFO ] [MAIN ] Update Progress: 531/2366 symbols completed. CRGY took 33.8s. Estimated remaining: 3h 50m 57s. Rate: 7.9 symbols/min [2025-10-28T18:06:52.764420] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-10. [2025-10-28T18:06:52.887602] [INFO ] [MAIN ] CRL: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:06:52.926220] [DEBUG] [LOCAL ] CRL: Loaded 42476 existing records from primary storage. [2025-10-28T18:06:52.926500] [INFO ] [MAIN ] CRL: Loaded 42476 existing records. [2025-10-28T18:06:53.101927] [WARN ] [MAIN ] CRL: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:06:53.102147] [INFO ] [MAIN ] CRL: Wiping existing primary data before full refresh. [2025-10-28T18:06:53.102195] [INFO ] [LOCAL ] CRL: Starting deletion of primary data. [2025-10-28T18:06:53.102913] [DEBUG] [LOCAL ] CRL: Deleted primary data file. [2025-10-28T18:06:53.102969] [INFO ] [MAIN ] CRL: Starting full primary refresh. [2025-10-28T18:06:53.473941] [INFO ] [REMOTE ] CRL: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:06:53.502714] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-28T18:06:53.512231] [INFO ] [REMOTE ] CRI: Full fetch complete (71076 records). [2025-10-28T18:06:53.512365] [DEBUG] [VALIDATOR ] CRI: Validating primary data. [2025-10-28T18:06:53.566320] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-07. [2025-10-28T18:06:53.894439] [DEBUG] [VALIDATOR ] CRI: All expected trading days are present. [2025-10-28T18:06:53.894518] [DEBUG] [VALIDATOR ] CRI: Primary data validation passed. [2025-10-28T18:06:53.895474] [INFO ] [MAIN ] CRI: Fetched primary data is valid. [2025-10-28T18:06:53.895543] [DEBUG] [LOCAL ] CRI: Saving primary data. [2025-10-28T18:06:53.897154] [DEBUG] [LOCAL ] CRI: Trimmed 71076 records to 49467 (keeping 200 days of data) [2025-10-28T18:06:54.194399] [DEBUG] [LOCAL ] CRI: Primary data saved (49467 records). [2025-10-28T18:06:54.194556] [INFO ] [MAIN ] CRI: Full history saved. [2025-10-28T18:06:54.194718] [INFO ] [MAIN ] Update Progress: 532/2366 symbols completed. CRI took 30.9s. Estimated remaining: 3h 50m 28s. Rate: 8.0 symbols/min [2025-10-28T18:06:54.366343] [INFO ] [MAIN ] CRM: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:06:54.363804] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-01. [2025-10-28T18:06:54.400227] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-28T18:06:54.411190] [INFO ] [REMOTE ] CRH: Full fetch complete (77512 records). [2025-10-28T18:06:54.411317] [DEBUG] [VALIDATOR ] CRH: Validating primary data. [2025-10-28T18:06:54.736155] [DEBUG] [LOCAL ] CRM: Loaded 53770 existing records from primary storage. [2025-10-28T18:06:54.755205] [INFO ] [MAIN ] CRM: Loaded 53770 existing records. [2025-10-28T18:06:54.958024] [DEBUG] [VALIDATOR ] CRH: All expected trading days are present. [2025-10-28T18:06:54.963633] [DEBUG] [VALIDATOR ] CRH: Primary data validation passed. [2025-10-28T18:06:54.980376] [INFO ] [MAIN ] CRH: Fetched primary data is valid. [2025-10-28T18:06:55.008762] [DEBUG] [LOCAL ] CRH: Saving primary data. [2025-10-28T18:06:55.039061] [WARN ] [MAIN ] CRM: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:06:55.039751] [INFO ] [MAIN ] CRM: Wiping existing primary data before full refresh. [2025-10-28T18:06:55.040188] [INFO ] [LOCAL ] CRM: Starting deletion of primary data. [2025-10-28T18:06:55.040950] [DEBUG] [LOCAL ] CRM: Deleted primary data file. [2025-10-28T18:06:55.041227] [INFO ] [MAIN ] CRM: Starting full primary refresh. [2025-10-28T18:06:55.052561] [DEBUG] [LOCAL ] CRH: Trimmed 77512 records to 53383 (keeping 200 days of data) [2025-10-28T18:06:55.512814] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-28T18:06:55.595453] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-08. [2025-10-28T18:06:55.702315] [INFO ] [REMOTE ] CRM: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:06:55.794473] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-28T18:06:55.821075] [DEBUG] [LOCAL ] CRH: Primary data saved (53383 records). [2025-10-28T18:06:55.821188] [INFO ] [MAIN ] CRH: Full history saved. [2025-10-28T18:06:55.821261] [INFO ] [MAIN ] Update Progress: 533/2366 symbols completed. CRH took 34.9s. Estimated remaining: 3h 50m 0s. Rate: 8.0 symbols/min [2025-10-28T18:06:55.965259] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-02. [2025-10-28T18:06:55.992695] [INFO ] [MAIN ] CRS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:06:56.029636] [DEBUG] [LOCAL ] CRS: Loaded 43082 existing records from primary storage. [2025-10-28T18:06:56.029936] [INFO ] [MAIN ] CRS: Loaded 43082 existing records. [2025-10-28T18:06:56.210012] [WARN ] [MAIN ] CRS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:06:56.210238] [INFO ] [MAIN ] CRS: Wiping existing primary data before full refresh. [2025-10-28T18:06:56.210297] [INFO ] [LOCAL ] CRS: Starting deletion of primary data. [2025-10-28T18:06:56.211103] [DEBUG] [LOCAL ] CRS: Deleted primary data file. [2025-10-28T18:06:56.211161] [INFO ] [MAIN ] CRS: Starting full primary refresh. [2025-10-28T18:06:56.559309] [INFO ] [REMOTE ] CRS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:06:56.759385] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-01. [2025-10-28T18:06:56.945988] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-28T18:06:57.245890] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-28T18:06:57.559384] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-03. [2025-10-28T18:06:58.359311] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-01. [2025-10-28T18:06:58.597396] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-10-28T18:06:58.741626] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-28T18:06:59.159318] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-09. [2025-10-28T18:06:59.485570] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-28T18:06:59.959316] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-02. [2025-10-28T18:07:00.578010] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-28T18:07:00.759367] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-02. [2025-10-28T18:07:01.264481] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-28T18:07:01.559344] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-10. [2025-10-28T18:07:02.359396] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-04. [2025-10-28T18:07:02.484793] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-10-28T18:07:03.030761] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-28T18:07:03.041158] [INFO ] [REMOTE ] CRK: Full fetch complete (75369 records). [2025-10-28T18:07:03.041318] [DEBUG] [VALIDATOR ] CRK: Validating primary data. [2025-10-28T18:07:03.042219] [FATAL] [VALIDATOR ] CRK: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T18:07:03.042313] [FATAL] [MAIN ] CRK: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:07:03.042358] [WARN ] [MAIN ] CRK: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:07:03.042397] [INFO ] [LOCAL ] CRK: Starting deletion of primary data. [2025-10-28T18:07:03.042456] [DEBUG] [LOCAL ] CRK: No primary data file found to delete. [2025-10-28T18:07:03.042490] [INFO ] [LOCAL ] CRK: Starting deletion of derivative data. [2025-10-28T18:07:03.042707] [DEBUG] [LOCAL ] CRK: Deleted derivative data file. [2025-10-28T18:07:03.042811] [INFO ] [MAIN ] Update Progress: 534/2366 symbols completed. CRK took 31.3s. Estimated remaining: 3h 49m 52s. Rate: 8.0 symbols/min [2025-10-28T18:07:03.164554] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-03. [2025-10-28T18:07:03.212294] [INFO ] [MAIN ] CRT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:07:03.217937] [DEBUG] [LOCAL ] CRT: Loaded 4799 existing records from primary storage. [2025-10-28T18:07:03.218116] [INFO ] [MAIN ] CRT: Loaded 4799 existing records. [2025-10-28T18:07:03.402662] [WARN ] [MAIN ] CRT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:07:03.402885] [INFO ] [MAIN ] CRT: Wiping existing primary data before full refresh. [2025-10-28T18:07:03.402932] [INFO ] [LOCAL ] CRT: Starting deletion of primary data. [2025-10-28T18:07:03.403140] [DEBUG] [LOCAL ] CRT: Deleted primary data file. [2025-10-28T18:07:03.403198] [INFO ] [MAIN ] CRT: Starting full primary refresh. [2025-10-28T18:07:03.764295] [INFO ] [REMOTE ] CRT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:07:03.849256] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-28T18:07:03.959355] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-01. [2025-10-28T18:07:04.510999] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-28T18:07:04.512676] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-28T18:07:04.759347] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-04. [2025-10-28T18:07:05.559341] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-05. [2025-10-28T18:07:06.099021] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-28T18:07:06.359362] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-05. [2025-10-28T18:07:06.858709] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-28T18:07:07.159322] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-06. [2025-10-28T18:07:07.795929] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-28T18:07:07.959328] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-06. [2025-10-28T18:07:08.568022] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-28T18:07:08.759351] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-02. [2025-10-28T18:07:09.361015] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-28T18:07:09.424949] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-28T18:07:09.559337] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-03. [2025-10-28T18:07:09.964412] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-10-28T18:07:10.359325] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-03. [2025-10-28T18:07:11.159355] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-04. [2025-10-28T18:07:11.583269] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-28T18:07:11.959355] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-05. [2025-10-28T18:07:12.335770] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-10-28T18:07:12.442444] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-10-28T18:07:12.759357] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-07. [2025-10-28T18:07:13.559340] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-04. [2025-10-28T18:07:14.233561] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-28T18:07:14.359363] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-06. [2025-10-28T18:07:14.844251] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-28T18:07:15.159357] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-07. [2025-10-28T18:07:15.290579] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-28T18:07:15.959366] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-07. [2025-10-28T18:07:16.360408] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-10-28T18:07:16.681260] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-28T18:07:16.759344] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-08. [2025-10-28T18:07:17.559346] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-05. [2025-10-28T18:07:17.984013] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-28T18:07:18.359334] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-09. [2025-10-28T18:07:19.159312] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-08. [2025-10-28T18:07:19.334220] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-28T18:07:19.557344] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-10-28T18:07:19.655859] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-28T18:07:19.959351] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-09. [2025-10-28T18:07:20.431149] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-28T18:07:20.759357] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-10. [2025-10-28T18:07:21.447619] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-28T18:07:21.449221] [INFO ] [REMOTE ] CRT: Full fetch complete (7423 records). [2025-10-28T18:07:21.449304] [DEBUG] [VALIDATOR ] CRT: Validating primary data. [2025-10-28T18:07:21.564455] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-06. [2025-10-28T18:07:21.802188] [DEBUG] [VALIDATOR ] CRT: All expected trading days are present. [2025-10-28T18:07:21.802261] [DEBUG] [VALIDATOR ] CRT: Primary data validation passed. [2025-10-28T18:07:21.802449] [INFO ] [MAIN ] CRT: Fetched primary data is valid. [2025-10-28T18:07:21.802487] [DEBUG] [LOCAL ] CRT: Saving primary data. [2025-10-28T18:07:21.802887] [DEBUG] [LOCAL ] CRT: Trimmed 7423 records to 4820 (keeping 200 days of data) [2025-10-28T18:07:21.831527] [DEBUG] [LOCAL ] CRT: Primary data saved (4820 records). [2025-10-28T18:07:21.831601] [INFO ] [MAIN ] CRT: Full history saved. [2025-10-28T18:07:21.831713] [INFO ] [MAIN ] Update Progress: 535/2366 symbols completed. CRT took 18.8s. Estimated remaining: 3h 50m 23s. Rate: 7.9 symbols/min [2025-10-28T18:07:21.995827] [INFO ] [MAIN ] CSAN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:07:22.033685] [DEBUG] [LOCAL ] CSAN: Loaded 42109 existing records from primary storage. [2025-10-28T18:07:22.033962] [INFO ] [MAIN ] CSAN: Loaded 42109 existing records. [2025-10-28T18:07:22.207451] [WARN ] [MAIN ] CSAN: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:07:22.207687] [INFO ] [MAIN ] CSAN: Wiping existing primary data before full refresh. [2025-10-28T18:07:22.207744] [INFO ] [LOCAL ] CSAN: Starting deletion of primary data. [2025-10-28T18:07:22.208234] [DEBUG] [LOCAL ] CSAN: Deleted primary data file. [2025-10-28T18:07:22.208290] [INFO ] [MAIN ] CSAN: Starting full primary refresh. [2025-10-28T18:07:22.366620] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-10. [2025-10-28T18:07:22.562413] [INFO ] [REMOTE ] CSAN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:07:23.159382] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-01. [2025-10-28T18:07:23.415435] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-10-28T18:07:23.902374] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-28T18:07:23.912839] [INFO ] [REMOTE ] CRL: Full fetch complete (63791 records). [2025-10-28T18:07:23.912968] [DEBUG] [VALIDATOR ] CRL: Validating primary data. [2025-10-28T18:07:23.967372] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-07. [2025-10-28T18:07:24.320568] [DEBUG] [VALIDATOR ] CRL: All expected trading days are present. [2025-10-28T18:07:24.320724] [DEBUG] [VALIDATOR ] CRL: Primary data validation passed. [2025-10-28T18:07:24.321574] [INFO ] [MAIN ] CRL: Fetched primary data is valid. [2025-10-28T18:07:24.321714] [DEBUG] [LOCAL ] CRL: Saving primary data. [2025-10-28T18:07:24.337350] [DEBUG] [LOCAL ] CRL: Trimmed 63791 records to 42469 (keeping 200 days of data) [2025-10-28T18:07:24.349151] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-28T18:07:24.610077] [DEBUG] [LOCAL ] CRL: Primary data saved (42469 records). [2025-10-28T18:07:24.610239] [INFO ] [MAIN ] CRL: Full history saved. [2025-10-28T18:07:24.611174] [INFO ] [MAIN ] Update Progress: 536/2366 symbols completed. CRL took 31.9s. Estimated remaining: 3h 49m 59s. Rate: 8.0 symbols/min [2025-10-28T18:07:24.768470] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-08. [2025-10-28T18:07:24.799212] [INFO ] [MAIN ] CSL: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:07:24.831776] [DEBUG] [LOCAL ] CSL: Loaded 30902 existing records from primary storage. [2025-10-28T18:07:24.832014] [INFO ] [MAIN ] CSL: Loaded 30902 existing records. [2025-10-28T18:07:25.010355] [WARN ] [MAIN ] CSL: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:07:25.010571] [INFO ] [MAIN ] CSL: Wiping existing primary data before full refresh. [2025-10-28T18:07:25.010617] [INFO ] [LOCAL ] CSL: Starting deletion of primary data. [2025-10-28T18:07:25.011112] [DEBUG] [LOCAL ] CSL: Deleted primary data file. [2025-10-28T18:07:25.011169] [INFO ] [MAIN ] CSL: Starting full primary refresh. [2025-10-28T18:07:25.391943] [INFO ] [REMOTE ] CSL: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:07:25.559326] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-02. [2025-10-28T18:07:26.115711] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-28T18:07:26.156020] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-10-28T18:07:26.359335] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-09. [2025-10-28T18:07:26.762948] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-28T18:07:27.159324] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-03. [2025-10-28T18:07:27.727332] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-28T18:07:27.959369] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-08. [2025-10-28T18:07:28.275146] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-28T18:07:28.759371] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-10. [2025-10-28T18:07:29.559376] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-04. [2025-10-28T18:07:30.130766] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-10-28T18:07:30.224238] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-28T18:07:30.232702] [INFO ] [REMOTE ] CRS: Full fetch complete (62854 records). [2025-10-28T18:07:30.232821] [DEBUG] [VALIDATOR ] CRS: Validating primary data. [2025-10-28T18:07:30.371181] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-09. [2025-10-28T18:07:30.622248] [DEBUG] [VALIDATOR ] CRS: All expected trading days are present. [2025-10-28T18:07:30.622356] [DEBUG] [VALIDATOR ] CRS: Primary data validation passed. [2025-10-28T18:07:30.623362] [INFO ] [MAIN ] CRS: Fetched primary data is valid. [2025-10-28T18:07:30.623444] [DEBUG] [LOCAL ] CRS: Saving primary data. [2025-10-28T18:07:30.625079] [DEBUG] [LOCAL ] CRS: Trimmed 62854 records to 43073 (keeping 200 days of data) [2025-10-28T18:07:30.652350] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-28T18:07:30.926755] [DEBUG] [LOCAL ] CRS: Primary data saved (43073 records). [2025-10-28T18:07:30.926897] [INFO ] [MAIN ] CRS: Full history saved. [2025-10-28T18:07:30.926978] [INFO ] [MAIN ] Update Progress: 537/2366 symbols completed. CRS took 35.1s. Estimated remaining: 3h 49m 47s. Rate: 8.0 symbols/min [2025-10-28T18:07:31.093221] [INFO ] [MAIN ] CSR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:07:31.105941] [DEBUG] [LOCAL ] CSR: Loaded 13284 existing records from primary storage. [2025-10-28T18:07:31.106143] [INFO ] [MAIN ] CSR: Loaded 13284 existing records. [2025-10-28T18:07:31.167879] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-05. [2025-10-28T18:07:31.284050] [WARN ] [MAIN ] CSR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:07:31.284236] [INFO ] [MAIN ] CSR: Wiping existing primary data before full refresh. [2025-10-28T18:07:31.284281] [INFO ] [LOCAL ] CSR: Starting deletion of primary data. [2025-10-28T18:07:31.284565] [DEBUG] [LOCAL ] CSR: Deleted primary data file. [2025-10-28T18:07:31.284605] [INFO ] [MAIN ] CSR: Starting full primary refresh. [2025-10-28T18:07:31.651359] [INFO ] [REMOTE ] CSR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:07:31.959355] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-01. [2025-10-28T18:07:32.355110] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-28T18:07:32.631587] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-09 (2.26 seconds). [2025-10-28T18:07:32.759306] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-06. [2025-10-28T18:07:32.777888] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-28T18:07:33.559381] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-10. [2025-10-28T18:07:33.876297] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-28T18:07:34.166204] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-28T18:07:34.177293] [INFO ] [REMOTE ] CRM: Full fetch complete (77947 records). [2025-10-28T18:07:34.177413] [DEBUG] [VALIDATOR ] CRM: Validating primary data. [2025-10-28T18:07:34.371199] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-07. [2025-10-28T18:07:34.571510] [DEBUG] [VALIDATOR ] CRM: All expected trading days are present. [2025-10-28T18:07:34.571579] [DEBUG] [VALIDATOR ] CRM: Primary data validation passed. [2025-10-28T18:07:34.572429] [INFO ] [MAIN ] CRM: Fetched primary data is valid. [2025-10-28T18:07:34.572489] [DEBUG] [LOCAL ] CRM: Saving primary data. [2025-10-28T18:07:34.573843] [DEBUG] [LOCAL ] CRM: Trimmed 77947 records to 53770 (keeping 200 days of data) [2025-10-28T18:07:34.903068] [DEBUG] [LOCAL ] CRM: Primary data saved (53770 records). [2025-10-28T18:07:34.903205] [INFO ] [MAIN ] CRM: Full history saved. [2025-10-28T18:07:34.903282] [INFO ] [MAIN ] Update Progress: 538/2366 symbols completed. CRM took 40.7s. Estimated remaining: 3h 49m 27s. Rate: 8.0 symbols/min [2025-10-28T18:07:35.072031] [INFO ] [MAIN ] CSTM: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:07:35.113777] [DEBUG] [LOCAL ] CSTM: Loaded 47323 existing records from primary storage. [2025-10-28T18:07:35.114153] [INFO ] [MAIN ] CSTM: Loaded 47323 existing records. [2025-10-28T18:07:35.170440] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-02. [2025-10-28T18:07:35.310701] [WARN ] [MAIN ] CSTM: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:07:35.310954] [INFO ] [MAIN ] CSTM: Wiping existing primary data before full refresh. [2025-10-28T18:07:35.311004] [INFO ] [LOCAL ] CSTM: Starting deletion of primary data. [2025-10-28T18:07:35.311729] [DEBUG] [LOCAL ] CSTM: Deleted primary data file. [2025-10-28T18:07:35.311789] [INFO ] [MAIN ] CSTM: Starting full primary refresh. [2025-10-28T18:07:35.669808] [INFO ] [REMOTE ] CSTM: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:07:35.695202] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-28T18:07:35.799408] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-28T18:07:35.959337] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-01. [2025-10-28T18:07:36.759387] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-03. [2025-10-28T18:07:37.297165] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-28T18:07:37.370592] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-28T18:07:37.559302] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-02. [2025-10-28T18:07:38.359339] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-08. [2025-10-28T18:07:38.806854] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-28T18:07:39.159350] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-04. [2025-10-28T18:07:39.628065] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-28T18:07:39.841192] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-28T18:07:39.959372] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-09. [2025-10-28T18:07:40.759341] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-01. [2025-10-28T18:07:41.272436] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-28T18:07:41.559402] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-03. [2025-10-28T18:07:41.847895] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-28T18:07:42.359337] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-02. [2025-10-28T18:07:42.774106] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-28T18:07:43.159418] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-05. [2025-10-28T18:07:43.391318] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-28T18:07:43.904589] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-28T18:07:43.959306] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-06. [2025-10-28T18:07:44.614560] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-28T18:07:44.759336] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-07. [2025-10-28T18:07:45.436119] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-28T18:07:45.559356] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-03. [2025-10-28T18:07:46.359386] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-10. [2025-10-28T18:07:46.662034] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-28T18:07:47.159344] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-04. [2025-10-28T18:07:47.804892] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-28T18:07:47.813098] [INFO ] [REMOTE ] CSAN: Full fetch complete (60283 records). [2025-10-28T18:07:47.813255] [DEBUG] [VALIDATOR ] CSAN: Validating primary data. [2025-10-28T18:07:47.964498] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-04. [2025-10-28T18:07:48.219611] [DEBUG] [VALIDATOR ] CSAN: All expected trading days are present. [2025-10-28T18:07:48.219723] [DEBUG] [VALIDATOR ] CSAN: Primary data validation passed. [2025-10-28T18:07:48.220478] [INFO ] [MAIN ] CSAN: Fetched primary data is valid. [2025-10-28T18:07:48.220522] [DEBUG] [LOCAL ] CSAN: Saving primary data. [2025-10-28T18:07:48.221767] [DEBUG] [LOCAL ] CSAN: Trimmed 60283 records to 41980 (keeping 200 days of data) [2025-10-28T18:07:48.449815] [DEBUG] [LOCAL ] CSAN: Primary data saved (41980 records). [2025-10-28T18:07:48.449944] [INFO ] [MAIN ] CSAN: Full history saved. [2025-10-28T18:07:48.450022] [INFO ] [MAIN ] Update Progress: 539/2366 symbols completed. CSAN took 26.6s. Estimated remaining: 3h 49m 40s. Rate: 8.0 symbols/min [2025-10-28T18:07:48.625986] [INFO ] [MAIN ] CSV: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:07:48.670377] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-10-28T18:07:48.686927] [DEBUG] [LOCAL ] CSV: Loaded 12119 existing records from primary storage. [2025-10-28T18:07:48.687236] [INFO ] [MAIN ] CSV: Loaded 12119 existing records. [2025-10-28T18:07:48.764494] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-08. [2025-10-28T18:07:48.871610] [WARN ] [MAIN ] CSV: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:07:48.872249] [INFO ] [MAIN ] CSV: Wiping existing primary data before full refresh. [2025-10-28T18:07:48.872303] [INFO ] [LOCAL ] CSV: Starting deletion of primary data. [2025-10-28T18:07:48.872523] [DEBUG] [LOCAL ] CSV: Deleted primary data file. [2025-10-28T18:07:48.872567] [INFO ] [MAIN ] CSV: Starting full primary refresh. [2025-10-28T18:07:49.241222] [INFO ] [REMOTE ] CSV: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:07:49.285510] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-28T18:07:49.454328] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-28T18:07:49.559356] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-05. [2025-10-28T18:07:50.359417] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-05. [2025-10-28T18:07:50.662453] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-28T18:07:51.159426] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-01. [2025-10-28T18:07:51.437733] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-28T18:07:51.881728] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-28T18:07:51.959383] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-06. [2025-10-28T18:07:52.759406] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-02. [2025-10-28T18:07:52.904297] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-28T18:07:53.484251] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-28T18:07:53.559541] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-07. [2025-10-28T18:07:54.359371] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-03. [2025-10-28T18:07:54.774634] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-28T18:07:55.016816] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-28T18:07:55.159334] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-08. [2025-10-28T18:07:55.959332] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-04. [2025-10-28T18:07:56.154338] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-28T18:07:56.735498] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-28T18:07:56.759301] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-05. [2025-10-28T18:07:57.413581] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-28T18:07:57.559350] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-09. [2025-10-28T18:07:58.359328] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-06. [2025-10-28T18:07:58.772071] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-28T18:07:59.159407] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-09. [2025-10-28T18:07:59.959360] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-06. [2025-10-28T18:08:00.115949] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-28T18:08:00.158258] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-10-28T18:08:00.521415] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-28T18:08:00.759376] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-10. [2025-10-28T18:08:01.559342] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-07. [2025-10-28T18:08:01.728963] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-28T18:08:01.732064] [INFO ] [REMOTE ] CSR: Full fetch complete (17872 records). [2025-10-28T18:08:01.732132] [DEBUG] [VALIDATOR ] CSR: Validating primary data. [2025-10-28T18:08:01.732513] [FATAL] [VALIDATOR ] CSR: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T18:08:01.732593] [FATAL] [MAIN ] CSR: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:08:01.732636] [WARN ] [MAIN ] CSR: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:08:01.732725] [INFO ] [LOCAL ] CSR: Starting deletion of primary data. [2025-10-28T18:08:01.732785] [DEBUG] [LOCAL ] CSR: No primary data file found to delete. [2025-10-28T18:08:01.732820] [INFO ] [LOCAL ] CSR: Starting deletion of derivative data. [2025-10-28T18:08:01.732995] [DEBUG] [LOCAL ] CSR: Deleted derivative data file. [2025-10-28T18:08:01.733081] [INFO ] [MAIN ] Update Progress: 540/2366 symbols completed. CSR took 30.8s. Estimated remaining: 3h 49m 52s. Rate: 7.9 symbols/min [2025-10-28T18:08:01.897224] [INFO ] [MAIN ] CSW: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:08:01.897404] [DEBUG] [LOCAL ] CSW: No existing data file found in primary storage. [2025-10-28T18:08:01.897441] [WARN ] [MAIN ] CSW: No existing data found, performing full refresh instead. [2025-10-28T18:08:01.897546] [INFO ] [MAIN ] CSW: Wiping existing primary data before full refresh. [2025-10-28T18:08:01.897587] [INFO ] [LOCAL ] CSW: Starting deletion of primary data. [2025-10-28T18:08:01.897627] [DEBUG] [LOCAL ] CSW: No primary data file found to delete. [2025-10-28T18:08:01.897694] [INFO ] [MAIN ] CSW: Starting full primary refresh. [2025-10-28T18:08:02.242128] [INFO ] [REMOTE ] CSW: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:08:02.359365] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-01. [2025-10-28T18:08:02.505396] [DEBUG] [REMOTE ] CSW: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-28T18:08:02.505776] [WARN ] [REMOTE ] CSW: No data returned for month 2025-01 [2025-10-28T18:08:02.505885] [FATAL] [REMOTE ] CSW: API call failed - aborting fetch to avoid wasting further API calls [2025-10-28T18:08:02.505935] [FATAL] [MAIN ] CSW: Failed to fetch primary data. [2025-10-28T18:08:02.505985] [WARN ] [MAIN ] CSW: Deleting existing primary and derivative data due to fetch failure. [2025-10-28T18:08:02.506071] [INFO ] [LOCAL ] CSW: Starting deletion of primary data. [2025-10-28T18:08:02.506168] [DEBUG] [LOCAL ] CSW: No primary data file found to delete. [2025-10-28T18:08:02.506240] [INFO ] [LOCAL ] CSW: Starting deletion of derivative data. [2025-10-28T18:08:02.506305] [DEBUG] [LOCAL ] CSW: No derivative data file found to delete. [2025-10-28T18:08:02.506373] [INFO ] [MAIN ] Update Progress: 541/2366 symbols completed. CSW took 0.8s. Estimated remaining: 3h 49m 22s. Rate: 8.0 symbols/min [2025-10-28T18:08:02.682097] [INFO ] [MAIN ] CTBB: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:08:02.689336] [DEBUG] [LOCAL ] CTBB: Loaded 6201 existing records from primary storage. [2025-10-28T18:08:02.689519] [INFO ] [MAIN ] CTBB: Loaded 6201 existing records. [2025-10-28T18:08:02.866072] [WARN ] [MAIN ] CTBB: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:08:02.866353] [INFO ] [MAIN ] CTBB: Wiping existing primary data before full refresh. [2025-10-28T18:08:02.866577] [INFO ] [LOCAL ] CTBB: Starting deletion of primary data. [2025-10-28T18:08:02.866942] [DEBUG] [LOCAL ] CTBB: Deleted primary data file. [2025-10-28T18:08:02.867014] [INFO ] [MAIN ] CTBB: Starting full primary refresh. [2025-10-28T18:08:03.060785] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-28T18:08:03.164510] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-10. [2025-10-28T18:08:03.261988] [INFO ] [REMOTE ] CTBB: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:08:03.959320] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-01. [2025-10-28T18:08:04.344861] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-28T18:08:04.350904] [INFO ] [REMOTE ] CSL: Full fetch complete (45528 records). [2025-10-28T18:08:04.350995] [DEBUG] [VALIDATOR ] CSL: Validating primary data. [2025-10-28T18:08:04.351575] [FATAL] [VALIDATOR ] CSL: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T18:08:04.351683] [FATAL] [MAIN ] CSL: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:08:04.351736] [WARN ] [MAIN ] CSL: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:08:04.351778] [INFO ] [LOCAL ] CSL: Starting deletion of primary data. [2025-10-28T18:08:04.351853] [DEBUG] [LOCAL ] CSL: No primary data file found to delete. [2025-10-28T18:08:04.351890] [INFO ] [LOCAL ] CSL: Starting deletion of derivative data. [2025-10-28T18:08:04.352060] [DEBUG] [LOCAL ] CSL: Deleted derivative data file. [2025-10-28T18:08:04.352159] [INFO ] [MAIN ] Update Progress: 542/2366 symbols completed. CSL took 39.7s. Estimated remaining: 3h 48m 55s. Rate: 8.0 symbols/min [2025-10-28T18:08:04.518548] [INFO ] [MAIN ] CTDD: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:08:04.528318] [DEBUG] [LOCAL ] CTDD: Loaded 5011 existing records from primary storage. [2025-10-28T18:08:04.528574] [INFO ] [MAIN ] CTDD: Loaded 5011 existing records. [2025-10-28T18:08:04.704877] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-28T18:08:04.728293] [WARN ] [MAIN ] CTDD: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:08:04.728472] [INFO ] [MAIN ] CTDD: Wiping existing primary data before full refresh. [2025-10-28T18:08:04.728529] [INFO ] [LOCAL ] CTDD: Starting deletion of primary data. [2025-10-28T18:08:04.728723] [DEBUG] [LOCAL ] CTDD: Deleted primary data file. [2025-10-28T18:08:04.728781] [INFO ] [MAIN ] CTDD: Starting full primary refresh. [2025-10-28T18:08:04.764421] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-07. [2025-10-28T18:08:05.075897] [INFO ] [REMOTE ] CTDD: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:08:05.491050] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-28T18:08:05.559327] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-08. [2025-10-28T18:08:06.359335] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-08. [2025-10-28T18:08:06.779960] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-28T18:08:07.016275] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-28T18:08:07.159339] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-01. [2025-10-28T18:08:07.653812] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-28T18:08:07.959341] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-02. [2025-10-28T18:08:08.428139] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-28T18:08:08.759341] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-09. [2025-10-28T18:08:09.559339] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-09. [2025-10-28T18:08:10.161585] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-28T18:08:10.167089] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-28T18:08:10.359335] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-10. [2025-10-28T18:08:11.159359] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-10. [2025-10-28T18:08:11.733686] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-28T18:08:11.743537] [INFO ] [REMOTE ] CSTM: Full fetch complete (69571 records). [2025-10-28T18:08:11.743734] [DEBUG] [VALIDATOR ] CSTM: Validating primary data. [2025-10-28T18:08:11.913731] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-28T18:08:11.925895] [INFO ] [REMOTE ] CSV: Full fetch complete (18810 records). [2025-10-28T18:08:11.941203] [DEBUG] [VALIDATOR ] CSV: Validating primary data. [2025-10-28T18:08:11.960333] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-02. [2025-10-28T18:08:12.343510] [DEBUG] [VALIDATOR ] CSTM: All expected trading days are present. [2025-10-28T18:08:12.399277] [DEBUG] [VALIDATOR ] CSTM: Primary data validation passed. [2025-10-28T18:08:12.426299] [INFO ] [MAIN ] CSTM: Fetched primary data is valid. [2025-10-28T18:08:12.440878] [DEBUG] [LOCAL ] CSTM: Saving primary data. [2025-10-28T18:08:12.492159] [DEBUG] [LOCAL ] CSTM: Trimmed 69571 records to 47316 (keeping 200 days of data) [2025-10-28T18:08:12.570444] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-28T18:08:12.572730] [DEBUG] [VALIDATOR ] CSV: All expected trading days are present. [2025-10-28T18:08:12.622031] [DEBUG] [VALIDATOR ] CSV: Primary data validation passed. [2025-10-28T18:08:12.630930] [INFO ] [MAIN ] CSV: Fetched primary data is valid. [2025-10-28T18:08:12.657353] [DEBUG] [LOCAL ] CSV: Saving primary data. [2025-10-28T18:08:12.684355] [DEBUG] [LOCAL ] CSV: Trimmed 18810 records to 11936 (keeping 200 days of data) [2025-10-28T18:08:12.773808] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-03. [2025-10-28T18:08:12.891113] [DEBUG] [LOCAL ] CSV: Primary data saved (11936 records). [2025-10-28T18:08:12.891332] [INFO ] [MAIN ] CSV: Full history saved. [2025-10-28T18:08:12.891460] [INFO ] [MAIN ] Update Progress: 543/2366 symbols completed. CSV took 24.4s. Estimated remaining: 3h 48m 51s. Rate: 8.0 symbols/min [2025-10-28T18:08:13.046742] [DEBUG] [LOCAL ] CSTM: Primary data saved (47316 records). [2025-10-28T18:08:13.046989] [INFO ] [MAIN ] CSTM: Full history saved. [2025-10-28T18:08:13.047156] [INFO ] [MAIN ] Update Progress: 544/2366 symbols completed. CSTM took 38.1s. Estimated remaining: 3h 48m 19s. Rate: 8.0 symbols/min [2025-10-28T18:08:13.209745] [INFO ] [MAIN ] CTEV: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:08:13.233004] [DEBUG] [LOCAL ] CTEV: No existing data file found in primary storage. [2025-10-28T18:08:13.233126] [WARN ] [MAIN ] CTEV: No existing data found, performing full refresh instead. [2025-10-28T18:08:13.244074] [INFO ] [MAIN ] CTEV: Wiping existing primary data before full refresh. [2025-10-28T18:08:13.255173] [INFO ] [LOCAL ] CTEV: Starting deletion of primary data. [2025-10-28T18:08:13.308672] [DEBUG] [LOCAL ] CTEV: No primary data file found to delete. [2025-10-28T18:08:13.312911] [INFO ] [MAIN ] CTO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:08:13.314014] [INFO ] [MAIN ] CTEV: Starting full primary refresh. [2025-10-28T18:08:13.447851] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-10-28T18:08:13.526964] [DEBUG] [LOCAL ] CTO: Loaded 27078 existing records from primary storage. [2025-10-28T18:08:13.545161] [INFO ] [MAIN ] CTO: Loaded 27078 existing records. [2025-10-28T18:08:13.570027] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-04. [2025-10-28T18:08:13.921864] [INFO ] [REMOTE ] CTEV: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:08:13.925215] [WARN ] [MAIN ] CTO: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:08:13.925620] [INFO ] [MAIN ] CTO: Wiping existing primary data before full refresh. [2025-10-28T18:08:13.925711] [INFO ] [LOCAL ] CTO: Starting deletion of primary data. [2025-10-28T18:08:13.926233] [DEBUG] [LOCAL ] CTO: Deleted primary data file. [2025-10-28T18:08:13.926291] [INFO ] [MAIN ] CTO: Starting full primary refresh. [2025-10-28T18:08:14.281863] [INFO ] [REMOTE ] CTO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:08:14.336548] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-28T18:08:14.359303] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-01. [2025-10-28T18:08:15.159356] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-03. [2025-10-28T18:08:15.463104] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-28T18:08:15.848026] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-28T18:08:15.959337] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-02. [2025-10-28T18:08:16.759314] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-04. [2025-10-28T18:08:16.837166] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-28T18:08:17.253170] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-28T18:08:17.559357] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-01. [2025-10-28T18:08:17.706599] [DEBUG] [REMOTE ] CTEV: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-28T18:08:17.706954] [WARN ] [REMOTE ] CTEV: No data returned for month 2025-01 [2025-10-28T18:08:17.707024] [FATAL] [REMOTE ] CTEV: API call failed - aborting fetch to avoid wasting further API calls [2025-10-28T18:08:17.707063] [FATAL] [MAIN ] CTEV: Failed to fetch primary data. [2025-10-28T18:08:17.707150] [WARN ] [MAIN ] CTEV: Deleting existing primary and derivative data due to fetch failure. [2025-10-28T18:08:17.707196] [INFO ] [LOCAL ] CTEV: Starting deletion of primary data. [2025-10-28T18:08:17.707253] [DEBUG] [LOCAL ] CTEV: No primary data file found to delete. [2025-10-28T18:08:17.707288] [INFO ] [LOCAL ] CTEV: Starting deletion of derivative data. [2025-10-28T18:08:17.707326] [DEBUG] [LOCAL ] CTEV: No derivative data file found to delete. [2025-10-28T18:08:17.707370] [INFO ] [MAIN ] Update Progress: 545/2366 symbols completed. CTEV took 4.8s. Estimated remaining: 3h 48m 2s. Rate: 8.0 symbols/min [2025-10-28T18:08:17.873317] [INFO ] [MAIN ] CTOS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:08:17.905962] [DEBUG] [LOCAL ] CTOS: Loaded 37098 existing records from primary storage. [2025-10-28T18:08:17.906223] [INFO ] [MAIN ] CTOS: Loaded 37098 existing records. [2025-10-28T18:08:18.079403] [WARN ] [MAIN ] CTOS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:08:18.079609] [INFO ] [MAIN ] CTOS: Wiping existing primary data before full refresh. [2025-10-28T18:08:18.079680] [INFO ] [LOCAL ] CTOS: Starting deletion of primary data. [2025-10-28T18:08:18.080113] [DEBUG] [LOCAL ] CTOS: Deleted primary data file. [2025-10-28T18:08:18.080169] [INFO ] [MAIN ] CTOS: Starting full primary refresh. [2025-10-28T18:08:18.364561] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-05. [2025-10-28T18:08:18.433960] [INFO ] [REMOTE ] CTOS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:08:18.961402] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-28T18:08:19.159363] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-01. [2025-10-28T18:08:19.959389] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-03. [2025-10-28T18:08:20.759337] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-06. [2025-10-28T18:08:21.107154] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-28T18:08:21.283556] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-28T18:08:21.559334] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-04. [2025-10-28T18:08:22.197916] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-01 (3.04 seconds). [2025-10-28T18:08:22.359319] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-07. [2025-10-28T18:08:22.519100] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-28T18:08:22.952817] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-28T18:08:23.159404] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-05. [2025-10-28T18:08:23.648024] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-28T18:08:23.959386] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-06. [2025-10-28T18:08:24.380848] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-28T18:08:24.759317] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-08. [2025-10-28T18:08:25.247211] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-28T18:08:25.559346] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-09. [2025-10-28T18:08:25.954905] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-10-28T18:08:26.359323] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-05. [2025-10-28T18:08:27.159339] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-07. [2025-10-28T18:08:27.588896] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-28T18:08:27.655220] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-28T18:08:27.959350] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-10. [2025-10-28T18:08:28.759298] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-06. [2025-10-28T18:08:28.987605] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-28T18:08:28.989269] [INFO ] [REMOTE ] CTBB: Full fetch complete (10015 records). [2025-10-28T18:08:28.989338] [DEBUG] [VALIDATOR ] CTBB: Validating primary data. [2025-10-28T18:08:29.348408] [DEBUG] [VALIDATOR ] CTBB: All expected trading days are present. [2025-10-28T18:08:29.348480] [DEBUG] [VALIDATOR ] CTBB: Primary data validation passed. [2025-10-28T18:08:29.348730] [INFO ] [MAIN ] CTBB: Fetched primary data is valid. [2025-10-28T18:08:29.348789] [DEBUG] [LOCAL ] CTBB: Saving primary data. [2025-10-28T18:08:29.349216] [DEBUG] [LOCAL ] CTBB: Trimmed 10015 records to 6178 (keeping 200 days of data) [2025-10-28T18:08:29.388409] [DEBUG] [LOCAL ] CTBB: Primary data saved (6178 records). [2025-10-28T18:08:29.388515] [INFO ] [MAIN ] CTBB: Full history saved. [2025-10-28T18:08:29.388604] [INFO ] [MAIN ] Update Progress: 546/2366 symbols completed. CTBB took 26.9s. Estimated remaining: 3h 48m 8s. Rate: 8.0 symbols/min [2025-10-28T18:08:29.559745] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-08. [2025-10-28T18:08:29.559612] [INFO ] [MAIN ] CTRA: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:08:29.606214] [DEBUG] [LOCAL ] CTRA: Loaded 53647 existing records from primary storage. [2025-10-28T18:08:29.606504] [INFO ] [MAIN ] CTRA: Loaded 53647 existing records. [2025-10-28T18:08:29.796584] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-28T18:08:29.800881] [WARN ] [MAIN ] CTRA: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:08:29.801084] [INFO ] [MAIN ] CTRA: Wiping existing primary data before full refresh. [2025-10-28T18:08:29.806406] [INFO ] [LOCAL ] CTRA: Starting deletion of primary data. [2025-10-28T18:08:29.807791] [DEBUG] [LOCAL ] CTRA: Deleted primary data file. [2025-10-28T18:08:29.807850] [INFO ] [MAIN ] CTRA: Starting full primary refresh. [2025-10-28T18:08:30.084359] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-28T18:08:30.175370] [INFO ] [REMOTE ] CTRA: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:08:30.359314] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-01. [2025-10-28T18:08:31.159323] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-09. [2025-10-28T18:08:31.788730] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-28T18:08:31.951614] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-28T18:08:31.961683] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-10. [2025-10-28T18:08:32.403253] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-28T18:08:32.404530] [INFO ] [REMOTE ] CTDD: Full fetch complete (7906 records). [2025-10-28T18:08:32.404597] [DEBUG] [VALIDATOR ] CTDD: Validating primary data. [2025-10-28T18:08:32.761877] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-07. [2025-10-28T18:08:32.762956] [DEBUG] [VALIDATOR ] CTDD: All expected trading days are present. [2025-10-28T18:08:32.763017] [DEBUG] [VALIDATOR ] CTDD: Primary data validation passed. [2025-10-28T18:08:32.763250] [INFO ] [MAIN ] CTDD: Fetched primary data is valid. [2025-10-28T18:08:32.763316] [DEBUG] [LOCAL ] CTDD: Saving primary data. [2025-10-28T18:08:32.764112] [DEBUG] [LOCAL ] CTDD: Trimmed 7906 records to 4993 (keeping 200 days of data) [2025-10-28T18:08:32.794674] [DEBUG] [LOCAL ] CTDD: Primary data saved (4993 records). [2025-10-28T18:08:32.794774] [INFO ] [MAIN ] CTDD: Full history saved. [2025-10-28T18:08:32.794846] [INFO ] [MAIN ] Update Progress: 547/2366 symbols completed. CTDD took 28.4s. Estimated remaining: 3h 47m 47s. Rate: 8.0 symbols/min [2025-10-28T18:08:32.966350] [INFO ] [MAIN ] CTRE: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:08:33.011022] [DEBUG] [LOCAL ] CTRE: Loaded 49379 existing records from primary storage. [2025-10-28T18:08:33.011352] [INFO ] [MAIN ] CTRE: Loaded 49379 existing records. [2025-10-28T18:08:33.216930] [WARN ] [MAIN ] CTRE: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:08:33.217168] [INFO ] [MAIN ] CTRE: Wiping existing primary data before full refresh. [2025-10-28T18:08:33.217223] [INFO ] [LOCAL ] CTRE: Starting deletion of primary data. [2025-10-28T18:08:33.218352] [DEBUG] [LOCAL ] CTRE: Deleted primary data file. [2025-10-28T18:08:33.218413] [INFO ] [MAIN ] CTRE: Starting full primary refresh. [2025-10-28T18:08:33.564466] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-02. [2025-10-28T18:08:33.625885] [INFO ] [REMOTE ] CTRE: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:08:34.359328] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-02. [2025-10-28T18:08:34.886883] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-28T18:08:35.159502] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-03. [2025-10-28T18:08:35.367597] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-28T18:08:35.413453] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-07 (2.65 seconds). [2025-10-28T18:08:35.959335] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-01. [2025-10-28T18:08:36.759315] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-03. [2025-10-28T18:08:37.186339] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-28T18:08:37.559382] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-02. [2025-10-28T18:08:37.835123] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-28T18:08:38.359312] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-04. [2025-10-28T18:08:38.549249] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-03 (3.39 seconds). [2025-10-28T18:08:39.159323] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-04. [2025-10-28T18:08:39.959391] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-08. [2025-10-28T18:08:40.492125] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-02 (2.93 seconds). [2025-10-28T18:08:40.582563] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-28T18:08:40.759313] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-05. [2025-10-28T18:08:40.836117] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-28T18:08:41.559355] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-09. [2025-10-28T18:08:42.359336] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-03. [2025-10-28T18:08:42.463012] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-28T18:08:43.159331] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-10. [2025-10-28T18:08:43.432135] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-05 (2.67 seconds). [2025-10-28T18:08:43.571245] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-04 (5.21 seconds). [2025-10-28T18:08:43.821184] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-28T18:08:43.959393] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-04. [2025-10-28T18:08:44.759348] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-06. [2025-10-28T18:08:45.024570] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-28T18:08:45.030753] [INFO ] [REMOTE ] CTO: Full fetch complete (41391 records). [2025-10-28T18:08:45.030869] [DEBUG] [VALIDATOR ] CTO: Validating primary data. [2025-10-28T18:08:45.437341] [DEBUG] [VALIDATOR ] CTO: All expected trading days are present. [2025-10-28T18:08:45.437446] [DEBUG] [VALIDATOR ] CTO: Primary data validation passed. [2025-10-28T18:08:45.438279] [INFO ] [MAIN ] CTO: Fetched primary data is valid. [2025-10-28T18:08:45.438368] [DEBUG] [LOCAL ] CTO: Saving primary data. [2025-10-28T18:08:45.439676] [DEBUG] [LOCAL ] CTO: Trimmed 41391 records to 27014 (keeping 200 days of data) [2025-10-28T18:08:45.560283] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-05. [2025-10-28T18:08:45.612284] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-28T18:08:45.651297] [DEBUG] [LOCAL ] CTO: Primary data saved (27014 records). [2025-10-28T18:08:45.651537] [INFO ] [MAIN ] CTO: Full history saved. [2025-10-28T18:08:45.651680] [INFO ] [MAIN ] Update Progress: 548/2366 symbols completed. CTO took 32.6s. Estimated remaining: 3h 47m 57s. Rate: 8.0 symbols/min [2025-10-28T18:08:45.923383] [INFO ] [MAIN ] CTRI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:08:45.968945] [DEBUG] [LOCAL ] CTRI: Loaded 41068 existing records from primary storage. [2025-10-28T18:08:45.969346] [INFO ] [MAIN ] CTRI: Loaded 41068 existing records. [2025-10-28T18:08:46.204605] [WARN ] [MAIN ] CTRI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:08:46.204990] [INFO ] [MAIN ] CTRI: Wiping existing primary data before full refresh. [2025-10-28T18:08:46.205077] [INFO ] [LOCAL ] CTRI: Starting deletion of primary data. [2025-10-28T18:08:46.205548] [DEBUG] [LOCAL ] CTRI: Deleted primary data file. [2025-10-28T18:08:46.205609] [INFO ] [MAIN ] CTRI: Starting full primary refresh. [2025-10-28T18:08:46.371868] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-05. [2025-10-28T18:08:46.628187] [INFO ] [REMOTE ] CTRI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:08:46.869953] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-28T18:08:47.159382] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-06. [2025-10-28T18:08:47.588395] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-06 (2.83 seconds). [2025-10-28T18:08:47.863939] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-28T18:08:47.959348] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-07. [2025-10-28T18:08:48.059501] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-28T18:08:48.759444] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-06. [2025-10-28T18:08:49.559357] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-01. [2025-10-28T18:08:50.359359] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-07. [2025-10-28T18:08:50.585319] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-28T18:08:51.159324] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-02. [2025-10-28T18:08:51.318753] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-07 (3.36 seconds). [2025-10-28T18:08:51.477959] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-28T18:08:51.918724] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-28T18:08:51.959317] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-03. [2025-10-28T18:08:52.644778] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-06 (3.89 seconds). [2025-10-28T18:08:52.759317] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-08. [2025-10-28T18:08:53.559323] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-08. [2025-10-28T18:08:53.771095] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-10-28T18:08:53.846363] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-28T18:08:54.359329] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-09. [2025-10-28T18:08:55.159363] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-07. [2025-10-28T18:08:55.193769] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-28T18:08:55.400292] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-28T18:08:55.959390] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-10. [2025-10-28T18:08:56.353465] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-28T18:08:56.759348] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-09. [2025-10-28T18:08:57.559375] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-08. [2025-10-28T18:08:58.040863] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-10 (2.08 seconds). [2025-10-28T18:08:58.051000] [INFO ] [REMOTE ] CTOS: Full fetch complete (54055 records). [2025-10-28T18:08:58.051229] [DEBUG] [VALIDATOR ] CTOS: Validating primary data. [2025-10-28T18:08:58.360770] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-04. [2025-10-28T18:08:58.496076] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-28T18:08:58.527471] [DEBUG] [VALIDATOR ] CTOS: All expected trading days are present. [2025-10-28T18:08:58.527853] [DEBUG] [VALIDATOR ] CTOS: Primary data validation passed. [2025-10-28T18:08:58.529262] [INFO ] [MAIN ] CTOS: Fetched primary data is valid. [2025-10-28T18:08:58.529355] [DEBUG] [LOCAL ] CTOS: Saving primary data. [2025-10-28T18:08:58.531488] [DEBUG] [LOCAL ] CTOS: Trimmed 54055 records to 37111 (keeping 200 days of data) [2025-10-28T18:08:58.754610] [DEBUG] [LOCAL ] CTOS: Primary data saved (37111 records). [2025-10-28T18:08:58.754860] [INFO ] [MAIN ] CTOS: Full history saved. [2025-10-28T18:08:58.754969] [INFO ] [MAIN ] Update Progress: 549/2366 symbols completed. CTOS took 41.0s. Estimated remaining: 3h 48m 8s. Rate: 8.0 symbols/min [2025-10-28T18:08:58.978125] [INFO ] [MAIN ] CTS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:08:59.001380] [DEBUG] [LOCAL ] CTS: Loaded 19302 existing records from primary storage. [2025-10-28T18:08:59.001824] [INFO ] [MAIN ] CTS: Loaded 19302 existing records. [2025-10-28T18:08:59.164179] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-10. [2025-10-28T18:08:59.236801] [WARN ] [MAIN ] CTS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:08:59.237595] [INFO ] [MAIN ] CTS: Wiping existing primary data before full refresh. [2025-10-28T18:08:59.238004] [INFO ] [LOCAL ] CTS: Starting deletion of primary data. [2025-10-28T18:08:59.238397] [DEBUG] [LOCAL ] CTS: Deleted primary data file. [2025-10-28T18:08:59.238470] [INFO ] [MAIN ] CTS: Starting full primary refresh. [2025-10-28T18:08:59.435038] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-28T18:08:59.693704] [INFO ] [REMOTE ] CTS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:08:59.959343] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-01. [2025-10-28T18:09:00.091315] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-08 (2.53 seconds). [2025-10-28T18:09:00.762878] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-05. [2025-10-28T18:09:00.768454] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-28T18:09:00.779377] [INFO ] [REMOTE ] CTRA: Full fetch complete (77820 records). [2025-10-28T18:09:00.779517] [DEBUG] [VALIDATOR ] CTRA: Validating primary data. [2025-10-28T18:09:01.173906] [DEBUG] [VALIDATOR ] CTRA: All expected trading days are present. [2025-10-28T18:09:01.174000] [DEBUG] [VALIDATOR ] CTRA: Primary data validation passed. [2025-10-28T18:09:01.174892] [INFO ] [MAIN ] CTRA: Fetched primary data is valid. [2025-10-28T18:09:01.174954] [DEBUG] [LOCAL ] CTRA: Saving primary data. [2025-10-28T18:09:01.176476] [DEBUG] [LOCAL ] CTRA: Trimmed 77820 records to 53647 (keeping 200 days of data) [2025-10-28T18:09:01.402367] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-28T18:09:01.515067] [DEBUG] [LOCAL ] CTRA: Primary data saved (53647 records). [2025-10-28T18:09:01.515201] [INFO ] [MAIN ] CTRA: Full history saved. [2025-10-28T18:09:01.515281] [INFO ] [MAIN ] Update Progress: 550/2366 symbols completed. CTRA took 32.1s. Estimated remaining: 3h 47m 45s. Rate: 8.0 symbols/min [2025-10-28T18:09:01.568474] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-09. [2025-10-28T18:09:01.702765] [INFO ] [MAIN ] CTVA: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:09:01.756079] [DEBUG] [LOCAL ] CTVA: Loaded 53299 existing records from primary storage. [2025-10-28T18:09:01.756397] [INFO ] [MAIN ] CTVA: Loaded 53299 existing records. [2025-10-28T18:09:01.962608] [WARN ] [MAIN ] CTVA: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:09:01.963029] [INFO ] [MAIN ] CTVA: Wiping existing primary data before full refresh. [2025-10-28T18:09:01.963084] [INFO ] [LOCAL ] CTVA: Starting deletion of primary data. [2025-10-28T18:09:01.964158] [DEBUG] [LOCAL ] CTVA: Deleted primary data file. [2025-10-28T18:09:01.964217] [INFO ] [MAIN ] CTVA: Starting full primary refresh. [2025-10-28T18:09:02.379360] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-02. [2025-10-28T18:09:02.387012] [INFO ] [REMOTE ] CTVA: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:09:02.687698] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-28T18:09:02.859373] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-28T18:09:03.159350] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-06. [2025-10-28T18:09:03.350878] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-28T18:09:03.959377] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-10. [2025-10-28T18:09:04.238876] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-28T18:09:04.759342] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-03. [2025-10-28T18:09:05.312340] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-28T18:09:05.322550] [INFO ] [REMOTE ] CTRE: Full fetch complete (71365 records). [2025-10-28T18:09:05.322736] [DEBUG] [VALIDATOR ] CTRE: Validating primary data. [2025-10-28T18:09:05.568436] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-07. [2025-10-28T18:09:05.724562] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-28T18:09:05.788179] [DEBUG] [VALIDATOR ] CTRE: All expected trading days are present. [2025-10-28T18:09:05.788596] [DEBUG] [VALIDATOR ] CTRE: Primary data validation passed. [2025-10-28T18:09:05.789625] [INFO ] [MAIN ] CTRE: Fetched primary data is valid. [2025-10-28T18:09:05.789715] [DEBUG] [LOCAL ] CTRE: Saving primary data. [2025-10-28T18:09:05.791339] [DEBUG] [LOCAL ] CTRE: Trimmed 71365 records to 49394 (keeping 200 days of data) [2025-10-28T18:09:06.102081] [DEBUG] [LOCAL ] CTRE: Primary data saved (49394 records). [2025-10-28T18:09:06.102211] [INFO ] [MAIN ] CTRE: Full history saved. [2025-10-28T18:09:06.102285] [INFO ] [MAIN ] Update Progress: 551/2366 symbols completed. CTRE took 33.3s. Estimated remaining: 3h 47m 27s. Rate: 8.0 symbols/min [2025-10-28T18:09:06.287801] [INFO ] [MAIN ] CUBB: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:09:06.287968] [DEBUG] [LOCAL ] CUBB: No existing data file found in primary storage. [2025-10-28T18:09:06.288004] [WARN ] [MAIN ] CUBB: No existing data found, performing full refresh instead. [2025-10-28T18:09:06.288112] [INFO ] [MAIN ] CUBB: Wiping existing primary data before full refresh. [2025-10-28T18:09:06.288152] [INFO ] [LOCAL ] CUBB: Starting deletion of primary data. [2025-10-28T18:09:06.288192] [DEBUG] [LOCAL ] CUBB: No primary data file found to delete. [2025-10-28T18:09:06.288223] [INFO ] [MAIN ] CUBB: Starting full primary refresh. [2025-10-28T18:09:06.364468] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-04. [2025-10-28T18:09:06.649311] [INFO ] [REMOTE ] CUBB: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:09:07.159390] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-01. [2025-10-28T18:09:07.280899] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-28T18:09:07.604213] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-28T18:09:07.959414] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-05. [2025-10-28T18:09:08.553040] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-28T18:09:08.759385] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-08. [2025-10-28T18:09:09.022735] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-28T18:09:09.559361] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-02. [2025-10-28T18:09:10.359337] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-01. [2025-10-28T18:09:10.723763] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-10-28T18:09:11.048233] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-28T18:09:11.159319] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-03. [2025-10-28T18:09:11.257558] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-08 (2.50 seconds). [2025-10-28T18:09:11.959342] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-02. [2025-10-28T18:09:12.237870] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-02 (0.28 seconds). [2025-10-28T18:09:12.677464] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-28T18:09:12.759337] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-04. [2025-10-28T18:09:13.559343] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-09. [2025-10-28T18:09:14.359329] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-03. [2025-10-28T18:09:14.474551] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-10-28T18:09:14.584060] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-03 (0.22 seconds). [2025-10-28T18:09:15.079710] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-28T18:09:15.159326] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-10. [2025-10-28T18:09:15.959518] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-06. [2025-10-28T18:09:16.759310] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-05. [2025-10-28T18:09:16.857773] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-28T18:09:17.055391] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-28T18:09:17.065322] [INFO ] [REMOTE ] CTRI: Full fetch complete (55163 records). [2025-10-28T18:09:17.065480] [DEBUG] [VALIDATOR ] CTRI: Validating primary data. [2025-10-28T18:09:17.441876] [DEBUG] [VALIDATOR ] CTRI: All expected trading days are present. [2025-10-28T18:09:17.442062] [DEBUG] [VALIDATOR ] CTRI: Primary data validation passed. [2025-10-28T18:09:17.442852] [INFO ] [MAIN ] CTRI: Fetched primary data is valid. [2025-10-28T18:09:17.442917] [DEBUG] [LOCAL ] CTRI: Saving primary data. [2025-10-28T18:09:17.444152] [DEBUG] [LOCAL ] CTRI: Trimmed 55163 records to 41153 (keeping 200 days of data) [2025-10-28T18:09:17.603065] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-04. [2025-10-28T18:09:17.682308] [DEBUG] [LOCAL ] CTRI: Primary data saved (41153 records). [2025-10-28T18:09:17.682437] [INFO ] [MAIN ] CTRI: Full history saved. [2025-10-28T18:09:17.682539] [INFO ] [MAIN ] Update Progress: 552/2366 symbols completed. CTRI took 32.0s. Estimated remaining: 3h 47m 33s. Rate: 8.0 symbols/min [2025-10-28T18:09:17.858874] [INFO ] [MAIN ] CUBE: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:09:17.859094] [DEBUG] [LOCAL ] CUBE: No existing data file found in primary storage. [2025-10-28T18:09:17.859147] [WARN ] [MAIN ] CUBE: No existing data found, performing full refresh instead. [2025-10-28T18:09:17.859253] [INFO ] [MAIN ] CUBE: Wiping existing primary data before full refresh. [2025-10-28T18:09:17.859295] [INFO ] [LOCAL ] CUBE: Starting deletion of primary data. [2025-10-28T18:09:17.859338] [DEBUG] [LOCAL ] CUBE: No primary data file found to delete. [2025-10-28T18:09:17.859371] [INFO ] [MAIN ] CUBE: Starting full primary refresh. [2025-10-28T18:09:17.896916] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-04 (0.29 seconds). [2025-10-28T18:09:18.223381] [INFO ] [REMOTE ] CUBE: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:09:18.252523] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-28T18:09:18.359304] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-01. [2025-10-28T18:09:19.159355] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-05. [2025-10-28T18:09:19.397931] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-05 (0.24 seconds). [2025-10-28T18:09:19.959316] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-06. [2025-10-28T18:09:20.132802] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-06 (0.17 seconds). [2025-10-28T18:09:20.759320] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-07. [2025-10-28T18:09:21.100391] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-10-28T18:09:21.559328] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-06. [2025-10-28T18:09:22.359366] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-07. [2025-10-28T18:09:22.820403] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-28T18:09:22.832076] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-01 (4.47 seconds). [2025-10-28T18:09:23.159418] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-07. [2025-10-28T18:09:23.959390] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-02. [2025-10-28T18:09:24.545489] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-28T18:09:24.759386] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-08. [2025-10-28T18:09:25.559358] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-08. [2025-10-28T18:09:25.719339] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-07 (3.36 seconds). [2025-10-28T18:09:26.240699] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-28T18:09:26.359351] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-09. [2025-10-28T18:09:27.159362] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-08. [2025-10-28T18:09:27.622613] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-02 (3.66 seconds). [2025-10-28T18:09:27.667693] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-28T18:09:27.680780] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-10-28T18:09:27.959350] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-09. [2025-10-28T18:09:28.759396] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-10. [2025-10-28T18:09:29.020605] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-28T18:09:29.050376] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-28T18:09:29.559390] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-10. [2025-10-28T18:09:29.912835] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-10 (0.35 seconds). [2025-10-28T18:09:29.914036] [INFO ] [REMOTE ] CUBB: Full fetch complete (965 records). [2025-10-28T18:09:29.914131] [DEBUG] [VALIDATOR ] CUBB: Validating primary data. [2025-10-28T18:09:30.222751] [WARN ] [VALIDATOR ] CUBB: Validation failed - insufficient historical data. Have 183 unique days, need 200 days [2025-10-28T18:09:30.223139] [FATAL] [MAIN ] CUBB: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:09:30.223229] [WARN ] [MAIN ] CUBB: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:09:30.223386] [INFO ] [LOCAL ] CUBB: Starting deletion of primary data. [2025-10-28T18:09:30.223575] [DEBUG] [LOCAL ] CUBB: No primary data file found to delete. [2025-10-28T18:09:30.223676] [INFO ] [LOCAL ] CUBB: Starting deletion of derivative data. [2025-10-28T18:09:30.223877] [DEBUG] [LOCAL ] CUBB: No derivative data file found to delete. [2025-10-28T18:09:30.224085] [INFO ] [MAIN ] Update Progress: 553/2366 symbols completed. CUBB took 24.1s. Estimated remaining: 3h 47m 42s. Rate: 8.0 symbols/min [2025-10-28T18:09:30.359860] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-09. [2025-10-28T18:09:30.466245] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-28T18:09:30.533613] [INFO ] [MAIN ] CUBI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:09:30.531882] [INFO ] [REMOTE ] CTVA: Full fetch complete (77239 records). [2025-10-28T18:09:30.534096] [DEBUG] [VALIDATOR ] CTVA: Validating primary data. [2025-10-28T18:09:30.803900] [DEBUG] [LOCAL ] CUBI: Loaded 26871 existing records from primary storage. [2025-10-28T18:09:30.832497] [INFO ] [MAIN ] CUBI: Loaded 26871 existing records. [2025-10-28T18:09:31.088040] [DEBUG] [VALIDATOR ] CTVA: All expected trading days are present. [2025-10-28T18:09:31.098464] [DEBUG] [VALIDATOR ] CTVA: Primary data validation passed. [2025-10-28T18:09:31.117684] [INFO ] [MAIN ] CTVA: Fetched primary data is valid. [2025-10-28T18:09:31.136741] [DEBUG] [LOCAL ] CTVA: Saving primary data. [2025-10-28T18:09:31.161173] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-03. [2025-10-28T18:09:31.160987] [WARN ] [MAIN ] CUBI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:09:31.162685] [INFO ] [MAIN ] CUBI: Wiping existing primary data before full refresh. [2025-10-28T18:09:31.162809] [INFO ] [LOCAL ] CUBI: Starting deletion of primary data. [2025-10-28T18:09:31.163406] [DEBUG] [LOCAL ] CUBI: Deleted primary data file. [2025-10-28T18:09:31.163846] [DEBUG] [LOCAL ] CTVA: Trimmed 77239 records to 53299 (keeping 200 days of data) [2025-10-28T18:09:31.163716] [INFO ] [MAIN ] CUBI: Starting full primary refresh. [2025-10-28T18:09:31.355249] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-28T18:09:31.764861] [INFO ] [REMOTE ] CUBI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:09:31.871353] [DEBUG] [LOCAL ] CTVA: Primary data saved (53299 records). [2025-10-28T18:09:31.871484] [INFO ] [MAIN ] CTVA: Full history saved. [2025-10-28T18:09:31.871564] [INFO ] [MAIN ] Update Progress: 554/2366 symbols completed. CTVA took 30.4s. Estimated remaining: 3h 47m 15s. Rate: 8.0 symbols/min [2025-10-28T18:09:31.968614] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-01. [2025-10-28T18:09:32.043688] [INFO ] [MAIN ] CUK: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:09:32.088870] [DEBUG] [LOCAL ] CUK: Loaded 51033 existing records from primary storage. [2025-10-28T18:09:32.089162] [INFO ] [MAIN ] CUK: Loaded 51033 existing records. [2025-10-28T18:09:32.267022] [WARN ] [MAIN ] CUK: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:09:32.267238] [INFO ] [MAIN ] CUK: Wiping existing primary data before full refresh. [2025-10-28T18:09:32.267286] [INFO ] [LOCAL ] CUK: Starting deletion of primary data. [2025-10-28T18:09:32.268089] [DEBUG] [LOCAL ] CUK: Deleted primary data file. [2025-10-28T18:09:32.268148] [INFO ] [MAIN ] CUK: Starting full primary refresh. [2025-10-28T18:09:32.627994] [INFO ] [REMOTE ] CUK: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:09:32.759324] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-10. [2025-10-28T18:09:32.976451] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-28T18:09:33.559350] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-01. [2025-10-28T18:09:33.588594] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-28T18:09:33.593587] [INFO ] [REMOTE ] CTS: Full fetch complete (27532 records). [2025-10-28T18:09:33.593782] [DEBUG] [VALIDATOR ] CTS: Validating primary data. [2025-10-28T18:09:33.969051] [DEBUG] [VALIDATOR ] CTS: All expected trading days are present. [2025-10-28T18:09:33.969148] [DEBUG] [VALIDATOR ] CTS: Primary data validation passed. [2025-10-28T18:09:33.969688] [INFO ] [MAIN ] CTS: Fetched primary data is valid. [2025-10-28T18:09:33.969751] [DEBUG] [LOCAL ] CTS: Saving primary data. [2025-10-28T18:09:33.970697] [DEBUG] [LOCAL ] CTS: Trimmed 27532 records to 19303 (keeping 200 days of data) [2025-10-28T18:09:34.082093] [DEBUG] [LOCAL ] CTS: Primary data saved (19303 records). [2025-10-28T18:09:34.082213] [INFO ] [MAIN ] CTS: Full history saved. [2025-10-28T18:09:34.082289] [INFO ] [MAIN ] Update Progress: 555/2366 symbols completed. CTS took 35.3s. Estimated remaining: 3h 46m 51s. Rate: 8.0 symbols/min [2025-10-28T18:09:34.254275] [INFO ] [MAIN ] CULP: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:09:34.258291] [DEBUG] [LOCAL ] CULP: Loaded 2757 existing records from primary storage. [2025-10-28T18:09:34.258429] [INFO ] [MAIN ] CULP: Loaded 2757 existing records. [2025-10-28T18:09:34.368056] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-02. [2025-10-28T18:09:34.461152] [WARN ] [MAIN ] CULP: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:09:34.461414] [INFO ] [MAIN ] CULP: Wiping existing primary data before full refresh. [2025-10-28T18:09:34.461498] [INFO ] [LOCAL ] CULP: Starting deletion of primary data. [2025-10-28T18:09:34.461727] [DEBUG] [LOCAL ] CULP: Deleted primary data file. [2025-10-28T18:09:34.461785] [INFO ] [MAIN ] CULP: Starting full primary refresh. [2025-10-28T18:09:34.779838] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-03 (3.62 seconds). [2025-10-28T18:09:34.863116] [INFO ] [REMOTE ] CULP: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:09:35.064291] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-28T18:09:35.159339] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-02. [2025-10-28T18:09:35.959342] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-01. [2025-10-28T18:09:35.980313] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-10-28T18:09:36.297019] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-28T18:09:36.478159] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-10-28T18:09:36.759427] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-03. [2025-10-28T18:09:37.559352] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-04. [2025-10-28T18:09:38.347835] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-28T18:09:38.359293] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-04. [2025-10-28T18:09:39.159334] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-02. [2025-10-28T18:09:39.436522] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-02 (0.28 seconds). [2025-10-28T18:09:39.641166] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-28T18:09:39.959310] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-03. [2025-10-28T18:09:40.377554] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-28T18:09:40.759401] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-03. [2025-10-28T18:09:41.061930] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-04 (3.50 seconds). [2025-10-28T18:09:41.559317] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-05. [2025-10-28T18:09:42.359402] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-04. [2025-10-28T18:09:42.745573] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-10-28T18:09:42.772666] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-10-28T18:09:42.845456] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-28T18:09:43.159415] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-05. [2025-10-28T18:09:43.579819] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-28T18:09:43.959330] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-06. [2025-10-28T18:09:44.380435] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-28T18:09:44.759401] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-04. [2025-10-28T18:09:45.559354] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-07. [2025-10-28T18:09:45.944809] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-10-28T18:09:46.359385] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-05. [2025-10-28T18:09:47.048061] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-04 (2.29 seconds). [2025-10-28T18:09:47.159355] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-05. [2025-10-28T18:09:47.803109] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-28T18:09:47.828758] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-28T18:09:47.959377] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-06. [2025-10-28T18:09:48.664059] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-28T18:09:48.759346] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-07. [2025-10-28T18:09:49.559393] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-06. [2025-10-28T18:09:49.645975] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-28T18:09:50.359421] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-08. [2025-10-28T18:09:50.677576] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-28T18:09:51.100044] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-28T18:09:51.159355] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-09. [2025-10-28T18:09:51.959331] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-08. [2025-10-28T18:09:51.990799] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-28T18:09:52.414721] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-28T18:09:52.759348] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-06. [2025-10-28T18:09:53.559340] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-09. [2025-10-28T18:09:54.359325] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-10. [2025-10-28T18:09:54.399083] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-28T18:09:55.159317] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-07. [2025-10-28T18:09:55.302706] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-10 (0.94 seconds). [2025-10-28T18:09:55.308090] [INFO ] [REMOTE ] CUBI: Full fetch complete (39139 records). [2025-10-28T18:09:55.308172] [DEBUG] [VALIDATOR ] CUBI: Validating primary data. [2025-10-28T18:09:55.692196] [DEBUG] [VALIDATOR ] CUBI: All expected trading days are present. [2025-10-28T18:09:55.692274] [DEBUG] [VALIDATOR ] CUBI: Primary data validation passed. [2025-10-28T18:09:55.692829] [INFO ] [MAIN ] CUBI: Fetched primary data is valid. [2025-10-28T18:09:55.692890] [DEBUG] [LOCAL ] CUBI: Saving primary data. [2025-10-28T18:09:55.693708] [DEBUG] [LOCAL ] CUBI: Trimmed 39139 records to 26775 (keeping 200 days of data) [2025-10-28T18:09:55.844756] [DEBUG] [LOCAL ] CUBI: Primary data saved (26775 records). [2025-10-28T18:09:55.844879] [INFO ] [MAIN ] CUBI: Full history saved. [2025-10-28T18:09:55.844956] [INFO ] [MAIN ] Update Progress: 556/2366 symbols completed. CUBI took 25.6s. Estimated remaining: 3h 47m 29s. Rate: 8.0 symbols/min [2025-10-28T18:09:55.964501] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-07. [2025-10-28T18:09:56.014086] [INFO ] [MAIN ] CURB: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:09:56.046346] [DEBUG] [LOCAL ] CURB: Loaded 32698 existing records from primary storage. [2025-10-28T18:09:56.046589] [INFO ] [MAIN ] CURB: Loaded 32698 existing records. [2025-10-28T18:09:56.180288] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-09 (2.62 seconds). [2025-10-28T18:09:56.234637] [WARN ] [MAIN ] CURB: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:09:56.234879] [INFO ] [MAIN ] CURB: Wiping existing primary data before full refresh. [2025-10-28T18:09:56.234928] [INFO ] [LOCAL ] CURB: Starting deletion of primary data. [2025-10-28T18:09:56.235543] [DEBUG] [LOCAL ] CURB: Deleted primary data file. [2025-10-28T18:09:56.235630] [INFO ] [MAIN ] CURB: Starting full primary refresh. [2025-10-28T18:09:56.596192] [INFO ] [REMOTE ] CURB: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:09:56.632161] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-28T18:09:56.759339] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-01. [2025-10-28T18:09:57.559380] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-10. [2025-10-28T18:09:57.716141] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-28T18:09:57.984951] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-28T18:09:57.986637] [INFO ] [REMOTE ] CULP: Full fetch complete (4400 records). [2025-10-28T18:09:57.986815] [DEBUG] [VALIDATOR ] CULP: Validating primary data. [2025-10-28T18:09:58.369551] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-02. [2025-10-28T18:09:58.397007] [DEBUG] [VALIDATOR ] CULP: All expected trading days are present. [2025-10-28T18:09:58.397192] [DEBUG] [VALIDATOR ] CULP: Primary data validation passed. [2025-10-28T18:09:58.397458] [INFO ] [MAIN ] CULP: Fetched primary data is valid. [2025-10-28T18:09:58.397505] [DEBUG] [LOCAL ] CULP: Saving primary data. [2025-10-28T18:09:58.398337] [DEBUG] [LOCAL ] CULP: Trimmed 4400 records to 2753 (keeping 200 days of data) [2025-10-28T18:09:58.416465] [DEBUG] [LOCAL ] CULP: Primary data saved (2753 records). [2025-10-28T18:09:58.416698] [INFO ] [MAIN ] CULP: Full history saved. [2025-10-28T18:09:58.416820] [INFO ] [MAIN ] Update Progress: 557/2366 symbols completed. CULP took 24.3s. Estimated remaining: 3h 47m 6s. Rate: 8.0 symbols/min [2025-10-28T18:09:59.159326] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-08. [2025-10-28T18:09:59.410466] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-28T18:09:59.959374] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-03. [2025-10-28T18:10:01.108039] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-28T18:10:01.115595] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-04. [2025-10-28T18:10:02.493497] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-28T18:10:02.502499] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-05. [2025-10-28T18:10:03.436081] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-07 (7.47 seconds). [2025-10-28T18:10:03.447472] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-08. [2025-10-28T18:10:08.177031] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-08 (9.02 seconds). [2025-10-28T18:10:08.188306] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-09. [2025-10-28T18:10:09.657865] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-28T18:10:09.668837] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-10. [2025-10-28T18:10:10.974721] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-05 (8.47 seconds). [2025-10-28T18:10:10.980678] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-06. [2025-10-28T18:10:11.237672] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-28T18:10:11.248286] [INFO ] [REMOTE ] CUK: Full fetch complete (74400 records). [2025-10-28T18:10:11.248451] [DEBUG] [VALIDATOR ] CUK: Validating primary data. [2025-10-28T18:10:11.645165] [DEBUG] [VALIDATOR ] CUK: All expected trading days are present. [2025-10-28T18:10:11.645316] [DEBUG] [VALIDATOR ] CUK: Primary data validation passed. [2025-10-28T18:10:11.646297] [INFO ] [MAIN ] CUK: Fetched primary data is valid. [2025-10-28T18:10:11.646372] [DEBUG] [LOCAL ] CUK: Saving primary data. [2025-10-28T18:10:11.648049] [DEBUG] [LOCAL ] CUK: Trimmed 74400 records to 51034 (keeping 200 days of data) [2025-10-28T18:10:11.920246] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-28T18:10:11.937878] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-07. [2025-10-28T18:10:12.004780] [DEBUG] [LOCAL ] CUK: Primary data saved (51034 records). [2025-10-28T18:10:12.004930] [INFO ] [MAIN ] CUK: Full history saved. [2025-10-28T18:10:12.005010] [INFO ] [MAIN ] Update Progress: 558/2366 symbols completed. CUK took 40.1s. Estimated remaining: 3h 47m 18s. Rate: 8.0 symbols/min [2025-10-28T18:10:13.049693] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-28T18:10:13.057921] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-08. [2025-10-28T18:10:14.489936] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-08 (11.04 seconds). [2025-10-28T18:10:14.501528] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-09. [2025-10-28T18:10:16.220416] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-08 (3.16 seconds). [2025-10-28T18:10:16.228507] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-09. [2025-10-28T18:10:17.623438] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-28T18:10:17.632600] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-10. [2025-10-28T18:10:18.812817] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-28T18:10:18.821418] [INFO ] [REMOTE ] CURB: Full fetch complete (47714 records). [2025-10-28T18:10:18.821607] [DEBUG] [VALIDATOR ] CURB: Validating primary data. [2025-10-28T18:10:19.238072] [DEBUG] [VALIDATOR ] CURB: All expected trading days are present. [2025-10-28T18:10:19.238201] [DEBUG] [VALIDATOR ] CURB: Primary data validation passed. [2025-10-28T18:10:19.239005] [INFO ] [MAIN ] CURB: Fetched primary data is valid. [2025-10-28T18:10:19.239072] [DEBUG] [LOCAL ] CURB: Saving primary data. [2025-10-28T18:10:19.240498] [DEBUG] [LOCAL ] CURB: Trimmed 47714 records to 32676 (keeping 200 days of data) [2025-10-28T18:10:19.457435] [DEBUG] [LOCAL ] CURB: Primary data saved (32676 records). [2025-10-28T18:10:19.457637] [INFO ] [MAIN ] CURB: Full history saved. [2025-10-28T18:10:19.457783] [INFO ] [MAIN ] Update Progress: 559/2366 symbols completed. CURB took 23.6s. Estimated remaining: 3h 47m 10s. Rate: 8.0 symbols/min [2025-10-28T18:10:20.176212] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-09 (5.67 seconds). [2025-10-28T18:10:20.188319] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-10. [2025-10-28T18:10:21.523276] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-28T18:10:21.534753] [INFO ] [REMOTE ] CUBE: Full fetch complete (72948 records). [2025-10-28T18:10:21.534994] [DEBUG] [VALIDATOR ] CUBE: Validating primary data. [2025-10-28T18:10:21.536152] [FATAL] [VALIDATOR ] CUBE: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T18:10:21.536256] [FATAL] [MAIN ] CUBE: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:10:21.536317] [WARN ] [MAIN ] CUBE: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:10:21.536425] [INFO ] [LOCAL ] CUBE: Starting deletion of primary data. [2025-10-28T18:10:21.536513] [DEBUG] [LOCAL ] CUBE: No primary data file found to delete. [2025-10-28T18:10:21.536555] [INFO ] [LOCAL ] CUBE: Starting deletion of derivative data. [2025-10-28T18:10:21.536598] [DEBUG] [LOCAL ] CUBE: No derivative data file found to delete. [2025-10-28T18:10:21.536712] [INFO ] [MAIN ] Update Progress: 560/2366 symbols completed. CUBE took 1m 4s. Estimated remaining: 3h 46m 45s. Rate: 8.0 symbols/min [2025-10-28T18:10:22.084733] [INFO ] [MAIN ] CVE: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:10:22.154476] [INFO ] [MAIN ] CUZ: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:10:22.285379] [INFO ] [MAIN ] CURV: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:10:22.289044] [INFO ] [MAIN ] CVEO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:10:22.339697] [DEBUG] [LOCAL ] CVEO: Loaded 15001 existing records from primary storage. [2025-10-28T18:10:22.340479] [INFO ] [MAIN ] CVEO: Loaded 15001 existing records. [2025-10-28T18:10:22.414508] [DEBUG] [LOCAL ] CUZ: Loaded 49312 existing records from primary storage. [2025-10-28T18:10:22.421605] [INFO ] [MAIN ] CUZ: Loaded 49312 existing records. [2025-10-28T18:10:22.434829] [DEBUG] [LOCAL ] CURV: Loaded 27358 existing records from primary storage. [2025-10-28T18:10:22.541542] [INFO ] [MAIN ] CURV: Loaded 27358 existing records. [2025-10-28T18:10:22.657705] [DEBUG] [LOCAL ] CVE: Loaded 53560 existing records from primary storage. [2025-10-28T18:10:22.783376] [INFO ] [MAIN ] CVE: Loaded 53560 existing records. [2025-10-28T18:10:22.840053] [WARN ] [MAIN ] CUZ: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:10:22.898499] [INFO ] [MAIN ] CUZ: Wiping existing primary data before full refresh. [2025-10-28T18:10:22.931160] [INFO ] [LOCAL ] CUZ: Starting deletion of primary data. [2025-10-28T18:10:22.910200] [WARN ] [MAIN ] CVEO: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:10:22.988075] [INFO ] [MAIN ] CVEO: Wiping existing primary data before full refresh. [2025-10-28T18:10:22.987946] [DEBUG] [LOCAL ] CUZ: Deleted primary data file. [2025-10-28T18:10:22.998568] [INFO ] [LOCAL ] CVEO: Starting deletion of primary data. [2025-10-28T18:10:23.036134] [DEBUG] [LOCAL ] CVEO: Deleted primary data file. [2025-10-28T18:10:23.014279] [INFO ] [MAIN ] CUZ: Starting full primary refresh. [2025-10-28T18:10:23.061856] [INFO ] [MAIN ] CVEO: Starting full primary refresh. [2025-10-28T18:10:23.203311] [WARN ] [MAIN ] CURV: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:10:23.295042] [INFO ] [MAIN ] CURV: Wiping existing primary data before full refresh. [2025-10-28T18:10:23.342567] [INFO ] [LOCAL ] CURV: Starting deletion of primary data. [2025-10-28T18:10:23.424638] [DEBUG] [LOCAL ] CURV: Deleted primary data file. [2025-10-28T18:10:23.424523] [WARN ] [MAIN ] CVE: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:10:23.430941] [INFO ] [MAIN ] CURV: Starting full primary refresh. [2025-10-28T18:10:23.431260] [INFO ] [MAIN ] CVE: Wiping existing primary data before full refresh. [2025-10-28T18:10:23.464487] [INFO ] [LOCAL ] CVE: Starting deletion of primary data. [2025-10-28T18:10:23.579448] [DEBUG] [LOCAL ] CVE: Deleted primary data file. [2025-10-28T18:10:23.620944] [INFO ] [MAIN ] CVE: Starting full primary refresh. [2025-10-28T18:10:24.434897] [INFO ] [REMOTE ] CVEO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:10:24.456996] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-01. [2025-10-28T18:10:24.511397] [INFO ] [REMOTE ] CUZ: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:10:24.543587] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-01. [2025-10-28T18:10:24.695292] [INFO ] [REMOTE ] CURV: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:10:24.747563] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-01. [2025-10-28T18:10:24.870142] [INFO ] [REMOTE ] CVE: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:10:24.870510] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-01. [2025-10-28T18:10:25.704349] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-28T18:10:25.710767] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-02. [2025-10-28T18:10:25.794213] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-28T18:10:25.803631] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-02. [2025-10-28T18:10:26.102980] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-28T18:10:26.114082] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-02. [2025-10-28T18:10:26.436152] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-28T18:10:26.442413] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-03. [2025-10-28T18:10:26.871200] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-01 (2.41 seconds). [2025-10-28T18:10:26.873762] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-02. [2025-10-28T18:10:26.921955] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-28T18:10:26.931682] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-03. [2025-10-28T18:10:27.264268] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-28T18:10:27.271178] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-04. [2025-10-28T18:10:27.352940] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-28T18:10:27.363849] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-03. [2025-10-28T18:10:27.385274] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-28T18:10:27.389259] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-03. [2025-10-28T18:10:27.980620] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-28T18:10:28.003171] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-28T18:10:28.008890] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-04. [2025-10-28T18:10:28.008503] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-04. [2025-10-28T18:10:28.026941] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-28T18:10:28.033062] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-05. [2025-10-28T18:10:28.553335] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-28T18:10:28.557953] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-05. [2025-10-28T18:10:28.571747] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-28T18:10:28.577007] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-06. [2025-10-28T18:10:29.302215] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-28T18:10:29.307938] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-06. [2025-10-28T18:10:29.343308] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-28T18:10:29.354841] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-05. [2025-10-28T18:10:30.088677] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-28T18:10:30.093136] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-07. [2025-10-28T18:10:30.355016] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-28T18:10:30.365810] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-06. [2025-10-28T18:10:30.530472] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-28T18:10:30.534631] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-08. [2025-10-28T18:10:30.885041] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-06 (2.31 seconds). [2025-10-28T18:10:30.890881] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-07. [2025-10-28T18:10:31.104755] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-28T18:10:31.108875] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-09. [2025-10-28T18:10:31.577504] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-28T18:10:31.601367] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-28T18:10:31.599886] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-07. [2025-10-28T18:10:31.606458] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-10. [2025-10-28T18:10:32.404244] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-28T18:10:32.407936] [INFO ] [REMOTE ] CVEO: Full fetch complete (21008 records). [2025-10-28T18:10:32.408028] [DEBUG] [VALIDATOR ] CVEO: Validating primary data. [2025-10-28T18:10:32.794846] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-03 (5.43 seconds). [2025-10-28T18:10:32.901121] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-04. [2025-10-28T18:10:32.907696] [DEBUG] [VALIDATOR ] CVEO: All expected trading days are present. [2025-10-28T18:10:32.908920] [DEBUG] [VALIDATOR ] CVEO: Primary data validation passed. [2025-10-28T18:10:32.909713] [INFO ] [MAIN ] CVEO: Fetched primary data is valid. [2025-10-28T18:10:32.909801] [DEBUG] [LOCAL ] CVEO: Saving primary data. [2025-10-28T18:10:32.911289] [DEBUG] [LOCAL ] CVEO: Trimmed 21008 records to 15047 (keeping 200 days of data) [2025-10-28T18:10:33.019516] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-28T18:10:33.046448] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-08. [2025-10-28T18:10:33.059288] [DEBUG] [LOCAL ] CVEO: Primary data saved (15047 records). [2025-10-28T18:10:33.059500] [INFO ] [MAIN ] CVEO: Full history saved. [2025-10-28T18:10:33.059731] [INFO ] [MAIN ] Update Progress: 561/2366 symbols completed. CVEO took 11.5s. Estimated remaining: 3h 46m 50s. Rate: 8.0 symbols/min [2025-10-28T18:10:33.245494] [INFO ] [MAIN ] CVI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:10:33.310068] [DEBUG] [LOCAL ] CVI: Loaded 46550 existing records from primary storage. [2025-10-28T18:10:33.310493] [INFO ] [MAIN ] CVI: Loaded 46550 existing records. [2025-10-28T18:10:33.506144] [WARN ] [MAIN ] CVI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:10:33.506446] [INFO ] [MAIN ] CVI: Wiping existing primary data before full refresh. [2025-10-28T18:10:33.506498] [INFO ] [LOCAL ] CVI: Starting deletion of primary data. [2025-10-28T18:10:33.507131] [DEBUG] [LOCAL ] CVI: Deleted primary data file. [2025-10-28T18:10:33.507192] [INFO ] [MAIN ] CVI: Starting full primary refresh. [2025-10-28T18:10:33.870974] [INFO ] [REMOTE ] CVI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:10:33.871327] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-01. [2025-10-28T18:10:34.615087] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-10-28T18:10:34.626047] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-09. [2025-10-28T18:10:35.177957] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-28T18:10:35.186962] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-02. [2025-10-28T18:10:36.161252] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-07 (5.27 seconds). [2025-10-28T18:10:36.169372] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-08. [2025-10-28T18:10:36.289769] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-28T18:10:36.759324] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-03. [2025-10-28T18:10:37.268601] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-28T18:10:37.559335] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-09. [2025-10-28T18:10:37.954719] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-28T18:10:38.359398] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-04. [2025-10-28T18:10:38.518047] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-04 (5.62 seconds). [2025-10-28T18:10:38.579837] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-28T18:10:39.159338] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-05. [2025-10-28T18:10:39.618346] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-28T18:10:39.959381] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-05. [2025-10-28T18:10:40.147669] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-09 (5.52 seconds). [2025-10-28T18:10:40.759395] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-10. [2025-10-28T18:10:41.253963] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-28T18:10:41.559364] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-06. [2025-10-28T18:10:41.617834] [DEBUG] [REMOTE ] CVI: Error fetching primary data for 2025-06: 'API call returned an empty response.' [2025-10-28T18:10:41.618115] [WARN ] [REMOTE ] CVI: No data returned for month 2025-06 [2025-10-28T18:10:41.618207] [FATAL] [REMOTE ] CVI: API call failed - aborting fetch to avoid wasting further API calls [2025-10-28T18:10:41.618288] [FATAL] [MAIN ] CVI: Failed to fetch primary data. [2025-10-28T18:10:41.618349] [WARN ] [MAIN ] CVI: Deleting existing primary and derivative data due to fetch failure. [2025-10-28T18:10:41.618423] [INFO ] [LOCAL ] CVI: Starting deletion of primary data. [2025-10-28T18:10:41.618486] [DEBUG] [LOCAL ] CVI: No primary data file found to delete. [2025-10-28T18:10:41.618523] [INFO ] [LOCAL ] CVI: Starting deletion of derivative data. [2025-10-28T18:10:41.618736] [DEBUG] [LOCAL ] CVI: Deleted derivative data file. [2025-10-28T18:10:41.618823] [INFO ] [MAIN ] Update Progress: 562/2366 symbols completed. CVI took 8.6s. Estimated remaining: 3h 46m 46s. Rate: 8.0 symbols/min [2025-10-28T18:10:41.788929] [INFO ] [MAIN ] CVLG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:10:41.804272] [DEBUG] [LOCAL ] CVLG: Loaded 15185 existing records from primary storage. [2025-10-28T18:10:41.804531] [INFO ] [MAIN ] CVLG: Loaded 15185 existing records. [2025-10-28T18:10:41.998275] [WARN ] [MAIN ] CVLG: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:10:41.998631] [INFO ] [MAIN ] CVLG: Wiping existing primary data before full refresh. [2025-10-28T18:10:41.998722] [INFO ] [LOCAL ] CVLG: Starting deletion of primary data. [2025-10-28T18:10:41.999443] [DEBUG] [LOCAL ] CVLG: Deleted primary data file. [2025-10-28T18:10:41.999503] [INFO ] [MAIN ] CVLG: Starting full primary refresh. [2025-10-28T18:10:42.353909] [INFO ] [REMOTE ] CVLG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:10:42.368836] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-10. [2025-10-28T18:10:42.381188] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-28T18:10:42.391090] [INFO ] [REMOTE ] CUZ: Full fetch complete (70788 records). [2025-10-28T18:10:42.391205] [DEBUG] [VALIDATOR ] CUZ: Validating primary data. [2025-10-28T18:10:42.793803] [DEBUG] [VALIDATOR ] CUZ: All expected trading days are present. [2025-10-28T18:10:42.793889] [DEBUG] [VALIDATOR ] CUZ: Primary data validation passed. [2025-10-28T18:10:42.794728] [INFO ] [MAIN ] CUZ: Fetched primary data is valid. [2025-10-28T18:10:42.794798] [DEBUG] [LOCAL ] CUZ: Saving primary data. [2025-10-28T18:10:42.796238] [DEBUG] [LOCAL ] CUZ: Trimmed 70788 records to 49295 (keeping 200 days of data) [2025-10-28T18:10:43.110595] [DEBUG] [LOCAL ] CUZ: Primary data saved (49295 records). [2025-10-28T18:10:43.110834] [INFO ] [MAIN ] CUZ: Full history saved. [2025-10-28T18:10:43.110930] [INFO ] [MAIN ] Update Progress: 563/2366 symbols completed. CUZ took 21.6s. Estimated remaining: 3h 46m 19s. Rate: 8.0 symbols/min [2025-10-28T18:10:43.173447] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-01. [2025-10-28T18:10:43.289421] [INFO ] [MAIN ] CVNA: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:10:43.343796] [DEBUG] [LOCAL ] CVNA: Loaded 52806 existing records from primary storage. [2025-10-28T18:10:43.344168] [INFO ] [MAIN ] CVNA: Loaded 52806 existing records. [2025-10-28T18:10:43.556949] [WARN ] [MAIN ] CVNA: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:10:43.576725] [INFO ] [MAIN ] CVNA: Wiping existing primary data before full refresh. [2025-10-28T18:10:43.576957] [INFO ] [LOCAL ] CVNA: Starting deletion of primary data. [2025-10-28T18:10:43.578558] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-05 (4.42 seconds). [2025-10-28T18:10:43.578604] [DEBUG] [LOCAL ] CVNA: Deleted primary data file. [2025-10-28T18:10:43.589364] [INFO ] [MAIN ] CVNA: Starting full primary refresh. [2025-10-28T18:10:43.961916] [INFO ] [REMOTE ] CVNA: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:10:43.961978] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-06. [2025-10-28T18:10:44.186382] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-28T18:10:44.759426] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-02. [2025-10-28T18:10:45.559322] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-01. [2025-10-28T18:10:45.683789] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-28T18:10:46.359346] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-03. [2025-10-28T18:10:46.582955] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-10 (4.21 seconds). [2025-10-28T18:10:46.589862] [INFO ] [REMOTE ] CURV: Full fetch complete (39145 records). [2025-10-28T18:10:46.590005] [DEBUG] [VALIDATOR ] CURV: Validating primary data. [2025-10-28T18:10:46.979429] [DEBUG] [VALIDATOR ] CURV: All expected trading days are present. [2025-10-28T18:10:46.979616] [DEBUG] [VALIDATOR ] CURV: Primary data validation passed. [2025-10-28T18:10:46.988465] [INFO ] [MAIN ] CURV: Fetched primary data is valid. [2025-10-28T18:10:46.988922] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-28T18:10:46.992511] [DEBUG] [LOCAL ] CURV: Saving primary data. [2025-10-28T18:10:46.993587] [DEBUG] [LOCAL ] CURV: Trimmed 39145 records to 27484 (keeping 200 days of data) [2025-10-28T18:10:47.143569] [DEBUG] [LOCAL ] CURV: Primary data saved (27484 records). [2025-10-28T18:10:47.143731] [INFO ] [MAIN ] CURV: Full history saved. [2025-10-28T18:10:47.143822] [INFO ] [MAIN ] Update Progress: 564/2366 symbols completed. CURV took 25.6s. Estimated remaining: 3h 46m 0s. Rate: 8.0 symbols/min [2025-10-28T18:10:47.164816] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-04. [2025-10-28T18:10:47.321233] [INFO ] [MAIN ] CVS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:10:47.351769] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-28T18:10:47.414308] [DEBUG] [LOCAL ] CVS: Loaded 53694 existing records from primary storage. [2025-10-28T18:10:47.414775] [INFO ] [MAIN ] CVS: Loaded 53694 existing records. [2025-10-28T18:10:47.616806] [WARN ] [MAIN ] CVS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:10:47.617066] [INFO ] [MAIN ] CVS: Wiping existing primary data before full refresh. [2025-10-28T18:10:47.617126] [INFO ] [LOCAL ] CVS: Starting deletion of primary data. [2025-10-28T18:10:47.617996] [DEBUG] [LOCAL ] CVS: Deleted primary data file. [2025-10-28T18:10:47.618054] [INFO ] [MAIN ] CVS: Starting full primary refresh. [2025-10-28T18:10:47.816186] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-06 (3.85 seconds). [2025-10-28T18:10:47.962612] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-07. [2025-10-28T18:10:48.025378] [INFO ] [REMOTE ] CVS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:10:48.040689] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-28T18:10:48.759331] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-01. [2025-10-28T18:10:49.473067] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-28T18:10:49.559327] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-05. [2025-10-28T18:10:50.308236] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-28T18:10:50.342750] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-28T18:10:50.359295] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-02. [2025-10-28T18:10:51.159358] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-08. [2025-10-28T18:10:51.959318] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-02. [2025-10-28T18:10:52.007577] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-28T18:10:52.759386] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-03. [2025-10-28T18:10:53.559386] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-06. [2025-10-28T18:10:53.651609] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-10-28T18:10:54.309112] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-28T18:10:54.360490] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-07. [2025-10-28T18:10:54.364843] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-28T18:10:55.043610] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-28T18:10:55.159362] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-04. [2025-10-28T18:10:55.959339] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-03. [2025-10-28T18:10:56.309821] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-08 (5.15 seconds). [2025-10-28T18:10:56.759345] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-09. [2025-10-28T18:10:57.559351] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-08. [2025-10-28T18:10:57.957872] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-10-28T18:10:58.052855] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-28T18:10:58.086373] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-28T18:10:58.359355] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-10. [2025-10-28T18:10:59.159325] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-09. [2025-10-28T18:10:59.959367] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-04. [2025-10-28T18:11:02.122925] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-09 (2.96 seconds). [2025-10-28T18:11:02.126853] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-10. [2025-10-28T18:11:02.162737] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-10-28T18:11:02.175824] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-05. [2025-10-28T18:11:03.005055] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-28T18:11:03.008371] [INFO ] [REMOTE ] CVLG: Full fetch complete (21407 records). [2025-10-28T18:11:03.008479] [DEBUG] [VALIDATOR ] CVLG: Validating primary data. [2025-10-28T18:11:03.172669] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-04 (8.01 seconds). [2025-10-28T18:11:03.232795] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-05. [2025-10-28T18:11:03.441075] [DEBUG] [VALIDATOR ] CVLG: All expected trading days are present. [2025-10-28T18:11:03.441160] [DEBUG] [VALIDATOR ] CVLG: Primary data validation passed. [2025-10-28T18:11:03.441596] [INFO ] [MAIN ] CVLG: Fetched primary data is valid. [2025-10-28T18:11:03.441677] [DEBUG] [LOCAL ] CVLG: Saving primary data. [2025-10-28T18:11:03.442298] [DEBUG] [LOCAL ] CVLG: Trimmed 21407 records to 15144 (keeping 200 days of data) [2025-10-28T18:11:03.531002] [DEBUG] [LOCAL ] CVLG: Primary data saved (15144 records). [2025-10-28T18:11:03.531120] [INFO ] [MAIN ] CVLG: Full history saved. [2025-10-28T18:11:03.531193] [INFO ] [MAIN ] Update Progress: 565/2366 symbols completed. CVLG took 21.9s. Estimated remaining: 3h 46m 21s. Rate: 8.0 symbols/min [2025-10-28T18:11:03.697918] [INFO ] [MAIN ] CVX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:11:03.746023] [DEBUG] [LOCAL ] CVX: Loaded 53760 existing records from primary storage. [2025-10-28T18:11:03.746332] [INFO ] [MAIN ] CVX: Loaded 53760 existing records. [2025-10-28T18:11:03.921610] [WARN ] [MAIN ] CVX: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:11:03.921846] [INFO ] [MAIN ] CVX: Wiping existing primary data before full refresh. [2025-10-28T18:11:03.921891] [INFO ] [LOCAL ] CVX: Starting deletion of primary data. [2025-10-28T18:11:03.922870] [DEBUG] [LOCAL ] CVX: Deleted primary data file. [2025-10-28T18:11:03.922927] [INFO ] [MAIN ] CVX: Starting full primary refresh. [2025-10-28T18:11:04.279255] [INFO ] [REMOTE ] CVX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:11:04.279579] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-01. [2025-10-28T18:11:07.636543] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-10 (9.28 seconds). [2025-10-28T18:11:07.647434] [INFO ] [REMOTE ] CVE: Full fetch complete (77711 records). [2025-10-28T18:11:07.647605] [DEBUG] [VALIDATOR ] CVE: Validating primary data. [2025-10-28T18:11:08.048244] [DEBUG] [VALIDATOR ] CVE: All expected trading days are present. [2025-10-28T18:11:08.048341] [DEBUG] [VALIDATOR ] CVE: Primary data validation passed. [2025-10-28T18:11:08.049282] [INFO ] [MAIN ] CVE: Fetched primary data is valid. [2025-10-28T18:11:08.049346] [DEBUG] [LOCAL ] CVE: Saving primary data. [2025-10-28T18:11:08.050849] [DEBUG] [LOCAL ] CVE: Trimmed 77711 records to 53558 (keeping 200 days of data) [2025-10-28T18:11:08.378755] [DEBUG] [LOCAL ] CVE: Primary data saved (53558 records). [2025-10-28T18:11:08.378985] [INFO ] [MAIN ] CVE: Full history saved. [2025-10-28T18:11:08.379088] [INFO ] [MAIN ] Update Progress: 566/2366 symbols completed. CVE took 46.8s. Estimated remaining: 3h 46m 5s. Rate: 8.0 symbols/min [2025-10-28T18:11:08.554216] [INFO ] [MAIN ] CW: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:11:08.575272] [DEBUG] [LOCAL ] CW: Loaded 21509 existing records from primary storage. [2025-10-28T18:11:08.575520] [INFO ] [MAIN ] CW: Loaded 21509 existing records. [2025-10-28T18:11:08.756269] [WARN ] [MAIN ] CW: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:11:08.756467] [INFO ] [MAIN ] CW: Wiping existing primary data before full refresh. [2025-10-28T18:11:08.756513] [INFO ] [LOCAL ] CW: Starting deletion of primary data. [2025-10-28T18:11:08.756873] [DEBUG] [LOCAL ] CW: Deleted primary data file. [2025-10-28T18:11:08.756952] [INFO ] [MAIN ] CW: Starting full primary refresh. [2025-10-28T18:11:09.117103] [INFO ] [REMOTE ] CW: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:11:09.117438] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-01. [2025-10-28T18:11:10.235778] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-28T18:11:10.241692] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-02. [2025-10-28T18:11:11.238218] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-28T18:11:11.243914] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-03. [2025-10-28T18:11:13.438322] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-05 (11.26 seconds). [2025-10-28T18:11:13.449309] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-06. [2025-10-28T18:11:15.130839] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-10-28T18:11:15.143847] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-07. [2025-10-28T18:11:15.673579] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-05 (12.44 seconds). [2025-10-28T18:11:15.685396] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-06. [2025-10-28T18:11:17.103819] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-28T18:11:17.115805] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-08. [2025-10-28T18:11:18.165573] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-01 (13.89 seconds). [2025-10-28T18:11:18.176812] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-02. [2025-10-28T18:11:19.955746] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-28T18:11:19.966144] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-03. [2025-10-28T18:11:24.002444] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-03 (12.76 seconds). [2025-10-28T18:11:24.007580] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-04. [2025-10-28T18:11:27.073948] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-06 (11.39 seconds). [2025-10-28T18:11:27.084784] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-07. [2025-10-28T18:11:29.560800] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-08 (12.44 seconds). [2025-10-28T18:11:29.572481] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-09. [2025-10-28T18:11:31.333506] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-28T18:11:31.345144] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-10. [2025-10-28T18:11:33.389676] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-28T18:11:33.400274] [INFO ] [REMOTE ] CVNA: Full fetch complete (76710 records). [2025-10-28T18:11:33.400429] [DEBUG] [VALIDATOR ] CVNA: Validating primary data. [2025-10-28T18:11:33.807064] [DEBUG] [VALIDATOR ] CVNA: All expected trading days are present. [2025-10-28T18:11:33.807160] [DEBUG] [VALIDATOR ] CVNA: Primary data validation passed. [2025-10-28T18:11:33.808147] [INFO ] [MAIN ] CVNA: Fetched primary data is valid. [2025-10-28T18:11:33.808217] [DEBUG] [LOCAL ] CVNA: Saving primary data. [2025-10-28T18:11:33.810017] [DEBUG] [LOCAL ] CVNA: Trimmed 76710 records to 52804 (keeping 200 days of data) [2025-10-28T18:11:33.926235] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-03 (13.96 seconds). [2025-10-28T18:11:33.948101] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-04. [2025-10-28T18:11:34.175534] [DEBUG] [LOCAL ] CVNA: Primary data saved (52804 records). [2025-10-28T18:11:34.175679] [INFO ] [MAIN ] CVNA: Full history saved. [2025-10-28T18:11:34.175781] [INFO ] [MAIN ] Update Progress: 567/2366 symbols completed. CVNA took 51.1s. Estimated remaining: 3h 46m 55s. Rate: 7.9 symbols/min [2025-10-28T18:11:34.350146] [INFO ] [MAIN ] CWAN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:11:34.396878] [DEBUG] [LOCAL ] CWAN: Loaded 52664 existing records from primary storage. [2025-10-28T18:11:34.397228] [INFO ] [MAIN ] CWAN: Loaded 52664 existing records. [2025-10-28T18:11:34.572172] [WARN ] [MAIN ] CWAN: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:11:34.572380] [INFO ] [MAIN ] CWAN: Wiping existing primary data before full refresh. [2025-10-28T18:11:34.572426] [INFO ] [LOCAL ] CWAN: Starting deletion of primary data. [2025-10-28T18:11:34.573276] [DEBUG] [LOCAL ] CWAN: Deleted primary data file. [2025-10-28T18:11:34.573333] [INFO ] [MAIN ] CWAN: Starting full primary refresh. [2025-10-28T18:11:34.919319] [INFO ] [REMOTE ] CWAN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:11:34.919619] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-01. [2025-10-28T18:11:36.129035] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-10-28T18:11:36.140954] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-05. [2025-10-28T18:11:36.169198] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-04 (12.16 seconds). [2025-10-28T18:11:36.174317] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-05. [2025-10-28T18:11:36.365596] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-28T18:11:36.375589] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-02. [2025-10-28T18:11:37.512817] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-28T18:11:37.522547] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-03. [2025-10-28T18:11:39.005298] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-28T18:11:39.015959] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-04. [2025-10-28T18:11:40.352068] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-28T18:11:40.362830] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-05. [2025-10-28T18:11:41.717486] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-28T18:11:41.728980] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-06. [2025-10-28T18:11:43.047685] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-28T18:11:43.058973] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-07. [2025-10-28T18:11:43.541553] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-07 (16.46 seconds). [2025-10-28T18:11:43.553406] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-08. [2025-10-28T18:11:44.459845] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-28T18:11:44.471278] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-08. [2025-10-28T18:11:45.142954] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-28T18:11:45.154797] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-09. [2025-10-28T18:11:45.826668] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-28T18:11:45.841207] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-09. [2025-10-28T18:11:46.864052] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-10-28T18:11:46.880412] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-10. [2025-10-28T18:11:47.163845] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-28T18:11:47.175033] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-10. [2025-10-28T18:11:47.385670] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-28T18:11:47.396786] [INFO ] [REMOTE ] CVS: Full fetch complete (77874 records). [2025-10-28T18:11:47.396936] [DEBUG] [VALIDATOR ] CVS: Validating primary data. [2025-10-28T18:11:47.790611] [DEBUG] [VALIDATOR ] CVS: All expected trading days are present. [2025-10-28T18:11:47.790736] [DEBUG] [VALIDATOR ] CVS: Primary data validation passed. [2025-10-28T18:11:47.791754] [INFO ] [MAIN ] CVS: Fetched primary data is valid. [2025-10-28T18:11:47.791817] [DEBUG] [LOCAL ] CVS: Saving primary data. [2025-10-28T18:11:47.793354] [DEBUG] [LOCAL ] CVS: Trimmed 77874 records to 53694 (keeping 200 days of data) [2025-10-28T18:11:48.125184] [DEBUG] [LOCAL ] CVS: Primary data saved (53694 records). [2025-10-28T18:11:48.125345] [INFO ] [MAIN ] CVS: Full history saved. [2025-10-28T18:11:48.125435] [INFO ] [MAIN ] Update Progress: 568/2366 symbols completed. CVS took 1m 1s. Estimated remaining: 3h 47m 8s. Rate: 7.9 symbols/min [2025-10-28T18:11:48.301162] [INFO ] [MAIN ] CWEN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:11:48.340730] [DEBUG] [LOCAL ] CWEN: Loaded 45119 existing records from primary storage. [2025-10-28T18:11:48.341070] [INFO ] [MAIN ] CWEN: Loaded 45119 existing records. [2025-10-28T18:11:48.522270] [WARN ] [MAIN ] CWEN: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:11:48.522520] [INFO ] [MAIN ] CWEN: Wiping existing primary data before full refresh. [2025-10-28T18:11:48.522584] [INFO ] [LOCAL ] CWEN: Starting deletion of primary data. [2025-10-28T18:11:48.522988] [DEBUG] [LOCAL ] CWEN: Deleted primary data file. [2025-10-28T18:11:48.523047] [INFO ] [MAIN ] CWEN: Starting full primary refresh. [2025-10-28T18:11:48.874616] [INFO ] [REMOTE ] CWEN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:11:48.874976] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-01. [2025-10-28T18:11:50.012832] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-28T18:11:50.021296] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-02. [2025-10-28T18:11:51.075845] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-05 (14.90 seconds). [2025-10-28T18:11:51.082227] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-06. [2025-10-28T18:11:51.118679] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-28T18:11:51.127299] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-03. [2025-10-28T18:11:52.114950] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-28T18:11:52.120312] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-07. [2025-10-28T18:11:52.267503] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-28T18:11:52.277114] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-04. [2025-10-28T18:11:53.333992] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-28T18:11:53.343827] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-05. [2025-10-28T18:12:00.394931] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-07 (8.27 seconds). [2025-10-28T18:12:00.399787] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-08. [2025-10-28T18:12:02.139310] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-05 (26.00 seconds). [2025-10-28T18:12:02.151237] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-06. [2025-10-28T18:12:04.076374] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-10-28T18:12:04.087155] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-07. [2025-10-28T18:12:07.558054] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-05 (14.21 seconds). [2025-10-28T18:12:07.567023] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-06. [2025-10-28T18:12:07.744175] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-10 (20.57 seconds). [2025-10-28T18:12:07.755347] [INFO ] [REMOTE ] CWAN: Full fetch complete (75643 records). [2025-10-28T18:12:07.755501] [DEBUG] [VALIDATOR ] CWAN: Validating primary data. [2025-10-28T18:12:08.142833] [DEBUG] [VALIDATOR ] CWAN: All expected trading days are present. [2025-10-28T18:12:08.142906] [DEBUG] [VALIDATOR ] CWAN: Primary data validation passed. [2025-10-28T18:12:08.143734] [INFO ] [MAIN ] CWAN: Fetched primary data is valid. [2025-10-28T18:12:08.143795] [DEBUG] [LOCAL ] CWAN: Saving primary data. [2025-10-28T18:12:08.145121] [DEBUG] [LOCAL ] CWAN: Trimmed 75643 records to 52664 (keeping 200 days of data) [2025-10-28T18:12:08.441986] [DEBUG] [LOCAL ] CWAN: Primary data saved (52664 records). [2025-10-28T18:12:08.442109] [INFO ] [MAIN ] CWAN: Full history saved. [2025-10-28T18:12:08.442183] [INFO ] [MAIN ] Update Progress: 569/2366 symbols completed. CWAN took 34.3s. Estimated remaining: 3h 47m 41s. Rate: 7.9 symbols/min [2025-10-28T18:12:08.607302] [INFO ] [MAIN ] CWH: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:12:08.654599] [DEBUG] [LOCAL ] CWH: Loaded 51204 existing records from primary storage. [2025-10-28T18:12:08.654974] [INFO ] [MAIN ] CWH: Loaded 51204 existing records. [2025-10-28T18:12:08.829231] [WARN ] [MAIN ] CWH: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:12:08.829475] [INFO ] [MAIN ] CWH: Wiping existing primary data before full refresh. [2025-10-28T18:12:08.829522] [INFO ] [LOCAL ] CWH: Starting deletion of primary data. [2025-10-28T18:12:08.830125] [DEBUG] [LOCAL ] CWH: Deleted primary data file. [2025-10-28T18:12:08.830187] [INFO ] [MAIN ] CWH: Starting full primary refresh. [2025-10-28T18:12:09.179302] [INFO ] [REMOTE ] CWH: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:12:09.179554] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-01. [2025-10-28T18:12:13.696442] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-08 (13.30 seconds). [2025-10-28T18:12:13.701726] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-09. [2025-10-28T18:12:17.688297] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-01 (8.51 seconds). [2025-10-28T18:12:17.697859] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-02. [2025-10-28T18:12:19.031039] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-28T18:12:19.040251] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-03. [2025-10-28T18:12:20.276170] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-28T18:12:20.286914] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-04. [2025-10-28T18:12:21.790104] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-28T18:12:21.802480] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-05. [2025-10-28T18:12:23.140051] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-28T18:12:23.151265] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-06. [2025-10-28T18:12:23.483096] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-07 (19.40 seconds). [2025-10-28T18:12:23.495051] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-08. [2025-10-28T18:12:24.403247] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-28T18:12:24.413451] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-07. [2025-10-28T18:12:25.134670] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-10-28T18:12:25.145823] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-09. [2025-10-28T18:12:25.831450] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-28T18:12:25.842801] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-08. [2025-10-28T18:12:30.126635] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-06 (22.56 seconds). [2025-10-28T18:12:30.135542] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-07. [2025-10-28T18:12:31.412916] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-28T18:12:31.422765] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-08. [2025-10-28T18:12:32.575885] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-28T18:12:32.585572] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-09. [2025-10-28T18:12:34.808840] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-09 (21.11 seconds). [2025-10-28T18:12:34.813259] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-10. [2025-10-28T18:12:35.926307] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-28T18:12:35.932149] [INFO ] [REMOTE ] CW: Full fetch complete (32895 records). [2025-10-28T18:12:35.932307] [DEBUG] [VALIDATOR ] CW: Validating primary data. [2025-10-28T18:12:36.332305] [DEBUG] [VALIDATOR ] CW: All expected trading days are present. [2025-10-28T18:12:36.332382] [DEBUG] [VALIDATOR ] CW: Primary data validation passed. [2025-10-28T18:12:36.332898] [INFO ] [MAIN ] CW: Fetched primary data is valid. [2025-10-28T18:12:36.332958] [DEBUG] [LOCAL ] CW: Saving primary data. [2025-10-28T18:12:36.333687] [DEBUG] [LOCAL ] CW: Trimmed 32895 records to 21599 (keeping 200 days of data) [2025-10-28T18:12:36.472831] [DEBUG] [LOCAL ] CW: Primary data saved (21599 records). [2025-10-28T18:12:36.472968] [INFO ] [MAIN ] CW: Full history saved. [2025-10-28T18:12:36.473062] [INFO ] [MAIN ] Update Progress: 570/2366 symbols completed. CW took 1m 28s. Estimated remaining: 3h 48m 37s. Rate: 7.9 symbols/min [2025-10-28T18:12:36.640855] [INFO ] [MAIN ] CWK: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:12:36.685908] [DEBUG] [LOCAL ] CWK: Loaded 49600 existing records from primary storage. [2025-10-28T18:12:36.686222] [INFO ] [MAIN ] CWK: Loaded 49600 existing records. [2025-10-28T18:12:36.868908] [WARN ] [MAIN ] CWK: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:12:36.869125] [INFO ] [MAIN ] CWK: Wiping existing primary data before full refresh. [2025-10-28T18:12:36.869174] [INFO ] [LOCAL ] CWK: Starting deletion of primary data. [2025-10-28T18:12:36.869931] [DEBUG] [LOCAL ] CWK: Deleted primary data file. [2025-10-28T18:12:36.869992] [INFO ] [MAIN ] CWK: Starting full primary refresh. [2025-10-28T18:12:37.221949] [INFO ] [REMOTE ] CWK: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:12:37.222273] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-01. [2025-10-28T18:12:38.324228] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-28T18:12:38.333949] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-02. [2025-10-28T18:12:38.902620] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-09 (13.76 seconds). [2025-10-28T18:12:38.914110] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-10. [2025-10-28T18:12:39.329583] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-09 (6.74 seconds). [2025-10-28T18:12:39.339353] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-10. [2025-10-28T18:12:40.927783] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-28T18:12:40.937200] [INFO ] [REMOTE ] CWEN: Full fetch complete (65649 records). [2025-10-28T18:12:40.937322] [DEBUG] [VALIDATOR ] CWEN: Validating primary data. [2025-10-28T18:12:41.322783] [DEBUG] [VALIDATOR ] CWEN: All expected trading days are present. [2025-10-28T18:12:41.322872] [DEBUG] [VALIDATOR ] CWEN: Primary data validation passed. [2025-10-28T18:12:41.323719] [INFO ] [MAIN ] CWEN: Fetched primary data is valid. [2025-10-28T18:12:41.323803] [DEBUG] [LOCAL ] CWEN: Saving primary data. [2025-10-28T18:12:41.325137] [DEBUG] [LOCAL ] CWEN: Trimmed 65649 records to 45068 (keeping 200 days of data) [2025-10-28T18:12:41.597244] [DEBUG] [LOCAL ] CWEN: Primary data saved (45068 records). [2025-10-28T18:12:41.597394] [INFO ] [MAIN ] CWEN: Full history saved. [2025-10-28T18:12:41.597504] [INFO ] [MAIN ] Update Progress: 571/2366 symbols completed. CWEN took 53.5s. Estimated remaining: 3h 48m 22s. Rate: 7.9 symbols/min [2025-10-28T18:12:41.770722] [INFO ] [MAIN ] CWT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:12:41.796991] [DEBUG] [LOCAL ] CWT: Loaded 27782 existing records from primary storage. [2025-10-28T18:12:41.797274] [INFO ] [MAIN ] CWT: Loaded 27782 existing records. [2025-10-28T18:12:41.974793] [WARN ] [MAIN ] CWT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:12:41.975195] [INFO ] [MAIN ] CWT: Wiping existing primary data before full refresh. [2025-10-28T18:12:41.975255] [INFO ] [LOCAL ] CWT: Starting deletion of primary data. [2025-10-28T18:12:41.975716] [DEBUG] [LOCAL ] CWT: Deleted primary data file. [2025-10-28T18:12:41.975773] [INFO ] [MAIN ] CWT: Starting full primary refresh. [2025-10-28T18:12:42.358832] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-08 (16.52 seconds). [2025-10-28T18:12:42.411153] [INFO ] [REMOTE ] CWT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:12:42.411779] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-01. [2025-10-28T18:12:42.412952] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-09. [2025-10-28T18:12:42.440543] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-02 (4.11 seconds). [2025-10-28T18:12:42.450132] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-03. [2025-10-28T18:12:43.745508] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-28T18:12:43.751838] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-02. [2025-10-28T18:12:43.834018] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-10 (4.92 seconds). [2025-10-28T18:12:43.837776] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-28T18:12:43.862584] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-10. [2025-10-28T18:12:43.862854] [INFO ] [REMOTE ] CVX: Full fetch complete (77940 records). [2025-10-28T18:12:43.864166] [DEBUG] [VALIDATOR ] CVX: Validating primary data. [2025-10-28T18:12:44.304071] [DEBUG] [VALIDATOR ] CVX: All expected trading days are present. [2025-10-28T18:12:44.330449] [DEBUG] [VALIDATOR ] CVX: Primary data validation passed. [2025-10-28T18:12:44.332172] [INFO ] [MAIN ] CVX: Fetched primary data is valid. [2025-10-28T18:12:44.333679] [DEBUG] [LOCAL ] CVX: Saving primary data. [2025-10-28T18:12:44.333520] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-10-28T18:12:44.344860] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-04. [2025-10-28T18:12:44.346378] [DEBUG] [LOCAL ] CVX: Trimmed 77940 records to 53760 (keeping 200 days of data) [2025-10-28T18:12:44.678746] [DEBUG] [LOCAL ] CVX: Primary data saved (53760 records). [2025-10-28T18:12:44.678951] [INFO ] [MAIN ] CVX: Full history saved. [2025-10-28T18:12:44.694122] [INFO ] [MAIN ] Update Progress: 572/2366 symbols completed. CVX took 1m 41s. Estimated remaining: 3h 47m 60s. Rate: 7.9 symbols/min [2025-10-28T18:12:44.772430] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-28T18:12:44.805802] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-03. [2025-10-28T18:12:44.876176] [INFO ] [MAIN ] CX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:12:44.925788] [DEBUG] [LOCAL ] CX: Loaded 52770 existing records from primary storage. [2025-10-28T18:12:44.926104] [INFO ] [MAIN ] CX: Loaded 52770 existing records. [2025-10-28T18:12:45.098928] [WARN ] [MAIN ] CX: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:12:45.099122] [INFO ] [MAIN ] CX: Wiping existing primary data before full refresh. [2025-10-28T18:12:45.099167] [INFO ] [LOCAL ] CX: Starting deletion of primary data. [2025-10-28T18:12:45.099589] [DEBUG] [LOCAL ] CX: Deleted primary data file. [2025-10-28T18:12:45.099688] [INFO ] [MAIN ] CX: Starting full primary refresh. [2025-10-28T18:12:45.454209] [INFO ] [REMOTE ] CX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:12:45.454609] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-01. [2025-10-28T18:12:45.481617] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-28T18:12:45.492130] [INFO ] [REMOTE ] CWH: Full fetch complete (73260 records). [2025-10-28T18:12:45.492261] [DEBUG] [VALIDATOR ] CWH: Validating primary data. [2025-10-28T18:12:45.868256] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-28T18:12:45.927629] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-04. [2025-10-28T18:12:45.928039] [DEBUG] [VALIDATOR ] CWH: All expected trading days are present. [2025-10-28T18:12:45.928332] [DEBUG] [VALIDATOR ] CWH: Primary data validation passed. [2025-10-28T18:12:45.930099] [INFO ] [MAIN ] CWH: Fetched primary data is valid. [2025-10-28T18:12:45.930203] [DEBUG] [LOCAL ] CWH: Saving primary data. [2025-10-28T18:12:45.958870] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-28T18:12:45.969479] [DEBUG] [LOCAL ] CWH: Trimmed 73260 records to 51203 (keeping 200 days of data) [2025-10-28T18:12:45.970721] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-05. [2025-10-28T18:12:46.272448] [DEBUG] [LOCAL ] CWH: Primary data saved (51203 records). [2025-10-28T18:12:46.272572] [INFO ] [MAIN ] CWH: Full history saved. [2025-10-28T18:12:46.272745] [INFO ] [MAIN ] Update Progress: 573/2366 symbols completed. CWH took 37.8s. Estimated remaining: 3h 47m 33s. Rate: 7.9 symbols/min [2025-10-28T18:12:46.447282] [INFO ] [MAIN ] CXE: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:12:46.455423] [DEBUG] [LOCAL ] CXE: Loaded 6300 existing records from primary storage. [2025-10-28T18:12:46.455614] [INFO ] [MAIN ] CXE: Loaded 6300 existing records. [2025-10-28T18:12:46.632586] [WARN ] [MAIN ] CXE: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:12:46.632796] [INFO ] [MAIN ] CXE: Wiping existing primary data before full refresh. [2025-10-28T18:12:46.632893] [INFO ] [LOCAL ] CXE: Starting deletion of primary data. [2025-10-28T18:12:46.633053] [DEBUG] [LOCAL ] CXE: Deleted primary data file. [2025-10-28T18:12:46.633123] [INFO ] [MAIN ] CXE: Starting full primary refresh. [2025-10-28T18:12:46.997121] [INFO ] [REMOTE ] CXE: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:12:46.997508] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-01. [2025-10-28T18:12:47.018004] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-28T18:12:47.025164] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-05. [2025-10-28T18:12:47.055003] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-10-28T18:12:47.065085] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-02. [2025-10-28T18:12:47.216715] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-28T18:12:47.230111] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-06. [2025-10-28T18:12:47.763530] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-28T18:12:47.766164] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-02. [2025-10-28T18:12:48.178280] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-28T18:12:48.185139] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-06. [2025-10-28T18:12:48.287396] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-28T18:12:48.288815] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-28T18:12:48.303623] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-03. [2025-10-28T18:12:48.302677] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-03. [2025-10-28T18:12:48.839772] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-28T18:12:48.842986] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-04. [2025-10-28T18:12:48.995051] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-10-28T18:12:49.004421] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-07. [2025-10-28T18:12:49.073945] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-28T18:12:49.079761] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-07. [2025-10-28T18:12:49.517540] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-28T18:12:49.519547] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-05. [2025-10-28T18:12:49.945068] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-28T18:12:49.956391] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-04. [2025-10-28T18:12:49.996832] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-28T18:12:50.003916] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-08. [2025-10-28T18:12:50.012444] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-28T18:12:50.015055] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-06. [2025-10-28T18:12:50.417368] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-10-28T18:12:50.419445] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-07. [2025-10-28T18:12:50.811627] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-28T18:12:50.817799] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-09. [2025-10-28T18:12:50.825587] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-10-28T18:12:50.827540] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-08. [2025-10-28T18:12:51.144461] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-08 (0.32 seconds). [2025-10-28T18:12:51.146288] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-09. [2025-10-28T18:12:51.293004] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-10-28T18:12:51.304450] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-08. [2025-10-28T18:12:51.345920] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-28T18:12:51.356946] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-05. [2025-10-28T18:12:51.584406] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-28T18:12:51.590615] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-10. [2025-10-28T18:12:51.652105] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-28T18:12:51.654380] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-10. [2025-10-28T18:12:52.265379] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-28T18:12:52.267182] [INFO ] [REMOTE ] CXE: Full fetch complete (10957 records). [2025-10-28T18:12:52.267266] [DEBUG] [VALIDATOR ] CXE: Validating primary data. [2025-10-28T18:12:52.640051] [DEBUG] [VALIDATOR ] CXE: All expected trading days are present. [2025-10-28T18:12:52.640291] [DEBUG] [VALIDATOR ] CXE: Primary data validation passed. [2025-10-28T18:12:52.640899] [INFO ] [MAIN ] CXE: Fetched primary data is valid. [2025-10-28T18:12:52.641140] [DEBUG] [LOCAL ] CXE: Saving primary data. [2025-10-28T18:12:52.655760] [DEBUG] [LOCAL ] CXE: Trimmed 10957 records to 6302 (keeping 200 days of data) [2025-10-28T18:12:52.659634] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-28T18:12:52.721256] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-28T18:12:52.718707] [INFO ] [REMOTE ] CWT: Full fetch complete (41310 records). [2025-10-28T18:12:52.734694] [DEBUG] [VALIDATOR ] CWT: Validating primary data. [2025-10-28T18:12:52.741463] [DEBUG] [LOCAL ] CXE: Primary data saved (6302 records). [2025-10-28T18:12:52.741578] [INFO ] [MAIN ] CXE: Full history saved. [2025-10-28T18:12:52.742005] [INFO ] [MAIN ] Update Progress: 574/2366 symbols completed. CXE took 6.5s. Estimated remaining: 3h 47m 22s. Rate: 7.9 symbols/min [2025-10-28T18:12:52.784156] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-09. [2025-10-28T18:12:53.091477] [INFO ] [MAIN ] CXH: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:12:53.215668] [DEBUG] [LOCAL ] CXH: Loaded 4349 existing records from primary storage. [2025-10-28T18:12:53.258534] [INFO ] [MAIN ] CXH: Loaded 4349 existing records. [2025-10-28T18:12:53.317522] [DEBUG] [VALIDATOR ] CWT: All expected trading days are present. [2025-10-28T18:12:53.332934] [DEBUG] [VALIDATOR ] CWT: Primary data validation passed. [2025-10-28T18:12:53.340221] [INFO ] [MAIN ] CWT: Fetched primary data is valid. [2025-10-28T18:12:53.355874] [DEBUG] [LOCAL ] CWT: Saving primary data. [2025-10-28T18:12:53.435475] [DEBUG] [LOCAL ] CWT: Trimmed 41310 records to 27707 (keeping 200 days of data) [2025-10-28T18:12:53.454308] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-10-28T18:12:53.581313] [WARN ] [MAIN ] CXH: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:12:53.590909] [INFO ] [MAIN ] CXH: Wiping existing primary data before full refresh. [2025-10-28T18:12:53.590615] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-06. [2025-10-28T18:12:53.617504] [INFO ] [LOCAL ] CXH: Starting deletion of primary data. [2025-10-28T18:12:53.626358] [DEBUG] [LOCAL ] CXH: Deleted primary data file. [2025-10-28T18:12:53.641207] [INFO ] [MAIN ] CXH: Starting full primary refresh. [2025-10-28T18:12:53.802137] [DEBUG] [LOCAL ] CWT: Primary data saved (27707 records). [2025-10-28T18:12:53.811113] [INFO ] [MAIN ] CWT: Full history saved. [2025-10-28T18:12:53.817694] [INFO ] [MAIN ] Update Progress: 575/2366 symbols completed. CWT took 12.2s. Estimated remaining: 3h 46m 54s. Rate: 7.9 symbols/min [2025-10-28T18:12:54.182589] [INFO ] [MAIN ] CXM: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:12:54.287161] [INFO ] [REMOTE ] CXH: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:12:54.287867] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-01. [2025-10-28T18:12:54.320883] [DEBUG] [LOCAL ] CXM: Loaded 47108 existing records from primary storage. [2025-10-28T18:12:54.321194] [INFO ] [MAIN ] CXM: Loaded 47108 existing records. [2025-10-28T18:12:54.527443] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-28T18:12:54.531810] [WARN ] [MAIN ] CXM: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:12:54.541919] [INFO ] [MAIN ] CXM: Wiping existing primary data before full refresh. [2025-10-28T18:12:54.542298] [INFO ] [LOCAL ] CXM: Starting deletion of primary data. [2025-10-28T18:12:54.542761] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-10. [2025-10-28T18:12:54.543673] [DEBUG] [LOCAL ] CXM: Deleted primary data file. [2025-10-28T18:12:54.543737] [INFO ] [MAIN ] CXM: Starting full primary refresh. [2025-10-28T18:12:54.816706] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-28T18:12:54.828073] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-02. [2025-10-28T18:12:54.908812] [INFO ] [REMOTE ] CXM: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:12:54.909161] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-01. [2025-10-28T18:12:54.953601] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-28T18:12:54.964304] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-07. [2025-10-28T18:12:55.230033] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-28T18:12:55.231159] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-03. [2025-10-28T18:12:55.529418] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-03 (0.30 seconds). [2025-10-28T18:12:55.530561] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-04. [2025-10-28T18:12:55.858188] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-04 (0.33 seconds). [2025-10-28T18:12:55.859822] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-05. [2025-10-28T18:12:56.030978] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-28T18:12:56.040519] [INFO ] [REMOTE ] CWK: Full fetch complete (71023 records). [2025-10-28T18:12:56.040628] [DEBUG] [VALIDATOR ] CWK: Validating primary data. [2025-10-28T18:12:56.041465] [FATAL] [VALIDATOR ] CWK: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T18:12:56.041546] [FATAL] [MAIN ] CWK: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:12:56.041589] [WARN ] [MAIN ] CWK: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:12:56.041677] [INFO ] [LOCAL ] CWK: Starting deletion of primary data. [2025-10-28T18:12:56.041752] [DEBUG] [LOCAL ] CWK: No primary data file found to delete. [2025-10-28T18:12:56.041789] [INFO ] [LOCAL ] CWK: Starting deletion of derivative data. [2025-10-28T18:12:56.041964] [DEBUG] [LOCAL ] CWK: Deleted derivative data file. [2025-10-28T18:12:56.042051] [INFO ] [MAIN ] Update Progress: 576/2366 symbols completed. CWK took 19.6s. Estimated remaining: 3h 46m 30s. Rate: 7.9 symbols/min [2025-10-28T18:12:56.216101] [INFO ] [MAIN ] CXT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:12:56.244904] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-10-28T18:12:56.246811] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-28T18:12:56.258881] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-06. [2025-10-28T18:12:56.260166] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-02. [2025-10-28T18:12:56.292727] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-28T18:12:56.311913] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-08. [2025-10-28T18:12:56.323212] [DEBUG] [LOCAL ] CXT: Loaded 30425 existing records from primary storage. [2025-10-28T18:12:56.323431] [INFO ] [MAIN ] CXT: Loaded 30425 existing records. [2025-10-28T18:12:56.496683] [WARN ] [MAIN ] CXT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:12:56.496849] [INFO ] [MAIN ] CXT: Wiping existing primary data before full refresh. [2025-10-28T18:12:56.496912] [INFO ] [LOCAL ] CXT: Starting deletion of primary data. [2025-10-28T18:12:56.500611] [DEBUG] [LOCAL ] CXT: Deleted primary data file. [2025-10-28T18:12:56.500715] [INFO ] [MAIN ] CXT: Starting full primary refresh. [2025-10-28T18:12:56.678177] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-28T18:12:56.727512] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-07. [2025-10-28T18:12:56.860507] [INFO ] [REMOTE ] CXT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:12:56.860791] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-01. [2025-10-28T18:12:57.189306] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-28T18:12:57.198045] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-03. [2025-10-28T18:12:57.581044] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-28T18:12:57.583563] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-08. [2025-10-28T18:12:57.767808] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-28T18:12:57.779009] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-09. [2025-10-28T18:12:57.922115] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-28T18:12:57.928783] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-02. [2025-10-28T18:12:57.964226] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-10-28T18:12:57.965819] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-09. [2025-10-28T18:12:58.306207] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-28T18:12:58.317281] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-04. [2025-10-28T18:12:58.360918] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-10-28T18:12:58.362895] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-10. [2025-10-28T18:12:58.761253] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-28T18:12:58.767865] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-03. [2025-10-28T18:12:58.771731] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-28T18:12:58.772865] [INFO ] [REMOTE ] CXH: Full fetch complete (5304 records). [2025-10-28T18:12:58.772975] [DEBUG] [VALIDATOR ] CXH: Validating primary data. [2025-10-28T18:12:59.141553] [DEBUG] [VALIDATOR ] CXH: All expected trading days are present. [2025-10-28T18:12:59.141714] [DEBUG] [VALIDATOR ] CXH: Primary data validation passed. [2025-10-28T18:12:59.141950] [INFO ] [MAIN ] CXH: Fetched primary data is valid. [2025-10-28T18:12:59.142028] [DEBUG] [LOCAL ] CXH: Saving primary data. [2025-10-28T18:12:59.168958] [DEBUG] [LOCAL ] CXH: Trimmed 5304 records to 4335 (keeping 200 days of data) [2025-10-28T18:12:59.184002] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-28T18:12:59.210944] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-10. [2025-10-28T18:12:59.210566] [DEBUG] [LOCAL ] CXH: Primary data saved (4335 records). [2025-10-28T18:12:59.211813] [INFO ] [MAIN ] CXH: Full history saved. [2025-10-28T18:12:59.211899] [INFO ] [MAIN ] Update Progress: 577/2366 symbols completed. CXH took 6.5s. Estimated remaining: 3h 46m 9s. Rate: 7.9 symbols/min [2025-10-28T18:12:59.381128] [INFO ] [MAIN ] CXW: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:12:59.421901] [DEBUG] [LOCAL ] CXW: Loaded 43394 existing records from primary storage. [2025-10-28T18:12:59.422297] [INFO ] [MAIN ] CXW: Loaded 43394 existing records. [2025-10-28T18:12:59.578564] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-28T18:12:59.643945] [WARN ] [MAIN ] CXW: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:12:59.644909] [INFO ] [MAIN ] CXW: Wiping existing primary data before full refresh. [2025-10-28T18:12:59.645037] [INFO ] [LOCAL ] CXW: Starting deletion of primary data. [2025-10-28T18:12:59.644794] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-05. [2025-10-28T18:12:59.646299] [DEBUG] [LOCAL ] CXW: Deleted primary data file. [2025-10-28T18:12:59.646369] [INFO ] [MAIN ] CXW: Starting full primary refresh. [2025-10-28T18:12:59.804619] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-28T18:12:59.929531] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-04. [2025-10-28T18:13:00.028703] [INFO ] [REMOTE ] CXW: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:13:00.028986] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-01. [2025-10-28T18:13:00.876118] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-28T18:13:00.889180] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-06. [2025-10-28T18:13:01.040820] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-28T18:13:01.048485] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-05. [2025-10-28T18:13:01.102789] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-28T18:13:01.113209] [INFO ] [REMOTE ] CX: Full fetch complete (76556 records). [2025-10-28T18:13:01.113351] [DEBUG] [VALIDATOR ] CX: Validating primary data. [2025-10-28T18:13:01.507179] [DEBUG] [VALIDATOR ] CX: All expected trading days are present. [2025-10-28T18:13:01.507296] [DEBUG] [VALIDATOR ] CX: Primary data validation passed. [2025-10-28T18:13:01.508261] [INFO ] [MAIN ] CX: Fetched primary data is valid. [2025-10-28T18:13:01.508482] [DEBUG] [LOCAL ] CX: Saving primary data. [2025-10-28T18:13:01.534147] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-28T18:13:01.534283] [DEBUG] [LOCAL ] CX: Trimmed 76556 records to 52770 (keeping 200 days of data) [2025-10-28T18:13:01.543861] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-02. [2025-10-28T18:13:01.865287] [DEBUG] [LOCAL ] CX: Primary data saved (52770 records). [2025-10-28T18:13:01.865438] [INFO ] [MAIN ] CX: Full history saved. [2025-10-28T18:13:01.865529] [INFO ] [MAIN ] Update Progress: 578/2366 symbols completed. CX took 17.2s. Estimated remaining: 3h 45m 46s. Rate: 7.9 symbols/min [2025-10-28T18:13:02.044072] [INFO ] [MAIN ] CYD: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:13:02.062153] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-28T18:13:02.069165] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-06. [2025-10-28T18:13:02.107093] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-28T18:13:02.126375] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-07. [2025-10-28T18:13:02.126878] [DEBUG] [LOCAL ] CYD: Loaded 27069 existing records from primary storage. [2025-10-28T18:13:02.127224] [INFO ] [MAIN ] CYD: Loaded 27069 existing records. [2025-10-28T18:13:02.301735] [WARN ] [MAIN ] CYD: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:13:02.301975] [INFO ] [MAIN ] CYD: Wiping existing primary data before full refresh. [2025-10-28T18:13:02.302029] [INFO ] [LOCAL ] CYD: Starting deletion of primary data. [2025-10-28T18:13:02.302301] [DEBUG] [LOCAL ] CYD: Deleted primary data file. [2025-10-28T18:13:02.302340] [INFO ] [MAIN ] CYD: Starting full primary refresh. [2025-10-28T18:13:02.659169] [INFO ] [REMOTE ] CYD: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:13:02.659485] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-01. [2025-10-28T18:13:02.859198] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-28T18:13:02.868619] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-03. [2025-10-28T18:13:03.043443] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-28T18:13:03.050458] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-07. [2025-10-28T18:13:03.222794] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-28T18:13:03.224385] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-02. [2025-10-28T18:13:03.547774] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-28T18:13:03.558186] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-08. [2025-10-28T18:13:03.934272] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-28T18:13:03.948221] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-04. [2025-10-28T18:13:03.961968] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-28T18:13:03.966828] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-03. [2025-10-28T18:13:04.014014] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-28T18:13:04.024377] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-08. [2025-10-28T18:13:04.660120] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-28T18:13:04.675618] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-09. [2025-10-28T18:13:04.758929] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-28T18:13:04.769857] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-04. [2025-10-28T18:13:05.006998] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-28T18:13:05.014376] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-09. [2025-10-28T18:13:05.321119] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-28T18:13:05.330955] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-05. [2025-10-28T18:13:05.706685] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-28T18:13:05.712946] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-05. [2025-10-28T18:13:05.937079] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-28T18:13:05.944458] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-10. [2025-10-28T18:13:06.064783] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-28T18:13:06.076214] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-10. [2025-10-28T18:13:06.354704] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-28T18:13:06.364060] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-06. [2025-10-28T18:13:06.521002] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-28T18:13:06.526438] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-06. [2025-10-28T18:13:07.065706] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-28T18:13:07.071936] [INFO ] [REMOTE ] CXT: Full fetch complete (45517 records). [2025-10-28T18:13:07.072025] [DEBUG] [VALIDATOR ] CXT: Validating primary data. [2025-10-28T18:13:07.476702] [DEBUG] [VALIDATOR ] CXT: All expected trading days are present. [2025-10-28T18:13:07.477432] [DEBUG] [VALIDATOR ] CXT: Primary data validation passed. [2025-10-28T18:13:07.478459] [INFO ] [MAIN ] CXT: Fetched primary data is valid. [2025-10-28T18:13:07.479338] [DEBUG] [LOCAL ] CXT: Saving primary data. [2025-10-28T18:13:07.536245] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-28T18:13:07.534856] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-28T18:13:07.536920] [DEBUG] [LOCAL ] CXT: Trimmed 45517 records to 30366 (keeping 200 days of data) [2025-10-28T18:13:07.558032] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-07. [2025-10-28T18:13:07.613549] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-07. [2025-10-28T18:13:07.683280] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-28T18:13:07.730838] [INFO ] [REMOTE ] CXM: Full fetch complete (68320 records). [2025-10-28T18:13:07.734393] [DEBUG] [VALIDATOR ] CXM: Validating primary data. [2025-10-28T18:13:07.862184] [DEBUG] [LOCAL ] CXT: Primary data saved (30366 records). [2025-10-28T18:13:07.875396] [INFO ] [MAIN ] CXT: Full history saved. [2025-10-28T18:13:07.886158] [INFO ] [MAIN ] Update Progress: 579/2366 symbols completed. CXT took 11.8s. Estimated remaining: 3h 45m 33s. Rate: 7.9 symbols/min [2025-10-28T18:13:08.345316] [INFO ] [MAIN ] CYH: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:13:08.474260] [DEBUG] [VALIDATOR ] CXM: All expected trading days are present. [2025-10-28T18:13:08.474488] [DEBUG] [VALIDATOR ] CXM: Primary data validation passed. [2025-10-28T18:13:08.475327] [INFO ] [MAIN ] CXM: Fetched primary data is valid. [2025-10-28T18:13:08.475388] [DEBUG] [LOCAL ] CXM: Saving primary data. [2025-10-28T18:13:08.476639] [DEBUG] [LOCAL ] CXM: Trimmed 68320 records to 47019 (keeping 200 days of data) [2025-10-28T18:13:08.669441] [DEBUG] [LOCAL ] CYH: Loaded 47628 existing records from primary storage. [2025-10-28T18:13:08.722303] [INFO ] [MAIN ] CYH: Loaded 47628 existing records. [2025-10-28T18:13:08.824484] [DEBUG] [LOCAL ] CXM: Primary data saved (47019 records). [2025-10-28T18:13:08.834392] [INFO ] [MAIN ] CXM: Full history saved. [2025-10-28T18:13:08.875922] [INFO ] [MAIN ] Update Progress: 580/2366 symbols completed. CXM took 15.0s. Estimated remaining: 3h 45m 5s. Rate: 7.9 symbols/min [2025-10-28T18:13:08.917606] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-28T18:13:08.979009] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-08. [2025-10-28T18:13:09.095613] [WARN ] [MAIN ] CYH: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:13:09.096312] [INFO ] [MAIN ] CYH: Wiping existing primary data before full refresh. [2025-10-28T18:13:09.113076] [INFO ] [LOCAL ] CYH: Starting deletion of primary data. [2025-10-28T18:13:09.137201] [DEBUG] [LOCAL ] CYH: Deleted primary data file. [2025-10-28T18:13:09.171124] [INFO ] [MAIN ] D: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:13:09.167003] [INFO ] [MAIN ] CYH: Starting full primary refresh. [2025-10-28T18:13:09.171458] [DEBUG] [LOCAL ] D: No existing data file found in primary storage. [2025-10-28T18:13:09.220279] [WARN ] [MAIN ] D: No existing data found, performing full refresh instead. [2025-10-28T18:13:09.236907] [INFO ] [MAIN ] D: Wiping existing primary data before full refresh. [2025-10-28T18:13:09.242249] [INFO ] [LOCAL ] D: Starting deletion of primary data. [2025-10-28T18:13:09.259566] [DEBUG] [LOCAL ] D: No primary data file found to delete. [2025-10-28T18:13:09.259726] [INFO ] [MAIN ] D: Starting full primary refresh. [2025-10-28T18:13:09.714348] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-10-28T18:13:09.843517] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-08. [2025-10-28T18:13:09.904355] [INFO ] [REMOTE ] CYH: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:13:09.934474] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-01. [2025-10-28T18:13:09.971413] [INFO ] [REMOTE ] D: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:13:09.971854] [INFO ] [REMOTE ] D: Fetching primary data for 2025-01. [2025-10-28T18:13:09.991553] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-28T18:13:09.998477] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-09. [2025-10-28T18:13:10.920967] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-28T18:13:10.928230] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-10. [2025-10-28T18:13:11.143790] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-28T18:13:11.153541] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-09. [2025-10-28T18:13:11.414152] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-28T18:13:11.423768] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-02. [2025-10-28T18:13:11.657060] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-28T18:13:11.667428] [INFO ] [REMOTE ] D: Fetching primary data for 2025-02. [2025-10-28T18:13:11.856094] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-28T18:13:11.862272] [INFO ] [REMOTE ] CYD: Full fetch complete (36492 records). [2025-10-28T18:13:11.862351] [DEBUG] [VALIDATOR ] CYD: Validating primary data. [2025-10-28T18:13:11.862880] [FATAL] [VALIDATOR ] CYD: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T18:13:11.862959] [FATAL] [MAIN ] CYD: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:13:11.863001] [WARN ] [MAIN ] CYD: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:13:11.863038] [INFO ] [LOCAL ] CYD: Starting deletion of primary data. [2025-10-28T18:13:11.863093] [DEBUG] [LOCAL ] CYD: No primary data file found to delete. [2025-10-28T18:13:11.863128] [INFO ] [LOCAL ] CYD: Starting deletion of derivative data. [2025-10-28T18:13:11.863278] [DEBUG] [LOCAL ] CYD: Deleted derivative data file. [2025-10-28T18:13:11.863346] [INFO ] [MAIN ] Update Progress: 581/2366 symbols completed. CYD took 10.0s. Estimated remaining: 3h 44m 44s. Rate: 7.9 symbols/min [2025-10-28T18:13:12.028394] [INFO ] [MAIN ] DAC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:13:12.040470] [DEBUG] [LOCAL ] DAC: Loaded 11984 existing records from primary storage. [2025-10-28T18:13:12.040746] [INFO ] [MAIN ] DAC: Loaded 11984 existing records. [2025-10-28T18:13:12.214741] [WARN ] [MAIN ] DAC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:13:12.214931] [INFO ] [MAIN ] DAC: Wiping existing primary data before full refresh. [2025-10-28T18:13:12.214976] [INFO ] [LOCAL ] DAC: Starting deletion of primary data. [2025-10-28T18:13:12.215174] [DEBUG] [LOCAL ] DAC: Deleted primary data file. [2025-10-28T18:13:12.215213] [INFO ] [MAIN ] DAC: Starting full primary refresh. [2025-10-28T18:13:12.593454] [INFO ] [REMOTE ] DAC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:13:12.604490] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-01. [2025-10-28T18:13:12.604132] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-28T18:13:12.615944] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-10. [2025-10-28T18:13:12.644928] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-28T18:13:12.655864] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-03. [2025-10-28T18:13:12.881913] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-28T18:13:12.891932] [INFO ] [REMOTE ] D: Fetching primary data for 2025-03. [2025-10-28T18:13:13.400060] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-28T18:13:13.403826] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-02. [2025-10-28T18:13:13.635588] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-28T18:13:13.645336] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-04. [2025-10-28T18:13:14.059331] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-28T18:13:14.068533] [INFO ] [REMOTE ] CXW: Full fetch complete (64675 records). [2025-10-28T18:13:14.068724] [DEBUG] [VALIDATOR ] CXW: Validating primary data. [2025-10-28T18:13:14.174074] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-28T18:13:14.186113] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-03. [2025-10-28T18:13:14.510901] [DEBUG] [VALIDATOR ] CXW: All expected trading days are present. [2025-10-28T18:13:14.511011] [DEBUG] [VALIDATOR ] CXW: Primary data validation passed. [2025-10-28T18:13:14.511831] [INFO ] [MAIN ] CXW: Fetched primary data is valid. [2025-10-28T18:13:14.511976] [DEBUG] [LOCAL ] CXW: Saving primary data. [2025-10-28T18:13:14.514500] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-28T18:13:14.526007] [INFO ] [REMOTE ] D: Fetching primary data for 2025-04. [2025-10-28T18:13:14.526915] [DEBUG] [LOCAL ] CXW: Trimmed 64675 records to 43420 (keeping 200 days of data) [2025-10-28T18:13:14.780284] [DEBUG] [LOCAL ] CXW: Primary data saved (43420 records). [2025-10-28T18:13:14.780404] [INFO ] [MAIN ] CXW: Full history saved. [2025-10-28T18:13:14.780483] [INFO ] [MAIN ] Update Progress: 582/2366 symbols completed. CXW took 15.6s. Estimated remaining: 3h 44m 22s. Rate: 8.0 symbols/min [2025-10-28T18:13:14.991312] [INFO ] [MAIN ] DAL: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:13:14.992370] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-28T18:13:14.992592] [DEBUG] [LOCAL ] DAL: No existing data file found in primary storage. [2025-10-28T18:13:14.996361] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-04. [2025-10-28T18:13:14.997323] [WARN ] [MAIN ] DAL: No existing data found, performing full refresh instead. [2025-10-28T18:13:14.997574] [INFO ] [MAIN ] DAL: Wiping existing primary data before full refresh. [2025-10-28T18:13:14.997688] [INFO ] [LOCAL ] DAL: Starting deletion of primary data. [2025-10-28T18:13:14.997902] [DEBUG] [LOCAL ] DAL: No primary data file found to delete. [2025-10-28T18:13:14.997957] [INFO ] [MAIN ] DAL: Starting full primary refresh. [2025-10-28T18:13:15.131677] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-28T18:13:15.168288] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-05. [2025-10-28T18:13:15.398810] [INFO ] [REMOTE ] DAL: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:13:15.399115] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-01. [2025-10-28T18:13:15.717024] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-28T18:13:15.720876] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-05. [2025-10-28T18:13:16.052793] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-28T18:13:16.064024] [INFO ] [REMOTE ] D: Fetching primary data for 2025-05. [2025-10-28T18:13:16.306090] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-28T18:13:16.309436] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-06. [2025-10-28T18:13:16.586339] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-28T18:13:16.759360] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-06. [2025-10-28T18:13:16.971424] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-28T18:13:17.071255] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-10-28T18:13:17.377228] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-28T18:13:17.559365] [INFO ] [REMOTE ] D: Fetching primary data for 2025-06. [2025-10-28T18:13:17.819173] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-28T18:13:18.359329] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-07. [2025-10-28T18:13:18.818600] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-28T18:13:18.898442] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-28T18:13:19.159317] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-02. [2025-10-28T18:13:19.959327] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-07. [2025-10-28T18:13:20.574834] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-28T18:13:20.759376] [INFO ] [REMOTE ] D: Fetching primary data for 2025-07. [2025-10-28T18:13:21.266598] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-28T18:13:21.559333] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-08. [2025-10-28T18:13:22.232761] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-28T18:13:22.359346] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-08. [2025-10-28T18:13:22.901113] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-28T18:13:22.924834] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-28T18:13:23.159346] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-03. [2025-10-28T18:13:23.959352] [INFO ] [REMOTE ] D: Fetching primary data for 2025-08. [2025-10-28T18:13:24.759391] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-09. [2025-10-28T18:13:24.797443] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-28T18:13:25.384060] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-28T18:13:25.383817] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-28T18:13:25.559332] [INFO ] [REMOTE ] D: Fetching primary data for 2025-09. [2025-10-28T18:13:26.359333] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-10. [2025-10-28T18:13:27.006737] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-28T18:13:27.102594] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-28T18:13:27.105569] [INFO ] [REMOTE ] DAC: Full fetch complete (18826 records). [2025-10-28T18:13:27.105638] [DEBUG] [VALIDATOR ] DAC: Validating primary data. [2025-10-28T18:13:27.168788] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-09. [2025-10-28T18:13:27.492170] [DEBUG] [VALIDATOR ] DAC: All expected trading days are present. [2025-10-28T18:13:27.492255] [DEBUG] [VALIDATOR ] DAC: Primary data validation passed. [2025-10-28T18:13:27.492821] [INFO ] [MAIN ] DAC: Fetched primary data is valid. [2025-10-28T18:13:27.492882] [DEBUG] [LOCAL ] DAC: Saving primary data. [2025-10-28T18:13:27.493488] [DEBUG] [LOCAL ] DAC: Trimmed 18826 records to 11883 (keeping 200 days of data) [2025-10-28T18:13:27.564599] [DEBUG] [LOCAL ] DAC: Primary data saved (11883 records). [2025-10-28T18:13:27.564768] [INFO ] [MAIN ] DAC: Full history saved. [2025-10-28T18:13:27.564856] [INFO ] [MAIN ] Update Progress: 583/2366 symbols completed. DAC took 15.7s. Estimated remaining: 3h 44m 31s. Rate: 7.9 symbols/min [2025-10-28T18:13:27.730565] [INFO ] [MAIN ] DAN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:13:27.778004] [DEBUG] [LOCAL ] DAN: Loaded 49315 existing records from primary storage. [2025-10-28T18:13:27.778298] [INFO ] [MAIN ] DAN: Loaded 49315 existing records. [2025-10-28T18:13:27.954998] [WARN ] [MAIN ] DAN: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:13:27.955199] [INFO ] [MAIN ] DAN: Wiping existing primary data before full refresh. [2025-10-28T18:13:27.955245] [INFO ] [LOCAL ] DAN: Starting deletion of primary data. [2025-10-28T18:13:27.955762] [DEBUG] [LOCAL ] DAN: Deleted primary data file. [2025-10-28T18:13:27.955818] [INFO ] [MAIN ] DAN: Starting full primary refresh. [2025-10-28T18:13:27.966991] [INFO ] [REMOTE ] D: Fetching primary data for 2025-10. [2025-10-28T18:13:28.325803] [INFO ] [REMOTE ] DAN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:13:28.350114] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-28T18:13:28.616094] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-28T18:13:28.627025] [INFO ] [REMOTE ] D: Full fetch complete (77811 records). [2025-10-28T18:13:28.627186] [DEBUG] [VALIDATOR ] D: Validating primary data. [2025-10-28T18:13:28.768540] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-10. [2025-10-28T18:13:29.024206] [DEBUG] [VALIDATOR ] D: All expected trading days are present. [2025-10-28T18:13:29.024298] [DEBUG] [VALIDATOR ] D: Primary data validation passed. [2025-10-28T18:13:29.025306] [INFO ] [MAIN ] D: Fetched primary data is valid. [2025-10-28T18:13:29.025374] [DEBUG] [LOCAL ] D: Saving primary data. [2025-10-28T18:13:29.026890] [DEBUG] [LOCAL ] D: Trimmed 77811 records to 53648 (keeping 200 days of data) [2025-10-28T18:13:29.371732] [DEBUG] [LOCAL ] D: Primary data saved (53648 records). [2025-10-28T18:13:29.371873] [INFO ] [MAIN ] D: Full history saved. [2025-10-28T18:13:29.371945] [INFO ] [MAIN ] Update Progress: 584/2366 symbols completed. D took 20.5s. Estimated remaining: 3h 44m 5s. Rate: 8.0 symbols/min [2025-10-28T18:13:29.553362] [INFO ] [MAIN ] DAO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:13:29.563375] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-04. [2025-10-28T18:13:29.572456] [DEBUG] [LOCAL ] DAO: Loaded 19588 existing records from primary storage. [2025-10-28T18:13:29.572718] [INFO ] [MAIN ] DAO: Loaded 19588 existing records. [2025-10-28T18:13:29.760230] [WARN ] [MAIN ] DAO: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:13:29.760461] [INFO ] [MAIN ] DAO: Wiping existing primary data before full refresh. [2025-10-28T18:13:29.760506] [INFO ] [LOCAL ] DAO: Starting deletion of primary data. [2025-10-28T18:13:29.760847] [DEBUG] [LOCAL ] DAO: Deleted primary data file. [2025-10-28T18:13:29.760905] [INFO ] [MAIN ] DAO: Starting full primary refresh. [2025-10-28T18:13:30.160161] [INFO ] [REMOTE ] DAO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:13:30.190099] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-28T18:13:30.199902] [INFO ] [REMOTE ] CYH: Full fetch complete (69936 records). [2025-10-28T18:13:30.200040] [DEBUG] [VALIDATOR ] CYH: Validating primary data. [2025-10-28T18:13:30.374281] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-01. [2025-10-28T18:13:30.591231] [DEBUG] [VALIDATOR ] CYH: All expected trading days are present. [2025-10-28T18:13:30.591310] [DEBUG] [VALIDATOR ] CYH: Primary data validation passed. [2025-10-28T18:13:30.592200] [INFO ] [MAIN ] CYH: Fetched primary data is valid. [2025-10-28T18:13:30.592273] [DEBUG] [LOCAL ] CYH: Saving primary data. [2025-10-28T18:13:30.593751] [DEBUG] [LOCAL ] CYH: Trimmed 69936 records to 47632 (keeping 200 days of data) [2025-10-28T18:13:30.858224] [DEBUG] [LOCAL ] CYH: Primary data saved (47632 records). [2025-10-28T18:13:30.858377] [INFO ] [MAIN ] CYH: Full history saved. [2025-10-28T18:13:30.858465] [INFO ] [MAIN ] Update Progress: 585/2366 symbols completed. CYH took 23.0s. Estimated remaining: 3h 43m 39s. Rate: 8.0 symbols/min [2025-10-28T18:13:31.027935] [INFO ] [MAIN ] DAR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:13:31.074476] [DEBUG] [LOCAL ] DAR: Loaded 51980 existing records from primary storage. [2025-10-28T18:13:31.074809] [INFO ] [MAIN ] DAR: Loaded 51980 existing records. [2025-10-28T18:13:31.175453] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-01. [2025-10-28T18:13:31.305143] [WARN ] [MAIN ] DAR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:13:31.309374] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-28T18:13:31.314721] [INFO ] [MAIN ] DAR: Wiping existing primary data before full refresh. [2025-10-28T18:13:31.314852] [INFO ] [LOCAL ] DAR: Starting deletion of primary data. [2025-10-28T18:13:31.315702] [DEBUG] [LOCAL ] DAR: Deleted primary data file. [2025-10-28T18:13:31.315881] [INFO ] [MAIN ] DAR: Starting full primary refresh. [2025-10-28T18:13:31.682740] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-10-28T18:13:31.756608] [INFO ] [REMOTE ] DAR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:13:31.959411] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-02. [2025-10-28T18:13:32.500844] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-28T18:13:32.759352] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-02. [2025-10-28T18:13:32.925383] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-28T18:13:33.559335] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-03. [2025-10-28T18:13:33.902930] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-28T18:13:34.359439] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-05. [2025-10-28T18:13:34.475718] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-28T18:13:35.159401] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-03. [2025-10-28T18:13:35.964489] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-01. [2025-10-28T18:13:35.982587] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-28T18:13:36.348801] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-28T18:13:36.759343] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-04. [2025-10-28T18:13:37.274680] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-28T18:13:37.559301] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-02. [2025-10-28T18:13:37.609623] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-28T18:13:38.359398] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-05. [2025-10-28T18:13:38.676823] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-28T18:13:39.048757] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-28T18:13:39.159319] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-06. [2025-10-28T18:13:39.773267] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-28T18:13:39.959385] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-03. [2025-10-28T18:13:40.759384] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-06. [2025-10-28T18:13:41.421468] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-28T18:13:41.559332] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-04. [2025-10-28T18:13:42.299695] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-28T18:13:42.359311] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-07. [2025-10-28T18:13:42.903535] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-28T18:13:43.159345] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-07. [2025-10-28T18:13:43.783474] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-28T18:13:43.959315] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-04. [2025-10-28T18:13:44.007224] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-28T18:13:44.759389] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-05. [2025-10-28T18:13:45.338842] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-28T18:13:45.559358] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-08. [2025-10-28T18:13:45.949115] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-28T18:13:46.359353] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-06. [2025-10-28T18:13:46.375298] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-28T18:13:47.159359] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-09. [2025-10-28T18:13:47.583746] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-28T18:13:47.913118] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-28T18:13:47.959322] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-10. [2025-10-28T18:13:48.759341] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-07. [2025-10-28T18:13:48.801203] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-28T18:13:48.806227] [INFO ] [REMOTE ] DAO: Full fetch complete (32779 records). [2025-10-28T18:13:48.806389] [DEBUG] [VALIDATOR ] DAO: Validating primary data. [2025-10-28T18:13:49.179900] [DEBUG] [VALIDATOR ] DAO: All expected trading days are present. [2025-10-28T18:13:49.179968] [DEBUG] [VALIDATOR ] DAO: Primary data validation passed. [2025-10-28T18:13:49.180540] [INFO ] [MAIN ] DAO: Fetched primary data is valid. [2025-10-28T18:13:49.180583] [DEBUG] [LOCAL ] DAO: Saving primary data. [2025-10-28T18:13:49.181312] [DEBUG] [LOCAL ] DAO: Trimmed 32779 records to 19584 (keeping 200 days of data) [2025-10-28T18:13:49.289324] [DEBUG] [LOCAL ] DAO: Primary data saved (19584 records). [2025-10-28T18:13:49.289468] [INFO ] [MAIN ] DAO: Full history saved. [2025-10-28T18:13:49.289564] [INFO ] [MAIN ] Update Progress: 586/2366 symbols completed. DAO took 19.9s. Estimated remaining: 3h 44m 5s. Rate: 7.9 symbols/min [2025-10-28T18:13:49.455775] [INFO ] [MAIN ] DAVA: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:13:49.494898] [DEBUG] [LOCAL ] DAVA: Loaded 41895 existing records from primary storage. [2025-10-28T18:13:49.495187] [INFO ] [MAIN ] DAVA: Loaded 41895 existing records. [2025-10-28T18:13:49.568904] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-08. [2025-10-28T18:13:49.675825] [WARN ] [MAIN ] DAVA: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:13:49.676028] [INFO ] [MAIN ] DAVA: Wiping existing primary data before full refresh. [2025-10-28T18:13:49.676075] [INFO ] [LOCAL ] DAVA: Starting deletion of primary data. [2025-10-28T18:13:49.676532] [DEBUG] [LOCAL ] DAVA: Deleted primary data file. [2025-10-28T18:13:49.676590] [INFO ] [MAIN ] DAVA: Starting full primary refresh. [2025-10-28T18:13:50.058946] [INFO ] [REMOTE ] DAVA: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:13:50.131683] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-28T18:13:50.359340] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-01. [2025-10-28T18:13:51.081764] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-10-28T18:13:51.159321] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-09. [2025-10-28T18:13:51.330237] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-28T18:13:51.959420] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-02. [2025-10-28T18:13:52.744070] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-28T18:13:52.759294] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-10. [2025-10-28T18:13:52.900467] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-28T18:13:53.390550] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-28T18:13:53.401219] [INFO ] [REMOTE ] DAL: Full fetch complete (77931 records). [2025-10-28T18:13:53.401366] [DEBUG] [VALIDATOR ] DAL: Validating primary data. [2025-10-28T18:13:53.569403] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-03. [2025-10-28T18:13:53.791203] [DEBUG] [VALIDATOR ] DAL: All expected trading days are present. [2025-10-28T18:13:53.791279] [DEBUG] [VALIDATOR ] DAL: Primary data validation passed. [2025-10-28T18:13:53.792131] [INFO ] [MAIN ] DAL: Fetched primary data is valid. [2025-10-28T18:13:53.792197] [DEBUG] [LOCAL ] DAL: Saving primary data. [2025-10-28T18:13:53.793662] [DEBUG] [LOCAL ] DAL: Trimmed 77931 records to 53753 (keeping 200 days of data) [2025-10-28T18:13:54.123458] [DEBUG] [LOCAL ] DAL: Primary data saved (53753 records). [2025-10-28T18:13:54.123662] [INFO ] [MAIN ] DAL: Full history saved. [2025-10-28T18:13:54.123773] [INFO ] [MAIN ] Update Progress: 587/2366 symbols completed. DAL took 39.3s. Estimated remaining: 3h 43m 49s. Rate: 7.9 symbols/min [2025-10-28T18:13:54.297375] [INFO ] [MAIN ] DAY: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:13:54.339404] [DEBUG] [LOCAL ] DAY: Loaded 49047 existing records from primary storage. [2025-10-28T18:13:54.339771] [INFO ] [MAIN ] DAY: Loaded 49047 existing records. [2025-10-28T18:13:54.364467] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-08. [2025-10-28T18:13:54.530822] [WARN ] [MAIN ] DAY: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:13:54.531087] [INFO ] [MAIN ] DAY: Wiping existing primary data before full refresh. [2025-10-28T18:13:54.531258] [INFO ] [LOCAL ] DAY: Starting deletion of primary data. [2025-10-28T18:13:54.532099] [DEBUG] [LOCAL ] DAY: Deleted primary data file. [2025-10-28T18:13:54.532158] [INFO ] [MAIN ] DAY: Starting full primary refresh. [2025-10-28T18:13:54.837629] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-28T18:13:54.918836] [INFO ] [REMOTE ] DAY: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:13:55.159341] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-04. [2025-10-28T18:13:55.726233] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-28T18:13:55.959356] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-05. [2025-10-28T18:13:56.125385] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-28T18:13:56.759346] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-01. [2025-10-28T18:13:57.215310] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-28T18:13:57.559331] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-06. [2025-10-28T18:13:58.097600] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-28T18:13:58.359334] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-09. [2025-10-28T18:13:58.680621] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-28T18:13:59.159323] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-07. [2025-10-28T18:13:59.743553] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-28T18:13:59.959335] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-10. [2025-10-28T18:14:00.409590] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-28T18:14:00.759392] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-05. [2025-10-28T18:14:01.533980] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-28T18:14:01.545815] [INFO ] [REMOTE ] DAR: Full fetch complete (75204 records). [2025-10-28T18:14:01.545991] [DEBUG] [VALIDATOR ] DAR: Validating primary data. [2025-10-28T18:14:01.569050] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-08. [2025-10-28T18:14:01.971961] [DEBUG] [VALIDATOR ] DAR: All expected trading days are present. [2025-10-28T18:14:01.972152] [DEBUG] [VALIDATOR ] DAR: Primary data validation passed. [2025-10-28T18:14:01.973270] [INFO ] [MAIN ] DAR: Fetched primary data is valid. [2025-10-28T18:14:01.973361] [DEBUG] [LOCAL ] DAR: Saving primary data. [2025-10-28T18:14:01.975091] [DEBUG] [LOCAL ] DAR: Trimmed 75204 records to 51973 (keeping 200 days of data) [2025-10-28T18:14:02.209798] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-28T18:14:02.317235] [DEBUG] [LOCAL ] DAR: Primary data saved (51973 records). [2025-10-28T18:14:02.317363] [INFO ] [MAIN ] DAR: Full history saved. [2025-10-28T18:14:02.317440] [INFO ] [MAIN ] Update Progress: 588/2366 symbols completed. DAR took 31.5s. Estimated remaining: 3h 43m 44s. Rate: 7.9 symbols/min [2025-10-28T18:14:02.370770] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-02. [2025-10-28T18:14:02.485701] [INFO ] [MAIN ] DB: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:14:02.532885] [DEBUG] [LOCAL ] DB: Loaded 52404 existing records from primary storage. [2025-10-28T18:14:02.533178] [INFO ] [MAIN ] DB: Loaded 52404 existing records. [2025-10-28T18:14:02.706920] [WARN ] [MAIN ] DB: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:14:02.707296] [INFO ] [MAIN ] DB: Wiping existing primary data before full refresh. [2025-10-28T18:14:02.707373] [INFO ] [LOCAL ] DB: Starting deletion of primary data. [2025-10-28T18:14:02.707962] [DEBUG] [LOCAL ] DB: Deleted primary data file. [2025-10-28T18:14:02.708028] [INFO ] [MAIN ] DB: Starting full primary refresh. [2025-10-28T18:14:03.119323] [INFO ] [REMOTE ] DB: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:14:03.113838] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-28T18:14:03.159290] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-09. [2025-10-28T18:14:03.518220] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-28T18:14:03.959335] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-01. [2025-10-28T18:14:04.402261] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-28T18:14:04.759351] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-03. [2025-10-28T18:14:05.530276] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-10-28T18:14:05.559325] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-06. [2025-10-28T18:14:05.865551] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-28T18:14:06.359447] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-02. [2025-10-28T18:14:06.507036] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-28T18:14:07.159368] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-07. [2025-10-28T18:14:07.622563] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-28T18:14:07.959342] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-03. [2025-10-28T18:14:08.044701] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-28T18:14:08.759334] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-08. [2025-10-28T18:14:09.448515] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-28T18:14:09.559334] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-04. [2025-10-28T18:14:09.918808] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-28T18:14:10.359317] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-09. [2025-10-28T18:14:10.766590] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-28T18:14:11.159372] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-04. [2025-10-28T18:14:11.770732] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-28T18:14:11.959329] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-10. [2025-10-28T18:14:12.767441] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-10. [2025-10-28T18:14:12.774075] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-28T18:14:13.340168] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-28T18:14:13.349834] [INFO ] [REMOTE ] DAN: Full fetch complete (71060 records). [2025-10-28T18:14:13.350000] [DEBUG] [VALIDATOR ] DAN: Validating primary data. [2025-10-28T18:14:13.350721] [FATAL] [VALIDATOR ] DAN: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T18:14:13.350809] [FATAL] [MAIN ] DAN: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:14:13.350863] [WARN ] [MAIN ] DAN: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:14:13.350933] [INFO ] [LOCAL ] DAN: Starting deletion of primary data. [2025-10-28T18:14:13.350996] [DEBUG] [LOCAL ] DAN: No primary data file found to delete. [2025-10-28T18:14:13.351031] [INFO ] [LOCAL ] DAN: Starting deletion of derivative data. [2025-10-28T18:14:13.351196] [DEBUG] [LOCAL ] DAN: Deleted derivative data file. [2025-10-28T18:14:13.351288] [INFO ] [MAIN ] Update Progress: 589/2366 symbols completed. DAN took 45.8s. Estimated remaining: 3h 43m 47s. Rate: 7.9 symbols/min [2025-10-28T18:14:13.522334] [INFO ] [MAIN ] DBD: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:14:13.522516] [DEBUG] [LOCAL ] DBD: No existing data file found in primary storage. [2025-10-28T18:14:13.522552] [WARN ] [MAIN ] DBD: No existing data found, performing full refresh instead. [2025-10-28T18:14:13.522679] [INFO ] [MAIN ] DBD: Wiping existing primary data before full refresh. [2025-10-28T18:14:13.522732] [INFO ] [LOCAL ] DBD: Starting deletion of primary data. [2025-10-28T18:14:13.522774] [DEBUG] [LOCAL ] DBD: No primary data file found to delete. [2025-10-28T18:14:13.522805] [INFO ] [MAIN ] DBD: Starting full primary refresh. [2025-10-28T18:14:13.565015] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-05. [2025-10-28T18:14:13.883988] [INFO ] [REMOTE ] DBD: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:14:14.158597] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-28T18:14:14.169160] [INFO ] [REMOTE ] DAVA: Full fetch complete (57475 records). [2025-10-28T18:14:14.169340] [DEBUG] [VALIDATOR ] DAVA: Validating primary data. [2025-10-28T18:14:14.369443] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-01. [2025-10-28T18:14:14.549724] [DEBUG] [VALIDATOR ] DAVA: All expected trading days are present. [2025-10-28T18:14:14.549821] [DEBUG] [VALIDATOR ] DAVA: Primary data validation passed. [2025-10-28T18:14:14.550508] [INFO ] [MAIN ] DAVA: Fetched primary data is valid. [2025-10-28T18:14:14.550547] [DEBUG] [LOCAL ] DAVA: Saving primary data. [2025-10-28T18:14:14.551705] [DEBUG] [LOCAL ] DAVA: Trimmed 57475 records to 41936 (keeping 200 days of data) [2025-10-28T18:14:14.786507] [DEBUG] [LOCAL ] DAVA: Primary data saved (41936 records). [2025-10-28T18:14:14.786625] [INFO ] [MAIN ] DAVA: Full history saved. [2025-10-28T18:14:14.786750] [INFO ] [MAIN ] Update Progress: 590/2366 symbols completed. DAVA took 25.5s. Estimated remaining: 3h 43m 21s. Rate: 8.0 symbols/min [2025-10-28T18:14:14.968082] [INFO ] [MAIN ] DBI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:14:15.029613] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-28T18:14:15.028050] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-28T18:14:15.059125] [DEBUG] [LOCAL ] DBI: Loaded 43009 existing records from primary storage. [2025-10-28T18:14:15.059785] [INFO ] [MAIN ] DBI: Loaded 43009 existing records. [2025-10-28T18:14:15.164460] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-05. [2025-10-28T18:14:15.248497] [WARN ] [MAIN ] DBI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:14:15.248715] [INFO ] [MAIN ] DBI: Wiping existing primary data before full refresh. [2025-10-28T18:14:15.248769] [INFO ] [LOCAL ] DBI: Starting deletion of primary data. [2025-10-28T18:14:15.249312] [DEBUG] [LOCAL ] DBI: Deleted primary data file. [2025-10-28T18:14:15.249369] [INFO ] [MAIN ] DBI: Starting full primary refresh. [2025-10-28T18:14:15.644394] [INFO ] [REMOTE ] DBI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:14:15.959324] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-01. [2025-10-28T18:14:16.322844] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-28T18:14:16.759421] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-06. [2025-10-28T18:14:17.257670] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-28T18:14:17.559332] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-06. [2025-10-28T18:14:18.264257] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-28T18:14:18.359337] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-07. [2025-10-28T18:14:18.787134] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-28T18:14:19.159330] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-02. [2025-10-28T18:14:19.773232] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-28T18:14:19.945080] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-28T18:14:19.959512] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-02. [2025-10-28T18:14:20.759380] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-08. [2025-10-28T18:14:21.021118] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-28T18:14:21.559382] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-03. [2025-10-28T18:14:22.258807] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-28T18:14:22.366983] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-07. [2025-10-28T18:14:22.370273] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-10-28T18:14:23.159356] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-03. [2025-10-28T18:14:23.686635] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-28T18:14:23.959383] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-08. [2025-10-28T18:14:24.616017] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-28T18:14:24.759372] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-04. [2025-10-28T18:14:25.091840] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-28T18:14:25.446784] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-28T18:14:25.559336] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-09. [2025-10-28T18:14:26.359399] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-04. [2025-10-28T18:14:27.012353] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-28T18:14:27.159336] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-05. [2025-10-28T18:14:27.800834] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-28T18:14:27.959321] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-09. [2025-10-28T18:14:28.097675] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-28T18:14:28.759326] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-10. [2025-10-28T18:14:29.175180] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-28T18:14:29.559365] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-10. [2025-10-28T18:14:30.359349] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-06. [2025-10-28T18:14:30.467917] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-28T18:14:30.478312] [INFO ] [REMOTE ] DB: Full fetch complete (75756 records). [2025-10-28T18:14:30.478459] [DEBUG] [VALIDATOR ] DB: Validating primary data. [2025-10-28T18:14:30.872724] [DEBUG] [VALIDATOR ] DB: All expected trading days are present. [2025-10-28T18:14:30.872835] [DEBUG] [VALIDATOR ] DB: Primary data validation passed. [2025-10-28T18:14:30.873746] [INFO ] [MAIN ] DB: Fetched primary data is valid. [2025-10-28T18:14:30.873915] [DEBUG] [LOCAL ] DB: Saving primary data. [2025-10-28T18:14:30.875575] [DEBUG] [LOCAL ] DB: Trimmed 75756 records to 52388 (keeping 200 days of data) [2025-10-28T18:14:30.902338] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-28T18:14:31.006025] [INFO ] [REMOTE ] DAY: Full fetch complete (71901 records). [2025-10-28T18:14:31.031783] [DEBUG] [VALIDATOR ] DAY: Validating primary data. [2025-10-28T18:14:31.204675] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-05. [2025-10-28T18:14:31.231199] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-28T18:14:31.455320] [DEBUG] [LOCAL ] DB: Primary data saved (52388 records). [2025-10-28T18:14:31.475639] [INFO ] [MAIN ] DB: Full history saved. [2025-10-28T18:14:31.494849] [INFO ] [MAIN ] Update Progress: 591/2366 symbols completed. DB took 29.2s. Estimated remaining: 3h 43m 41s. Rate: 7.9 symbols/min [2025-10-28T18:14:31.897131] [DEBUG] [VALIDATOR ] DAY: All expected trading days are present. [2025-10-28T18:14:31.898775] [DEBUG] [VALIDATOR ] DAY: Primary data validation passed. [2025-10-28T18:14:31.898697] [INFO ] [MAIN ] DBL: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:14:31.899871] [INFO ] [MAIN ] DAY: Fetched primary data is valid. [2025-10-28T18:14:31.900342] [DEBUG] [LOCAL ] DAY: Saving primary data. [2025-10-28T18:14:31.902943] [DEBUG] [LOCAL ] DAY: Trimmed 71901 records to 49049 (keeping 200 days of data) [2025-10-28T18:14:31.957062] [DEBUG] [LOCAL ] DBL: Loaded 9267 existing records from primary storage. [2025-10-28T18:14:31.965541] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-07. [2025-10-28T18:14:31.966164] [INFO ] [MAIN ] DBL: Loaded 9267 existing records. [2025-10-28T18:14:32.218833] [WARN ] [MAIN ] DBL: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:14:32.237193] [INFO ] [MAIN ] DBL: Wiping existing primary data before full refresh. [2025-10-28T18:14:32.237268] [INFO ] [LOCAL ] DBL: Starting deletion of primary data. [2025-10-28T18:14:32.237719] [DEBUG] [LOCAL ] DBL: Deleted primary data file. [2025-10-28T18:14:32.237778] [INFO ] [MAIN ] DBL: Starting full primary refresh. [2025-10-28T18:14:32.584669] [DEBUG] [LOCAL ] DAY: Primary data saved (49049 records). [2025-10-28T18:14:32.598181] [INFO ] [MAIN ] DAY: Full history saved. [2025-10-28T18:14:32.615953] [INFO ] [MAIN ] Update Progress: 592/2366 symbols completed. DAY took 38.5s. Estimated remaining: 3h 43m 14s. Rate: 7.9 symbols/min [2025-10-28T18:14:32.981002] [INFO ] [REMOTE ] DBL: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:14:32.992061] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-01. [2025-10-28T18:14:33.023293] [INFO ] [MAIN ] DBRG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:14:33.029799] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-10-28T18:14:33.057997] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-28T18:14:33.104272] [DEBUG] [LOCAL ] DBRG: Loaded 49964 existing records from primary storage. [2025-10-28T18:14:33.104587] [INFO ] [MAIN ] DBRG: Loaded 49964 existing records. [2025-10-28T18:14:33.277786] [WARN ] [MAIN ] DBRG: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:14:33.278001] [INFO ] [MAIN ] DBRG: Wiping existing primary data before full refresh. [2025-10-28T18:14:33.278047] [INFO ] [LOCAL ] DBRG: Starting deletion of primary data. [2025-10-28T18:14:33.278860] [DEBUG] [LOCAL ] DBRG: Deleted primary data file. [2025-10-28T18:14:33.278916] [INFO ] [MAIN ] DBRG: Starting full primary refresh. [2025-10-28T18:14:33.564477] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-06. [2025-10-28T18:14:33.635038] [INFO ] [REMOTE ] DBRG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:14:33.640545] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-28T18:14:34.359346] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-02. [2025-10-28T18:14:34.725447] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-28T18:14:34.798742] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-28T18:14:35.159342] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-08. [2025-10-28T18:14:35.908358] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-28T18:14:35.959313] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-09. [2025-10-28T18:14:36.735907] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-28T18:14:36.759298] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-10. [2025-10-28T18:14:37.442183] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-28T18:14:37.447900] [INFO ] [REMOTE ] DBD: Full fetch complete (32166 records). [2025-10-28T18:14:37.448067] [DEBUG] [VALIDATOR ] DBD: Validating primary data. [2025-10-28T18:14:37.448614] [FATAL] [VALIDATOR ] DBD: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T18:14:37.448870] [FATAL] [MAIN ] DBD: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:14:37.448938] [WARN ] [MAIN ] DBD: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:14:37.448988] [INFO ] [LOCAL ] DBD: Starting deletion of primary data. [2025-10-28T18:14:37.449045] [DEBUG] [LOCAL ] DBD: No primary data file found to delete. [2025-10-28T18:14:37.449097] [INFO ] [LOCAL ] DBD: Starting deletion of derivative data. [2025-10-28T18:14:37.449138] [DEBUG] [LOCAL ] DBD: No derivative data file found to delete. [2025-10-28T18:14:37.449193] [INFO ] [MAIN ] Update Progress: 593/2366 symbols completed. DBD took 24.1s. Estimated remaining: 3h 42m 58s. Rate: 8.0 symbols/min [2025-10-28T18:14:37.564470] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-07. [2025-10-28T18:14:37.640599] [INFO ] [MAIN ] DCI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:14:37.677380] [DEBUG] [LOCAL ] DCI: Loaded 36620 existing records from primary storage. [2025-10-28T18:14:37.677712] [INFO ] [MAIN ] DCI: Loaded 36620 existing records. [2025-10-28T18:14:37.851914] [WARN ] [MAIN ] DCI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:14:37.852104] [INFO ] [MAIN ] DCI: Wiping existing primary data before full refresh. [2025-10-28T18:14:37.852148] [INFO ] [LOCAL ] DCI: Starting deletion of primary data. [2025-10-28T18:14:37.852491] [DEBUG] [LOCAL ] DCI: Deleted primary data file. [2025-10-28T18:14:37.852554] [INFO ] [MAIN ] DCI: Starting full primary refresh. [2025-10-28T18:14:38.198292] [INFO ] [REMOTE ] DCI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:14:38.359320] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-01. [2025-10-28T18:14:39.018987] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-28T18:14:39.159316] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-08. [2025-10-28T18:14:39.479615] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-28T18:14:39.959337] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-03. [2025-10-28T18:14:40.236094] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-28T18:14:40.319534] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-10-28T18:14:40.759341] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-02. [2025-10-28T18:14:41.559396] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-04. [2025-10-28T18:14:41.592868] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-28T18:14:42.071958] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-28T18:14:42.359396] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-05. [2025-10-28T18:14:42.687312] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-10-28T18:14:43.159358] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-01. [2025-10-28T18:14:43.959355] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-03. [2025-10-28T18:14:44.367794] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-28T18:14:44.759355] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-06. [2025-10-28T18:14:44.949680] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-10-28T18:14:45.339941] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-28T18:14:45.559354] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-04. [2025-10-28T18:14:46.359335] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-09. [2025-10-28T18:14:46.710461] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-28T18:14:47.159383] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-05. [2025-10-28T18:14:47.478783] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-28T18:14:47.959320] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-07. [2025-10-28T18:14:48.057065] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-28T18:14:48.509725] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-28T18:14:48.759324] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-08. [2025-10-28T18:14:49.279077] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-28T18:14:49.559344] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-09. [2025-10-28T18:14:50.041589] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-28T18:14:50.359402] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-06. [2025-10-28T18:14:51.159354] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-10. [2025-10-28T18:14:51.464455] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-28T18:14:51.658571] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-28T18:14:51.660771] [INFO ] [REMOTE ] DBL: Full fetch complete (12771 records). [2025-10-28T18:14:51.660848] [DEBUG] [VALIDATOR ] DBL: Validating primary data. [2025-10-28T18:14:51.964551] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-10. [2025-10-28T18:14:52.038873] [DEBUG] [VALIDATOR ] DBL: All expected trading days are present. [2025-10-28T18:14:52.038957] [DEBUG] [VALIDATOR ] DBL: Primary data validation passed. [2025-10-28T18:14:52.039277] [INFO ] [MAIN ] DBL: Fetched primary data is valid. [2025-10-28T18:14:52.039335] [DEBUG] [LOCAL ] DBL: Saving primary data. [2025-10-28T18:14:52.039896] [DEBUG] [LOCAL ] DBL: Trimmed 12771 records to 9211 (keeping 200 days of data) [2025-10-28T18:14:52.093958] [DEBUG] [LOCAL ] DBL: Primary data saved (9211 records). [2025-10-28T18:14:52.094079] [INFO ] [MAIN ] DBL: Full history saved. [2025-10-28T18:14:52.094155] [INFO ] [MAIN ] Update Progress: 594/2366 symbols completed. DBL took 20.6s. Estimated remaining: 3h 43m 12s. Rate: 7.9 symbols/min [2025-10-28T18:14:52.261113] [INFO ] [MAIN ] DCO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:14:52.261265] [DEBUG] [LOCAL ] DCO: No existing data file found in primary storage. [2025-10-28T18:14:52.261300] [WARN ] [MAIN ] DCO: No existing data found, performing full refresh instead. [2025-10-28T18:14:52.261405] [INFO ] [MAIN ] DCO: Wiping existing primary data before full refresh. [2025-10-28T18:14:52.261445] [INFO ] [LOCAL ] DCO: Starting deletion of primary data. [2025-10-28T18:14:52.261486] [DEBUG] [LOCAL ] DCO: No primary data file found to delete. [2025-10-28T18:14:52.261517] [INFO ] [MAIN ] DCO: Starting full primary refresh. [2025-10-28T18:14:52.648016] [INFO ] [REMOTE ] DCO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:14:52.759349] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-01. [2025-10-28T18:14:53.359137] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-28T18:14:53.559340] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-07. [2025-10-28T18:14:53.619995] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-28T18:14:53.627569] [INFO ] [REMOTE ] DBI: Full fetch complete (64396 records). [2025-10-28T18:14:53.627770] [DEBUG] [VALIDATOR ] DBI: Validating primary data. [2025-10-28T18:14:54.065631] [DEBUG] [VALIDATOR ] DBI: All expected trading days are present. [2025-10-28T18:14:54.065753] [DEBUG] [VALIDATOR ] DBI: Primary data validation passed. [2025-10-28T18:14:54.066686] [INFO ] [MAIN ] DBI: Fetched primary data is valid. [2025-10-28T18:14:54.066757] [DEBUG] [LOCAL ] DBI: Saving primary data. [2025-10-28T18:14:54.068184] [DEBUG] [LOCAL ] DBI: Trimmed 64396 records to 42870 (keeping 200 days of data) [2025-10-28T18:14:54.331882] [DEBUG] [LOCAL ] DBI: Primary data saved (42870 records). [2025-10-28T18:14:54.332034] [INFO ] [MAIN ] DBI: Full history saved. [2025-10-28T18:14:54.332119] [INFO ] [MAIN ] Update Progress: 595/2366 symbols completed. DBI took 39.5s. Estimated remaining: 3h 42m 48s. Rate: 7.9 symbols/min [2025-10-28T18:14:54.364310] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-02. [2025-10-28T18:14:54.510847] [INFO ] [MAIN ] DD: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:14:54.537667] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-28T18:14:54.588184] [DEBUG] [LOCAL ] DD: Loaded 52906 existing records from primary storage. [2025-10-28T18:14:54.588552] [INFO ] [MAIN ] DD: Loaded 52906 existing records. [2025-10-28T18:14:54.761743] [WARN ] [MAIN ] DD: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:14:54.761953] [INFO ] [MAIN ] DD: Wiping existing primary data before full refresh. [2025-10-28T18:14:54.762000] [INFO ] [LOCAL ] DD: Starting deletion of primary data. [2025-10-28T18:14:54.763126] [DEBUG] [LOCAL ] DD: Deleted primary data file. [2025-10-28T18:14:54.763183] [INFO ] [MAIN ] DD: Starting full primary refresh. [2025-10-28T18:14:55.098684] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-28T18:14:55.153330] [INFO ] [REMOTE ] DD: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:14:55.159294] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-01. [2025-10-28T18:14:55.959354] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-08. [2025-10-28T18:14:56.668392] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-28T18:14:56.759337] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-02. [2025-10-28T18:14:57.034134] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-28T18:14:57.559346] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-03. [2025-10-28T18:14:58.076664] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-28T18:14:58.191431] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-28T18:14:58.359329] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-04. [2025-10-28T18:14:58.853489] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-28T18:14:59.159330] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-05. [2025-10-28T18:14:59.731388] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-28T18:14:59.959337] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-06. [2025-10-28T18:15:00.684294] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-28T18:15:00.759403] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-03. [2025-10-28T18:15:01.559340] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-09. [2025-10-28T18:15:02.328018] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-28T18:15:02.359328] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-02. [2025-10-28T18:15:03.165789] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-04. [2025-10-28T18:15:03.181229] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-28T18:15:03.959306] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-10. [2025-10-28T18:15:04.172396] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-28T18:15:04.759295] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-03. [2025-10-28T18:15:04.908783] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-10-28T18:15:05.119688] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-28T18:15:05.126291] [INFO ] [REMOTE ] DCI: Full fetch complete (53527 records). [2025-10-28T18:15:05.126372] [DEBUG] [VALIDATOR ] DCI: Validating primary data. [2025-10-28T18:15:05.127033] [FATAL] [VALIDATOR ] DCI: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T18:15:05.127114] [FATAL] [MAIN ] DCI: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:15:05.127157] [WARN ] [MAIN ] DCI: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:15:05.127193] [INFO ] [LOCAL ] DCI: Starting deletion of primary data. [2025-10-28T18:15:05.127246] [DEBUG] [LOCAL ] DCI: No primary data file found to delete. [2025-10-28T18:15:05.127280] [INFO ] [LOCAL ] DCI: Starting deletion of derivative data. [2025-10-28T18:15:05.127469] [DEBUG] [LOCAL ] DCI: Deleted derivative data file. [2025-10-28T18:15:05.127554] [INFO ] [MAIN ] Update Progress: 596/2366 symbols completed. DCI took 27.7s. Estimated remaining: 3h 42m 50s. Rate: 7.9 symbols/min [2025-10-28T18:15:05.295723] [INFO ] [MAIN ] DDD: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:15:05.340437] [DEBUG] [LOCAL ] DDD: Loaded 50909 existing records from primary storage. [2025-10-28T18:15:05.340747] [INFO ] [MAIN ] DDD: Loaded 50909 existing records. [2025-10-28T18:15:05.517453] [WARN ] [MAIN ] DDD: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:15:05.517632] [INFO ] [MAIN ] DDD: Wiping existing primary data before full refresh. [2025-10-28T18:15:05.517713] [INFO ] [LOCAL ] DDD: Starting deletion of primary data. [2025-10-28T18:15:05.518449] [DEBUG] [LOCAL ] DDD: Deleted primary data file. [2025-10-28T18:15:05.518506] [INFO ] [MAIN ] DDD: Starting full primary refresh. [2025-10-28T18:15:05.564516] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-07. [2025-10-28T18:15:05.878043] [INFO ] [REMOTE ] DDD: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:15:06.363404] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-05. [2025-10-28T18:15:06.371754] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-28T18:15:06.413927] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-28T18:15:07.159397] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-01. [2025-10-28T18:15:07.934669] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-28T18:15:07.959321] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-06. [2025-10-28T18:15:08.661102] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-28T18:15:08.759389] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-04. [2025-10-28T18:15:09.230997] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-28T18:15:09.559332] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-08. [2025-10-28T18:15:10.036784] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-28T18:15:10.192190] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-28T18:15:10.359357] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-09. [2025-10-28T18:15:11.114952] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-28T18:15:11.159301] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-10. [2025-10-28T18:15:11.959316] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-05. [2025-10-28T18:15:12.057178] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-28T18:15:12.061095] [INFO ] [REMOTE ] DCO: Full fetch complete (19793 records). [2025-10-28T18:15:12.061175] [DEBUG] [VALIDATOR ] DCO: Validating primary data. [2025-10-28T18:15:12.061598] [FATAL] [VALIDATOR ] DCO: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T18:15:12.061740] [FATAL] [MAIN ] DCO: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:15:12.061820] [WARN ] [MAIN ] DCO: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:15:12.061906] [INFO ] [LOCAL ] DCO: Starting deletion of primary data. [2025-10-28T18:15:12.061983] [DEBUG] [LOCAL ] DCO: No primary data file found to delete. [2025-10-28T18:15:12.062034] [INFO ] [LOCAL ] DCO: Starting deletion of derivative data. [2025-10-28T18:15:12.062089] [DEBUG] [LOCAL ] DCO: No derivative data file found to delete. [2025-10-28T18:15:12.062165] [INFO ] [MAIN ] Update Progress: 597/2366 symbols completed. DCO took 20.0s. Estimated remaining: 3h 42m 41s. Rate: 7.9 symbols/min [2025-10-28T18:15:12.759339] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-07. [2025-10-28T18:15:13.362187] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-28T18:15:13.559315] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-06. [2025-10-28T18:15:14.155613] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-28T18:15:14.359343] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-02. [2025-10-28T18:15:15.126513] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-28T18:15:15.159293] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-07. [2025-10-28T18:15:15.811607] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-28T18:15:15.959382] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-03. [2025-10-28T18:15:16.615672] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-28T18:15:16.759382] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-08. [2025-10-28T18:15:17.362001] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-28T18:15:17.559335] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-04. [2025-10-28T18:15:18.359394] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-08. [2025-10-28T18:15:18.408161] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-28T18:15:19.094886] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-28T18:15:19.159314] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-09. [2025-10-28T18:15:19.506385] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-28T18:15:19.959355] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-05. [2025-10-28T18:15:20.623692] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-28T18:15:20.759334] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-10. [2025-10-28T18:15:21.292713] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-28T18:15:21.411841] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-28T18:15:21.422459] [INFO ] [REMOTE ] DD: Full fetch complete (76624 records). [2025-10-28T18:15:21.422602] [DEBUG] [VALIDATOR ] DD: Validating primary data. [2025-10-28T18:15:21.566838] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-09. [2025-10-28T18:15:21.820100] [DEBUG] [VALIDATOR ] DD: All expected trading days are present. [2025-10-28T18:15:21.820182] [DEBUG] [VALIDATOR ] DD: Primary data validation passed. [2025-10-28T18:15:21.821034] [INFO ] [MAIN ] DD: Fetched primary data is valid. [2025-10-28T18:15:21.821096] [DEBUG] [LOCAL ] DD: Saving primary data. [2025-10-28T18:15:21.822491] [DEBUG] [LOCAL ] DD: Trimmed 76624 records to 52906 (keeping 200 days of data) [2025-10-28T18:15:22.144629] [DEBUG] [LOCAL ] DD: Primary data saved (52906 records). [2025-10-28T18:15:22.144802] [INFO ] [MAIN ] DD: Full history saved. [2025-10-28T18:15:22.144881] [INFO ] [MAIN ] Update Progress: 598/2366 symbols completed. DD took 27.8s. Estimated remaining: 3h 42m 41s. Rate: 7.9 symbols/min [2025-10-28T18:15:22.359355] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-06. [2025-10-28T18:15:22.765530] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-28T18:15:23.159403] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-10. [2025-10-28T18:15:23.708812] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-28T18:15:23.959335] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-07. [2025-10-28T18:15:24.601090] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-28T18:15:24.611225] [INFO ] [REMOTE ] DBRG: Full fetch complete (72667 records). [2025-10-28T18:15:24.611337] [DEBUG] [VALIDATOR ] DBRG: Validating primary data. [2025-10-28T18:15:24.991581] [DEBUG] [VALIDATOR ] DBRG: All expected trading days are present. [2025-10-28T18:15:24.991680] [DEBUG] [VALIDATOR ] DBRG: Primary data validation passed. [2025-10-28T18:15:24.992508] [INFO ] [MAIN ] DBRG: Fetched primary data is valid. [2025-10-28T18:15:24.992548] [DEBUG] [LOCAL ] DBRG: Saving primary data. [2025-10-28T18:15:24.994019] [DEBUG] [LOCAL ] DBRG: Trimmed 72667 records to 49956 (keeping 200 days of data) [2025-10-28T18:15:25.293466] [DEBUG] [LOCAL ] DBRG: Primary data saved (49956 records). [2025-10-28T18:15:25.293584] [INFO ] [MAIN ] DBRG: Full history saved. [2025-10-28T18:15:25.293691] [INFO ] [MAIN ] Update Progress: 599/2366 symbols completed. DBRG took 52.7s. Estimated remaining: 3h 42m 20s. Rate: 7.9 symbols/min [2025-10-28T18:15:25.390975] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-28T18:15:25.402535] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-08. [2025-10-28T18:15:26.888195] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-28T18:15:26.898815] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-09. [2025-10-28T18:15:28.152284] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-28T18:15:28.163183] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-10. [2025-10-28T18:15:29.803737] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-28T18:15:29.814529] [INFO ] [REMOTE ] DDD: Full fetch complete (74029 records). [2025-10-28T18:15:29.814733] [DEBUG] [VALIDATOR ] DDD: Validating primary data. [2025-10-28T18:15:30.255501] [DEBUG] [VALIDATOR ] DDD: All expected trading days are present. [2025-10-28T18:15:30.255598] [DEBUG] [VALIDATOR ] DDD: Primary data validation passed. [2025-10-28T18:15:30.256597] [INFO ] [MAIN ] DDD: Fetched primary data is valid. [2025-10-28T18:15:30.256710] [DEBUG] [LOCAL ] DDD: Saving primary data. [2025-10-28T18:15:30.258352] [DEBUG] [LOCAL ] DDD: Trimmed 74029 records to 50922 (keeping 200 days of data) [2025-10-28T18:15:30.538462] [DEBUG] [LOCAL ] DDD: Primary data saved (50922 records). [2025-10-28T18:15:30.538603] [INFO ] [MAIN ] DDD: Full history saved. [2025-10-28T18:15:30.538720] [INFO ] [MAIN ] Update Progress: 600/2366 symbols completed. DDD took 25.4s. Estimated remaining: 3h 42m 6s. Rate: 8.0 symbols/min [2025-10-28T18:15:31.149224] [INFO ] [MAIN ] DDS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:15:31.259945] [INFO ] [MAIN ] DDT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:15:31.260876] [INFO ] [MAIN ] DE: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:15:31.292605] [INFO ] [MAIN ] DDL: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:15:31.293377] [DEBUG] [LOCAL ] DDL: No existing data file found in primary storage. [2025-10-28T18:15:31.293561] [WARN ] [MAIN ] DDL: No existing data found, performing full refresh instead. [2025-10-28T18:15:31.293813] [INFO ] [MAIN ] DDL: Wiping existing primary data before full refresh. [2025-10-28T18:15:31.293903] [INFO ] [LOCAL ] DDL: Starting deletion of primary data. [2025-10-28T18:15:31.294042] [DEBUG] [LOCAL ] DDL: No primary data file found to delete. [2025-10-28T18:15:31.294101] [INFO ] [MAIN ] DDL: Starting full primary refresh. [2025-10-28T18:15:31.381282] [DEBUG] [LOCAL ] DDT: Loaded 1794 existing records from primary storage. [2025-10-28T18:15:31.412440] [DEBUG] [LOCAL ] DDS: Loaded 11957 existing records from primary storage. [2025-10-28T18:15:31.412122] [INFO ] [MAIN ] DDT: Loaded 1794 existing records. [2025-10-28T18:15:31.412715] [INFO ] [MAIN ] DDS: Loaded 11957 existing records. [2025-10-28T18:15:31.868555] [DEBUG] [LOCAL ] DE: Loaded 47383 existing records from primary storage. [2025-10-28T18:15:31.959715] [INFO ] [MAIN ] DE: Loaded 47383 existing records. [2025-10-28T18:15:31.954327] [WARN ] [MAIN ] DDT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:15:31.979125] [INFO ] [MAIN ] DDT: Wiping existing primary data before full refresh. [2025-10-28T18:15:32.004543] [INFO ] [LOCAL ] DDT: Starting deletion of primary data. [2025-10-28T18:15:32.054490] [DEBUG] [LOCAL ] DDT: Deleted primary data file. [2025-10-28T18:15:32.120788] [WARN ] [MAIN ] DDS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:15:32.141596] [INFO ] [MAIN ] DDT: Starting full primary refresh. [2025-10-28T18:15:32.183845] [INFO ] [MAIN ] DDS: Wiping existing primary data before full refresh. [2025-10-28T18:15:32.256839] [INFO ] [REMOTE ] DDL: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:15:32.277265] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-01. [2025-10-28T18:15:32.262179] [INFO ] [LOCAL ] DDS: Starting deletion of primary data. [2025-10-28T18:15:32.326526] [DEBUG] [LOCAL ] DDS: Deleted primary data file. [2025-10-28T18:15:32.335355] [INFO ] [MAIN ] DDS: Starting full primary refresh. [2025-10-28T18:15:32.580782] [WARN ] [MAIN ] DE: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:15:32.640818] [INFO ] [MAIN ] DE: Wiping existing primary data before full refresh. [2025-10-28T18:15:32.675920] [INFO ] [LOCAL ] DE: Starting deletion of primary data. [2025-10-28T18:15:32.750669] [DEBUG] [LOCAL ] DE: Deleted primary data file. [2025-10-28T18:15:32.817997] [INFO ] [MAIN ] DE: Starting full primary refresh. [2025-10-28T18:15:33.261293] [INFO ] [REMOTE ] DDS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:15:33.310616] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-01. [2025-10-28T18:15:33.295012] [INFO ] [REMOTE ] DDT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:15:33.361818] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-01. [2025-10-28T18:15:33.492048] [INFO ] [REMOTE ] DE: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:15:33.492517] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-01. [2025-10-28T18:15:33.512737] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-28T18:15:33.519569] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-02. [2025-10-28T18:15:33.834052] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-28T18:15:33.835100] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-02. [2025-10-28T18:15:34.094660] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-28T18:15:34.097595] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-02. [2025-10-28T18:15:34.217134] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-10-28T18:15:34.218258] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-03. [2025-10-28T18:15:34.365871] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-28T18:15:34.374615] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-03. [2025-10-28T18:15:34.520433] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-03 (0.30 seconds). [2025-10-28T18:15:34.521604] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-04. [2025-10-28T18:15:34.719590] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-28T18:15:34.905381] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-10-28T18:15:35.021151] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-28T18:15:35.159390] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-03. [2025-10-28T18:15:35.280735] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-28T18:15:35.899811] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-28T18:15:35.959303] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-04. [2025-10-28T18:15:36.713117] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-28T18:15:36.759310] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-05. [2025-10-28T18:15:37.373981] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-28T18:15:37.559332] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-04. [2025-10-28T18:15:38.359352] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-02. [2025-10-28T18:15:38.812320] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-28T18:15:39.159333] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-05. [2025-10-28T18:15:39.459249] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-05 (0.30 seconds). [2025-10-28T18:15:39.842781] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-28T18:15:39.959374] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-06. [2025-10-28T18:15:40.255477] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-06 (0.30 seconds). [2025-10-28T18:15:40.759389] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-06. [2025-10-28T18:15:41.333215] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-28T18:15:41.559341] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-07. [2025-10-28T18:15:41.919274] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-10-28T18:15:42.359339] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-08. [2025-10-28T18:15:42.658757] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-08 (0.30 seconds). [2025-10-28T18:15:43.159362] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-09. [2025-10-28T18:15:43.444475] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-09 (0.29 seconds). [2025-10-28T18:15:43.959366] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-10. [2025-10-28T18:15:44.452047] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-28T18:15:44.452936] [INFO ] [REMOTE ] DDT: Full fetch complete (2817 records). [2025-10-28T18:15:44.453003] [DEBUG] [VALIDATOR ] DDT: Validating primary data. [2025-10-28T18:15:44.767745] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-05. [2025-10-28T18:15:44.809378] [DEBUG] [VALIDATOR ] DDT: All expected trading days are present. [2025-10-28T18:15:44.809469] [DEBUG] [VALIDATOR ] DDT: Primary data validation passed. [2025-10-28T18:15:44.809596] [INFO ] [MAIN ] DDT: Fetched primary data is valid. [2025-10-28T18:15:44.809637] [DEBUG] [LOCAL ] DDT: Saving primary data. [2025-10-28T18:15:44.810074] [DEBUG] [LOCAL ] DDT: Trimmed 2817 records to 1781 (keeping 200 days of data) [2025-10-28T18:15:44.821572] [DEBUG] [LOCAL ] DDT: Primary data saved (1781 records). [2025-10-28T18:15:44.821712] [INFO ] [MAIN ] DDT: Full history saved. [2025-10-28T18:15:44.821801] [INFO ] [MAIN ] Update Progress: 601/2366 symbols completed. DDT took 14.3s. Estimated remaining: 3h 42m 18s. Rate: 7.9 symbols/min [2025-10-28T18:15:45.001763] [INFO ] [MAIN ] DEA: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:15:45.037322] [DEBUG] [LOCAL ] DEA: Loaded 39763 existing records from primary storage. [2025-10-28T18:15:45.037603] [INFO ] [MAIN ] DEA: Loaded 39763 existing records. [2025-10-28T18:15:45.216999] [WARN ] [MAIN ] DEA: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:15:45.217239] [INFO ] [MAIN ] DEA: Wiping existing primary data before full refresh. [2025-10-28T18:15:45.217321] [INFO ] [LOCAL ] DEA: Starting deletion of primary data. [2025-10-28T18:15:45.218143] [DEBUG] [LOCAL ] DEA: Deleted primary data file. [2025-10-28T18:15:45.218218] [INFO ] [MAIN ] DEA: Starting full primary refresh. [2025-10-28T18:15:45.567924] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-07. [2025-10-28T18:15:45.567855] [INFO ] [REMOTE ] DEA: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:15:46.113922] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-28T18:15:46.335156] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-28T18:15:46.359302] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-03. [2025-10-28T18:15:47.159358] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-06. [2025-10-28T18:15:47.949894] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-28T18:15:47.963290] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-01. [2025-10-28T18:15:48.051295] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-28T18:15:48.759336] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-07. [2025-10-28T18:15:49.176603] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-28T18:15:49.559302] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-08. [2025-10-28T18:15:49.626093] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-28T18:15:50.135905] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-28T18:15:50.359338] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-09. [2025-10-28T18:15:50.880476] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-28T18:15:51.159344] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-10. [2025-10-28T18:15:51.874147] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-28T18:15:51.876285] [INFO ] [REMOTE ] DDS: Full fetch complete (18200 records). [2025-10-28T18:15:51.876365] [DEBUG] [VALIDATOR ] DDS: Validating primary data. [2025-10-28T18:15:51.964635] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-04. [2025-10-28T18:15:52.255714] [DEBUG] [VALIDATOR ] DDS: All expected trading days are present. [2025-10-28T18:15:52.255799] [DEBUG] [VALIDATOR ] DDS: Primary data validation passed. [2025-10-28T18:15:52.256221] [INFO ] [MAIN ] DDS: Fetched primary data is valid. [2025-10-28T18:15:52.256261] [DEBUG] [LOCAL ] DDS: Saving primary data. [2025-10-28T18:15:52.256844] [DEBUG] [LOCAL ] DDS: Trimmed 18200 records to 11887 (keeping 200 days of data) [2025-10-28T18:15:52.332775] [DEBUG] [LOCAL ] DDS: Primary data saved (11887 records). [2025-10-28T18:15:52.332909] [INFO ] [MAIN ] DDS: Full history saved. [2025-10-28T18:15:52.332993] [INFO ] [MAIN ] Update Progress: 602/2366 symbols completed. DDS took 21.8s. Estimated remaining: 3h 42m 11s. Rate: 7.9 symbols/min [2025-10-28T18:15:52.506373] [INFO ] [MAIN ] DEC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:15:52.533990] [DEBUG] [LOCAL ] DEC: Loaded 29884 existing records from primary storage. [2025-10-28T18:15:52.534297] [INFO ] [MAIN ] DEC: Loaded 29884 existing records. [2025-10-28T18:15:52.725672] [WARN ] [MAIN ] DEC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:15:52.725946] [INFO ] [MAIN ] DEC: Wiping existing primary data before full refresh. [2025-10-28T18:15:52.726001] [INFO ] [LOCAL ] DEC: Starting deletion of primary data. [2025-10-28T18:15:52.726746] [DEBUG] [LOCAL ] DEC: Deleted primary data file. [2025-10-28T18:15:52.726805] [INFO ] [MAIN ] DEC: Starting full primary refresh. [2025-10-28T18:15:52.764533] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-08. [2025-10-28T18:15:53.094385] [INFO ] [REMOTE ] DEC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:15:53.559339] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-01. [2025-10-28T18:15:53.640864] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-28T18:15:53.930204] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-28T18:15:54.359357] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-05. [2025-10-28T18:15:54.468347] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-28T18:15:55.159345] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-02. [2025-10-28T18:15:55.780328] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-28T18:15:55.959341] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-06. [2025-10-28T18:15:56.546938] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-28T18:15:56.759362] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-09. [2025-10-28T18:15:57.142809] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-28T18:15:57.559344] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-02. [2025-10-28T18:15:57.812805] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-28T18:15:58.367204] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-07. [2025-10-28T18:15:58.382267] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-28T18:15:59.159316] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-10. [2025-10-28T18:15:59.959328] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-03. [2025-10-28T18:16:00.055136] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-28T18:16:00.219865] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-28T18:16:00.228448] [INFO ] [REMOTE ] DDL: Full fetch complete (53871 records). [2025-10-28T18:16:00.228580] [DEBUG] [VALIDATOR ] DDL: Validating primary data. [2025-10-28T18:16:00.601913] [DEBUG] [VALIDATOR ] DDL: All expected trading days are present. [2025-10-28T18:16:00.601988] [DEBUG] [VALIDATOR ] DDL: Primary data validation passed. [2025-10-28T18:16:00.602715] [INFO ] [MAIN ] DDL: Fetched primary data is valid. [2025-10-28T18:16:00.602777] [DEBUG] [LOCAL ] DDL: Saving primary data. [2025-10-28T18:16:00.603873] [DEBUG] [LOCAL ] DDL: Trimmed 53871 records to 37084 (keeping 200 days of data) [2025-10-28T18:16:00.778778] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-03. [2025-10-28T18:16:00.806408] [DEBUG] [LOCAL ] DDL: Primary data saved (37084 records). [2025-10-28T18:16:00.806522] [INFO ] [MAIN ] DDL: Full history saved. [2025-10-28T18:16:00.806592] [INFO ] [MAIN ] Update Progress: 603/2366 symbols completed. DDL took 30.3s. Estimated remaining: 3h 42m 6s. Rate: 7.9 symbols/min [2025-10-28T18:16:00.986038] [INFO ] [MAIN ] DECK: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:16:00.986265] [DEBUG] [LOCAL ] DECK: No existing data file found in primary storage. [2025-10-28T18:16:00.986323] [WARN ] [MAIN ] DECK: No existing data found, performing full refresh instead. [2025-10-28T18:16:00.986450] [INFO ] [MAIN ] DECK: Wiping existing primary data before full refresh. [2025-10-28T18:16:00.986492] [INFO ] [LOCAL ] DECK: Starting deletion of primary data. [2025-10-28T18:16:00.986533] [DEBUG] [LOCAL ] DECK: No primary data file found to delete. [2025-10-28T18:16:00.986566] [INFO ] [MAIN ] DECK: Starting full primary refresh. [2025-10-28T18:16:01.369463] [INFO ] [REMOTE ] DECK: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:16:01.371748] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-28T18:16:01.559320] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-01. [2025-10-28T18:16:02.359317] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-08. [2025-10-28T18:16:02.441483] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-10-28T18:16:02.954404] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-28T18:16:03.159352] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-02. [2025-10-28T18:16:03.522935] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-28T18:16:03.959337] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-04. [2025-10-28T18:16:04.759321] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-09. [2025-10-28T18:16:04.818286] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-28T18:16:05.553575] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-10-28T18:16:05.563402] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-04. [2025-10-28T18:16:06.171100] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-28T18:16:06.359388] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-10. [2025-10-28T18:16:06.750096] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-28T18:16:07.159407] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-05. [2025-10-28T18:16:07.908345] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-28T18:16:07.918531] [INFO ] [REMOTE ] DE: Full fetch complete (69902 records). [2025-10-28T18:16:07.918746] [DEBUG] [VALIDATOR ] DE: Validating primary data. [2025-10-28T18:16:07.965369] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-03. [2025-10-28T18:16:08.328711] [DEBUG] [VALIDATOR ] DE: All expected trading days are present. [2025-10-28T18:16:08.328902] [DEBUG] [VALIDATOR ] DE: Primary data validation passed. [2025-10-28T18:16:08.329735] [INFO ] [MAIN ] DE: Fetched primary data is valid. [2025-10-28T18:16:08.329813] [DEBUG] [LOCAL ] DE: Saving primary data. [2025-10-28T18:16:08.353918] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-28T18:16:08.354076] [DEBUG] [LOCAL ] DE: Trimmed 69902 records to 47337 (keeping 200 days of data) [2025-10-28T18:16:08.651590] [DEBUG] [LOCAL ] DE: Primary data saved (47337 records). [2025-10-28T18:16:08.651739] [INFO ] [MAIN ] DE: Full history saved. [2025-10-28T18:16:08.651821] [INFO ] [MAIN ] Update Progress: 604/2366 symbols completed. DE took 38.1s. Estimated remaining: 3h 41m 59s. Rate: 7.9 symbols/min [2025-10-28T18:16:08.760451] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-05. [2025-10-28T18:16:08.832501] [INFO ] [MAIN ] DEI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:16:08.874701] [DEBUG] [LOCAL ] DEI: Loaded 48162 existing records from primary storage. [2025-10-28T18:16:08.875004] [INFO ] [MAIN ] DEI: Loaded 48162 existing records. [2025-10-28T18:16:09.056786] [WARN ] [MAIN ] DEI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:16:09.057021] [INFO ] [MAIN ] DEI: Wiping existing primary data before full refresh. [2025-10-28T18:16:09.057071] [INFO ] [LOCAL ] DEI: Starting deletion of primary data. [2025-10-28T18:16:09.058030] [DEBUG] [LOCAL ] DEI: Deleted primary data file. [2025-10-28T18:16:09.058090] [INFO ] [MAIN ] DEI: Starting full primary refresh. [2025-10-28T18:16:09.414022] [INFO ] [REMOTE ] DEI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:16:09.560957] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-06. [2025-10-28T18:16:09.563884] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-28T18:16:09.727015] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-28T18:16:10.359396] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-04. [2025-10-28T18:16:10.613908] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-28T18:16:11.159405] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-01. [2025-10-28T18:16:11.815314] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-28T18:16:11.959382] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-05. [2025-10-28T18:16:12.375254] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-28T18:16:12.759379] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-07. [2025-10-28T18:16:13.559381] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-02. [2025-10-28T18:16:13.627485] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-28T18:16:13.970327] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-28T18:16:14.359348] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-06. [2025-10-28T18:16:14.596231] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-28T18:16:15.159404] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-03. [2025-10-28T18:16:15.959332] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-08. [2025-10-28T18:16:15.992068] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-28T18:16:16.569421] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-28T18:16:16.759403] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-06. [2025-10-28T18:16:16.939618] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-28T18:16:17.559352] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-04. [2025-10-28T18:16:17.875218] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-28T18:16:18.359334] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-07. [2025-10-28T18:16:18.888181] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-28T18:16:19.159331] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-05. [2025-10-28T18:16:19.959336] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-07. [2025-10-28T18:16:20.033091] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-28T18:16:20.507005] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-28T18:16:20.759306] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-09. [2025-10-28T18:16:20.847373] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-28T18:16:21.559377] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-06. [2025-10-28T18:16:21.889754] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-28T18:16:22.359343] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-08. [2025-10-28T18:16:22.944301] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-28T18:16:23.159346] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-07. [2025-10-28T18:16:23.959313] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-08. [2025-10-28T18:16:24.015478] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-28T18:16:24.496273] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-28T18:16:24.759321] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-08. [2025-10-28T18:16:24.795763] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-28T18:16:25.559333] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-09. [2025-10-28T18:16:26.368423] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-09. [2025-10-28T18:16:26.375443] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-28T18:16:26.434969] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-28T18:16:27.159336] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-10. [2025-10-28T18:16:27.959356] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-09. [2025-10-28T18:16:28.109593] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-10-28T18:16:28.759426] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-10. [2025-10-28T18:16:29.003737] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-28T18:16:29.010293] [INFO ] [REMOTE ] DEC: Full fetch complete (44464 records). [2025-10-28T18:16:29.010434] [DEBUG] [VALIDATOR ] DEC: Validating primary data. [2025-10-28T18:16:29.011119] [FATAL] [VALIDATOR ] DEC: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T18:16:29.011205] [FATAL] [MAIN ] DEC: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:16:29.011271] [WARN ] [MAIN ] DEC: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:16:29.011344] [INFO ] [LOCAL ] DEC: Starting deletion of primary data. [2025-10-28T18:16:29.011407] [DEBUG] [LOCAL ] DEC: No primary data file found to delete. [2025-10-28T18:16:29.011443] [INFO ] [LOCAL ] DEC: Starting deletion of derivative data. [2025-10-28T18:16:29.011684] [DEBUG] [LOCAL ] DEC: Deleted derivative data file. [2025-10-28T18:16:29.011798] [INFO ] [MAIN ] Update Progress: 605/2366 symbols completed. DEC took 36.7s. Estimated remaining: 3h 42m 29s. Rate: 7.9 symbols/min [2025-10-28T18:16:29.188078] [INFO ] [MAIN ] DELL: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:16:29.240308] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-28T18:16:29.267253] [DEBUG] [LOCAL ] DELL: Loaded 53736 existing records from primary storage. [2025-10-28T18:16:29.267575] [INFO ] [MAIN ] DELL: Loaded 53736 existing records. [2025-10-28T18:16:29.438172] [WARN ] [MAIN ] DELL: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:16:29.438376] [INFO ] [MAIN ] DELL: Wiping existing primary data before full refresh. [2025-10-28T18:16:29.438423] [INFO ] [LOCAL ] DELL: Starting deletion of primary data. [2025-10-28T18:16:29.439407] [DEBUG] [LOCAL ] DELL: Deleted primary data file. [2025-10-28T18:16:29.439465] [INFO ] [MAIN ] DELL: Starting full primary refresh. [2025-10-28T18:16:29.574409] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-10. [2025-10-28T18:16:29.791409] [INFO ] [REMOTE ] DELL: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:16:30.359393] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-01. [2025-10-28T18:16:30.818836] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-10 (2.06 seconds). [2025-10-28T18:16:30.829487] [INFO ] [REMOTE ] DECK: Full fetch complete (77237 records). [2025-10-28T18:16:30.829617] [DEBUG] [VALIDATOR ] DECK: Validating primary data. [2025-10-28T18:16:31.161433] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-10. [2025-10-28T18:16:31.237574] [DEBUG] [VALIDATOR ] DECK: All expected trading days are present. [2025-10-28T18:16:31.238132] [DEBUG] [VALIDATOR ] DECK: Primary data validation passed. [2025-10-28T18:16:31.239033] [INFO ] [MAIN ] DECK: Fetched primary data is valid. [2025-10-28T18:16:31.248005] [DEBUG] [LOCAL ] DECK: Saving primary data. [2025-10-28T18:16:31.266667] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-28T18:16:31.270265] [DEBUG] [LOCAL ] DECK: Trimmed 77237 records to 53302 (keeping 200 days of data) [2025-10-28T18:16:31.277163] [INFO ] [REMOTE ] DEI: Full fetch complete (69894 records). [2025-10-28T18:16:31.277257] [DEBUG] [VALIDATOR ] DEI: Validating primary data. [2025-10-28T18:16:31.971537] [DEBUG] [VALIDATOR ] DEI: All expected trading days are present. [2025-10-28T18:16:31.989745] [DEBUG] [VALIDATOR ] DEI: Primary data validation passed. [2025-10-28T18:16:31.991061] [INFO ] [MAIN ] DEI: Fetched primary data is valid. [2025-10-28T18:16:31.991143] [DEBUG] [LOCAL ] DEI: Saving primary data. [2025-10-28T18:16:32.012524] [DEBUG] [LOCAL ] DEI: Trimmed 69894 records to 48147 (keeping 200 days of data) [2025-10-28T18:16:32.015068] [DEBUG] [LOCAL ] DECK: Primary data saved (53302 records). [2025-10-28T18:16:32.015540] [INFO ] [MAIN ] DECK: Full history saved. [2025-10-28T18:16:32.015684] [INFO ] [MAIN ] Update Progress: 606/2366 symbols completed. DECK took 31.2s. Estimated remaining: 3h 42m 8s. Rate: 7.9 symbols/min [2025-10-28T18:16:32.291791] [INFO ] [MAIN ] DEO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:16:32.494944] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-01 (2.14 seconds). [2025-10-28T18:16:32.509083] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-02. [2025-10-28T18:16:32.508366] [DEBUG] [LOCAL ] DEO: Loaded 49158 existing records from primary storage. [2025-10-28T18:16:32.513333] [INFO ] [MAIN ] DEO: Loaded 49158 existing records. [2025-10-28T18:16:32.702233] [DEBUG] [LOCAL ] DEI: Primary data saved (48147 records). [2025-10-28T18:16:32.715325] [INFO ] [MAIN ] DEI: Full history saved. [2025-10-28T18:16:32.725904] [INFO ] [MAIN ] Update Progress: 607/2366 symbols completed. DEI took 24.1s. Estimated remaining: 3h 41m 40s. Rate: 7.9 symbols/min [2025-10-28T18:16:32.755958] [WARN ] [MAIN ] DEO: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:16:32.767111] [INFO ] [MAIN ] DEO: Wiping existing primary data before full refresh. [2025-10-28T18:16:32.767196] [INFO ] [LOCAL ] DEO: Starting deletion of primary data. [2025-10-28T18:16:32.872214] [DEBUG] [LOCAL ] DEO: Deleted primary data file. [2025-10-28T18:16:32.880016] [INFO ] [MAIN ] DEO: Starting full primary refresh. [2025-10-28T18:16:32.890899] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-28T18:16:32.962444] [INFO ] [REMOTE ] DEA: Full fetch complete (61469 records). [2025-10-28T18:16:32.999964] [DEBUG] [VALIDATOR ] DEA: Validating primary data. [2025-10-28T18:16:33.149016] [INFO ] [MAIN ] DFH: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:16:33.609576] [DEBUG] [LOCAL ] DFH: Loaded 31185 existing records from primary storage. [2025-10-28T18:16:33.647893] [INFO ] [REMOTE ] DEO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:16:33.670105] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-01. [2025-10-28T18:16:33.670342] [INFO ] [MAIN ] DFH: Loaded 31185 existing records. [2025-10-28T18:16:33.872239] [DEBUG] [VALIDATOR ] DEA: All expected trading days are present. [2025-10-28T18:16:33.872339] [DEBUG] [VALIDATOR ] DEA: Primary data validation passed. [2025-10-28T18:16:33.873166] [INFO ] [MAIN ] DEA: Fetched primary data is valid. [2025-10-28T18:16:33.873551] [DEBUG] [LOCAL ] DEA: Saving primary data. [2025-10-28T18:16:33.924360] [DEBUG] [LOCAL ] DEA: Trimmed 61469 records to 39679 (keeping 200 days of data) [2025-10-28T18:16:33.954000] [WARN ] [MAIN ] DFH: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:16:33.954473] [INFO ] [MAIN ] DFH: Wiping existing primary data before full refresh. [2025-10-28T18:16:33.954525] [INFO ] [LOCAL ] DFH: Starting deletion of primary data. [2025-10-28T18:16:33.954959] [DEBUG] [LOCAL ] DFH: Deleted primary data file. [2025-10-28T18:16:33.955019] [INFO ] [MAIN ] DFH: Starting full primary refresh. [2025-10-28T18:16:34.440636] [DEBUG] [LOCAL ] DEA: Primary data saved (39679 records). [2025-10-28T18:16:34.467717] [INFO ] [MAIN ] DEA: Full history saved. [2025-10-28T18:16:34.479293] [INFO ] [MAIN ] Update Progress: 608/2366 symbols completed. DEA took 49.7s. Estimated remaining: 3h 41m 16s. Rate: 7.9 symbols/min [2025-10-28T18:16:34.678347] [INFO ] [REMOTE ] DFH: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:16:34.682297] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-01. [2025-10-28T18:16:34.754462] [INFO ] [MAIN ] DFIN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:16:34.782330] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-02 (2.27 seconds). [2025-10-28T18:16:34.800356] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-03. [2025-10-28T18:16:34.810104] [DEBUG] [LOCAL ] DFIN: Loaded 22124 existing records from primary storage. [2025-10-28T18:16:34.810315] [INFO ] [MAIN ] DFIN: Loaded 22124 existing records. [2025-10-28T18:16:34.984034] [WARN ] [MAIN ] DFIN: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:16:34.984221] [INFO ] [MAIN ] DFIN: Wiping existing primary data before full refresh. [2025-10-28T18:16:34.984267] [INFO ] [LOCAL ] DFIN: Starting deletion of primary data. [2025-10-28T18:16:34.984701] [DEBUG] [LOCAL ] DFIN: Deleted primary data file. [2025-10-28T18:16:34.984758] [INFO ] [MAIN ] DFIN: Starting full primary refresh. [2025-10-28T18:16:35.376878] [INFO ] [REMOTE ] DFIN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:16:35.377289] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-01. [2025-10-28T18:16:35.408413] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-10-28T18:16:35.660618] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-28T18:16:35.959331] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-02. [2025-10-28T18:16:36.284163] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-28T18:16:36.725627] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-10-28T18:16:36.759300] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-04. [2025-10-28T18:16:37.237179] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-28T18:16:37.559338] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-03. [2025-10-28T18:16:38.359423] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-02. [2025-10-28T18:16:38.661411] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-10-28T18:16:39.032258] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-28T18:16:39.055625] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-28T18:16:39.159336] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-04. [2025-10-28T18:16:39.960870] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-05. [2025-10-28T18:16:40.705871] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-28T18:16:40.759407] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-05. [2025-10-28T18:16:41.559346] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-02. [2025-10-28T18:16:41.653670] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-10-28T18:16:41.947688] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-28T18:16:42.359359] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-03. [2025-10-28T18:16:42.599305] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-28T18:16:43.159331] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-06. [2025-10-28T18:16:43.183525] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-28T18:16:43.959330] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-04. [2025-10-28T18:16:44.759385] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-06. [2025-10-28T18:16:45.048667] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-28T18:16:45.147357] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-10-28T18:16:45.559346] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-05. [2025-10-28T18:16:46.348539] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-28T18:16:46.359290] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-03. [2025-10-28T18:16:46.391815] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-28T18:16:47.159352] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-06. [2025-10-28T18:16:47.448965] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-28T18:16:47.896771] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-28T18:16:47.959317] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-07. [2025-10-28T18:16:48.685145] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-28T18:16:48.759371] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-07. [2025-10-28T18:16:49.559336] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-07. [2025-10-28T18:16:50.359352] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-04. [2025-10-28T18:16:50.684695] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-10-28T18:16:51.086310] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-28T18:16:51.159339] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-08. [2025-10-28T18:16:51.500171] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-28T18:16:51.959351] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-08. [2025-10-28T18:16:52.759301] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-08. [2025-10-28T18:16:52.978121] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-10-28T18:16:53.512268] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-28T18:16:53.559318] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-09. [2025-10-28T18:16:53.619211] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-10-28T18:16:54.307996] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-28T18:16:54.359334] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-09. [2025-10-28T18:16:55.159333] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-10. [2025-10-28T18:16:55.959339] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-09. [2025-10-28T18:16:56.238090] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-28T18:16:56.334883] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-28T18:16:56.339293] [INFO ] [REMOTE ] DFIN: Full fetch complete (33359 records). [2025-10-28T18:16:56.339456] [DEBUG] [VALIDATOR ] DFIN: Validating primary data. [2025-10-28T18:16:56.340143] [FATAL] [VALIDATOR ] DFIN: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T18:16:56.340242] [FATAL] [MAIN ] DFIN: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:16:56.340329] [WARN ] [MAIN ] DFIN: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:16:56.340424] [INFO ] [LOCAL ] DFIN: Starting deletion of primary data. [2025-10-28T18:16:56.340512] [DEBUG] [LOCAL ] DFIN: No primary data file found to delete. [2025-10-28T18:16:56.340552] [INFO ] [LOCAL ] DFIN: Starting deletion of derivative data. [2025-10-28T18:16:56.340746] [DEBUG] [LOCAL ] DFIN: Deleted derivative data file. [2025-10-28T18:16:56.340839] [INFO ] [MAIN ] Update Progress: 609/2366 symbols completed. DFIN took 21.9s. Estimated remaining: 3h 41m 50s. Rate: 7.9 symbols/min [2025-10-28T18:16:56.512334] [INFO ] [MAIN ] DFP: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:16:56.523443] [DEBUG] [LOCAL ] DFP: Loaded 10752 existing records from primary storage. [2025-10-28T18:16:56.523688] [INFO ] [MAIN ] DFP: Loaded 10752 existing records. [2025-10-28T18:16:56.705758] [WARN ] [MAIN ] DFP: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:16:56.706012] [INFO ] [MAIN ] DFP: Wiping existing primary data before full refresh. [2025-10-28T18:16:56.706065] [INFO ] [LOCAL ] DFP: Starting deletion of primary data. [2025-10-28T18:16:56.706326] [DEBUG] [LOCAL ] DFP: Deleted primary data file. [2025-10-28T18:16:56.706365] [INFO ] [MAIN ] DFP: Starting full primary refresh. [2025-10-28T18:16:56.768573] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-05. [2025-10-28T18:16:57.076475] [INFO ] [REMOTE ] DFP: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:16:57.559333] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-10. [2025-10-28T18:16:57.849332] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-28T18:16:57.909112] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-10-28T18:16:58.359349] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-01. [2025-10-28T18:16:58.928872] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-28T18:16:59.159306] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-02. [2025-10-28T18:16:59.370006] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-28T18:16:59.380172] [INFO ] [REMOTE ] DEO: Full fetch complete (71731 records). [2025-10-28T18:16:59.380297] [DEBUG] [VALIDATOR ] DEO: Validating primary data. [2025-10-28T18:16:59.777591] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-28T18:16:59.801228] [DEBUG] [VALIDATOR ] DEO: All expected trading days are present. [2025-10-28T18:16:59.801283] [DEBUG] [VALIDATOR ] DEO: Primary data validation passed. [2025-10-28T18:16:59.802075] [INFO ] [MAIN ] DEO: Fetched primary data is valid. [2025-10-28T18:16:59.802135] [DEBUG] [LOCAL ] DEO: Saving primary data. [2025-10-28T18:16:59.803340] [DEBUG] [LOCAL ] DEO: Trimmed 71731 records to 49131 (keeping 200 days of data) [2025-10-28T18:16:59.980726] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-10. [2025-10-28T18:17:00.108335] [DEBUG] [LOCAL ] DEO: Primary data saved (49131 records). [2025-10-28T18:17:00.108485] [INFO ] [MAIN ] DEO: Full history saved. [2025-10-28T18:17:00.109380] [INFO ] [MAIN ] Update Progress: 610/2366 symbols completed. DEO took 28.1s. Estimated remaining: 3h 41m 31s. Rate: 7.9 symbols/min [2025-10-28T18:17:00.280359] [INFO ] [MAIN ] DG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:17:00.333412] [DEBUG] [LOCAL ] DG: Loaded 53220 existing records from primary storage. [2025-10-28T18:17:00.333733] [INFO ] [MAIN ] DG: Loaded 53220 existing records. [2025-10-28T18:17:00.510052] [WARN ] [MAIN ] DG: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:17:00.510268] [INFO ] [MAIN ] DG: Wiping existing primary data before full refresh. [2025-10-28T18:17:00.510315] [INFO ] [LOCAL ] DG: Starting deletion of primary data. [2025-10-28T18:17:00.510865] [DEBUG] [LOCAL ] DG: Deleted primary data file. [2025-10-28T18:17:00.510922] [INFO ] [MAIN ] DG: Starting full primary refresh. [2025-10-28T18:17:00.764496] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-06. [2025-10-28T18:17:00.874712] [INFO ] [REMOTE ] DG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:17:01.559353] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-03. [2025-10-28T18:17:01.962771] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-28T18:17:02.089222] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-28T18:17:02.187687] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-10 (2.21 seconds). [2025-10-28T18:17:02.198854] [INFO ] [REMOTE ] DELL: Full fetch complete (77525 records). [2025-10-28T18:17:02.199072] [DEBUG] [VALIDATOR ] DELL: Validating primary data. [2025-10-28T18:17:02.199998] [FATAL] [VALIDATOR ] DELL: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T18:17:02.200099] [FATAL] [MAIN ] DELL: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:17:02.200143] [WARN ] [MAIN ] DELL: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:17:02.200186] [INFO ] [LOCAL ] DELL: Starting deletion of primary data. [2025-10-28T18:17:02.200251] [DEBUG] [LOCAL ] DELL: No primary data file found to delete. [2025-10-28T18:17:02.200288] [INFO ] [LOCAL ] DELL: Starting deletion of derivative data. [2025-10-28T18:17:02.200550] [DEBUG] [LOCAL ] DELL: Deleted derivative data file. [2025-10-28T18:17:02.200703] [INFO ] [MAIN ] Update Progress: 611/2366 symbols completed. DELL took 33.2s. Estimated remaining: 3h 41m 8s. Rate: 7.9 symbols/min [2025-10-28T18:17:02.364986] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-01. [2025-10-28T18:17:02.396663] [INFO ] [MAIN ] DGX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:17:02.445195] [DEBUG] [LOCAL ] DGX: Loaded 44445 existing records from primary storage. [2025-10-28T18:17:02.445596] [INFO ] [MAIN ] DGX: Loaded 44445 existing records. [2025-10-28T18:17:02.633737] [WARN ] [MAIN ] DGX: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:17:02.634098] [INFO ] [MAIN ] DGX: Wiping existing primary data before full refresh. [2025-10-28T18:17:02.634156] [INFO ] [LOCAL ] DGX: Starting deletion of primary data. [2025-10-28T18:17:02.634502] [DEBUG] [LOCAL ] DGX: Deleted primary data file. [2025-10-28T18:17:02.634597] [INFO ] [MAIN ] DGX: Starting full primary refresh. [2025-10-28T18:17:03.069397] [INFO ] [REMOTE ] DGX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:17:03.159359] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-07. [2025-10-28T18:17:03.959349] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-04. [2025-10-28T18:17:04.082009] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-28T18:17:04.156140] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-28T18:17:04.395342] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-28T18:17:04.759338] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-08. [2025-10-28T18:17:05.559364] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-05. [2025-10-28T18:17:05.841017] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-28T18:17:06.130170] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-28T18:17:06.359355] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-02. [2025-10-28T18:17:07.159317] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-01. [2025-10-28T18:17:07.556740] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-28T18:17:07.959381] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-03. [2025-10-28T18:17:08.527722] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-28T18:17:08.759363] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-06. [2025-10-28T18:17:09.369297] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-28T18:17:09.514610] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-28T18:17:09.559356] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-07. [2025-10-28T18:17:10.126605] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-28T18:17:10.359315] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-02. [2025-10-28T18:17:11.159346] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-08. [2025-10-28T18:17:11.685779] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-28T18:17:11.687552] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-10-28T18:17:11.959338] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-03. [2025-10-28T18:17:12.759351] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-09. [2025-10-28T18:17:13.286909] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-28T18:17:13.352435] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-28T18:17:13.559332] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-10. [2025-10-28T18:17:14.134989] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-28T18:17:14.140161] [INFO ] [REMOTE ] DFP: Full fetch complete (15802 records). [2025-10-28T18:17:14.140282] [DEBUG] [VALIDATOR ] DFP: Validating primary data. [2025-10-28T18:17:14.364528] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-09. [2025-10-28T18:17:14.504034] [DEBUG] [VALIDATOR ] DFP: All expected trading days are present. [2025-10-28T18:17:14.504115] [DEBUG] [VALIDATOR ] DFP: Primary data validation passed. [2025-10-28T18:17:14.504501] [INFO ] [MAIN ] DFP: Fetched primary data is valid. [2025-10-28T18:17:14.504541] [DEBUG] [LOCAL ] DFP: Saving primary data. [2025-10-28T18:17:14.505102] [DEBUG] [LOCAL ] DFP: Trimmed 15802 records to 10701 (keeping 200 days of data) [2025-10-28T18:17:14.568182] [DEBUG] [LOCAL ] DFP: Primary data saved (10701 records). [2025-10-28T18:17:14.568303] [INFO ] [MAIN ] DFP: Full history saved. [2025-10-28T18:17:14.568382] [INFO ] [MAIN ] Update Progress: 612/2366 symbols completed. DFP took 18.2s. Estimated remaining: 3h 41m 14s. Rate: 7.9 symbols/min [2025-10-28T18:17:14.741376] [INFO ] [MAIN ] DHF: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:17:14.759465] [DEBUG] [LOCAL ] DHF: Loaded 20579 existing records from primary storage. [2025-10-28T18:17:14.759712] [INFO ] [MAIN ] DHF: Loaded 20579 existing records. [2025-10-28T18:17:14.943990] [WARN ] [MAIN ] DHF: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:17:14.944184] [INFO ] [MAIN ] DHF: Wiping existing primary data before full refresh. [2025-10-28T18:17:14.944231] [INFO ] [LOCAL ] DHF: Starting deletion of primary data. [2025-10-28T18:17:14.944778] [DEBUG] [LOCAL ] DHF: Deleted primary data file. [2025-10-28T18:17:14.944837] [INFO ] [MAIN ] DHF: Starting full primary refresh. [2025-10-28T18:17:15.167744] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-04. [2025-10-28T18:17:15.311089] [INFO ] [REMOTE ] DHF: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:17:15.354390] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-28T18:17:15.959355] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-10. [2025-10-28T18:17:16.455124] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-28T18:17:16.759361] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-01. [2025-10-28T18:17:16.886289] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-28T18:17:16.893176] [INFO ] [REMOTE ] DFH: Full fetch complete (47040 records). [2025-10-28T18:17:16.893329] [DEBUG] [VALIDATOR ] DFH: Validating primary data. [2025-10-28T18:17:17.307432] [DEBUG] [VALIDATOR ] DFH: All expected trading days are present. [2025-10-28T18:17:17.307515] [DEBUG] [VALIDATOR ] DFH: Primary data validation passed. [2025-10-28T18:17:17.308148] [INFO ] [MAIN ] DFH: Fetched primary data is valid. [2025-10-28T18:17:17.308210] [DEBUG] [LOCAL ] DFH: Saving primary data. [2025-10-28T18:17:17.309325] [DEBUG] [LOCAL ] DFH: Trimmed 47040 records to 31085 (keeping 200 days of data) [2025-10-28T18:17:17.504241] [DEBUG] [LOCAL ] DFH: Primary data saved (31085 records). [2025-10-28T18:17:17.504560] [INFO ] [MAIN ] DFH: Full history saved. [2025-10-28T18:17:17.504765] [INFO ] [MAIN ] Update Progress: 613/2366 symbols completed. DFH took 44.8s. Estimated remaining: 3h 40m 53s. Rate: 7.9 symbols/min [2025-10-28T18:17:17.554634] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-28T18:17:17.564557] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-04. [2025-10-28T18:17:17.721834] [INFO ] [MAIN ] DHI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:17:17.722010] [DEBUG] [LOCAL ] DHI: No existing data file found in primary storage. [2025-10-28T18:17:17.722048] [WARN ] [MAIN ] DHI: No existing data found, performing full refresh instead. [2025-10-28T18:17:17.722155] [INFO ] [MAIN ] DHI: Wiping existing primary data before full refresh. [2025-10-28T18:17:17.722200] [INFO ] [LOCAL ] DHI: Starting deletion of primary data. [2025-10-28T18:17:17.722243] [DEBUG] [LOCAL ] DHI: No primary data file found to delete. [2025-10-28T18:17:17.722276] [INFO ] [MAIN ] DHI: Starting full primary refresh. [2025-10-28T18:17:18.083229] [INFO ] [REMOTE ] DHI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:17:18.359344] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-01. [2025-10-28T18:17:19.159289] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-02. [2025-10-28T18:17:19.528577] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-10-28T18:17:19.882401] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-28T18:17:19.916937] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-28T18:17:19.959386] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-03. [2025-10-28T18:17:20.660301] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-28T18:17:20.759318] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-04. [2025-10-28T18:17:21.546816] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-28T18:17:21.559292] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-05. [2025-10-28T18:17:22.359328] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-05. [2025-10-28T18:17:23.065082] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-28T18:17:23.064619] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-28T18:17:23.159347] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-06. [2025-10-28T18:17:23.891631] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-28T18:17:23.959323] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-05. [2025-10-28T18:17:24.759332] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-06. [2025-10-28T18:17:25.206615] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-28T18:17:25.559359] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-06. [2025-10-28T18:17:26.359341] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-07. [2025-10-28T18:17:26.398570] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-28T18:17:26.680197] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-28T18:17:26.989520] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-28T18:17:27.159396] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-07. [2025-10-28T18:17:27.959415] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-08. [2025-10-28T18:17:28.498718] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-28T18:17:28.759362] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-02. [2025-10-28T18:17:28.827338] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-28T18:17:29.559355] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-09. [2025-10-28T18:17:30.154188] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-28T18:17:30.194093] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-28T18:17:30.359329] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-08. [2025-10-28T18:17:31.159346] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-07. [2025-10-28T18:17:31.521500] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-28T18:17:31.959355] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-10. [2025-10-28T18:17:32.669263] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-28T18:17:32.671176] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-28T18:17:32.685859] [INFO ] [REMOTE ] DHF: Full fetch complete (29767 records). [2025-10-28T18:17:32.686039] [DEBUG] [VALIDATOR ] DHF: Validating primary data. [2025-10-28T18:17:32.686872] [FATAL] [VALIDATOR ] DHF: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T18:17:32.686951] [FATAL] [MAIN ] DHF: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:17:32.687013] [WARN ] [MAIN ] DHF: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:17:32.687083] [INFO ] [LOCAL ] DHF: Starting deletion of primary data. [2025-10-28T18:17:32.687144] [DEBUG] [LOCAL ] DHF: No primary data file found to delete. [2025-10-28T18:17:32.687195] [INFO ] [LOCAL ] DHF: Starting deletion of derivative data. [2025-10-28T18:17:32.687364] [DEBUG] [LOCAL ] DHF: Deleted derivative data file. [2025-10-28T18:17:32.687448] [INFO ] [MAIN ] Update Progress: 614/2366 symbols completed. DHF took 18.1s. Estimated remaining: 3h 41m 8s. Rate: 7.9 symbols/min [2025-10-28T18:17:32.764401] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-08. [2025-10-28T18:17:32.854544] [INFO ] [MAIN ] DHR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:17:32.905019] [DEBUG] [LOCAL ] DHR: Loaded 53369 existing records from primary storage. [2025-10-28T18:17:32.905336] [INFO ] [MAIN ] DHR: Loaded 53369 existing records. [2025-10-28T18:17:33.082805] [WARN ] [MAIN ] DHR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:17:33.083017] [INFO ] [MAIN ] DHR: Wiping existing primary data before full refresh. [2025-10-28T18:17:33.083063] [INFO ] [LOCAL ] DHR: Starting deletion of primary data. [2025-10-28T18:17:33.083616] [DEBUG] [LOCAL ] DHR: Deleted primary data file. [2025-10-28T18:17:33.083709] [INFO ] [MAIN ] DHR: Starting full primary refresh. [2025-10-28T18:17:33.437310] [INFO ] [REMOTE ] DHR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:17:33.559373] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-09. [2025-10-28T18:17:34.311399] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-28T18:17:34.359326] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-01. [2025-10-28T18:17:34.915037] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-28T18:17:35.159341] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-10. [2025-10-28T18:17:35.691441] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-28T18:17:35.959340] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-03. [2025-10-28T18:17:36.601056] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-28T18:17:36.610781] [INFO ] [REMOTE ] DGX: Full fetch complete (65401 records). [2025-10-28T18:17:36.611134] [DEBUG] [VALIDATOR ] DGX: Validating primary data. [2025-10-28T18:17:36.612467] [FATAL] [VALIDATOR ] DGX: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T18:17:36.612586] [FATAL] [MAIN ] DGX: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:17:36.612633] [WARN ] [MAIN ] DGX: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:17:36.612722] [INFO ] [LOCAL ] DGX: Starting deletion of primary data. [2025-10-28T18:17:36.612798] [DEBUG] [LOCAL ] DGX: No primary data file found to delete. [2025-10-28T18:17:36.612838] [INFO ] [LOCAL ] DGX: Starting deletion of derivative data. [2025-10-28T18:17:36.613059] [DEBUG] [LOCAL ] DGX: Deleted derivative data file. [2025-10-28T18:17:36.613177] [INFO ] [MAIN ] Update Progress: 615/2366 symbols completed. DGX took 34.4s. Estimated remaining: 3h 40m 50s. Rate: 7.9 symbols/min [2025-10-28T18:17:36.764588] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-02. [2025-10-28T18:17:36.832941] [INFO ] [MAIN ] DHT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:17:36.883773] [DEBUG] [LOCAL ] DHT: Loaded 47756 existing records from primary storage. [2025-10-28T18:17:36.884311] [INFO ] [MAIN ] DHT: Loaded 47756 existing records. [2025-10-28T18:17:37.093065] [WARN ] [MAIN ] DHT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:17:37.093335] [INFO ] [MAIN ] DHT: Wiping existing primary data before full refresh. [2025-10-28T18:17:37.093414] [INFO ] [LOCAL ] DHT: Starting deletion of primary data. [2025-10-28T18:17:37.094381] [DEBUG] [LOCAL ] DHT: Deleted primary data file. [2025-10-28T18:17:37.094442] [INFO ] [MAIN ] DHT: Starting full primary refresh. [2025-10-28T18:17:37.474381] [INFO ] [REMOTE ] DHT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:17:37.512750] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-28T18:17:37.559299] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-04. [2025-10-28T18:17:38.184540] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-28T18:17:38.359390] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-03. [2025-10-28T18:17:38.836274] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-28T18:17:39.159381] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-01. [2025-10-28T18:17:39.729004] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-28T18:17:39.959403] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-09. [2025-10-28T18:17:40.423354] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-28T18:17:40.759360] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-04. [2025-10-28T18:17:41.501799] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-28T18:17:41.559330] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-10. [2025-10-28T18:17:42.121217] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-28T18:17:42.172465] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-28T18:17:42.183256] [INFO ] [REMOTE ] DG: Full fetch complete (77274 records). [2025-10-28T18:17:42.183417] [DEBUG] [VALIDATOR ] DG: Validating primary data. [2025-10-28T18:17:42.361763] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-02. [2025-10-28T18:17:42.576603] [DEBUG] [VALIDATOR ] DG: All expected trading days are present. [2025-10-28T18:17:42.576731] [DEBUG] [VALIDATOR ] DG: Primary data validation passed. [2025-10-28T18:17:42.577598] [INFO ] [MAIN ] DG: Fetched primary data is valid. [2025-10-28T18:17:42.577696] [DEBUG] [LOCAL ] DG: Saving primary data. [2025-10-28T18:17:42.579262] [DEBUG] [LOCAL ] DG: Trimmed 77274 records to 53192 (keeping 200 days of data) [2025-10-28T18:17:42.901961] [DEBUG] [LOCAL ] DG: Primary data saved (53192 records). [2025-10-28T18:17:42.902083] [INFO ] [MAIN ] DG: Full history saved. [2025-10-28T18:17:42.902824] [INFO ] [MAIN ] Update Progress: 616/2366 symbols completed. DG took 42.8s. Estimated remaining: 3h 40m 38s. Rate: 7.9 symbols/min [2025-10-28T18:17:43.069118] [INFO ] [MAIN ] DHX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:17:43.084140] [DEBUG] [LOCAL ] DHX: Loaded 13037 existing records from primary storage. [2025-10-28T18:17:43.084414] [INFO ] [MAIN ] DHX: Loaded 13037 existing records. [2025-10-28T18:17:43.164487] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-05. [2025-10-28T18:17:43.260799] [WARN ] [MAIN ] DHX: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:17:43.261031] [INFO ] [MAIN ] DHX: Wiping existing primary data before full refresh. [2025-10-28T18:17:43.261092] [INFO ] [LOCAL ] DHX: Starting deletion of primary data. [2025-10-28T18:17:43.261413] [DEBUG] [LOCAL ] DHX: Deleted primary data file. [2025-10-28T18:17:43.261471] [INFO ] [MAIN ] DHX: Starting full primary refresh. [2025-10-28T18:17:43.636732] [INFO ] [REMOTE ] DHX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:17:43.673167] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-28T18:17:43.959370] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-05. [2025-10-28T18:17:44.767875] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-01. [2025-10-28T18:17:44.772454] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-28T18:17:45.283607] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-28T18:17:45.421409] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-28T18:17:45.559307] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-02. [2025-10-28T18:17:46.316585] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-28T18:17:46.359300] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-03. [2025-10-28T18:17:46.987332] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-28T18:17:47.159362] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-04. [2025-10-28T18:17:47.793745] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-28T18:17:47.959335] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-06. [2025-10-28T18:17:48.759384] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-03. [2025-10-28T18:17:49.071881] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-28T18:17:49.559323] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-06. [2025-10-28T18:17:50.033703] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-28T18:17:50.359330] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-05. [2025-10-28T18:17:50.945247] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-28T18:17:51.128246] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-28T18:17:51.159299] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-06. [2025-10-28T18:17:51.654233] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-28T18:17:51.959367] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-04. [2025-10-28T18:17:52.759346] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-07. [2025-10-28T18:17:53.162145] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-28T18:17:53.559324] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-05. [2025-10-28T18:17:54.198542] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-28T18:17:54.359332] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-07. [2025-10-28T18:17:54.775421] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-10-28T18:17:54.905760] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-28T18:17:55.159332] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-07. [2025-10-28T18:17:55.959341] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-06. [2025-10-28T18:17:56.759309] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-08. [2025-10-28T18:17:56.993671] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-10-28T18:17:57.195162] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-28T18:17:57.559332] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-07. [2025-10-28T18:17:58.359347] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-08. [2025-10-28T18:17:58.641563] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-10-28T18:17:58.689519] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-28T18:17:59.159320] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-08. [2025-10-28T18:17:59.661715] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-28T18:17:59.772816] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-28T18:17:59.959333] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-08. [2025-10-28T18:18:00.759402] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-09. [2025-10-28T18:18:01.559317] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-09. [2025-10-28T18:18:01.963061] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-28T18:18:02.359306] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-09. [2025-10-28T18:18:02.433987] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-28T18:18:02.693159] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-28T18:18:03.159344] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-10. [2025-10-28T18:18:03.904262] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-28T18:18:03.909094] [INFO ] [REMOTE ] DHX: Full fetch complete (21490 records). [2025-10-28T18:18:03.909194] [DEBUG] [VALIDATOR ] DHX: Validating primary data. [2025-10-28T18:18:03.971421] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-10. [2025-10-28T18:18:04.285150] [DEBUG] [VALIDATOR ] DHX: All expected trading days are present. [2025-10-28T18:18:04.285345] [DEBUG] [VALIDATOR ] DHX: Primary data validation passed. [2025-10-28T18:18:04.285921] [INFO ] [MAIN ] DHX: Fetched primary data is valid. [2025-10-28T18:18:04.286000] [DEBUG] [LOCAL ] DHX: Saving primary data. [2025-10-28T18:18:04.286739] [DEBUG] [LOCAL ] DHX: Trimmed 21490 records to 13052 (keeping 200 days of data) [2025-10-28T18:18:04.385828] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-10-28T18:18:04.401016] [DEBUG] [LOCAL ] DHX: Primary data saved (13052 records). [2025-10-28T18:18:04.401460] [INFO ] [MAIN ] DHX: Full history saved. [2025-10-28T18:18:04.401559] [INFO ] [MAIN ] Update Progress: 617/2366 symbols completed. DHX took 21.5s. Estimated remaining: 3h 41m 10s. Rate: 7.9 symbols/min [2025-10-28T18:18:04.582855] [INFO ] [MAIN ] DIAX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:18:04.583093] [DEBUG] [LOCAL ] DIAX: No existing data file found in primary storage. [2025-10-28T18:18:04.583265] [WARN ] [MAIN ] DIAX: No existing data found, performing full refresh instead. [2025-10-28T18:18:04.583691] [INFO ] [MAIN ] DIAX: Wiping existing primary data before full refresh. [2025-10-28T18:18:04.583837] [INFO ] [LOCAL ] DIAX: Starting deletion of primary data. [2025-10-28T18:18:04.583917] [DEBUG] [LOCAL ] DIAX: No primary data file found to delete. [2025-10-28T18:18:04.583971] [INFO ] [MAIN ] DIAX: Starting full primary refresh. [2025-10-28T18:18:04.769121] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-09. [2025-10-28T18:18:04.882791] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-28T18:18:04.914905] [INFO ] [REMOTE ] DHR: Full fetch complete (77438 records). [2025-10-28T18:18:04.925232] [DEBUG] [VALIDATOR ] DHR: Validating primary data. [2025-10-28T18:18:05.078917] [INFO ] [REMOTE ] DIAX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:18:05.363343] [DEBUG] [VALIDATOR ] DHR: All expected trading days are present. [2025-10-28T18:18:05.363410] [DEBUG] [VALIDATOR ] DHR: Primary data validation passed. [2025-10-28T18:18:05.364256] [INFO ] [MAIN ] DHR: Fetched primary data is valid. [2025-10-28T18:18:05.364321] [DEBUG] [LOCAL ] DHR: Saving primary data. [2025-10-28T18:18:05.365670] [DEBUG] [LOCAL ] DHR: Trimmed 77438 records to 53365 (keeping 200 days of data) [2025-10-28T18:18:05.574459] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-01. [2025-10-28T18:18:05.691174] [DEBUG] [LOCAL ] DHR: Primary data saved (53365 records). [2025-10-28T18:18:05.691298] [INFO ] [MAIN ] DHR: Full history saved. [2025-10-28T18:18:05.691904] [INFO ] [MAIN ] Update Progress: 618/2366 symbols completed. DHR took 33.0s. Estimated remaining: 3h 40m 45s. Rate: 7.9 symbols/min [2025-10-28T18:18:05.857785] [INFO ] [MAIN ] DIN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:18:05.891591] [DEBUG] [LOCAL ] DIN: Loaded 36358 existing records from primary storage. [2025-10-28T18:18:05.891881] [INFO ] [MAIN ] DIN: Loaded 36358 existing records. [2025-10-28T18:18:06.068319] [WARN ] [MAIN ] DIN: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:18:06.068568] [INFO ] [MAIN ] DIN: Wiping existing primary data before full refresh. [2025-10-28T18:18:06.068733] [INFO ] [LOCAL ] DIN: Starting deletion of primary data. [2025-10-28T18:18:06.069478] [DEBUG] [LOCAL ] DIN: Deleted primary data file. [2025-10-28T18:18:06.069538] [INFO ] [MAIN ] DIN: Starting full primary refresh. [2025-10-28T18:18:06.182016] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-28T18:18:06.280636] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-28T18:18:06.364442] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-10. [2025-10-28T18:18:06.481256] [INFO ] [REMOTE ] DIN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:18:07.159415] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-02. [2025-10-28T18:18:07.670610] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-28T18:18:07.959355] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-10. [2025-10-28T18:18:08.113452] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-28T18:18:08.124100] [INFO ] [REMOTE ] DHI: Full fetch complete (77408 records). [2025-10-28T18:18:08.124213] [DEBUG] [VALIDATOR ] DHI: Validating primary data. [2025-10-28T18:18:08.506487] [DEBUG] [VALIDATOR ] DHI: All expected trading days are present. [2025-10-28T18:18:08.506577] [DEBUG] [VALIDATOR ] DHI: Primary data validation passed. [2025-10-28T18:18:08.507436] [INFO ] [MAIN ] DHI: Fetched primary data is valid. [2025-10-28T18:18:08.507497] [DEBUG] [LOCAL ] DHI: Saving primary data. [2025-10-28T18:18:08.508886] [DEBUG] [LOCAL ] DHI: Trimmed 77408 records to 53348 (keeping 200 days of data) [2025-10-28T18:18:08.780973] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-03. [2025-10-28T18:18:08.827106] [DEBUG] [LOCAL ] DHI: Primary data saved (53348 records). [2025-10-28T18:18:08.827252] [INFO ] [MAIN ] DHI: Full history saved. [2025-10-28T18:18:08.827342] [INFO ] [MAIN ] Update Progress: 619/2366 symbols completed. DHI took 51.3s. Estimated remaining: 3h 40m 25s. Rate: 7.9 symbols/min [2025-10-28T18:18:08.996300] [INFO ] [MAIN ] DINO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:18:09.041354] [DEBUG] [LOCAL ] DINO: Loaded 52788 existing records from primary storage. [2025-10-28T18:18:09.041636] [INFO ] [MAIN ] DINO: Loaded 52788 existing records. [2025-10-28T18:18:09.217251] [WARN ] [MAIN ] DINO: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:18:09.217419] [INFO ] [MAIN ] DINO: Wiping existing primary data before full refresh. [2025-10-28T18:18:09.217491] [INFO ] [LOCAL ] DINO: Starting deletion of primary data. [2025-10-28T18:18:09.218545] [DEBUG] [LOCAL ] DINO: Deleted primary data file. [2025-10-28T18:18:09.218603] [INFO ] [MAIN ] DINO: Starting full primary refresh. [2025-10-28T18:18:09.570005] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-01. [2025-10-28T18:18:09.580395] [INFO ] [REMOTE ] DINO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:18:09.582340] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-28T18:18:09.613538] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-28T18:18:09.623371] [INFO ] [REMOTE ] DHT: Full fetch complete (70328 records). [2025-10-28T18:18:09.623478] [DEBUG] [VALIDATOR ] DHT: Validating primary data. [2025-10-28T18:18:10.004739] [DEBUG] [VALIDATOR ] DHT: All expected trading days are present. [2025-10-28T18:18:10.004820] [DEBUG] [VALIDATOR ] DHT: Primary data validation passed. [2025-10-28T18:18:10.005596] [INFO ] [MAIN ] DHT: Fetched primary data is valid. [2025-10-28T18:18:10.005636] [DEBUG] [LOCAL ] DHT: Saving primary data. [2025-10-28T18:18:10.006969] [DEBUG] [LOCAL ] DHT: Trimmed 70328 records to 47743 (keeping 200 days of data) [2025-10-28T18:18:10.280901] [DEBUG] [LOCAL ] DHT: Primary data saved (47743 records). [2025-10-28T18:18:10.281022] [INFO ] [MAIN ] DHT: Full history saved. [2025-10-28T18:18:10.281098] [INFO ] [MAIN ] Update Progress: 620/2366 symbols completed. DHT took 33.7s. Estimated remaining: 3h 40m 0s. Rate: 7.9 symbols/min [2025-10-28T18:18:10.364526] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-04. [2025-10-28T18:18:10.449662] [INFO ] [MAIN ] DIS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:18:10.497505] [DEBUG] [LOCAL ] DIS: Loaded 53788 existing records from primary storage. [2025-10-28T18:18:10.497815] [INFO ] [MAIN ] DIS: Loaded 53788 existing records. [2025-10-28T18:18:10.679829] [WARN ] [MAIN ] DIS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:18:10.680024] [INFO ] [MAIN ] DIS: Wiping existing primary data before full refresh. [2025-10-28T18:18:10.680078] [INFO ] [LOCAL ] DIS: Starting deletion of primary data. [2025-10-28T18:18:10.681075] [DEBUG] [LOCAL ] DIS: Deleted primary data file. [2025-10-28T18:18:10.681134] [INFO ] [MAIN ] DIS: Starting full primary refresh. [2025-10-28T18:18:11.039602] [INFO ] [REMOTE ] DIS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:18:11.049721] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-28T18:18:11.075198] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-28T18:18:11.159307] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-01. [2025-10-28T18:18:11.959379] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-02. [2025-10-28T18:18:12.759351] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-01. [2025-10-28T18:18:13.013152] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-28T18:18:13.559304] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-05. [2025-10-28T18:18:13.729024] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-01 (2.57 seconds). [2025-10-28T18:18:14.116799] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-28T18:18:14.198887] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-28T18:18:14.359315] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-06. [2025-10-28T18:18:14.840141] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-28T18:18:15.159319] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-03. [2025-10-28T18:18:15.959570] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-07. [2025-10-28T18:18:16.367881] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-28T18:18:16.636452] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-28T18:18:16.759392] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-02. [2025-10-28T18:18:17.559331] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-02. [2025-10-28T18:18:17.945741] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-28T18:18:18.359327] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-08. [2025-10-28T18:18:18.955558] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-28T18:18:19.159354] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-03. [2025-10-28T18:18:19.373883] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-10-28T18:18:19.959465] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-09. [2025-10-28T18:18:20.362932] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-28T18:18:20.481547] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-28T18:18:20.759367] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-04. [2025-10-28T18:18:21.559338] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-03. [2025-10-28T18:18:22.093728] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-28T18:18:22.359360] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-05. [2025-10-28T18:18:23.159331] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-04. [2025-10-28T18:18:23.496488] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-28T18:18:23.661209] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-10-28T18:18:23.959331] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-06. [2025-10-28T18:18:24.759345] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-04. [2025-10-28T18:18:25.559348] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-10. [2025-10-28T18:18:26.192571] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-28T18:18:26.195879] [INFO ] [REMOTE ] DIAX: Full fetch complete (17676 records). [2025-10-28T18:18:26.196023] [DEBUG] [VALIDATOR ] DIAX: Validating primary data. [2025-10-28T18:18:26.377384] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-04 (3.22 seconds). [2025-10-28T18:18:26.498061] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-05. [2025-10-28T18:18:26.667035] [DEBUG] [VALIDATOR ] DIAX: All expected trading days are present. [2025-10-28T18:18:26.667251] [DEBUG] [VALIDATOR ] DIAX: Primary data validation passed. [2025-10-28T18:18:26.667840] [INFO ] [MAIN ] DIAX: Fetched primary data is valid. [2025-10-28T18:18:26.667905] [DEBUG] [LOCAL ] DIAX: Saving primary data. [2025-10-28T18:18:26.668709] [DEBUG] [LOCAL ] DIAX: Trimmed 17676 records to 12223 (keeping 200 days of data) [2025-10-28T18:18:26.750312] [DEBUG] [LOCAL ] DIAX: Primary data saved (12223 records). [2025-10-28T18:18:26.750565] [INFO ] [MAIN ] DIAX: Full history saved. [2025-10-28T18:18:26.750709] [INFO ] [MAIN ] Update Progress: 621/2366 symbols completed. DIAX took 22.3s. Estimated remaining: 3h 40m 17s. Rate: 7.9 symbols/min [2025-10-28T18:18:26.934570] [INFO ] [MAIN ] DIVY: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:18:26.934950] [DEBUG] [LOCAL ] DIVY: No existing data file found in primary storage. [2025-10-28T18:18:26.935005] [WARN ] [MAIN ] DIVY: No existing data found, performing full refresh instead. [2025-10-28T18:18:26.935147] [INFO ] [MAIN ] DIVY: Wiping existing primary data before full refresh. [2025-10-28T18:18:26.935209] [INFO ] [LOCAL ] DIVY: Starting deletion of primary data. [2025-10-28T18:18:26.935312] [DEBUG] [LOCAL ] DIVY: No primary data file found to delete. [2025-10-28T18:18:26.935395] [INFO ] [MAIN ] DIVY: Starting full primary refresh. [2025-10-28T18:18:27.231804] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-06 (3.27 seconds). [2025-10-28T18:18:27.289020] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-07. [2025-10-28T18:18:27.299362] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-04 (2.54 seconds). [2025-10-28T18:18:27.389313] [INFO ] [REMOTE ] DIVY: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:18:27.960286] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-01. [2025-10-28T18:18:27.963156] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-28T18:18:28.327280] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-10-28T18:18:28.362688] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-28T18:18:28.759351] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-02. [2025-10-28T18:18:28.993711] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-02 (0.23 seconds). [2025-10-28T18:18:29.559334] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-05. [2025-10-28T18:18:30.359357] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-08. [2025-10-28T18:18:31.159415] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-03. [2025-10-28T18:18:31.391964] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-28T18:18:31.478936] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-10-28T18:18:31.512324] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-28T18:18:31.959354] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-09. [2025-10-28T18:18:32.759380] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-06. [2025-10-28T18:18:33.559341] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-04. [2025-10-28T18:18:33.935555] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-10-28T18:18:34.037727] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-28T18:18:34.359327] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-10. [2025-10-28T18:18:35.159350] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-06. [2025-10-28T18:18:35.424492] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-06 (2.67 seconds). [2025-10-28T18:18:35.458071] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-28T18:18:35.466042] [INFO ] [REMOTE ] DIN: Full fetch complete (54321 records). [2025-10-28T18:18:35.466175] [DEBUG] [VALIDATOR ] DIN: Validating primary data. [2025-10-28T18:18:35.849280] [DEBUG] [VALIDATOR ] DIN: All expected trading days are present. [2025-10-28T18:18:35.849369] [DEBUG] [VALIDATOR ] DIN: Primary data validation passed. [2025-10-28T18:18:35.850249] [INFO ] [MAIN ] DIN: Fetched primary data is valid. [2025-10-28T18:18:35.850325] [DEBUG] [LOCAL ] DIN: Saving primary data. [2025-10-28T18:18:35.852024] [DEBUG] [LOCAL ] DIN: Trimmed 54321 records to 36263 (keeping 200 days of data) [2025-10-28T18:18:35.961255] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-07. [2025-10-28T18:18:36.077733] [DEBUG] [LOCAL ] DIN: Primary data saved (36263 records). [2025-10-28T18:18:36.077874] [INFO ] [MAIN ] DIN: Full history saved. [2025-10-28T18:18:36.077956] [INFO ] [MAIN ] Update Progress: 622/2366 symbols completed. DIN took 30.4s. Estimated remaining: 3h 40m 15s. Rate: 7.9 symbols/min [2025-10-28T18:18:36.243776] [INFO ] [MAIN ] DK: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:18:36.289067] [DEBUG] [LOCAL ] DK: Loaded 49105 existing records from primary storage. [2025-10-28T18:18:36.289380] [INFO ] [MAIN ] DK: Loaded 49105 existing records. [2025-10-28T18:18:36.471847] [WARN ] [MAIN ] DK: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:18:36.472073] [INFO ] [MAIN ] DK: Wiping existing primary data before full refresh. [2025-10-28T18:18:36.472123] [INFO ] [LOCAL ] DK: Starting deletion of primary data. [2025-10-28T18:18:36.472683] [DEBUG] [LOCAL ] DK: Deleted primary data file. [2025-10-28T18:18:36.472757] [INFO ] [MAIN ] DK: Starting full primary refresh. [2025-10-28T18:18:36.765038] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-05. [2025-10-28T18:18:36.848150] [INFO ] [REMOTE ] DK: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:18:36.878860] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-10-28T18:18:37.114372] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-10-28T18:18:37.559417] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-07. [2025-10-28T18:18:37.736528] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-10-28T18:18:38.359339] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-08. [2025-10-28T18:18:38.963219] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-28T18:18:39.159329] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-01. [2025-10-28T18:18:39.965576] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-08. [2025-10-28T18:18:39.986078] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-28T18:18:40.598484] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-28T18:18:40.759338] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-06. [2025-10-28T18:18:41.052254] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-06 (0.29 seconds). [2025-10-28T18:18:41.559346] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-02. [2025-10-28T18:18:42.359316] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-09. [2025-10-28T18:18:42.677680] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-08 (2.71 seconds). [2025-10-28T18:18:42.835459] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-28T18:18:43.159331] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-03. [2025-10-28T18:18:43.959308] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-07. [2025-10-28T18:18:44.036698] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-10-28T18:18:44.214348] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-07 (0.26 seconds). [2025-10-28T18:18:44.563823] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-28T18:18:44.759338] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-10. [2025-10-28T18:18:45.559322] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-09. [2025-10-28T18:18:46.359349] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-04. [2025-10-28T18:18:47.159305] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-08. [2025-10-28T18:18:47.269900] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-10 (2.51 seconds). [2025-10-28T18:18:47.281413] [INFO ] [REMOTE ] DIS: Full fetch complete (77967 records). [2025-10-28T18:18:47.281557] [DEBUG] [VALIDATOR ] DIS: Validating primary data. [2025-10-28T18:18:47.463940] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-08 (0.30 seconds). [2025-10-28T18:18:47.744299] [DEBUG] [VALIDATOR ] DIS: All expected trading days are present. [2025-10-28T18:18:47.744393] [DEBUG] [VALIDATOR ] DIS: Primary data validation passed. [2025-10-28T18:18:47.745487] [INFO ] [MAIN ] DIS: Fetched primary data is valid. [2025-10-28T18:18:47.745554] [DEBUG] [LOCAL ] DIS: Saving primary data. [2025-10-28T18:18:47.747171] [DEBUG] [LOCAL ] DIS: Trimmed 77967 records to 53788 (keeping 200 days of data) [2025-10-28T18:18:47.974085] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-09. [2025-10-28T18:18:48.111853] [DEBUG] [LOCAL ] DIS: Primary data saved (53788 records). [2025-10-28T18:18:48.112023] [INFO ] [MAIN ] DIS: Full history saved. [2025-10-28T18:18:48.112147] [INFO ] [MAIN ] Update Progress: 623/2366 symbols completed. DIS took 37.8s. Estimated remaining: 3h 40m 20s. Rate: 7.9 symbols/min [2025-10-28T18:18:48.249871] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-09 (0.28 seconds). [2025-10-28T18:18:48.327462] [INFO ] [MAIN ] DKL: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:18:48.327588] [DEBUG] [LOCAL ] DKL: No existing data file found in primary storage. [2025-10-28T18:18:48.327701] [WARN ] [MAIN ] DKL: No existing data found, performing full refresh instead. [2025-10-28T18:18:48.327813] [INFO ] [MAIN ] DKL: Wiping existing primary data before full refresh. [2025-10-28T18:18:48.327865] [INFO ] [LOCAL ] DKL: Starting deletion of primary data. [2025-10-28T18:18:48.327923] [DEBUG] [LOCAL ] DKL: No primary data file found to delete. [2025-10-28T18:18:48.327982] [INFO ] [MAIN ] DKL: Starting full primary refresh. [2025-10-28T18:18:48.699391] [INFO ] [REMOTE ] DKL: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:18:48.759341] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-01. [2025-10-28T18:18:49.475220] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-28T18:18:49.559326] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-02. [2025-10-28T18:18:50.359332] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-10. [2025-10-28T18:18:50.401414] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-28T18:18:50.688823] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-10 (0.33 seconds). [2025-10-28T18:18:50.689547] [INFO ] [REMOTE ] DIVY: Full fetch complete (1661 records). [2025-10-28T18:18:50.689613] [DEBUG] [VALIDATOR ] DIVY: Validating primary data. [2025-10-28T18:18:50.865130] [WARN ] [VALIDATOR ] DIVY: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-28T18:18:50.865359] [FATAL] [MAIN ] DIVY: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:18:50.865425] [WARN ] [MAIN ] DIVY: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:18:50.865492] [INFO ] [LOCAL ] DIVY: Starting deletion of primary data. [2025-10-28T18:18:50.865554] [DEBUG] [LOCAL ] DIVY: No primary data file found to delete. [2025-10-28T18:18:50.865590] [INFO ] [LOCAL ] DIVY: Starting deletion of derivative data. [2025-10-28T18:18:50.865629] [DEBUG] [LOCAL ] DIVY: No derivative data file found to delete. [2025-10-28T18:18:50.865720] [INFO ] [MAIN ] Update Progress: 624/2366 symbols completed. DIVY took 24.1s. Estimated remaining: 3h 39m 59s. Rate: 7.9 symbols/min [2025-10-28T18:18:51.056079] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-09 (5.50 seconds). [2025-10-28T18:18:51.081925] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-04 (4.72 seconds). [2025-10-28T18:18:51.118851] [INFO ] [MAIN ] DKS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:18:51.170915] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-05. [2025-10-28T18:18:51.173884] [DEBUG] [LOCAL ] DKS: Loaded 49014 existing records from primary storage. [2025-10-28T18:18:51.174204] [INFO ] [MAIN ] DKS: Loaded 49014 existing records. [2025-10-28T18:18:51.362384] [WARN ] [MAIN ] DKS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:18:51.362610] [INFO ] [MAIN ] DKS: Wiping existing primary data before full refresh. [2025-10-28T18:18:51.362690] [INFO ] [LOCAL ] DKS: Starting deletion of primary data. [2025-10-28T18:18:51.363410] [DEBUG] [LOCAL ] DKS: Deleted primary data file. [2025-10-28T18:18:51.363468] [INFO ] [MAIN ] DKS: Starting full primary refresh. [2025-10-28T18:18:51.744419] [INFO ] [REMOTE ] DKS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:18:51.959335] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-01. [2025-10-28T18:18:52.693025] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-28T18:18:52.759326] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-06. [2025-10-28T18:18:53.290546] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-28T18:18:53.559339] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-02. [2025-10-28T18:18:54.359311] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-03. [2025-10-28T18:18:54.818149] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-28T18:18:55.159321] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-03. [2025-10-28T18:18:55.537787] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-06 (2.78 seconds). [2025-10-28T18:18:55.947229] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-28T18:18:55.959292] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-04. [2025-10-28T18:18:56.486426] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-28T18:18:56.759322] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-04. [2025-10-28T18:18:56.844029] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-28T18:18:57.559327] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-10. [2025-10-28T18:18:58.359318] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-05. [2025-10-28T18:18:59.165938] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-07. [2025-10-28T18:18:59.177353] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-28T18:18:59.193436] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-04 (2.43 seconds). [2025-10-28T18:18:59.203729] [INFO ] [REMOTE ] DINO: Full fetch complete (76304 records). [2025-10-28T18:18:59.204618] [DEBUG] [VALIDATOR ] DINO: Validating primary data. [2025-10-28T18:18:59.218072] [FATAL] [VALIDATOR ] DINO: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T18:18:59.218240] [FATAL] [MAIN ] DINO: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:18:59.218892] [WARN ] [MAIN ] DINO: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:18:59.219466] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-28T18:18:59.219677] [INFO ] [LOCAL ] DINO: Starting deletion of primary data. [2025-10-28T18:18:59.219858] [DEBUG] [LOCAL ] DINO: No primary data file found to delete. [2025-10-28T18:18:59.224868] [INFO ] [LOCAL ] DINO: Starting deletion of derivative data. [2025-10-28T18:18:59.225403] [DEBUG] [LOCAL ] DINO: Deleted derivative data file. [2025-10-28T18:18:59.225498] [INFO ] [MAIN ] Update Progress: 625/2366 symbols completed. DINO took 50.4s. Estimated remaining: 3h 39m 53s. Rate: 7.9 symbols/min [2025-10-28T18:18:59.395343] [INFO ] [MAIN ] DLB: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:18:59.423273] [DEBUG] [LOCAL ] DLB: Loaded 32098 existing records from primary storage. [2025-10-28T18:18:59.423547] [INFO ] [MAIN ] DLB: Loaded 32098 existing records. [2025-10-28T18:18:59.599399] [WARN ] [MAIN ] DLB: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:18:59.599608] [INFO ] [MAIN ] DLB: Wiping existing primary data before full refresh. [2025-10-28T18:18:59.599692] [INFO ] [LOCAL ] DLB: Starting deletion of primary data. [2025-10-28T18:18:59.600300] [DEBUG] [LOCAL ] DLB: Deleted primary data file. [2025-10-28T18:18:59.600358] [INFO ] [MAIN ] DLB: Starting full primary refresh. [2025-10-28T18:18:59.970572] [INFO ] [REMOTE ] DLB: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:18:59.965751] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-05. [2025-10-28T18:19:00.759330] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-06. [2025-10-28T18:19:01.544722] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-28T18:19:01.559299] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-06. [2025-10-28T18:19:01.673110] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-28T18:19:02.359363] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-01. [2025-10-28T18:19:02.693504] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-07 (3.53 seconds). [2025-10-28T18:19:02.884170] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-28T18:19:03.159386] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-08. [2025-10-28T18:19:03.529271] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-28T18:19:03.959372] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-07. [2025-10-28T18:19:04.638789] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-28T18:19:04.759328] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-02. [2025-10-28T18:19:05.180397] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-28T18:19:05.559347] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-08. [2025-10-28T18:19:06.194969] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-28T18:19:06.359308] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-09. [2025-10-28T18:19:06.443192] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-28T18:19:07.159361] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-07. [2025-10-28T18:19:07.721840] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-28T18:19:07.959321] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-09. [2025-10-28T18:19:08.604180] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-28T18:19:08.759312] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-10. [2025-10-28T18:19:08.898283] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-28T18:19:09.415930] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-28T18:19:09.418459] [INFO ] [REMOTE ] DKL: Full fetch complete (27416 records). [2025-10-28T18:19:09.418529] [DEBUG] [VALIDATOR ] DKL: Validating primary data. [2025-10-28T18:19:09.564406] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-10. [2025-10-28T18:19:09.807423] [DEBUG] [VALIDATOR ] DKL: All expected trading days are present. [2025-10-28T18:19:09.807505] [DEBUG] [VALIDATOR ] DKL: Primary data validation passed. [2025-10-28T18:19:09.807987] [INFO ] [MAIN ] DKL: Fetched primary data is valid. [2025-10-28T18:19:09.808046] [DEBUG] [LOCAL ] DKL: Saving primary data. [2025-10-28T18:19:09.808667] [DEBUG] [LOCAL ] DKL: Trimmed 27416 records to 15947 (keeping 200 days of data) [2025-10-28T18:19:09.900305] [DEBUG] [LOCAL ] DKL: Primary data saved (15947 records). [2025-10-28T18:19:09.900432] [INFO ] [MAIN ] DKL: Full history saved. [2025-10-28T18:19:09.900501] [INFO ] [MAIN ] Update Progress: 626/2366 symbols completed. DKL took 21.8s. Estimated remaining: 3h 39m 54s. Rate: 7.9 symbols/min [2025-10-28T18:19:10.069327] [INFO ] [MAIN ] DLNG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:19:10.075710] [DEBUG] [LOCAL ] DLNG: Loaded 5896 existing records from primary storage. [2025-10-28T18:19:10.075874] [INFO ] [MAIN ] DLNG: Loaded 5896 existing records. [2025-10-28T18:19:10.248424] [WARN ] [MAIN ] DLNG: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:19:10.248636] [INFO ] [MAIN ] DLNG: Wiping existing primary data before full refresh. [2025-10-28T18:19:10.248716] [INFO ] [LOCAL ] DLNG: Starting deletion of primary data. [2025-10-28T18:19:10.248957] [DEBUG] [LOCAL ] DLNG: Deleted primary data file. [2025-10-28T18:19:10.249013] [INFO ] [MAIN ] DLNG: Starting full primary refresh. [2025-10-28T18:19:10.364559] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-03. [2025-10-28T18:19:10.599171] [INFO ] [REMOTE ] DLNG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:19:10.861867] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-28T18:19:10.871358] [INFO ] [REMOTE ] DK: Full fetch complete (70772 records). [2025-10-28T18:19:10.871485] [DEBUG] [VALIDATOR ] DK: Validating primary data. [2025-10-28T18:19:11.164592] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-08. [2025-10-28T18:19:11.268835] [DEBUG] [VALIDATOR ] DK: All expected trading days are present. [2025-10-28T18:19:11.268910] [DEBUG] [VALIDATOR ] DK: Primary data validation passed. [2025-10-28T18:19:11.269792] [INFO ] [MAIN ] DK: Fetched primary data is valid. [2025-10-28T18:19:11.269853] [DEBUG] [LOCAL ] DK: Saving primary data. [2025-10-28T18:19:11.271352] [DEBUG] [LOCAL ] DK: Trimmed 70772 records to 49049 (keeping 200 days of data) [2025-10-28T18:19:11.556158] [DEBUG] [LOCAL ] DK: Primary data saved (49049 records). [2025-10-28T18:19:11.556478] [INFO ] [MAIN ] DK: Full history saved. [2025-10-28T18:19:11.556574] [INFO ] [MAIN ] Update Progress: 627/2366 symbols completed. DK took 35.5s. Estimated remaining: 3h 39m 30s. Rate: 7.9 symbols/min [2025-10-28T18:19:11.724940] [INFO ] [MAIN ] DLR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:19:11.774170] [DEBUG] [LOCAL ] DLR: Loaded 50574 existing records from primary storage. [2025-10-28T18:19:11.774485] [INFO ] [MAIN ] DLR: Loaded 50574 existing records. [2025-10-28T18:19:11.954467] [WARN ] [MAIN ] DLR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:19:11.954677] [INFO ] [MAIN ] DLR: Wiping existing primary data before full refresh. [2025-10-28T18:19:11.954735] [INFO ] [LOCAL ] DLR: Starting deletion of primary data. [2025-10-28T18:19:11.955320] [DEBUG] [LOCAL ] DLR: Deleted primary data file. [2025-10-28T18:19:11.955376] [INFO ] [MAIN ] DLR: Starting full primary refresh. [2025-10-28T18:19:11.985584] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-01. [2025-10-28T18:19:12.304386] [INFO ] [REMOTE ] DLR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:19:12.660407] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-03 (2.30 seconds). [2025-10-28T18:19:12.759312] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-04. [2025-10-28T18:19:13.335420] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-28T18:19:13.559388] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-02. [2025-10-28T18:19:14.359329] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-01. [2025-10-28T18:19:15.038283] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-08 (3.87 seconds). [2025-10-28T18:19:15.159316] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-09. [2025-10-28T18:19:15.339771] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-04 (2.58 seconds). [2025-10-28T18:19:15.912903] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-02 (2.35 seconds). [2025-10-28T18:19:15.959296] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-05. [2025-10-28T18:19:16.759374] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-03. [2025-10-28T18:19:17.039188] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-28T18:19:17.362093] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-28T18:19:17.559361] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-04. [2025-10-28T18:19:18.359359] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-06. [2025-10-28T18:19:19.096239] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-01 (4.74 seconds). [2025-10-28T18:19:19.159334] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-02. [2025-10-28T18:19:19.237636] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-28T18:19:19.959378] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-07. [2025-10-28T18:19:20.412399] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-28T18:19:20.759394] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-03. [2025-10-28T18:19:21.460686] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-09 (6.30 seconds). [2025-10-28T18:19:21.559325] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-10. [2025-10-28T18:19:22.164861] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-28T18:19:22.266539] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-04 (4.71 seconds). [2025-10-28T18:19:22.359381] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-05. [2025-10-28T18:19:23.159382] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-04. [2025-10-28T18:19:23.645340] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-07 (3.69 seconds). [2025-10-28T18:19:23.959426] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-08. [2025-10-28T18:19:24.505998] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-28T18:19:24.538876] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-10-28T18:19:24.759480] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-06. [2025-10-28T18:19:25.138455] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-10-28T18:19:25.507751] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-28T18:19:25.559306] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-09. [2025-10-28T18:19:26.359318] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-05. [2025-10-28T18:19:26.533606] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-28T18:19:26.656168] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-10 (5.10 seconds). [2025-10-28T18:19:26.668153] [INFO ] [REMOTE ] DKS: Full fetch complete (71352 records). [2025-10-28T18:19:26.668457] [DEBUG] [VALIDATOR ] DKS: Validating primary data. [2025-10-28T18:19:27.146567] [DEBUG] [VALIDATOR ] DKS: All expected trading days are present. [2025-10-28T18:19:27.146761] [DEBUG] [VALIDATOR ] DKS: Primary data validation passed. [2025-10-28T18:19:27.148037] [INFO ] [MAIN ] DKS: Fetched primary data is valid. [2025-10-28T18:19:27.148104] [DEBUG] [LOCAL ] DKS: Saving primary data. [2025-10-28T18:19:27.150467] [DEBUG] [LOCAL ] DKS: Trimmed 71352 records to 48935 (keeping 200 days of data) [2025-10-28T18:19:27.213350] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-10. [2025-10-28T18:19:27.507337] [DEBUG] [LOCAL ] DKS: Primary data saved (48935 records). [2025-10-28T18:19:27.507560] [INFO ] [MAIN ] DKS: Full history saved. [2025-10-28T18:19:27.507707] [INFO ] [MAIN ] Update Progress: 628/2366 symbols completed. DKS took 36.6s. Estimated remaining: 3h 39m 46s. Rate: 7.9 symbols/min [2025-10-28T18:19:27.711332] [INFO ] [MAIN ] DLX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:19:27.711622] [DEBUG] [LOCAL ] DLX: No existing data file found in primary storage. [2025-10-28T18:19:27.711783] [WARN ] [MAIN ] DLX: No existing data found, performing full refresh instead. [2025-10-28T18:19:27.711937] [INFO ] [MAIN ] DLX: Wiping existing primary data before full refresh. [2025-10-28T18:19:27.712014] [INFO ] [LOCAL ] DLX: Starting deletion of primary data. [2025-10-28T18:19:27.712058] [DEBUG] [LOCAL ] DLX: No primary data file found to delete. [2025-10-28T18:19:27.712092] [INFO ] [MAIN ] DLX: Starting full primary refresh. [2025-10-28T18:19:27.985752] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-07. [2025-10-28T18:19:28.121165] [INFO ] [REMOTE ] DLX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:19:28.251568] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-28T18:19:28.258386] [INFO ] [REMOTE ] DLB: Full fetch complete (47345 records). [2025-10-28T18:19:28.258492] [DEBUG] [VALIDATOR ] DLB: Validating primary data. [2025-10-28T18:19:28.259112] [FATAL] [VALIDATOR ] DLB: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T18:19:28.259196] [FATAL] [MAIN ] DLB: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:19:28.259238] [WARN ] [MAIN ] DLB: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:19:28.259304] [INFO ] [LOCAL ] DLB: Starting deletion of primary data. [2025-10-28T18:19:28.259366] [DEBUG] [LOCAL ] DLB: No primary data file found to delete. [2025-10-28T18:19:28.259402] [INFO ] [LOCAL ] DLB: Starting deletion of derivative data. [2025-10-28T18:19:28.259576] [DEBUG] [LOCAL ] DLB: Deleted derivative data file. [2025-10-28T18:19:28.259696] [INFO ] [MAIN ] Update Progress: 629/2366 symbols completed. DLB took 29.0s. Estimated remaining: 3h 39m 19s. Rate: 7.9 symbols/min [2025-10-28T18:19:28.423451] [INFO ] [MAIN ] DLY: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:19:28.442027] [DEBUG] [LOCAL ] DLY: Loaded 20602 existing records from primary storage. [2025-10-28T18:19:28.442732] [INFO ] [MAIN ] DLY: Loaded 20602 existing records. [2025-10-28T18:19:28.549370] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-28T18:19:28.626075] [WARN ] [MAIN ] DLY: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:19:28.626288] [INFO ] [MAIN ] DLY: Wiping existing primary data before full refresh. [2025-10-28T18:19:28.626359] [INFO ] [LOCAL ] DLY: Starting deletion of primary data. [2025-10-28T18:19:28.626876] [DEBUG] [LOCAL ] DLY: Deleted primary data file. [2025-10-28T18:19:28.626932] [INFO ] [MAIN ] DLY: Starting full primary refresh. [2025-10-28T18:19:28.764505] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-01. [2025-10-28T18:19:28.990323] [INFO ] [REMOTE ] DLY: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:19:29.566121] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-08. [2025-10-28T18:19:29.567402] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-28T18:19:29.810977] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-05 (3.45 seconds). [2025-10-28T18:19:29.966990] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-10-28T18:19:30.359395] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-06. [2025-10-28T18:19:31.159403] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-09. [2025-10-28T18:19:31.537496] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-28T18:19:31.551847] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-10-28T18:19:31.959375] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-07. [2025-10-28T18:19:32.759350] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-02. [2025-10-28T18:19:33.559321] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-01. [2025-10-28T18:19:33.705468] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-28T18:19:34.359303] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-03. [2025-10-28T18:19:34.817055] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-28T18:19:35.159331] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-10. [2025-10-28T18:19:35.391880] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-28T18:19:35.477693] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-07 (3.52 seconds). [2025-10-28T18:19:35.959315] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-02. [2025-10-28T18:19:35.973549] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-28T18:19:35.975267] [INFO ] [REMOTE ] DLNG: Full fetch complete (10964 records). [2025-10-28T18:19:35.975368] [DEBUG] [VALIDATOR ] DLNG: Validating primary data. [2025-10-28T18:19:36.331805] [DEBUG] [VALIDATOR ] DLNG: All expected trading days are present. [2025-10-28T18:19:36.331878] [DEBUG] [VALIDATOR ] DLNG: Primary data validation passed. [2025-10-28T18:19:36.332150] [INFO ] [MAIN ] DLNG: Fetched primary data is valid. [2025-10-28T18:19:36.332190] [DEBUG] [LOCAL ] DLNG: Saving primary data. [2025-10-28T18:19:36.332600] [DEBUG] [LOCAL ] DLNG: Trimmed 10964 records to 5867 (keeping 200 days of data) [2025-10-28T18:19:36.365660] [DEBUG] [LOCAL ] DLNG: Primary data saved (5867 records). [2025-10-28T18:19:36.365776] [INFO ] [MAIN ] DLNG: Full history saved. [2025-10-28T18:19:36.365856] [INFO ] [MAIN ] Update Progress: 630/2366 symbols completed. DLNG took 26.5s. Estimated remaining: 3h 39m 13s. Rate: 7.9 symbols/min [2025-10-28T18:19:36.538102] [INFO ] [MAIN ] DMA: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:19:36.543776] [DEBUG] [LOCAL ] DMA: Loaded 4689 existing records from primary storage. [2025-10-28T18:19:36.543931] [INFO ] [MAIN ] DMA: Loaded 4689 existing records. [2025-10-28T18:19:36.703466] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-28T18:19:36.742922] [WARN ] [MAIN ] DMA: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:19:36.743873] [INFO ] [MAIN ] DMA: Wiping existing primary data before full refresh. [2025-10-28T18:19:36.743929] [INFO ] [LOCAL ] DMA: Starting deletion of primary data. [2025-10-28T18:19:36.744132] [DEBUG] [LOCAL ] DMA: Deleted primary data file. [2025-10-28T18:19:36.744188] [INFO ] [MAIN ] DMA: Starting full primary refresh. [2025-10-28T18:19:36.764440] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-08. [2025-10-28T18:19:37.094433] [INFO ] [REMOTE ] DMA: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:19:37.559332] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-01. [2025-10-28T18:19:37.934448] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-10-28T18:19:38.359365] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-02. [2025-10-28T18:19:38.574232] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-28T18:19:38.914504] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-28T18:19:39.159380] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-03. [2025-10-28T18:19:39.651132] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-28T18:19:39.959340] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-09. [2025-10-28T18:19:40.759387] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-04. [2025-10-28T18:19:41.378873] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-28T18:19:41.559344] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-10. [2025-10-28T18:19:42.065467] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-10 (0.51 seconds). [2025-10-28T18:19:42.075471] [INFO ] [REMOTE ] DLR: Full fetch complete (74159 records). [2025-10-28T18:19:42.075593] [DEBUG] [VALIDATOR ] DLR: Validating primary data. [2025-10-28T18:19:42.364596] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-04. [2025-10-28T18:19:42.461964] [DEBUG] [VALIDATOR ] DLR: All expected trading days are present. [2025-10-28T18:19:42.462042] [DEBUG] [VALIDATOR ] DLR: Primary data validation passed. [2025-10-28T18:19:42.462867] [INFO ] [MAIN ] DLR: Fetched primary data is valid. [2025-10-28T18:19:42.462927] [DEBUG] [LOCAL ] DLR: Saving primary data. [2025-10-28T18:19:42.464310] [DEBUG] [LOCAL ] DLR: Trimmed 74159 records to 50543 (keeping 200 days of data) [2025-10-28T18:19:42.773401] [DEBUG] [LOCAL ] DLR: Primary data saved (50543 records). [2025-10-28T18:19:42.773526] [INFO ] [MAIN ] DLR: Full history saved. [2025-10-28T18:19:42.773601] [INFO ] [MAIN ] Update Progress: 631/2366 symbols completed. DLR took 31.2s. Estimated remaining: 3h 39m 2s. Rate: 7.9 symbols/min [2025-10-28T18:19:42.902161] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-10-28T18:19:42.947791] [INFO ] [MAIN ] DMB: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:19:42.957989] [DEBUG] [LOCAL ] DMB: Loaded 10487 existing records from primary storage. [2025-10-28T18:19:42.958187] [INFO ] [MAIN ] DMB: Loaded 10487 existing records. [2025-10-28T18:19:43.133815] [WARN ] [MAIN ] DMB: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:19:43.134034] [INFO ] [MAIN ] DMB: Wiping existing primary data before full refresh. [2025-10-28T18:19:43.134104] [INFO ] [LOCAL ] DMB: Starting deletion of primary data. [2025-10-28T18:19:43.134384] [DEBUG] [LOCAL ] DMB: Deleted primary data file. [2025-10-28T18:19:43.134437] [INFO ] [MAIN ] DMB: Starting full primary refresh. [2025-10-28T18:19:43.166691] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-05. [2025-10-28T18:19:43.523115] [INFO ] [REMOTE ] DMB: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:19:43.666260] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-28T18:19:43.909197] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-04 (3.15 seconds). [2025-10-28T18:19:43.959295] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-05. [2025-10-28T18:19:44.759380] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-06. [2025-10-28T18:19:44.901384] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-28T18:19:45.067850] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-06 (0.31 seconds). [2025-10-28T18:19:45.559348] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-03. [2025-10-28T18:19:46.309633] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-28T18:19:46.359304] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-04. [2025-10-28T18:19:47.159347] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-07. [2025-10-28T18:19:47.226100] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-28T18:19:47.510157] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-10-28T18:19:47.959343] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-01. [2025-10-28T18:19:48.759306] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-05. [2025-10-28T18:19:49.432676] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-28T18:19:49.559346] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-06. [2025-10-28T18:19:50.004305] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-10-28T18:19:50.359401] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-02. [2025-10-28T18:19:51.159369] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-06. [2025-10-28T18:19:51.426778] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-10-28T18:19:51.862504] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-28T18:19:51.959397] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-08. [2025-10-28T18:19:52.405145] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-28T18:19:52.759388] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-09. [2025-10-28T18:19:53.518220] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-28T18:19:53.559329] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-07. [2025-10-28T18:19:54.359367] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-03. [2025-10-28T18:19:54.382452] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-06 (3.22 seconds). [2025-10-28T18:19:55.159385] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-10. [2025-10-28T18:19:55.284004] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-28T18:19:55.593636] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-28T18:19:55.802736] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-28T18:19:55.804747] [INFO ] [REMOTE ] DMA: Full fetch complete (6532 records). [2025-10-28T18:19:55.804826] [DEBUG] [VALIDATOR ] DMA: Validating primary data. [2025-10-28T18:19:55.964416] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-08. [2025-10-28T18:19:56.176196] [DEBUG] [VALIDATOR ] DMA: All expected trading days are present. [2025-10-28T18:19:56.176260] [DEBUG] [VALIDATOR ] DMA: Primary data validation passed. [2025-10-28T18:19:56.176433] [INFO ] [MAIN ] DMA: Fetched primary data is valid. [2025-10-28T18:19:56.176471] [DEBUG] [LOCAL ] DMA: Saving primary data. [2025-10-28T18:19:56.176929] [DEBUG] [LOCAL ] DMA: Trimmed 6532 records to 4701 (keeping 200 days of data) [2025-10-28T18:19:56.203894] [DEBUG] [LOCAL ] DMA: Primary data saved (4701 records). [2025-10-28T18:19:56.203959] [INFO ] [MAIN ] DMA: Full history saved. [2025-10-28T18:19:56.204028] [INFO ] [MAIN ] Update Progress: 632/2366 symbols completed. DMA took 19.8s. Estimated remaining: 3h 39m 11s. Rate: 7.9 symbols/min [2025-10-28T18:19:56.378825] [INFO ] [MAIN ] DMO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:19:56.388719] [DEBUG] [LOCAL ] DMO: Loaded 9505 existing records from primary storage. [2025-10-28T18:19:56.388887] [INFO ] [MAIN ] DMO: Loaded 9505 existing records. [2025-10-28T18:19:56.562669] [WARN ] [MAIN ] DMO: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:19:56.562861] [INFO ] [MAIN ] DMO: Wiping existing primary data before full refresh. [2025-10-28T18:19:56.562907] [INFO ] [LOCAL ] DMO: Starting deletion of primary data. [2025-10-28T18:19:56.563143] [DEBUG] [LOCAL ] DMO: Deleted primary data file. [2025-10-28T18:19:56.563184] [INFO ] [MAIN ] DMO: Starting full primary refresh. [2025-10-28T18:19:56.765672] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-04. [2025-10-28T18:19:56.913577] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-28T18:19:56.957179] [INFO ] [REMOTE ] DMO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:19:57.373451] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-28T18:19:57.559329] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-01. [2025-10-28T18:19:58.120712] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-28T18:19:58.359331] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-02. [2025-10-28T18:19:58.850693] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-28T18:19:59.159327] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-03. [2025-10-28T18:19:59.670123] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-28T18:19:59.959333] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-09. [2025-10-28T18:20:00.759311] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-07. [2025-10-28T18:20:00.867293] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-28T18:20:01.559334] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-10. [2025-10-28T18:20:02.058578] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-28T18:20:02.359320] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-04. [2025-10-28T18:20:02.952525] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-28T18:20:03.007720] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-28T18:20:03.013484] [INFO ] [REMOTE ] DLY: Full fetch complete (28691 records). [2025-10-28T18:20:03.013590] [DEBUG] [VALIDATOR ] DLY: Validating primary data. [2025-10-28T18:20:03.014134] [FATAL] [VALIDATOR ] DLY: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T18:20:03.014218] [FATAL] [MAIN ] DLY: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:20:03.014262] [WARN ] [MAIN ] DLY: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:20:03.014329] [INFO ] [LOCAL ] DLY: Starting deletion of primary data. [2025-10-28T18:20:03.014392] [DEBUG] [LOCAL ] DLY: No primary data file found to delete. [2025-10-28T18:20:03.014429] [INFO ] [LOCAL ] DLY: Starting deletion of derivative data. [2025-10-28T18:20:03.014573] [DEBUG] [LOCAL ] DLY: Deleted derivative data file. [2025-10-28T18:20:03.014668] [INFO ] [MAIN ] Update Progress: 633/2366 symbols completed. DLY took 34.8s. Estimated remaining: 3h 39m 1s. Rate: 7.9 symbols/min [2025-10-28T18:20:03.167607] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-08. [2025-10-28T18:20:03.194146] [INFO ] [MAIN ] DNA: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:20:03.235444] [DEBUG] [LOCAL ] DNA: Loaded 48413 existing records from primary storage. [2025-10-28T18:20:03.235767] [INFO ] [MAIN ] DNA: Loaded 48413 existing records. [2025-10-28T18:20:03.412698] [WARN ] [MAIN ] DNA: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:20:03.412930] [INFO ] [MAIN ] DNA: Wiping existing primary data before full refresh. [2025-10-28T18:20:03.412988] [INFO ] [LOCAL ] DNA: Starting deletion of primary data. [2025-10-28T18:20:03.413693] [DEBUG] [LOCAL ] DNA: Deleted primary data file. [2025-10-28T18:20:03.413750] [INFO ] [MAIN ] DNA: Starting full primary refresh. [2025-10-28T18:20:03.768704] [INFO ] [REMOTE ] DNA: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:20:03.959347] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-01. [2025-10-28T18:20:04.100731] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-10-28T18:20:04.759341] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-05. [2025-10-28T18:20:05.546512] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-28T18:20:05.559296] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-02. [2025-10-28T18:20:05.708761] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-28T18:20:06.359396] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-05. [2025-10-28T18:20:06.983483] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-28T18:20:07.157899] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-28T18:20:07.166859] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-06. [2025-10-28T18:20:07.632221] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-28T18:20:07.959437] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-03. [2025-10-28T18:20:08.759390] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-09. [2025-10-28T18:20:09.509242] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-28T18:20:09.543179] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-28T18:20:09.559305] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-04. [2025-10-28T18:20:10.359346] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-10. [2025-10-28T18:20:10.891593] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-28T18:20:11.107914] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-28T18:20:11.113174] [INFO ] [REMOTE ] DLX: Full fetch complete (41395 records). [2025-10-28T18:20:11.113291] [DEBUG] [VALIDATOR ] DLX: Validating primary data. [2025-10-28T18:20:11.164628] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-06. [2025-10-28T18:20:11.534968] [DEBUG] [VALIDATOR ] DLX: All expected trading days are present. [2025-10-28T18:20:11.535041] [DEBUG] [VALIDATOR ] DLX: Primary data validation passed. [2025-10-28T18:20:11.535608] [INFO ] [MAIN ] DLX: Fetched primary data is valid. [2025-10-28T18:20:11.535670] [DEBUG] [LOCAL ] DLX: Saving primary data. [2025-10-28T18:20:11.536474] [DEBUG] [LOCAL ] DLX: Trimmed 41395 records to 27575 (keeping 200 days of data) [2025-10-28T18:20:11.694065] [DEBUG] [LOCAL ] DLX: Primary data saved (27575 records). [2025-10-28T18:20:11.694184] [INFO ] [MAIN ] DLX: Full history saved. [2025-10-28T18:20:11.694251] [INFO ] [MAIN ] Update Progress: 634/2366 symbols completed. DLX took 44.2s. Estimated remaining: 3h 38m 57s. Rate: 7.9 symbols/min [2025-10-28T18:20:11.864628] [INFO ] [MAIN ] DNOW: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:20:11.864784] [DEBUG] [LOCAL ] DNOW: No existing data file found in primary storage. [2025-10-28T18:20:11.864823] [WARN ] [MAIN ] DNOW: No existing data found, performing full refresh instead. [2025-10-28T18:20:11.864929] [INFO ] [MAIN ] DNOW: Wiping existing primary data before full refresh. [2025-10-28T18:20:11.864968] [INFO ] [LOCAL ] DNOW: Starting deletion of primary data. [2025-10-28T18:20:11.865008] [DEBUG] [LOCAL ] DNOW: No primary data file found to delete. [2025-10-28T18:20:11.865039] [INFO ] [MAIN ] DNOW: Starting full primary refresh. [2025-10-28T18:20:11.964054] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-05. [2025-10-28T18:20:12.221576] [INFO ] [REMOTE ] DNOW: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:20:12.653738] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-28T18:20:12.759326] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-07. [2025-10-28T18:20:13.293475] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-28T18:20:13.312972] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-28T18:20:13.559320] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-08. [2025-10-28T18:20:14.359310] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-06. [2025-10-28T18:20:14.910981] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-28T18:20:15.159395] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-09. [2025-10-28T18:20:15.959319] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-01. [2025-10-28T18:20:15.989541] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-10-28T18:20:16.759413] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-07. [2025-10-28T18:20:17.523566] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-09 (2.36 seconds). [2025-10-28T18:20:17.559371] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-10. [2025-10-28T18:20:18.186140] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-28T18:20:18.188612] [INFO ] [REMOTE ] DMO: Full fetch complete (14301 records). [2025-10-28T18:20:18.188846] [DEBUG] [VALIDATOR ] DMO: Validating primary data. [2025-10-28T18:20:18.363458] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-07. [2025-10-28T18:20:18.526908] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-28T18:20:18.587926] [DEBUG] [VALIDATOR ] DMO: All expected trading days are present. [2025-10-28T18:20:18.587999] [DEBUG] [VALIDATOR ] DMO: Primary data validation passed. [2025-10-28T18:20:18.588378] [INFO ] [MAIN ] DMO: Fetched primary data is valid. [2025-10-28T18:20:18.588428] [DEBUG] [LOCAL ] DMO: Saving primary data. [2025-10-28T18:20:18.588976] [DEBUG] [LOCAL ] DMO: Trimmed 14301 records to 9429 (keeping 200 days of data) [2025-10-28T18:20:18.645414] [DEBUG] [LOCAL ] DMO: Primary data saved (9429 records). [2025-10-28T18:20:18.645538] [INFO ] [MAIN ] DMO: Full history saved. [2025-10-28T18:20:18.645615] [INFO ] [MAIN ] Update Progress: 635/2366 symbols completed. DMO took 22.4s. Estimated remaining: 3h 38m 47s. Rate: 7.9 symbols/min [2025-10-28T18:20:18.813778] [INFO ] [MAIN ] DNP: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:20:18.842541] [DEBUG] [LOCAL ] DNP: Loaded 32861 existing records from primary storage. [2025-10-28T18:20:18.842829] [INFO ] [MAIN ] DNP: Loaded 32861 existing records. [2025-10-28T18:20:19.018079] [WARN ] [MAIN ] DNP: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:20:19.018371] [INFO ] [MAIN ] DNP: Wiping existing primary data before full refresh. [2025-10-28T18:20:19.018428] [INFO ] [LOCAL ] DNP: Starting deletion of primary data. [2025-10-28T18:20:19.019068] [DEBUG] [LOCAL ] DNP: Deleted primary data file. [2025-10-28T18:20:19.019128] [INFO ] [MAIN ] DNP: Starting full primary refresh. [2025-10-28T18:20:19.167335] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-08. [2025-10-28T18:20:19.391797] [INFO ] [REMOTE ] DNP: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:20:19.419015] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-01 (3.46 seconds). [2025-10-28T18:20:19.748939] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-28T18:20:19.959314] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-02. [2025-10-28T18:20:20.028086] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-28T18:20:20.759326] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-01. [2025-10-28T18:20:21.030111] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-28T18:20:21.559377] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-08. [2025-10-28T18:20:21.975449] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-28T18:20:22.359337] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-09. [2025-10-28T18:20:23.159310] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-03. [2025-10-28T18:20:23.959341] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-02. [2025-10-28T18:20:24.152711] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-28T18:20:24.265312] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-28T18:20:24.759319] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-04. [2025-10-28T18:20:24.907018] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-28T18:20:25.559346] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-03. [2025-10-28T18:20:25.931924] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-28T18:20:26.359385] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-10. [2025-10-28T18:20:26.488083] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-28T18:20:26.967680] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-28T18:20:26.970418] [INFO ] [REMOTE ] DMB: Full fetch complete (14457 records). [2025-10-28T18:20:26.970489] [DEBUG] [VALIDATOR ] DMB: Validating primary data. [2025-10-28T18:20:26.970917] [FATAL] [VALIDATOR ] DMB: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T18:20:26.970998] [FATAL] [MAIN ] DMB: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:20:26.971058] [WARN ] [MAIN ] DMB: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:20:26.971136] [INFO ] [LOCAL ] DMB: Starting deletion of primary data. [2025-10-28T18:20:26.971224] [DEBUG] [LOCAL ] DMB: No primary data file found to delete. [2025-10-28T18:20:26.971274] [INFO ] [LOCAL ] DMB: Starting deletion of derivative data. [2025-10-28T18:20:26.971452] [DEBUG] [LOCAL ] DMB: Deleted derivative data file. [2025-10-28T18:20:26.971549] [INFO ] [MAIN ] Update Progress: 636/2366 symbols completed. DMB took 44.2s. Estimated remaining: 3h 38m 42s. Rate: 7.9 symbols/min [2025-10-28T18:20:27.141295] [INFO ] [MAIN ] DOC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:20:27.166134] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-04. [2025-10-28T18:20:27.190305] [DEBUG] [LOCAL ] DOC: Loaded 53554 existing records from primary storage. [2025-10-28T18:20:27.190599] [INFO ] [MAIN ] DOC: Loaded 53554 existing records. [2025-10-28T18:20:27.368809] [WARN ] [MAIN ] DOC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:20:27.369096] [INFO ] [MAIN ] DOC: Wiping existing primary data before full refresh. [2025-10-28T18:20:27.369147] [INFO ] [LOCAL ] DOC: Starting deletion of primary data. [2025-10-28T18:20:27.370087] [DEBUG] [LOCAL ] DOC: Deleted primary data file. [2025-10-28T18:20:27.370145] [INFO ] [MAIN ] DOC: Starting full primary refresh. [2025-10-28T18:20:27.724468] [INFO ] [REMOTE ] DOC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:20:27.959313] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-05. [2025-10-28T18:20:28.606514] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-08 (7.05 seconds). [2025-10-28T18:20:28.759378] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-09. [2025-10-28T18:20:29.196631] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-28T18:20:29.559315] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-06. [2025-10-28T18:20:30.210964] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-28T18:20:30.359323] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-01. [2025-10-28T18:20:30.460373] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-28T18:20:31.159342] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-07. [2025-10-28T18:20:31.794675] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-28T18:20:31.935771] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-04 (4.77 seconds). [2025-10-28T18:20:31.959291] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-05. [2025-10-28T18:20:32.386572] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-28T18:20:32.759343] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-08. [2025-10-28T18:20:33.559316] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-10. [2025-10-28T18:20:33.834465] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-28T18:20:34.359400] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-09. [2025-10-28T18:20:35.159312] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-02. [2025-10-28T18:20:35.361848] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-28T18:20:35.372042] [INFO ] [REMOTE ] DNA: Full fetch complete (71074 records). [2025-10-28T18:20:35.372173] [DEBUG] [VALIDATOR ] DNA: Validating primary data. [2025-10-28T18:20:35.781941] [DEBUG] [VALIDATOR ] DNA: All expected trading days are present. [2025-10-28T18:20:35.790503] [DEBUG] [VALIDATOR ] DNA: Primary data validation passed. [2025-10-28T18:20:35.791464] [INFO ] [MAIN ] DNA: Fetched primary data is valid. [2025-10-28T18:20:35.791544] [DEBUG] [LOCAL ] DNA: Saving primary data. [2025-10-28T18:20:35.793854] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-28T18:20:35.803925] [DEBUG] [LOCAL ] DNA: Trimmed 71074 records to 48345 (keeping 200 days of data) [2025-10-28T18:20:35.960335] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-10. [2025-10-28T18:20:36.075456] [DEBUG] [LOCAL ] DNA: Primary data saved (48345 records). [2025-10-28T18:20:36.075581] [INFO ] [MAIN ] DNA: Full history saved. [2025-10-28T18:20:36.075687] [INFO ] [MAIN ] Update Progress: 637/2366 symbols completed. DNA took 33.1s. Estimated remaining: 3h 38m 38s. Rate: 7.9 symbols/min [2025-10-28T18:20:36.375816] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-05 (4.42 seconds). [2025-10-28T18:20:36.410853] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-28T18:20:36.759387] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-03. [2025-10-28T18:20:37.559370] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-06. [2025-10-28T18:20:38.509453] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-28T18:20:38.516005] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-07. [2025-10-28T18:20:38.952188] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-10 (2.99 seconds). [2025-10-28T18:20:38.961282] [INFO ] [REMOTE ] DNOW: Full fetch complete (63891 records). [2025-10-28T18:20:38.961383] [DEBUG] [VALIDATOR ] DNOW: Validating primary data. [2025-10-28T18:20:39.349257] [DEBUG] [VALIDATOR ] DNOW: All expected trading days are present. [2025-10-28T18:20:39.349337] [DEBUG] [VALIDATOR ] DNOW: Primary data validation passed. [2025-10-28T18:20:39.350132] [INFO ] [MAIN ] DNOW: Fetched primary data is valid. [2025-10-28T18:20:39.350193] [DEBUG] [LOCAL ] DNOW: Saving primary data. [2025-10-28T18:20:39.351440] [DEBUG] [LOCAL ] DNOW: Trimmed 63891 records to 43622 (keeping 200 days of data) [2025-10-28T18:20:39.600169] [DEBUG] [LOCAL ] DNOW: Primary data saved (43622 records). [2025-10-28T18:20:39.600294] [INFO ] [MAIN ] DNOW: Full history saved. [2025-10-28T18:20:39.600362] [INFO ] [MAIN ] Update Progress: 638/2366 symbols completed. DNOW took 27.9s. Estimated remaining: 3h 38m 20s. Rate: 7.9 symbols/min [2025-10-28T18:20:40.235046] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-03 (3.48 seconds). [2025-10-28T18:20:40.246377] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-28T18:20:40.261024] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-04. [2025-10-28T18:20:40.262848] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-08. [2025-10-28T18:20:41.143871] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-28T18:20:41.151436] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-09. [2025-10-28T18:20:41.680045] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-28T18:20:41.691067] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-05. [2025-10-28T18:20:42.076902] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-28T18:20:42.359392] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-10. [2025-10-28T18:20:43.100746] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-28T18:20:43.159317] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-06. [2025-10-28T18:20:43.487208] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-28T18:20:43.493751] [INFO ] [REMOTE ] DNP: Full fetch complete (48397 records). [2025-10-28T18:20:43.493843] [DEBUG] [VALIDATOR ] DNP: Validating primary data. [2025-10-28T18:20:43.860571] [DEBUG] [VALIDATOR ] DNP: All expected trading days are present. [2025-10-28T18:20:43.860666] [DEBUG] [VALIDATOR ] DNP: Primary data validation passed. [2025-10-28T18:20:43.861299] [INFO ] [MAIN ] DNP: Fetched primary data is valid. [2025-10-28T18:20:43.861340] [DEBUG] [LOCAL ] DNP: Saving primary data. [2025-10-28T18:20:43.862314] [DEBUG] [LOCAL ] DNP: Trimmed 48397 records to 32822 (keeping 200 days of data) [2025-10-28T18:20:44.051211] [DEBUG] [LOCAL ] DNP: Primary data saved (32822 records). [2025-10-28T18:20:44.051338] [INFO ] [MAIN ] DNP: Full history saved. [2025-10-28T18:20:44.051415] [INFO ] [MAIN ] Update Progress: 639/2366 symbols completed. DNP took 25.4s. Estimated remaining: 3h 38m 4s. Rate: 7.9 symbols/min [2025-10-28T18:20:44.407159] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-28T18:20:44.417904] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-07. [2025-10-28T18:20:45.900680] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-28T18:20:45.913942] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-08. [2025-10-28T18:20:47.303768] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-28T18:20:47.314951] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-09. [2025-10-28T18:20:48.658349] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-28T18:20:48.669677] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-10. [2025-10-28T18:20:50.214782] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-28T18:20:50.225495] [INFO ] [REMOTE ] DOC: Full fetch complete (77599 records). [2025-10-28T18:20:50.225685] [DEBUG] [VALIDATOR ] DOC: Validating primary data. [2025-10-28T18:20:50.614266] [DEBUG] [VALIDATOR ] DOC: All expected trading days are present. [2025-10-28T18:20:50.614343] [DEBUG] [VALIDATOR ] DOC: Primary data validation passed. [2025-10-28T18:20:50.615289] [INFO ] [MAIN ] DOC: Fetched primary data is valid. [2025-10-28T18:20:50.615352] [DEBUG] [LOCAL ] DOC: Saving primary data. [2025-10-28T18:20:50.616884] [DEBUG] [LOCAL ] DOC: Trimmed 77599 records to 53554 (keeping 200 days of data) [2025-10-28T18:20:50.947692] [DEBUG] [LOCAL ] DOC: Primary data saved (53554 records). [2025-10-28T18:20:50.947826] [INFO ] [MAIN ] DOC: Full history saved. [2025-10-28T18:20:50.947905] [INFO ] [MAIN ] Update Progress: 640/2366 symbols completed. DOC took 24.0s. Estimated remaining: 3h 37m 54s. Rate: 7.9 symbols/min [2025-10-28T18:20:51.479914] [INFO ] [MAIN ] DOCS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:20:51.571951] [INFO ] [MAIN ] DOUG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:20:51.607767] [INFO ] [MAIN ] DOCN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:20:51.634155] [INFO ] [MAIN ] DOLE: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:20:51.634551] [DEBUG] [LOCAL ] DOLE: No existing data file found in primary storage. [2025-10-28T18:20:51.634595] [WARN ] [MAIN ] DOLE: No existing data found, performing full refresh instead. [2025-10-28T18:20:51.634701] [INFO ] [MAIN ] DOLE: Wiping existing primary data before full refresh. [2025-10-28T18:20:51.634751] [INFO ] [LOCAL ] DOLE: Starting deletion of primary data. [2025-10-28T18:20:51.634792] [DEBUG] [LOCAL ] DOLE: No primary data file found to delete. [2025-10-28T18:20:51.634822] [INFO ] [MAIN ] DOLE: Starting full primary refresh. [2025-10-28T18:20:51.838884] [DEBUG] [LOCAL ] DOUG: Loaded 33433 existing records from primary storage. [2025-10-28T18:20:51.862893] [DEBUG] [LOCAL ] DOCS: Loaded 50150 existing records from primary storage. [2025-10-28T18:20:51.885340] [INFO ] [MAIN ] DOUG: Loaded 33433 existing records. [2025-10-28T18:20:51.892285] [INFO ] [MAIN ] DOCS: Loaded 50150 existing records. [2025-10-28T18:20:52.144900] [DEBUG] [LOCAL ] DOCN: Loaded 51095 existing records from primary storage. [2025-10-28T18:20:52.187090] [INFO ] [MAIN ] DOCN: Loaded 51095 existing records. [2025-10-28T18:20:52.422285] [INFO ] [REMOTE ] DOLE: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:20:52.477903] [WARN ] [MAIN ] DOUG: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:20:52.491832] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-01. [2025-10-28T18:20:52.535435] [INFO ] [MAIN ] DOUG: Wiping existing primary data before full refresh. [2025-10-28T18:20:52.536405] [INFO ] [LOCAL ] DOUG: Starting deletion of primary data. [2025-10-28T18:20:52.550945] [DEBUG] [LOCAL ] DOUG: Deleted primary data file. [2025-10-28T18:20:52.554432] [INFO ] [MAIN ] DOUG: Starting full primary refresh. [2025-10-28T18:20:52.554293] [WARN ] [MAIN ] DOCS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:20:52.588827] [INFO ] [MAIN ] DOCS: Wiping existing primary data before full refresh. [2025-10-28T18:20:52.594100] [INFO ] [LOCAL ] DOCS: Starting deletion of primary data. [2025-10-28T18:20:52.616615] [DEBUG] [LOCAL ] DOCS: Deleted primary data file. [2025-10-28T18:20:52.616848] [INFO ] [MAIN ] DOCS: Starting full primary refresh. [2025-10-28T18:20:52.846247] [WARN ] [MAIN ] DOCN: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:20:52.910513] [INFO ] [MAIN ] DOCN: Wiping existing primary data before full refresh. [2025-10-28T18:20:52.935628] [INFO ] [LOCAL ] DOCN: Starting deletion of primary data. [2025-10-28T18:20:52.948868] [DEBUG] [LOCAL ] DOCN: Deleted primary data file. [2025-10-28T18:20:53.019703] [INFO ] [MAIN ] DOCN: Starting full primary refresh. [2025-10-28T18:20:53.447395] [INFO ] [REMOTE ] DOUG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:20:53.487138] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-01. [2025-10-28T18:20:53.557724] [INFO ] [REMOTE ] DOCS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:20:53.559879] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-01. [2025-10-28T18:20:53.781889] [INFO ] [REMOTE ] DOCN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:20:53.782193] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-01. [2025-10-28T18:20:54.431557] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-28T18:20:54.438860] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-02. [2025-10-28T18:20:54.797037] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-28T18:20:54.806566] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-02. [2025-10-28T18:20:55.217023] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-28T18:20:55.227339] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-02. [2025-10-28T18:20:55.357584] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-28T18:20:55.364548] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-03. [2025-10-28T18:20:55.940350] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-01 (3.45 seconds). [2025-10-28T18:20:55.947492] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-02. [2025-10-28T18:20:56.325624] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-28T18:20:56.334007] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-04. [2025-10-28T18:20:56.365173] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-10-28T18:20:56.376229] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-03. [2025-10-28T18:20:56.407064] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-28T18:20:56.416524] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-03. [2025-10-28T18:20:56.993631] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-28T18:20:56.999984] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-03. [2025-10-28T18:20:57.115127] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-28T18:20:57.559302] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-05. [2025-10-28T18:20:57.697850] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-28T18:20:58.359316] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-04. [2025-10-28T18:20:58.612065] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-28T18:20:59.160893] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-06. [2025-10-28T18:20:59.163534] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-10-28T18:20:59.638265] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-28T18:20:59.959326] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-05. [2025-10-28T18:21:00.161447] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-28T18:21:00.367723] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-03 (3.95 seconds). [2025-10-28T18:21:00.759341] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-04. [2025-10-28T18:21:01.559307] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-04. [2025-10-28T18:21:01.707715] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-10-28T18:21:01.940941] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-28T18:21:02.359380] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-07. [2025-10-28T18:21:02.598329] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-28T18:21:03.159359] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-05. [2025-10-28T18:21:03.959420] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-06. [2025-10-28T18:21:04.636665] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-28T18:21:04.759361] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-06. [2025-10-28T18:21:05.414899] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-28T18:21:05.559391] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-07. [2025-10-28T18:21:05.719978] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-28T18:21:06.263799] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-07 (3.90 seconds). [2025-10-28T18:21:06.359344] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-07. [2025-10-28T18:21:06.857002] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-28T18:21:07.159417] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-08. [2025-10-28T18:21:07.397472] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-28T18:21:07.959363] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-05. [2025-10-28T18:21:08.759355] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-08. [2025-10-28T18:21:09.016822] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-28T18:21:09.542151] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-28T18:21:09.559369] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-08. [2025-10-28T18:21:10.173456] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-28T18:21:10.359324] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-09. [2025-10-28T18:21:10.456040] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-28T18:21:11.159337] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-09. [2025-10-28T18:21:11.734227] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-28T18:21:11.959362] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-09. [2025-10-28T18:21:12.358213] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-28T18:21:12.759361] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-10. [2025-10-28T18:21:13.559320] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-10. [2025-10-28T18:21:14.341547] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-09 (2.38 seconds). [2025-10-28T18:21:14.359346] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-06. [2025-10-28T18:21:14.916253] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-10 (2.16 seconds). [2025-10-28T18:21:14.923189] [INFO ] [REMOTE ] DOUG: Full fetch complete (49381 records). [2025-10-28T18:21:14.923669] [DEBUG] [VALIDATOR ] DOUG: Validating primary data. [2025-10-28T18:21:15.063260] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-28T18:21:15.113218] [INFO ] [REMOTE ] DOCS: Full fetch complete (73576 records). [2025-10-28T18:21:15.163885] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-10. [2025-10-28T18:21:15.148808] [DEBUG] [VALIDATOR ] DOCS: Validating primary data. [2025-10-28T18:21:15.594428] [DEBUG] [VALIDATOR ] DOUG: All expected trading days are present. [2025-10-28T18:21:15.613342] [DEBUG] [VALIDATOR ] DOUG: Primary data validation passed. [2025-10-28T18:21:15.628406] [INFO ] [MAIN ] DOUG: Fetched primary data is valid. [2025-10-28T18:21:15.638122] [DEBUG] [LOCAL ] DOUG: Saving primary data. [2025-10-28T18:21:15.706173] [DEBUG] [LOCAL ] DOUG: Trimmed 49381 records to 33370 (keeping 200 days of data) [2025-10-28T18:21:15.902587] [DEBUG] [VALIDATOR ] DOCS: All expected trading days are present. [2025-10-28T18:21:15.909803] [DEBUG] [VALIDATOR ] DOCS: Primary data validation passed. [2025-10-28T18:21:15.920254] [INFO ] [MAIN ] DOCS: Fetched primary data is valid. [2025-10-28T18:21:15.920364] [DEBUG] [LOCAL ] DOCS: Saving primary data. [2025-10-28T18:21:15.962716] [DEBUG] [LOCAL ] DOCS: Trimmed 73576 records to 50085 (keeping 200 days of data) [2025-10-28T18:21:16.123788] [DEBUG] [LOCAL ] DOUG: Primary data saved (33370 records). [2025-10-28T18:21:16.125284] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-10-28T18:21:16.124358] [INFO ] [MAIN ] DOUG: Full history saved. [2025-10-28T18:21:16.135546] [INFO ] [MAIN ] Update Progress: 641/2366 symbols completed. DOUG took 25.2s. Estimated remaining: 3h 38m 34s. Rate: 7.9 symbols/min [2025-10-28T18:21:16.161238] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-07. [2025-10-28T18:21:16.474180] [INFO ] [MAIN ] DOV: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:21:16.492458] [DEBUG] [LOCAL ] DOV: No existing data file found in primary storage. [2025-10-28T18:21:16.497189] [WARN ] [MAIN ] DOV: No existing data found, performing full refresh instead. [2025-10-28T18:21:16.500113] [INFO ] [MAIN ] DOV: Wiping existing primary data before full refresh. [2025-10-28T18:21:16.500701] [INFO ] [LOCAL ] DOV: Starting deletion of primary data. [2025-10-28T18:21:16.509132] [DEBUG] [LOCAL ] DOV: No primary data file found to delete. [2025-10-28T18:21:16.509218] [INFO ] [MAIN ] DOV: Starting full primary refresh. [2025-10-28T18:21:16.509022] [DEBUG] [LOCAL ] DOCS: Primary data saved (50085 records). [2025-10-28T18:21:16.545442] [INFO ] [MAIN ] DOCS: Full history saved. [2025-10-28T18:21:16.552579] [INFO ] [MAIN ] Update Progress: 642/2366 symbols completed. DOCS took 25.6s. Estimated remaining: 3h 38m 7s. Rate: 7.9 symbols/min [2025-10-28T18:21:16.959485] [INFO ] [MAIN ] DOW: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:21:17.079774] [INFO ] [REMOTE ] DOV: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:21:17.080224] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-01. [2025-10-28T18:21:17.083093] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-28T18:21:17.093237] [INFO ] [REMOTE ] DOLE: Full fetch complete (54711 records). [2025-10-28T18:21:17.093430] [DEBUG] [VALIDATOR ] DOLE: Validating primary data. [2025-10-28T18:21:17.338607] [DEBUG] [LOCAL ] DOW: Loaded 53733 existing records from primary storage. [2025-10-28T18:21:17.387445] [INFO ] [MAIN ] DOW: Loaded 53733 existing records. [2025-10-28T18:21:17.669858] [DEBUG] [VALIDATOR ] DOLE: All expected trading days are present. [2025-10-28T18:21:17.675336] [DEBUG] [VALIDATOR ] DOLE: Primary data validation passed. [2025-10-28T18:21:17.686797] [INFO ] [MAIN ] DOLE: Fetched primary data is valid. [2025-10-28T18:21:17.697602] [DEBUG] [LOCAL ] DOLE: Saving primary data. [2025-10-28T18:21:17.762277] [WARN ] [MAIN ] DOW: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:21:17.762753] [INFO ] [MAIN ] DOW: Wiping existing primary data before full refresh. [2025-10-28T18:21:17.762926] [INFO ] [LOCAL ] DOW: Starting deletion of primary data. [2025-10-28T18:21:17.763901] [DEBUG] [LOCAL ] DOW: Deleted primary data file. [2025-10-28T18:21:17.764075] [INFO ] [MAIN ] DOW: Starting full primary refresh. [2025-10-28T18:21:17.763826] [DEBUG] [LOCAL ] DOLE: Trimmed 54711 records to 39074 (keeping 200 days of data) [2025-10-28T18:21:18.340085] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-10-28T18:21:18.382176] [DEBUG] [LOCAL ] DOLE: Primary data saved (39074 records). [2025-10-28T18:21:18.409949] [INFO ] [MAIN ] DOLE: Full history saved. [2025-10-28T18:21:18.429429] [INFO ] [REMOTE ] DOW: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:21:18.430620] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-01. [2025-10-28T18:21:18.430307] [INFO ] [MAIN ] Update Progress: 643/2366 symbols completed. DOLE took 27.5s. Estimated remaining: 3h 37m 44s. Rate: 7.9 symbols/min [2025-10-28T18:21:18.430011] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-08. [2025-10-28T18:21:18.607292] [INFO ] [MAIN ] DPG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:21:18.632076] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-28T18:21:18.650838] [DEBUG] [LOCAL ] DPG: Loaded 13105 existing records from primary storage. [2025-10-28T18:21:18.651074] [INFO ] [MAIN ] DPG: Loaded 13105 existing records. [2025-10-28T18:21:18.834160] [WARN ] [MAIN ] DPG: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:21:18.834341] [INFO ] [MAIN ] DPG: Wiping existing primary data before full refresh. [2025-10-28T18:21:18.834389] [INFO ] [LOCAL ] DPG: Starting deletion of primary data. [2025-10-28T18:21:18.834559] [DEBUG] [LOCAL ] DPG: Deleted primary data file. [2025-10-28T18:21:18.834600] [INFO ] [MAIN ] DPG: Starting full primary refresh. [2025-10-28T18:21:19.170256] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-02. [2025-10-28T18:21:19.193817] [INFO ] [REMOTE ] DPG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:21:19.910218] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-28T18:21:19.959306] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-02. [2025-10-28T18:21:20.209010] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-28T18:21:20.759312] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-03. [2025-10-28T18:21:21.435716] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-28T18:21:21.559365] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-01. [2025-10-28T18:21:21.840818] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-08 (3.41 seconds). [2025-10-28T18:21:21.988446] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-28T18:21:22.359363] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-09. [2025-10-28T18:21:22.682829] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-28T18:21:23.159364] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-04. [2025-10-28T18:21:23.754442] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-28T18:21:23.959321] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-03. [2025-10-28T18:21:24.759373] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-02. [2025-10-28T18:21:25.553146] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-28T18:21:25.563720] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-10. [2025-10-28T18:21:26.359381] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-04. [2025-10-28T18:21:27.061048] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-04 (3.90 seconds). [2025-10-28T18:21:27.159352] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-05. [2025-10-28T18:21:27.252318] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-02 (2.49 seconds). [2025-10-28T18:21:27.958379] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-28T18:21:27.969564] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-03. [2025-10-28T18:21:28.583999] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-28T18:21:28.759323] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-05. [2025-10-28T18:21:28.939294] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-10 (3.38 seconds). [2025-10-28T18:21:28.949767] [INFO ] [REMOTE ] DOCN: Full fetch complete (73166 records). [2025-10-28T18:21:28.949911] [DEBUG] [VALIDATOR ] DOCN: Validating primary data. [2025-10-28T18:21:29.340207] [DEBUG] [VALIDATOR ] DOCN: All expected trading days are present. [2025-10-28T18:21:29.340341] [DEBUG] [VALIDATOR ] DOCN: Primary data validation passed. [2025-10-28T18:21:29.341201] [INFO ] [MAIN ] DOCN: Fetched primary data is valid. [2025-10-28T18:21:29.341322] [DEBUG] [LOCAL ] DOCN: Saving primary data. [2025-10-28T18:21:29.342901] [DEBUG] [LOCAL ] DOCN: Trimmed 73166 records to 51087 (keeping 200 days of data) [2025-10-28T18:21:29.563524] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-04. [2025-10-28T18:21:29.632718] [DEBUG] [LOCAL ] DOCN: Primary data saved (51087 records). [2025-10-28T18:21:29.632819] [INFO ] [MAIN ] DOCN: Full history saved. [2025-10-28T18:21:29.632893] [INFO ] [MAIN ] Update Progress: 644/2366 symbols completed. DOCN took 38.7s. Estimated remaining: 3h 37m 46s. Rate: 7.9 symbols/min [2025-10-28T18:21:29.802122] [INFO ] [MAIN ] DQ: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:21:29.843597] [DEBUG] [LOCAL ] DQ: Loaded 43643 existing records from primary storage. [2025-10-28T18:21:29.843900] [INFO ] [MAIN ] DQ: Loaded 43643 existing records. [2025-10-28T18:21:29.973870] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-05 (2.81 seconds). [2025-10-28T18:21:30.057993] [WARN ] [MAIN ] DQ: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:21:30.058180] [INFO ] [MAIN ] DQ: Wiping existing primary data before full refresh. [2025-10-28T18:21:30.058227] [INFO ] [LOCAL ] DQ: Starting deletion of primary data. [2025-10-28T18:21:30.058579] [DEBUG] [LOCAL ] DQ: Deleted primary data file. [2025-10-28T18:21:30.058618] [INFO ] [MAIN ] DQ: Starting full primary refresh. [2025-10-28T18:21:30.361589] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-06. [2025-10-28T18:21:30.414703] [INFO ] [REMOTE ] DQ: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:21:30.509856] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-28T18:21:31.159325] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-01. [2025-10-28T18:21:31.522396] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-28T18:21:31.959384] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-07. [2025-10-28T18:21:32.366341] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-05 (3.61 seconds). [2025-10-28T18:21:32.759316] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-05. [2025-10-28T18:21:33.131525] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-28T18:21:33.532992] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-28T18:21:33.559298] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-06. [2025-10-28T18:21:34.104582] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-01 (2.95 seconds). [2025-10-28T18:21:34.359316] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-06. [2025-10-28T18:21:34.478517] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-28T18:21:35.159360] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-07. [2025-10-28T18:21:35.757673] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-28T18:21:35.959315] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-08. [2025-10-28T18:21:36.531311] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-28T18:21:36.759302] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-09. [2025-10-28T18:21:37.328763] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-28T18:21:37.559313] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-10. [2025-10-28T18:21:37.631349] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-06 (3.27 seconds). [2025-10-28T18:21:38.359308] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-08. [2025-10-28T18:21:38.577762] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-28T18:21:38.580581] [INFO ] [REMOTE ] DPG: Full fetch complete (18966 records). [2025-10-28T18:21:38.580718] [DEBUG] [VALIDATOR ] DPG: Validating primary data. [2025-10-28T18:21:38.941449] [DEBUG] [VALIDATOR ] DPG: All expected trading days are present. [2025-10-28T18:21:38.941524] [DEBUG] [VALIDATOR ] DPG: Primary data validation passed. [2025-10-28T18:21:38.941968] [INFO ] [MAIN ] DPG: Fetched primary data is valid. [2025-10-28T18:21:38.942029] [DEBUG] [LOCAL ] DPG: Saving primary data. [2025-10-28T18:21:38.942559] [DEBUG] [LOCAL ] DPG: Trimmed 18966 records to 13104 (keeping 200 days of data) [2025-10-28T18:21:39.021867] [DEBUG] [LOCAL ] DPG: Primary data saved (13104 records). [2025-10-28T18:21:39.021998] [INFO ] [MAIN ] DPG: Full history saved. [2025-10-28T18:21:39.022075] [INFO ] [MAIN ] Update Progress: 645/2366 symbols completed. DPG took 20.6s. Estimated remaining: 3h 37m 44s. Rate: 7.9 symbols/min [2025-10-28T18:21:39.167560] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-07. [2025-10-28T18:21:39.194125] [INFO ] [MAIN ] DRD: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:21:39.231896] [DEBUG] [LOCAL ] DRD: Loaded 37947 existing records from primary storage. [2025-10-28T18:21:39.232157] [INFO ] [MAIN ] DRD: Loaded 37947 existing records. [2025-10-28T18:21:39.416448] [WARN ] [MAIN ] DRD: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:21:39.416735] [INFO ] [MAIN ] DRD: Wiping existing primary data before full refresh. [2025-10-28T18:21:39.416796] [INFO ] [LOCAL ] DRD: Starting deletion of primary data. [2025-10-28T18:21:39.417341] [DEBUG] [LOCAL ] DRD: Deleted primary data file. [2025-10-28T18:21:39.417398] [INFO ] [MAIN ] DRD: Starting full primary refresh. [2025-10-28T18:21:39.772192] [INFO ] [REMOTE ] DRD: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:21:39.796311] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-28T18:21:39.959304] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-02. [2025-10-28T18:21:40.759365] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-09. [2025-10-28T18:21:40.832542] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-10-28T18:21:41.098318] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-28T18:21:41.559345] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-03. [2025-10-28T18:21:42.146998] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-28T18:21:42.359397] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-08. [2025-10-28T18:21:43.159322] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-01. [2025-10-28T18:21:43.204130] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-28T18:21:43.959321] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-04. [2025-10-28T18:21:44.073094] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-28T18:21:44.166371] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-28T18:21:44.759386] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-02. [2025-10-28T18:21:45.124930] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-28T18:21:45.559357] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-05. [2025-10-28T18:21:45.783809] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-28T18:21:46.359357] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-09. [2025-10-28T18:21:46.645953] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-28T18:21:47.159360] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-06. [2025-10-28T18:21:47.872130] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-28T18:21:47.959302] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-10. [2025-10-28T18:21:48.128960] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-28T18:21:48.759373] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-10. [2025-10-28T18:21:49.559329] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-03. [2025-10-28T18:21:50.322587] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-28T18:21:50.332152] [INFO ] [REMOTE ] DOV: Full fetch complete (66380 records). [2025-10-28T18:21:50.332266] [DEBUG] [VALIDATOR ] DOV: Validating primary data. [2025-10-28T18:21:50.364515] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-07. [2025-10-28T18:21:50.739756] [DEBUG] [VALIDATOR ] DOV: All expected trading days are present. [2025-10-28T18:21:50.739840] [DEBUG] [VALIDATOR ] DOV: Primary data validation passed. [2025-10-28T18:21:50.740711] [INFO ] [MAIN ] DOV: Fetched primary data is valid. [2025-10-28T18:21:50.740794] [DEBUG] [LOCAL ] DOV: Saving primary data. [2025-10-28T18:21:50.768957] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-28T18:21:50.777805] [DEBUG] [LOCAL ] DOV: Trimmed 66380 records to 45528 (keeping 200 days of data) [2025-10-28T18:21:51.062558] [DEBUG] [LOCAL ] DOV: Primary data saved (45528 records). [2025-10-28T18:21:51.062696] [INFO ] [MAIN ] DOV: Full history saved. [2025-10-28T18:21:51.062785] [INFO ] [MAIN ] Update Progress: 646/2366 symbols completed. DOV took 34.9s. Estimated remaining: 3h 37m 48s. Rate: 7.9 symbols/min [2025-10-28T18:21:51.163815] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-04. [2025-10-28T18:21:51.234568] [INFO ] [MAIN ] DRH: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:21:51.276499] [DEBUG] [LOCAL ] DRH: Loaded 50096 existing records from primary storage. [2025-10-28T18:21:51.304053] [INFO ] [MAIN ] DRH: Loaded 50096 existing records. [2025-10-28T18:21:51.382517] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-10 (3.42 seconds). [2025-10-28T18:21:51.430678] [INFO ] [REMOTE ] DOW: Full fetch complete (77910 records). [2025-10-28T18:21:51.446197] [DEBUG] [VALIDATOR ] DOW: Validating primary data. [2025-10-28T18:21:51.594696] [WARN ] [MAIN ] DRH: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:21:51.614923] [INFO ] [MAIN ] DRH: Wiping existing primary data before full refresh. [2025-10-28T18:21:51.618301] [INFO ] [LOCAL ] DRH: Starting deletion of primary data. [2025-10-28T18:21:51.624227] [DEBUG] [LOCAL ] DRH: Deleted primary data file. [2025-10-28T18:21:51.645008] [INFO ] [MAIN ] DRH: Starting full primary refresh. [2025-10-28T18:21:52.195810] [DEBUG] [VALIDATOR ] DOW: All expected trading days are present. [2025-10-28T18:21:52.206328] [DEBUG] [VALIDATOR ] DOW: Primary data validation passed. [2025-10-28T18:21:52.228266] [INFO ] [MAIN ] DOW: Fetched primary data is valid. [2025-10-28T18:21:52.233636] [DEBUG] [LOCAL ] DOW: Saving primary data. [2025-10-28T18:21:52.319345] [INFO ] [REMOTE ] DRH: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:21:52.320229] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-01. [2025-10-28T18:21:52.319944] [DEBUG] [LOCAL ] DOW: Trimmed 77910 records to 53733 (keeping 200 days of data) [2025-10-28T18:21:52.351492] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-10-28T18:21:52.495524] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-28T18:21:52.726520] [DEBUG] [LOCAL ] DOW: Primary data saved (53733 records). [2025-10-28T18:21:52.726691] [INFO ] [MAIN ] DOW: Full history saved. [2025-10-28T18:21:52.726820] [INFO ] [MAIN ] Update Progress: 647/2366 symbols completed. DOW took 36.2s. Estimated remaining: 3h 37m 25s. Rate: 7.9 symbols/min [2025-10-28T18:21:52.769076] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-08. [2025-10-28T18:21:52.896399] [INFO ] [MAIN ] DRI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:21:52.936949] [DEBUG] [LOCAL ] DRI: Loaded 47373 existing records from primary storage. [2025-10-28T18:21:52.937230] [INFO ] [MAIN ] DRI: Loaded 47373 existing records. [2025-10-28T18:21:53.113196] [WARN ] [MAIN ] DRI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:21:53.113399] [INFO ] [MAIN ] DRI: Wiping existing primary data before full refresh. [2025-10-28T18:21:53.113454] [INFO ] [LOCAL ] DRI: Starting deletion of primary data. [2025-10-28T18:21:53.114266] [DEBUG] [LOCAL ] DRI: Deleted primary data file. [2025-10-28T18:21:53.114324] [INFO ] [MAIN ] DRI: Starting full primary refresh. [2025-10-28T18:21:53.468957] [INFO ] [REMOTE ] DRI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:21:53.559297] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-05. [2025-10-28T18:21:54.025767] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-28T18:21:54.359308] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-01. [2025-10-28T18:21:54.490586] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-28T18:21:55.159336] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-09. [2025-10-28T18:21:55.348762] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-01 (3.03 seconds). [2025-10-28T18:21:55.662778] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-28T18:21:55.959334] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-02. [2025-10-28T18:21:56.405800] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-28T18:21:56.759360] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-02. [2025-10-28T18:21:57.559311] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-10. [2025-10-28T18:21:57.854182] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-28T18:21:58.359327] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-03. [2025-10-28T18:21:59.006688] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-28T18:21:59.016385] [INFO ] [REMOTE ] DQ: Full fetch complete (63786 records). [2025-10-28T18:21:59.016505] [DEBUG] [VALIDATOR ] DQ: Validating primary data. [2025-10-28T18:21:59.164507] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-06. [2025-10-28T18:21:59.411967] [DEBUG] [VALIDATOR ] DQ: All expected trading days are present. [2025-10-28T18:21:59.412124] [DEBUG] [VALIDATOR ] DQ: Primary data validation passed. [2025-10-28T18:21:59.412957] [INFO ] [MAIN ] DQ: Fetched primary data is valid. [2025-10-28T18:21:59.413018] [DEBUG] [LOCAL ] DQ: Saving primary data. [2025-10-28T18:21:59.414259] [DEBUG] [LOCAL ] DQ: Trimmed 63786 records to 43647 (keeping 200 days of data) [2025-10-28T18:21:59.546223] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-02 (3.59 seconds). [2025-10-28T18:21:59.695104] [DEBUG] [LOCAL ] DQ: Primary data saved (43647 records). [2025-10-28T18:21:59.695221] [INFO ] [MAIN ] DQ: Full history saved. [2025-10-28T18:21:59.695298] [INFO ] [MAIN ] Update Progress: 648/2366 symbols completed. DQ took 30.1s. Estimated remaining: 3h 37m 15s. Rate: 7.9 symbols/min [2025-10-28T18:21:59.863071] [INFO ] [MAIN ] DRLL: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:21:59.871466] [DEBUG] [LOCAL ] DRLL: Loaded 8444 existing records from primary storage. [2025-10-28T18:21:59.871670] [INFO ] [MAIN ] DRLL: Loaded 8444 existing records. [2025-10-28T18:21:59.964513] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-03. [2025-10-28T18:22:00.054899] [WARN ] [MAIN ] DRLL: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:22:00.055553] [INFO ] [MAIN ] DRLL: Wiping existing primary data before full refresh. [2025-10-28T18:22:00.055613] [INFO ] [LOCAL ] DRLL: Starting deletion of primary data. [2025-10-28T18:22:00.055907] [DEBUG] [LOCAL ] DRLL: Deleted primary data file. [2025-10-28T18:22:00.055960] [INFO ] [MAIN ] DRLL: Starting full primary refresh. [2025-10-28T18:22:00.407278] [INFO ] [REMOTE ] DRLL: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:22:00.759331] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-01. [2025-10-28T18:22:01.574759] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-28T18:22:01.577583] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-02. [2025-10-28T18:22:02.122696] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-28T18:22:02.359398] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-03. [2025-10-28T18:22:03.092024] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-03 (4.73 seconds). [2025-10-28T18:22:03.159304] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-04. [2025-10-28T18:22:03.650294] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-03 (3.69 seconds). [2025-10-28T18:22:03.959420] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-04. [2025-10-28T18:22:04.552103] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-28T18:22:04.759312] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-05. [2025-10-28T18:22:04.884439] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-03 (2.53 seconds). [2025-10-28T18:22:05.203328] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-28T18:22:05.507556] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-06 (6.34 seconds). [2025-10-28T18:22:05.559305] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-04. [2025-10-28T18:22:06.017267] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-28T18:22:06.089437] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-28T18:22:06.359332] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-05. [2025-10-28T18:22:06.838369] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-28T18:22:07.159334] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-06. [2025-10-28T18:22:07.959385] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-06. [2025-10-28T18:22:08.759383] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-05. [2025-10-28T18:22:09.070617] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-28T18:22:09.559408] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-07. [2025-10-28T18:22:10.035383] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-28T18:22:10.359415] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-07. [2025-10-28T18:22:10.598089] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-06 (3.44 seconds). [2025-10-28T18:22:11.159320] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-06. [2025-10-28T18:22:11.460176] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-28T18:22:11.841305] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-07 (2.28 seconds). [2025-10-28T18:22:11.959368] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-08. [2025-10-28T18:22:12.759319] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-07. [2025-10-28T18:22:13.258001] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-28T18:22:13.489469] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-28T18:22:13.559385] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-08. [2025-10-28T18:22:13.839662] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-06 (2.68 seconds). [2025-10-28T18:22:14.082690] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-28T18:22:14.359406] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-07. [2025-10-28T18:22:15.159352] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-09. [2025-10-28T18:22:15.780087] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-28T18:22:15.782112] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-28T18:22:15.959391] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-08. [2025-10-28T18:22:16.759379] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-10. [2025-10-28T18:22:17.221029] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-28T18:22:17.559342] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-09. [2025-10-28T18:22:17.611799] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-28T18:22:17.613712] [INFO ] [REMOTE ] DRLL: Full fetch complete (14410 records). [2025-10-28T18:22:17.613782] [DEBUG] [VALIDATOR ] DRLL: Validating primary data. [2025-10-28T18:22:17.987546] [DEBUG] [VALIDATOR ] DRLL: All expected trading days are present. [2025-10-28T18:22:17.987623] [DEBUG] [VALIDATOR ] DRLL: Primary data validation passed. [2025-10-28T18:22:17.987986] [INFO ] [MAIN ] DRLL: Fetched primary data is valid. [2025-10-28T18:22:17.988041] [DEBUG] [LOCAL ] DRLL: Saving primary data. [2025-10-28T18:22:17.988529] [DEBUG] [LOCAL ] DRLL: Trimmed 14410 records to 8432 (keeping 200 days of data) [2025-10-28T18:22:18.043212] [DEBUG] [LOCAL ] DRLL: Primary data saved (8432 records). [2025-10-28T18:22:18.043393] [INFO ] [MAIN ] DRLL: Full history saved. [2025-10-28T18:22:18.043529] [INFO ] [MAIN ] Update Progress: 649/2366 symbols completed. DRLL took 18.3s. Estimated remaining: 3h 37m 36s. Rate: 7.9 symbols/min [2025-10-28T18:22:18.219390] [INFO ] [MAIN ] DSL: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:22:18.248469] [DEBUG] [LOCAL ] DSL: Loaded 28643 existing records from primary storage. [2025-10-28T18:22:18.248760] [INFO ] [MAIN ] DSL: Loaded 28643 existing records. [2025-10-28T18:22:18.364449] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-09. [2025-10-28T18:22:18.437303] [WARN ] [MAIN ] DSL: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:22:18.437506] [INFO ] [MAIN ] DSL: Wiping existing primary data before full refresh. [2025-10-28T18:22:18.437557] [INFO ] [LOCAL ] DSL: Starting deletion of primary data. [2025-10-28T18:22:18.438199] [DEBUG] [LOCAL ] DSL: Deleted primary data file. [2025-10-28T18:22:18.438259] [INFO ] [MAIN ] DSL: Starting full primary refresh. [2025-10-28T18:22:18.809861] [INFO ] [REMOTE ] DSL: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:22:18.998324] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-28T18:22:19.159321] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-08. [2025-10-28T18:22:19.925782] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-10-28T18:22:19.959374] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-10. [2025-10-28T18:22:20.631849] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-28T18:22:20.759371] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-01. [2025-10-28T18:22:21.536884] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-28T18:22:21.547922] [INFO ] [REMOTE ] DRD: Full fetch complete (52597 records). [2025-10-28T18:22:21.548694] [DEBUG] [VALIDATOR ] DRD: Validating primary data. [2025-10-28T18:22:21.560605] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-10. [2025-10-28T18:22:21.600622] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-28T18:22:21.966265] [DEBUG] [VALIDATOR ] DRD: All expected trading days are present. [2025-10-28T18:22:21.966386] [DEBUG] [VALIDATOR ] DRD: Primary data validation passed. [2025-10-28T18:22:21.967115] [INFO ] [MAIN ] DRD: Fetched primary data is valid. [2025-10-28T18:22:21.967186] [DEBUG] [LOCAL ] DRD: Saving primary data. [2025-10-28T18:22:21.968403] [DEBUG] [LOCAL ] DRD: Trimmed 52597 records to 37883 (keeping 200 days of data) [2025-10-28T18:22:22.207081] [DEBUG] [LOCAL ] DRD: Primary data saved (37883 records). [2025-10-28T18:22:22.207231] [INFO ] [MAIN ] DRD: Full history saved. [2025-10-28T18:22:22.207325] [INFO ] [MAIN ] Update Progress: 650/2366 symbols completed. DRD took 43.2s. Estimated remaining: 3h 37m 20s. Rate: 7.9 symbols/min [2025-10-28T18:22:22.375494] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-09. [2025-10-28T18:22:22.410073] [INFO ] [MAIN ] DSM: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:22:22.410253] [DEBUG] [LOCAL ] DSM: No existing data file found in primary storage. [2025-10-28T18:22:22.410296] [WARN ] [MAIN ] DSM: No existing data found, performing full refresh instead. [2025-10-28T18:22:22.410404] [INFO ] [MAIN ] DSM: Wiping existing primary data before full refresh. [2025-10-28T18:22:22.410445] [INFO ] [LOCAL ] DSM: Starting deletion of primary data. [2025-10-28T18:22:22.410486] [DEBUG] [LOCAL ] DSM: No primary data file found to delete. [2025-10-28T18:22:22.410518] [INFO ] [MAIN ] DSM: Starting full primary refresh. [2025-10-28T18:22:22.815411] [INFO ] [REMOTE ] DSM: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:22:23.108955] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-28T18:22:23.122047] [INFO ] [REMOTE ] DRI: Full fetch complete (69350 records). [2025-10-28T18:22:23.122241] [DEBUG] [VALIDATOR ] DRI: Validating primary data. [2025-10-28T18:22:23.169287] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-01. [2025-10-28T18:22:23.540553] [DEBUG] [VALIDATOR ] DRI: All expected trading days are present. [2025-10-28T18:22:23.540686] [DEBUG] [VALIDATOR ] DRI: Primary data validation passed. [2025-10-28T18:22:23.541579] [INFO ] [MAIN ] DRI: Fetched primary data is valid. [2025-10-28T18:22:23.541624] [DEBUG] [LOCAL ] DRI: Saving primary data. [2025-10-28T18:22:23.543061] [DEBUG] [LOCAL ] DRI: Trimmed 69350 records to 47301 (keeping 200 days of data) [2025-10-28T18:22:23.888003] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-10-28T18:22:23.917741] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-28T18:22:23.928481] [DEBUG] [LOCAL ] DRI: Primary data saved (47301 records). [2025-10-28T18:22:23.928690] [INFO ] [MAIN ] DRI: Full history saved. [2025-10-28T18:22:23.929626] [INFO ] [MAIN ] Update Progress: 651/2366 symbols completed. DRI took 31.2s. Estimated remaining: 3h 36m 56s. Rate: 7.9 symbols/min [2025-10-28T18:22:23.969084] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-02. [2025-10-28T18:22:24.117089] [INFO ] [MAIN ] DSMC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:22:24.120174] [DEBUG] [LOCAL ] DSMC: Loaded 1704 existing records from primary storage. [2025-10-28T18:22:24.120315] [INFO ] [MAIN ] DSMC: Loaded 1704 existing records. [2025-10-28T18:22:24.300418] [WARN ] [MAIN ] DSMC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:22:24.300726] [INFO ] [MAIN ] DSMC: Wiping existing primary data before full refresh. [2025-10-28T18:22:24.300779] [INFO ] [LOCAL ] DSMC: Starting deletion of primary data. [2025-10-28T18:22:24.301011] [DEBUG] [LOCAL ] DSMC: Deleted primary data file. [2025-10-28T18:22:24.301080] [INFO ] [MAIN ] DSMC: Starting full primary refresh. [2025-10-28T18:22:24.658711] [INFO ] [REMOTE ] DSMC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:22:24.759381] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-01. [2025-10-28T18:22:24.918731] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-28T18:22:25.171273] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-10-28T18:22:25.559317] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-02. [2025-10-28T18:22:26.359331] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-10. [2025-10-28T18:22:26.470911] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-28T18:22:27.159394] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-03. [2025-10-28T18:22:27.764692] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-28T18:22:27.776216] [INFO ] [REMOTE ] DRH: Full fetch complete (71876 records). [2025-10-28T18:22:27.776411] [DEBUG] [VALIDATOR ] DRH: Validating primary data. [2025-10-28T18:22:27.967569] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-02. [2025-10-28T18:22:28.088734] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-28T18:22:28.219492] [DEBUG] [VALIDATOR ] DRH: All expected trading days are present. [2025-10-28T18:22:28.219570] [DEBUG] [VALIDATOR ] DRH: Primary data validation passed. [2025-10-28T18:22:28.220436] [INFO ] [MAIN ] DRH: Fetched primary data is valid. [2025-10-28T18:22:28.220498] [DEBUG] [LOCAL ] DRH: Saving primary data. [2025-10-28T18:22:28.221912] [DEBUG] [LOCAL ] DRH: Trimmed 71876 records to 50049 (keeping 200 days of data) [2025-10-28T18:22:28.432915] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-28T18:22:28.515434] [DEBUG] [LOCAL ] DRH: Primary data saved (50049 records). [2025-10-28T18:22:28.515566] [INFO ] [MAIN ] DRH: Full history saved. [2025-10-28T18:22:28.515665] [INFO ] [MAIN ] Update Progress: 652/2366 symbols completed. DRH took 37.5s. Estimated remaining: 3h 36m 41s. Rate: 7.9 symbols/min [2025-10-28T18:22:28.681677] [INFO ] [MAIN ] DSU: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:22:28.681912] [DEBUG] [LOCAL ] DSU: No existing data file found in primary storage. [2025-10-28T18:22:28.681953] [WARN ] [MAIN ] DSU: No existing data found, performing full refresh instead. [2025-10-28T18:22:28.682024] [INFO ] [MAIN ] DSU: Wiping existing primary data before full refresh. [2025-10-28T18:22:28.682059] [INFO ] [LOCAL ] DSU: Starting deletion of primary data. [2025-10-28T18:22:28.682097] [DEBUG] [LOCAL ] DSU: No primary data file found to delete. [2025-10-28T18:22:28.682127] [INFO ] [MAIN ] DSU: Starting full primary refresh. [2025-10-28T18:22:28.764577] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-03. [2025-10-28T18:22:29.030339] [INFO ] [REMOTE ] DSU: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:22:29.203140] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-28T18:22:29.559337] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-04. [2025-10-28T18:22:29.935758] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-10-28T18:22:30.359385] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-01. [2025-10-28T18:22:31.159370] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-03. [2025-10-28T18:22:31.180094] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-28T18:22:31.959332] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-05. [2025-10-28T18:22:32.218769] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-28T18:22:32.250201] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-05 (0.29 seconds). [2025-10-28T18:22:32.759339] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-04. [2025-10-28T18:22:33.559366] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-02. [2025-10-28T18:22:33.905918] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-28T18:22:34.322453] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-28T18:22:34.359427] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-06. [2025-10-28T18:22:34.647869] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-06 (0.29 seconds). [2025-10-28T18:22:35.159371] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-07. [2025-10-28T18:22:35.661672] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-10-28T18:22:35.959339] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-08. [2025-10-28T18:22:36.258721] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-08 (0.30 seconds). [2025-10-28T18:22:36.759393] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-03. [2025-10-28T18:22:37.559330] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-05. [2025-10-28T18:22:37.668562] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-28T18:22:38.359318] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-04. [2025-10-28T18:22:38.388759] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-28T18:22:39.159364] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-04. [2025-10-28T18:22:39.185236] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-28T18:22:39.959449] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-05. [2025-10-28T18:22:40.329388] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-28T18:22:40.604901] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-28T18:22:40.759343] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-05. [2025-10-28T18:22:41.479801] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-28T18:22:41.559343] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-06. [2025-10-28T18:22:42.329003] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-28T18:22:42.359308] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-07. [2025-10-28T18:22:42.976434] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-28T18:22:43.159418] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-06. [2025-10-28T18:22:43.959319] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-08. [2025-10-28T18:22:44.121991] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-28T18:22:44.665403] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-28T18:22:44.759374] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-09. [2025-10-28T18:22:45.446264] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-28T18:22:45.559333] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-07. [2025-10-28T18:22:46.359332] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-06. [2025-10-28T18:22:46.606738] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-28T18:22:47.150240] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-28T18:22:47.159283] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-07. [2025-10-28T18:22:47.959361] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-10. [2025-10-28T18:22:48.124752] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-28T18:22:48.561040] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-28T18:22:48.563916] [INFO ] [REMOTE ] DSM: Full fetch complete (24091 records). [2025-10-28T18:22:48.563986] [DEBUG] [VALIDATOR ] DSM: Validating primary data. [2025-10-28T18:22:48.764503] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-08. [2025-10-28T18:22:48.922957] [DEBUG] [VALIDATOR ] DSM: All expected trading days are present. [2025-10-28T18:22:48.923034] [DEBUG] [VALIDATOR ] DSM: Primary data validation passed. [2025-10-28T18:22:48.923481] [INFO ] [MAIN ] DSM: Fetched primary data is valid. [2025-10-28T18:22:48.923519] [DEBUG] [LOCAL ] DSM: Saving primary data. [2025-10-28T18:22:48.924172] [DEBUG] [LOCAL ] DSM: Trimmed 24091 records to 13784 (keeping 200 days of data) [2025-10-28T18:22:49.002103] [DEBUG] [LOCAL ] DSM: Primary data saved (13784 records). [2025-10-28T18:22:49.002252] [INFO ] [MAIN ] DSM: Full history saved. [2025-10-28T18:22:49.002352] [INFO ] [MAIN ] Update Progress: 653/2366 symbols completed. DSM took 26.8s. Estimated remaining: 3h 37m 7s. Rate: 7.9 symbols/min [2025-10-28T18:22:49.189968] [INFO ] [MAIN ] DSX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:22:49.210845] [DEBUG] [LOCAL ] DSX: Loaded 23205 existing records from primary storage. [2025-10-28T18:22:49.211088] [INFO ] [MAIN ] DSX: Loaded 23205 existing records. [2025-10-28T18:22:49.399710] [WARN ] [MAIN ] DSX: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:22:49.399915] [INFO ] [MAIN ] DSX: Wiping existing primary data before full refresh. [2025-10-28T18:22:49.399961] [INFO ] [LOCAL ] DSX: Starting deletion of primary data. [2025-10-28T18:22:49.400452] [DEBUG] [LOCAL ] DSX: Deleted primary data file. [2025-10-28T18:22:49.400512] [INFO ] [MAIN ] DSX: Starting full primary refresh. [2025-10-28T18:22:49.572297] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-09. [2025-10-28T18:22:49.774322] [INFO ] [REMOTE ] DSX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:22:49.791269] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-28T18:22:49.954094] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-10-28T18:22:50.359336] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-09. [2025-10-28T18:22:51.159328] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-08. [2025-10-28T18:22:51.327479] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-28T18:22:51.959335] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-10. [2025-10-28T18:22:52.108741] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-28T18:22:52.321438] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-10 (0.36 seconds). [2025-10-28T18:22:52.322424] [INFO ] [REMOTE ] DSMC: Full fetch complete (2864 records). [2025-10-28T18:22:52.322496] [DEBUG] [VALIDATOR ] DSMC: Validating primary data. [2025-10-28T18:22:52.322910] [FATAL] [VALIDATOR ] DSMC: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T18:22:52.322995] [FATAL] [MAIN ] DSMC: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:22:52.323070] [WARN ] [MAIN ] DSMC: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:22:52.323140] [INFO ] [LOCAL ] DSMC: Starting deletion of primary data. [2025-10-28T18:22:52.323203] [DEBUG] [LOCAL ] DSMC: No primary data file found to delete. [2025-10-28T18:22:52.323272] [INFO ] [LOCAL ] DSMC: Starting deletion of derivative data. [2025-10-28T18:22:52.323450] [DEBUG] [LOCAL ] DSMC: Deleted derivative data file. [2025-10-28T18:22:52.323549] [INFO ] [MAIN ] Update Progress: 654/2366 symbols completed. DSMC took 28.4s. Estimated remaining: 3h 36m 48s. Rate: 7.9 symbols/min [2025-10-28T18:22:52.497111] [INFO ] [MAIN ] DT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:22:52.545112] [DEBUG] [LOCAL ] DT: Loaded 52910 existing records from primary storage. [2025-10-28T18:22:52.545398] [INFO ] [MAIN ] DT: Loaded 52910 existing records. [2025-10-28T18:22:52.727224] [WARN ] [MAIN ] DT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:22:52.727464] [INFO ] [MAIN ] DT: Wiping existing primary data before full refresh. [2025-10-28T18:22:52.727511] [INFO ] [LOCAL ] DT: Starting deletion of primary data. [2025-10-28T18:22:52.728280] [DEBUG] [LOCAL ] DT: Deleted primary data file. [2025-10-28T18:22:52.728336] [INFO ] [MAIN ] DT: Starting full primary refresh. [2025-10-28T18:22:52.764421] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-09. [2025-10-28T18:22:53.084255] [INFO ] [REMOTE ] DT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:22:53.559308] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-10. [2025-10-28T18:22:53.711770] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-28T18:22:54.359335] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-10. [2025-10-28T18:22:54.700698] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-28T18:22:54.707702] [INFO ] [REMOTE ] DSL: Full fetch complete (41739 records). [2025-10-28T18:22:54.707868] [DEBUG] [VALIDATOR ] DSL: Validating primary data. [2025-10-28T18:22:54.708611] [FATAL] [VALIDATOR ] DSL: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T18:22:54.708736] [FATAL] [MAIN ] DSL: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:22:54.708814] [WARN ] [MAIN ] DSL: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:22:54.708899] [INFO ] [LOCAL ] DSL: Starting deletion of primary data. [2025-10-28T18:22:54.708984] [DEBUG] [LOCAL ] DSL: No primary data file found to delete. [2025-10-28T18:22:54.709035] [INFO ] [LOCAL ] DSL: Starting deletion of derivative data. [2025-10-28T18:22:54.709220] [DEBUG] [LOCAL ] DSL: Deleted derivative data file. [2025-10-28T18:22:54.709325] [INFO ] [MAIN ] Update Progress: 655/2366 symbols completed. DSL took 36.7s. Estimated remaining: 3h 36m 27s. Rate: 7.9 symbols/min [2025-10-28T18:22:54.888438] [INFO ] [MAIN ] DTB: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:22:54.888662] [DEBUG] [LOCAL ] DTB: No existing data file found in primary storage. [2025-10-28T18:22:54.888720] [WARN ] [MAIN ] DTB: No existing data found, performing full refresh instead. [2025-10-28T18:22:54.888832] [INFO ] [MAIN ] DTB: Wiping existing primary data before full refresh. [2025-10-28T18:22:54.888876] [INFO ] [LOCAL ] DTB: Starting deletion of primary data. [2025-10-28T18:22:54.888922] [DEBUG] [LOCAL ] DTB: No primary data file found to delete. [2025-10-28T18:22:54.888957] [INFO ] [MAIN ] DTB: Starting full primary refresh. [2025-10-28T18:22:55.167536] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-01. [2025-10-28T18:22:55.255819] [INFO ] [REMOTE ] DTB: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:22:55.305032] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-28T18:22:55.310285] [INFO ] [REMOTE ] DSU: Full fetch complete (32944 records). [2025-10-28T18:22:55.310440] [DEBUG] [VALIDATOR ] DSU: Validating primary data. [2025-10-28T18:22:55.735290] [DEBUG] [VALIDATOR ] DSU: All expected trading days are present. [2025-10-28T18:22:55.735381] [DEBUG] [VALIDATOR ] DSU: Primary data validation passed. [2025-10-28T18:22:55.736005] [INFO ] [MAIN ] DSU: Fetched primary data is valid. [2025-10-28T18:22:55.736073] [DEBUG] [LOCAL ] DSU: Saving primary data. [2025-10-28T18:22:55.737130] [DEBUG] [LOCAL ] DSU: Trimmed 32944 records to 22359 (keeping 200 days of data) [2025-10-28T18:22:55.873604] [DEBUG] [LOCAL ] DSU: Primary data saved (22359 records). [2025-10-28T18:22:55.873762] [INFO ] [MAIN ] DSU: Full history saved. [2025-10-28T18:22:55.873841] [INFO ] [MAIN ] Update Progress: 656/2366 symbols completed. DSU took 27.4s. Estimated remaining: 3h 36m 3s. Rate: 7.9 symbols/min [2025-10-28T18:22:55.965521] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-01. [2025-10-28T18:22:56.048812] [INFO ] [MAIN ] DTE: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:22:56.090944] [DEBUG] [LOCAL ] DTE: Loaded 46946 existing records from primary storage. [2025-10-28T18:22:56.091240] [INFO ] [MAIN ] DTE: Loaded 46946 existing records. [2025-10-28T18:22:56.279607] [WARN ] [MAIN ] DTE: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:22:56.279912] [INFO ] [MAIN ] DTE: Wiping existing primary data before full refresh. [2025-10-28T18:22:56.279961] [INFO ] [LOCAL ] DTE: Starting deletion of primary data. [2025-10-28T18:22:56.280795] [DEBUG] [LOCAL ] DTE: Deleted primary data file. [2025-10-28T18:22:56.280852] [INFO ] [MAIN ] DTE: Starting full primary refresh. [2025-10-28T18:22:56.567915] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-28T18:22:56.576893] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-28T18:22:56.671872] [INFO ] [REMOTE ] DTE: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:22:56.759350] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-02. [2025-10-28T18:22:57.564586] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-01. [2025-10-28T18:22:57.575096] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-28T18:22:58.359333] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-02. [2025-10-28T18:22:59.159317] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-01. [2025-10-28T18:22:59.959545] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-03. [2025-10-28T18:23:03.318356] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-02 (4.96 seconds). [2025-10-28T18:23:03.319717] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-03. [2025-10-28T18:23:05.157199] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-01 (7.59 seconds). [2025-10-28T18:23:05.166994] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-02. [2025-10-28T18:23:05.564860] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-01 (6.41 seconds). [2025-10-28T18:23:05.575210] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-02. [2025-10-28T18:23:05.977674] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-03 (6.02 seconds). [2025-10-28T18:23:05.983710] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-04. [2025-10-28T18:23:06.198683] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-03 (2.88 seconds). [2025-10-28T18:23:06.200042] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-04. [2025-10-28T18:23:06.807119] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-28T18:23:06.809822] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-05. [2025-10-28T18:23:06.812442] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-10-28T18:23:06.823300] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-03. [2025-10-28T18:23:07.097822] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-28T18:23:07.108619] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-03. [2025-10-28T18:23:07.235388] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-28T18:23:07.237487] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-06. [2025-10-28T18:23:07.668510] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-10-28T18:23:07.959359] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-07. [2025-10-28T18:23:08.241954] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-28T18:23:08.480618] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-04 (2.50 seconds). [2025-10-28T18:23:08.528050] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-28T18:23:08.759309] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-08. [2025-10-28T18:23:08.957231] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-28T18:23:09.239869] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-28T18:23:09.559363] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-09. [2025-10-28T18:23:10.074454] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-28T18:23:10.359343] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-04. [2025-10-28T18:23:11.159356] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-04. [2025-10-28T18:23:11.930356] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-28T18:23:11.959293] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-05. [2025-10-28T18:23:12.646301] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-28T18:23:12.759328] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-05. [2025-10-28T18:23:13.414879] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-28T18:23:13.559299] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-10. [2025-10-28T18:23:13.590871] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-28T18:23:14.182619] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-28T18:23:14.183889] [INFO ] [REMOTE ] DTB: Full fetch complete (6481 records). [2025-10-28T18:23:14.183958] [DEBUG] [VALIDATOR ] DTB: Validating primary data. [2025-10-28T18:23:14.364539] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-06. [2025-10-28T18:23:14.564634] [DEBUG] [VALIDATOR ] DTB: All expected trading days are present. [2025-10-28T18:23:14.564764] [DEBUG] [VALIDATOR ] DTB: Primary data validation passed. [2025-10-28T18:23:14.564966] [INFO ] [MAIN ] DTB: Fetched primary data is valid. [2025-10-28T18:23:14.565011] [DEBUG] [LOCAL ] DTB: Saving primary data. [2025-10-28T18:23:14.565552] [DEBUG] [LOCAL ] DTB: Trimmed 6481 records to 4861 (keeping 200 days of data) [2025-10-28T18:23:14.597700] [DEBUG] [LOCAL ] DTB: Primary data saved (4861 records). [2025-10-28T18:23:14.597835] [INFO ] [MAIN ] DTB: Full history saved. [2025-10-28T18:23:14.597909] [INFO ] [MAIN ] Update Progress: 657/2366 symbols completed. DTB took 19.9s. Estimated remaining: 3h 36m 24s. Rate: 7.9 symbols/min [2025-10-28T18:23:14.768439] [INFO ] [MAIN ] DTF: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:23:14.768588] [DEBUG] [LOCAL ] DTF: No existing data file found in primary storage. [2025-10-28T18:23:14.768624] [WARN ] [MAIN ] DTF: No existing data found, performing full refresh instead. [2025-10-28T18:23:14.768748] [INFO ] [MAIN ] DTF: Wiping existing primary data before full refresh. [2025-10-28T18:23:14.768788] [INFO ] [LOCAL ] DTF: Starting deletion of primary data. [2025-10-28T18:23:14.768882] [DEBUG] [LOCAL ] DTF: No primary data file found to delete. [2025-10-28T18:23:14.768930] [INFO ] [MAIN ] DTF: Starting full primary refresh. [2025-10-28T18:23:15.111609] [INFO ] [REMOTE ] DTF: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:23:15.159296] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-01. [2025-10-28T18:23:15.364856] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-28T18:23:15.559865] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-10-28T18:23:15.959329] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-05. [2025-10-28T18:23:16.759344] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-06. [2025-10-28T18:23:17.486387] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-28T18:23:17.559315] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-06. [2025-10-28T18:23:18.130614] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-28T18:23:18.359337] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-07. [2025-10-28T18:23:18.966190] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-28T18:23:19.159327] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-07. [2025-10-28T18:23:19.747028] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-28T18:23:19.959388] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-02. [2025-10-28T18:23:20.210976] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-02 (0.25 seconds). [2025-10-28T18:23:20.213245] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-28T18:23:20.759397] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-03. [2025-10-28T18:23:21.042680] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-03 (0.28 seconds). [2025-10-28T18:23:21.559335] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-08. [2025-10-28T18:23:22.359344] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-08. [2025-10-28T18:23:22.423015] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-28T18:23:23.159340] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-04. [2025-10-28T18:23:23.467777] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-04 (0.31 seconds). [2025-10-28T18:23:23.899494] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-28T18:23:23.959317] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-09. [2025-10-28T18:23:24.759351] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-05. [2025-10-28T18:23:25.044411] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-05 (0.29 seconds). [2025-10-28T18:23:25.368602] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-28T18:23:25.559334] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-10. [2025-10-28T18:23:26.359366] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-07. [2025-10-28T18:23:27.123578] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-28T18:23:27.134731] [INFO ] [REMOTE ] DT: Full fetch complete (76865 records). [2025-10-28T18:23:27.134900] [DEBUG] [VALIDATOR ] DT: Validating primary data. [2025-10-28T18:23:27.165741] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-06. [2025-10-28T18:23:27.522392] [DEBUG] [VALIDATOR ] DT: All expected trading days are present. [2025-10-28T18:23:27.522475] [DEBUG] [VALIDATOR ] DT: Primary data validation passed. [2025-10-28T18:23:27.523431] [INFO ] [MAIN ] DT: Fetched primary data is valid. [2025-10-28T18:23:27.523496] [DEBUG] [LOCAL ] DT: Saving primary data. [2025-10-28T18:23:27.524984] [DEBUG] [LOCAL ] DT: Trimmed 76865 records to 52899 (keeping 200 days of data) [2025-10-28T18:23:27.745857] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-28T18:23:27.866700] [DEBUG] [LOCAL ] DT: Primary data saved (52899 records). [2025-10-28T18:23:27.866928] [INFO ] [MAIN ] DT: Full history saved. [2025-10-28T18:23:27.867947] [INFO ] [MAIN ] Update Progress: 658/2366 symbols completed. DT took 35.5s. Estimated remaining: 3h 36m 31s. Rate: 7.9 symbols/min [2025-10-28T18:23:27.869334] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-28T18:23:27.960723] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-07. [2025-10-28T18:23:28.065374] [INFO ] [MAIN ] DTG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:23:28.073089] [DEBUG] [LOCAL ] DTG: Loaded 5634 existing records from primary storage. [2025-10-28T18:23:28.073318] [INFO ] [MAIN ] DTG: Loaded 5634 existing records. [2025-10-28T18:23:28.272154] [WARN ] [MAIN ] DTG: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:23:28.272394] [INFO ] [MAIN ] DTG: Wiping existing primary data before full refresh. [2025-10-28T18:23:28.272442] [INFO ] [LOCAL ] DTG: Starting deletion of primary data. [2025-10-28T18:23:28.272713] [DEBUG] [LOCAL ] DTG: Deleted primary data file. [2025-10-28T18:23:28.272774] [INFO ] [MAIN ] DTG: Starting full primary refresh. [2025-10-28T18:23:28.353758] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-10-28T18:23:28.638545] [INFO ] [REMOTE ] DTG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:23:28.759327] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-01. [2025-10-28T18:23:29.311893] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-28T18:23:29.559371] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-09. [2025-10-28T18:23:30.359321] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-02. [2025-10-28T18:23:30.441162] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-28T18:23:30.755082] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-28T18:23:31.159351] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-08. [2025-10-28T18:23:31.959444] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-08. [2025-10-28T18:23:32.266743] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-08 (0.31 seconds). [2025-10-28T18:23:32.759313] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-10. [2025-10-28T18:23:32.920515] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-28T18:23:33.559312] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-03. [2025-10-28T18:23:33.649270] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-28T18:23:33.653967] [INFO ] [REMOTE ] DSX: Full fetch complete (35155 records). [2025-10-28T18:23:33.654053] [DEBUG] [VALIDATOR ] DSX: Validating primary data. [2025-10-28T18:23:34.044569] [DEBUG] [VALIDATOR ] DSX: All expected trading days are present. [2025-10-28T18:23:34.044715] [DEBUG] [VALIDATOR ] DSX: Primary data validation passed. [2025-10-28T18:23:34.045250] [INFO ] [MAIN ] DSX: Fetched primary data is valid. [2025-10-28T18:23:34.045291] [DEBUG] [LOCAL ] DSX: Saving primary data. [2025-10-28T18:23:34.046099] [DEBUG] [LOCAL ] DSX: Trimmed 35155 records to 23143 (keeping 200 days of data) [2025-10-28T18:23:34.138633] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-28T18:23:34.184021] [DEBUG] [LOCAL ] DSX: Primary data saved (23143 records). [2025-10-28T18:23:34.184149] [INFO ] [MAIN ] DSX: Full history saved. [2025-10-28T18:23:34.184226] [INFO ] [MAIN ] Update Progress: 659/2366 symbols completed. DSX took 45.2s. Estimated remaining: 3h 36m 20s. Rate: 7.9 symbols/min [2025-10-28T18:23:34.353907] [INFO ] [MAIN ] DTK: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:23:34.354063] [DEBUG] [LOCAL ] DTK: No existing data file found in primary storage. [2025-10-28T18:23:34.354100] [WARN ] [MAIN ] DTK: No existing data found, performing full refresh instead. [2025-10-28T18:23:34.354209] [INFO ] [MAIN ] DTK: Wiping existing primary data before full refresh. [2025-10-28T18:23:34.354250] [INFO ] [LOCAL ] DTK: Starting deletion of primary data. [2025-10-28T18:23:34.354292] [DEBUG] [LOCAL ] DTK: No primary data file found to delete. [2025-10-28T18:23:34.354323] [INFO ] [MAIN ] DTK: Starting full primary refresh. [2025-10-28T18:23:34.365147] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-09. [2025-10-28T18:23:34.722841] [INFO ] [REMOTE ] DTK: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:23:35.159348] [INFO ] [REMOTE ] DTK: Fetching primary data for 2025-01. [2025-10-28T18:23:35.311911] [DEBUG] [REMOTE ] DTK: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-28T18:23:35.312210] [WARN ] [REMOTE ] DTK: No data returned for month 2025-01 [2025-10-28T18:23:35.312297] [FATAL] [REMOTE ] DTK: API call failed - aborting fetch to avoid wasting further API calls [2025-10-28T18:23:35.312347] [FATAL] [MAIN ] DTK: Failed to fetch primary data. [2025-10-28T18:23:35.312407] [WARN ] [MAIN ] DTK: Deleting existing primary and derivative data due to fetch failure. [2025-10-28T18:23:35.312480] [INFO ] [LOCAL ] DTK: Starting deletion of primary data. [2025-10-28T18:23:35.312543] [DEBUG] [LOCAL ] DTK: No primary data file found to delete. [2025-10-28T18:23:35.312579] [INFO ] [LOCAL ] DTK: Starting deletion of derivative data. [2025-10-28T18:23:35.312619] [DEBUG] [LOCAL ] DTK: No derivative data file found to delete. [2025-10-28T18:23:35.312693] [INFO ] [MAIN ] Update Progress: 660/2366 symbols completed. DTK took 1.1s. Estimated remaining: 3h 35m 56s. Rate: 7.9 symbols/min [2025-10-28T18:23:35.497709] [INFO ] [MAIN ] DTM: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:23:35.535922] [DEBUG] [LOCAL ] DTM: Loaded 43642 existing records from primary storage. [2025-10-28T18:23:35.536204] [INFO ] [MAIN ] DTM: Loaded 43642 existing records. [2025-10-28T18:23:35.726857] [WARN ] [MAIN ] DTM: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:23:35.727110] [INFO ] [MAIN ] DTM: Wiping existing primary data before full refresh. [2025-10-28T18:23:35.727180] [INFO ] [LOCAL ] DTM: Starting deletion of primary data. [2025-10-28T18:23:35.728237] [DEBUG] [LOCAL ] DTM: Deleted primary data file. [2025-10-28T18:23:35.728308] [INFO ] [MAIN ] DTM: Starting full primary refresh. [2025-10-28T18:23:35.960602] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-04. [2025-10-28T18:23:36.137706] [INFO ] [REMOTE ] DTM: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:23:36.162536] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-10-28T18:23:36.442268] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-28T18:23:36.759354] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-05. [2025-10-28T18:23:37.181222] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-28T18:23:37.559334] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-09. [2025-10-28T18:23:37.968146] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-10-28T18:23:38.359330] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-01. [2025-10-28T18:23:39.159329] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-10. [2025-10-28T18:23:39.724550] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-28T18:23:39.959342] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-10. [2025-10-28T18:23:40.295103] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-10 (0.34 seconds). [2025-10-28T18:23:40.295957] [INFO ] [REMOTE ] DTF: Full fetch complete (1713 records). [2025-10-28T18:23:40.296030] [DEBUG] [VALIDATOR ] DTF: Validating primary data. [2025-10-28T18:23:40.476398] [WARN ] [VALIDATOR ] DTF: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-10-28T18:23:40.476717] [FATAL] [MAIN ] DTF: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:23:40.476799] [WARN ] [MAIN ] DTF: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:23:40.476900] [INFO ] [LOCAL ] DTF: Starting deletion of primary data. [2025-10-28T18:23:40.476967] [DEBUG] [LOCAL ] DTF: No primary data file found to delete. [2025-10-28T18:23:40.477004] [INFO ] [LOCAL ] DTF: Starting deletion of derivative data. [2025-10-28T18:23:40.477043] [DEBUG] [LOCAL ] DTF: No derivative data file found to delete. [2025-10-28T18:23:40.477097] [INFO ] [MAIN ] Update Progress: 661/2366 symbols completed. DTF took 25.9s. Estimated remaining: 3h 35m 42s. Rate: 7.9 symbols/min [2025-10-28T18:23:40.649584] [INFO ] [MAIN ] DTW: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:23:40.655156] [DEBUG] [LOCAL ] DTW: Loaded 4638 existing records from primary storage. [2025-10-28T18:23:40.655370] [INFO ] [MAIN ] DTW: Loaded 4638 existing records. [2025-10-28T18:23:40.761069] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-06. [2025-10-28T18:23:40.836443] [WARN ] [MAIN ] DTW: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:23:40.845675] [INFO ] [MAIN ] DTW: Wiping existing primary data before full refresh. [2025-10-28T18:23:40.858911] [INFO ] [LOCAL ] DTW: Starting deletion of primary data. [2025-10-28T18:23:40.859568] [DEBUG] [LOCAL ] DTW: Deleted primary data file. [2025-10-28T18:23:40.859634] [INFO ] [MAIN ] DTW: Starting full primary refresh. [2025-10-28T18:23:40.860410] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-28T18:23:40.953014] [INFO ] [REMOTE ] DTE: Full fetch complete (68478 records). [2025-10-28T18:23:40.973925] [DEBUG] [VALIDATOR ] DTE: Validating primary data. [2025-10-28T18:23:40.985918] [FATAL] [VALIDATOR ] DTE: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T18:23:40.996341] [FATAL] [MAIN ] DTE: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:23:41.026609] [WARN ] [MAIN ] DTE: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:23:41.052384] [INFO ] [LOCAL ] DTE: Starting deletion of primary data. [2025-10-28T18:23:41.097695] [DEBUG] [LOCAL ] DTE: No primary data file found to delete. [2025-10-28T18:23:41.118432] [INFO ] [LOCAL ] DTE: Starting deletion of derivative data. [2025-10-28T18:23:41.123957] [DEBUG] [LOCAL ] DTE: Deleted derivative data file. [2025-10-28T18:23:41.130245] [INFO ] [MAIN ] Update Progress: 662/2366 symbols completed. DTE took 45.3s. Estimated remaining: 3h 35m 17s. Rate: 7.9 symbols/min [2025-10-28T18:23:41.412532] [INFO ] [REMOTE ] DTW: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:23:41.416482] [INFO ] [MAIN ] DUK: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:23:41.416592] [DEBUG] [LOCAL ] DUK: No existing data file found in primary storage. [2025-10-28T18:23:41.421743] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-28T18:23:41.421552] [WARN ] [MAIN ] DUK: No existing data found, performing full refresh instead. [2025-10-28T18:23:41.422026] [INFO ] [MAIN ] DUK: Wiping existing primary data before full refresh. [2025-10-28T18:23:41.424283] [INFO ] [LOCAL ] DUK: Starting deletion of primary data. [2025-10-28T18:23:41.424462] [DEBUG] [LOCAL ] DUK: No primary data file found to delete. [2025-10-28T18:23:41.424507] [INFO ] [MAIN ] DUK: Starting full primary refresh. [2025-10-28T18:23:41.564538] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-07. [2025-10-28T18:23:41.830978] [INFO ] [REMOTE ] DUK: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:23:42.008355] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-28T18:23:42.359333] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-01. [2025-10-28T18:23:43.159401] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-01. [2025-10-28T18:23:43.691811] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-10-28T18:23:43.959312] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-02. [2025-10-28T18:23:44.109497] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-28T18:23:44.338891] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-10-28T18:23:44.759346] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-02. [2025-10-28T18:23:45.559379] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-08. [2025-10-28T18:23:45.931396] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-28T18:23:46.002809] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-28T18:23:46.359379] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-03. [2025-10-28T18:23:47.159356] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-03. [2025-10-28T18:23:47.589211] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-28T18:23:47.730187] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-28T18:23:47.959360] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-09. [2025-10-28T18:23:48.371004] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-10-28T18:23:48.759372] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-10. [2025-10-28T18:23:49.248466] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-28T18:23:49.250313] [INFO ] [REMOTE ] DTG: Full fetch complete (8437 records). [2025-10-28T18:23:49.250389] [DEBUG] [VALIDATOR ] DTG: Validating primary data. [2025-10-28T18:23:49.564456] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-02. [2025-10-28T18:23:49.620784] [DEBUG] [VALIDATOR ] DTG: All expected trading days are present. [2025-10-28T18:23:49.620874] [DEBUG] [VALIDATOR ] DTG: Primary data validation passed. [2025-10-28T18:23:49.621094] [INFO ] [MAIN ] DTG: Fetched primary data is valid. [2025-10-28T18:23:49.621133] [DEBUG] [LOCAL ] DTG: Saving primary data. [2025-10-28T18:23:49.621604] [DEBUG] [LOCAL ] DTG: Trimmed 8437 records to 5605 (keeping 200 days of data) [2025-10-28T18:23:49.655876] [DEBUG] [LOCAL ] DTG: Primary data saved (5605 records). [2025-10-28T18:23:49.656012] [INFO ] [MAIN ] DTG: Full history saved. [2025-10-28T18:23:49.656094] [INFO ] [MAIN ] Update Progress: 663/2366 symbols completed. DTG took 21.8s. Estimated remaining: 3h 35m 12s. Rate: 7.9 symbols/min [2025-10-28T18:23:49.824341] [INFO ] [MAIN ] DUKB: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:23:49.824563] [DEBUG] [LOCAL ] DUKB: No existing data file found in primary storage. [2025-10-28T18:23:49.824607] [WARN ] [MAIN ] DUKB: No existing data found, performing full refresh instead. [2025-10-28T18:23:49.824866] [INFO ] [MAIN ] DUKB: Wiping existing primary data before full refresh. [2025-10-28T18:23:49.824908] [INFO ] [LOCAL ] DUKB: Starting deletion of primary data. [2025-10-28T18:23:49.824948] [DEBUG] [LOCAL ] DUKB: No primary data file found to delete. [2025-10-28T18:23:49.824979] [INFO ] [MAIN ] DUKB: Starting full primary refresh. [2025-10-28T18:23:50.178233] [INFO ] [REMOTE ] DUKB: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:23:50.359359] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-04. [2025-10-28T18:23:50.959052] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-28T18:23:51.159400] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-01. [2025-10-28T18:23:51.759310] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-28T18:23:51.959306] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-02. [2025-10-28T18:23:52.289223] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-28T18:23:52.362093] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-28T18:23:52.759335] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-04. [2025-10-28T18:23:53.343329] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-28T18:23:53.559427] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-05. [2025-10-28T18:23:54.359341] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-05. [2025-10-28T18:23:54.811242] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-28T18:23:54.843545] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-28T18:23:55.159345] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-06. [2025-10-28T18:23:55.546947] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-10-28T18:23:55.959342] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-03. [2025-10-28T18:23:56.759329] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-03. [2025-10-28T18:23:57.175788] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-28T18:23:57.563132] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-06. [2025-10-28T18:23:57.569369] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-10-28T18:23:58.359348] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-07. [2025-10-28T18:23:58.773162] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-28T18:23:58.832277] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-28T18:23:59.159358] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-08. [2025-10-28T18:23:59.537461] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-10-28T18:23:59.959336] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-09. [2025-10-28T18:24:00.358969] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-10-28T18:24:00.759344] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-04. [2025-10-28T18:24:01.275029] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-28T18:24:01.559377] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-05. [2025-10-28T18:24:02.095090] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-28T18:24:02.359471] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-10. [2025-10-28T18:24:02.781797] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-28T18:24:02.783357] [INFO ] [REMOTE ] DTW: Full fetch complete (6863 records). [2025-10-28T18:24:02.783451] [DEBUG] [VALIDATOR ] DTW: Validating primary data. [2025-10-28T18:24:02.784027] [FATAL] [VALIDATOR ] DTW: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T18:24:02.784138] [FATAL] [MAIN ] DTW: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:24:02.784186] [WARN ] [MAIN ] DTW: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:24:02.784247] [INFO ] [LOCAL ] DTW: Starting deletion of primary data. [2025-10-28T18:24:02.784355] [DEBUG] [LOCAL ] DTW: No primary data file found to delete. [2025-10-28T18:24:02.784436] [INFO ] [LOCAL ] DTW: Starting deletion of derivative data. [2025-10-28T18:24:02.784712] [DEBUG] [LOCAL ] DTW: Deleted derivative data file. [2025-10-28T18:24:02.784832] [INFO ] [MAIN ] Update Progress: 664/2366 symbols completed. DTW took 22.3s. Estimated remaining: 3h 35m 18s. Rate: 7.9 symbols/min [2025-10-28T18:24:02.954913] [INFO ] [MAIN ] DV: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:24:03.003549] [DEBUG] [LOCAL ] DV: Loaded 51235 existing records from primary storage. [2025-10-28T18:24:03.003868] [INFO ] [MAIN ] DV: Loaded 51235 existing records. [2025-10-28T18:24:03.179587] [WARN ] [MAIN ] DV: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:24:03.159447] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-06. [2025-10-28T18:24:03.180067] [INFO ] [MAIN ] DV: Wiping existing primary data before full refresh. [2025-10-28T18:24:03.180160] [INFO ] [LOCAL ] DV: Starting deletion of primary data. [2025-10-28T18:24:03.181942] [DEBUG] [LOCAL ] DV: Deleted primary data file. [2025-10-28T18:24:03.182008] [INFO ] [MAIN ] DV: Starting full primary refresh. [2025-10-28T18:24:03.542663] [INFO ] [REMOTE ] DV: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:24:03.741386] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-28T18:24:03.959351] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-01. [2025-10-28T18:24:04.759397] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-04. [2025-10-28T18:24:05.297533] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-28T18:24:05.559356] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-02. [2025-10-28T18:24:06.218582] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-28T18:24:06.359393] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-07. [2025-10-28T18:24:06.808910] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-28T18:24:06.836348] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-28T18:24:07.159339] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-08. [2025-10-28T18:24:07.557915] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-10-28T18:24:07.959388] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-07. [2025-10-28T18:24:08.759381] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-05. [2025-10-28T18:24:09.422410] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-28T18:24:09.559320] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-08. [2025-10-28T18:24:10.359319] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-09. [2025-10-28T18:24:10.519542] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-28T18:24:10.760687] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-28T18:24:10.770074] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-10-28T18:24:11.159340] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-06. [2025-10-28T18:24:11.959337] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-10. [2025-10-28T18:24:12.524631] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-28T18:24:12.526080] [INFO ] [REMOTE ] DUKB: Full fetch complete (8909 records). [2025-10-28T18:24:12.526319] [DEBUG] [VALIDATOR ] DUKB: Validating primary data. [2025-10-28T18:24:12.771739] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-09. [2025-10-28T18:24:12.921805] [DEBUG] [VALIDATOR ] DUKB: All expected trading days are present. [2025-10-28T18:24:12.921926] [DEBUG] [VALIDATOR ] DUKB: Primary data validation passed. [2025-10-28T18:24:12.922280] [INFO ] [MAIN ] DUKB: Fetched primary data is valid. [2025-10-28T18:24:12.922405] [DEBUG] [LOCAL ] DUKB: Saving primary data. [2025-10-28T18:24:12.923178] [DEBUG] [LOCAL ] DUKB: Trimmed 8909 records to 5882 (keeping 200 days of data) [2025-10-28T18:24:12.984748] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-10-28T18:24:12.998508] [DEBUG] [LOCAL ] DUKB: Primary data saved (5882 records). [2025-10-28T18:24:12.998823] [INFO ] [MAIN ] DUKB: Full history saved. [2025-10-28T18:24:12.998924] [INFO ] [MAIN ] Update Progress: 665/2366 symbols completed. DUKB took 23.3s. Estimated remaining: 3h 35m 17s. Rate: 7.9 symbols/min [2025-10-28T18:24:13.169875] [INFO ] [MAIN ] DVA: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:24:13.170020] [DEBUG] [LOCAL ] DVA: No existing data file found in primary storage. [2025-10-28T18:24:13.170074] [WARN ] [MAIN ] DVA: No existing data found, performing full refresh instead. [2025-10-28T18:24:13.170182] [INFO ] [MAIN ] DVA: Wiping existing primary data before full refresh. [2025-10-28T18:24:13.170247] [INFO ] [LOCAL ] DVA: Starting deletion of primary data. [2025-10-28T18:24:13.170311] [DEBUG] [LOCAL ] DVA: No primary data file found to delete. [2025-10-28T18:24:13.170357] [INFO ] [MAIN ] DVA: Starting full primary refresh. [2025-10-28T18:24:13.529111] [INFO ] [REMOTE ] DVA: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:24:13.559294] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-01. [2025-10-28T18:24:14.035197] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-28T18:24:14.359379] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-07. [2025-10-28T18:24:14.688137] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-28T18:24:15.159430] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-03. [2025-10-28T18:24:15.959325] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-10. [2025-10-28T18:24:16.029048] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-10-28T18:24:16.681350] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-28T18:24:16.759330] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-08. [2025-10-28T18:24:17.352164] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-28T18:24:17.361222] [INFO ] [REMOTE ] DTM: Full fetch complete (65278 records). [2025-10-28T18:24:17.361329] [DEBUG] [VALIDATOR ] DTM: Validating primary data. [2025-10-28T18:24:17.564512] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-04. [2025-10-28T18:24:17.749264] [DEBUG] [VALIDATOR ] DTM: All expected trading days are present. [2025-10-28T18:24:17.749331] [DEBUG] [VALIDATOR ] DTM: Primary data validation passed. [2025-10-28T18:24:17.750092] [INFO ] [MAIN ] DTM: Fetched primary data is valid. [2025-10-28T18:24:17.750152] [DEBUG] [LOCAL ] DTM: Saving primary data. [2025-10-28T18:24:17.751284] [DEBUG] [LOCAL ] DTM: Trimmed 65278 records to 43576 (keeping 200 days of data) [2025-10-28T18:24:18.012329] [DEBUG] [LOCAL ] DTM: Primary data saved (43576 records). [2025-10-28T18:24:18.012447] [INFO ] [MAIN ] DTM: Full history saved. [2025-10-28T18:24:18.012520] [INFO ] [MAIN ] Update Progress: 666/2366 symbols completed. DTM took 42.7s. Estimated remaining: 3h 35m 3s. Rate: 7.9 symbols/min [2025-10-28T18:24:18.176551] [INFO ] [MAIN ] DVN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:24:18.224087] [DEBUG] [LOCAL ] DVN: Loaded 53699 existing records from primary storage. [2025-10-28T18:24:18.224371] [INFO ] [MAIN ] DVN: Loaded 53699 existing records. [2025-10-28T18:24:18.362197] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-02. [2025-10-28T18:24:18.407504] [WARN ] [MAIN ] DVN: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:24:18.408125] [INFO ] [MAIN ] DVN: Wiping existing primary data before full refresh. [2025-10-28T18:24:18.408254] [INFO ] [LOCAL ] DVN: Starting deletion of primary data. [2025-10-28T18:24:18.409149] [DEBUG] [LOCAL ] DVN: Deleted primary data file. [2025-10-28T18:24:18.409216] [INFO ] [MAIN ] DVN: Starting full primary refresh. [2025-10-28T18:24:18.727589] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-10-28T18:24:18.812596] [INFO ] [REMOTE ] DVN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:24:19.067613] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-10-28T18:24:19.159294] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-05. [2025-10-28T18:24:19.766608] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-28T18:24:19.959340] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-01. [2025-10-28T18:24:20.496395] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-28T18:24:20.759321] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-09. [2025-10-28T18:24:21.559365] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-06. [2025-10-28T18:24:21.681638] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-10-28T18:24:22.364421] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-03. [2025-10-28T18:24:22.380852] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-10-28T18:24:22.848377] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-28T18:24:23.159358] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-07. [2025-10-28T18:24:23.666986] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-28T18:24:23.959394] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-10. [2025-10-28T18:24:24.641874] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-28T18:24:24.759325] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-08. [2025-10-28T18:24:25.559449] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-02. [2025-10-28T18:24:25.862802] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-28T18:24:25.873391] [INFO ] [REMOTE ] DUK: Full fetch complete (77557 records). [2025-10-28T18:24:25.873511] [DEBUG] [VALIDATOR ] DUK: Validating primary data. [2025-10-28T18:24:26.275409] [DEBUG] [VALIDATOR ] DUK: All expected trading days are present. [2025-10-28T18:24:26.275673] [DEBUG] [VALIDATOR ] DUK: Primary data validation passed. [2025-10-28T18:24:26.276710] [INFO ] [MAIN ] DUK: Fetched primary data is valid. [2025-10-28T18:24:26.286959] [DEBUG] [LOCAL ] DUK: Saving primary data. [2025-10-28T18:24:26.306950] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-28T18:24:26.318633] [DEBUG] [LOCAL ] DUK: Trimmed 77557 records to 53418 (keeping 200 days of data) [2025-10-28T18:24:26.373187] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-04. [2025-10-28T18:24:26.645609] [DEBUG] [LOCAL ] DUK: Primary data saved (53418 records). [2025-10-28T18:24:26.645790] [INFO ] [MAIN ] DUK: Full history saved. [2025-10-28T18:24:26.645885] [INFO ] [MAIN ] Update Progress: 667/2366 symbols completed. DUK took 45.5s. Estimated remaining: 3h 34m 58s. Rate: 7.9 symbols/min [2025-10-28T18:24:26.819047] [INFO ] [MAIN ] DX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:24:26.819238] [DEBUG] [LOCAL ] DX: No existing data file found in primary storage. [2025-10-28T18:24:26.819275] [WARN ] [MAIN ] DX: No existing data found, performing full refresh instead. [2025-10-28T18:24:26.819385] [INFO ] [MAIN ] DX: Wiping existing primary data before full refresh. [2025-10-28T18:24:26.819426] [INFO ] [LOCAL ] DX: Starting deletion of primary data. [2025-10-28T18:24:26.819467] [DEBUG] [LOCAL ] DX: No primary data file found to delete. [2025-10-28T18:24:26.819498] [INFO ] [MAIN ] DX: Starting full primary refresh. [2025-10-28T18:24:27.167835] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-09. [2025-10-28T18:24:27.210475] [INFO ] [REMOTE ] DX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:24:27.256611] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-10-28T18:24:27.633229] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-28T18:24:27.959347] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-01. [2025-10-28T18:24:28.634324] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-28T18:24:28.759382] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-03. [2025-10-28T18:24:29.559334] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-10. [2025-10-28T18:24:29.667279] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-28T18:24:30.359402] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-02. [2025-10-28T18:24:30.495535] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-28T18:24:31.159315] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-05. [2025-10-28T18:24:31.218021] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-28T18:24:31.228286] [INFO ] [REMOTE ] DV: Full fetch complete (73903 records). [2025-10-28T18:24:31.228425] [DEBUG] [VALIDATOR ] DV: Validating primary data. [2025-10-28T18:24:31.609842] [DEBUG] [VALIDATOR ] DV: All expected trading days are present. [2025-10-28T18:24:31.609927] [DEBUG] [VALIDATOR ] DV: Primary data validation passed. [2025-10-28T18:24:31.610812] [INFO ] [MAIN ] DV: Fetched primary data is valid. [2025-10-28T18:24:31.610873] [DEBUG] [LOCAL ] DV: Saving primary data. [2025-10-28T18:24:31.612340] [DEBUG] [LOCAL ] DV: Trimmed 73903 records to 51217 (keeping 200 days of data) [2025-10-28T18:24:31.937665] [DEBUG] [LOCAL ] DV: Primary data saved (51217 records). [2025-10-28T18:24:31.938315] [INFO ] [MAIN ] DV: Full history saved. [2025-10-28T18:24:31.939518] [INFO ] [MAIN ] Update Progress: 668/2366 symbols completed. DV took 29.2s. Estimated remaining: 3h 34m 45s. Rate: 7.9 symbols/min [2025-10-28T18:24:31.939305] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-28T18:24:31.970344] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-04. [2025-10-28T18:24:32.118356] [INFO ] [MAIN ] DXC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:24:32.163052] [DEBUG] [LOCAL ] DXC: Loaded 49831 existing records from primary storage. [2025-10-28T18:24:32.163344] [INFO ] [MAIN ] DXC: Loaded 49831 existing records. [2025-10-28T18:24:32.359740] [WARN ] [MAIN ] DXC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:24:32.360064] [INFO ] [MAIN ] DXC: Wiping existing primary data before full refresh. [2025-10-28T18:24:32.360198] [INFO ] [LOCAL ] DXC: Starting deletion of primary data. [2025-10-28T18:24:32.360889] [DEBUG] [LOCAL ] DXC: Deleted primary data file. [2025-10-28T18:24:32.360950] [INFO ] [MAIN ] DXC: Starting full primary refresh. [2025-10-28T18:24:32.517590] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-28T18:24:32.765743] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-06. [2025-10-28T18:24:32.789757] [INFO ] [REMOTE ] DXC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:24:33.559405] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-03. [2025-10-28T18:24:33.862294] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-28T18:24:33.945134] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-28T18:24:34.359314] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-05. [2025-10-28T18:24:34.957796] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-28T18:24:35.159339] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-04. [2025-10-28T18:24:35.959299] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-07. [2025-10-28T18:24:36.117862] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-28T18:24:36.759314] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-01. [2025-10-28T18:24:36.834270] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-28T18:24:37.185751] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-28T18:24:37.559356] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-05. [2025-10-28T18:24:38.037810] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-28T18:24:38.359396] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-08. [2025-10-28T18:24:39.102767] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-28T18:24:39.159327] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-06. [2025-10-28T18:24:39.677719] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-28T18:24:39.959351] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-09. [2025-10-28T18:24:40.759419] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-02. [2025-10-28T18:24:40.967066] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-10-28T18:24:41.141740] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-28T18:24:41.559333] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-07. [2025-10-28T18:24:41.750808] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-28T18:24:42.359341] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-03. [2025-10-28T18:24:43.111349] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-28T18:24:43.159314] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-08. [2025-10-28T18:24:43.460152] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-28T18:24:43.959345] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-10. [2025-10-28T18:24:44.759598] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-04. [2025-10-28T18:24:44.762681] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-28T18:24:45.258428] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-28T18:24:45.266525] [INFO ] [REMOTE ] DVA: Full fetch complete (59601 records). [2025-10-28T18:24:45.266722] [DEBUG] [VALIDATOR ] DVA: Validating primary data. [2025-10-28T18:24:45.564474] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-06. [2025-10-28T18:24:45.667226] [DEBUG] [VALIDATOR ] DVA: All expected trading days are present. [2025-10-28T18:24:45.667305] [DEBUG] [VALIDATOR ] DVA: Primary data validation passed. [2025-10-28T18:24:45.668101] [INFO ] [MAIN ] DVA: Fetched primary data is valid. [2025-10-28T18:24:45.668162] [DEBUG] [LOCAL ] DVA: Saving primary data. [2025-10-28T18:24:45.669386] [DEBUG] [LOCAL ] DVA: Trimmed 59601 records to 40399 (keeping 200 days of data) [2025-10-28T18:24:45.909365] [DEBUG] [LOCAL ] DVA: Primary data saved (40399 records). [2025-10-28T18:24:45.909495] [INFO ] [MAIN ] DVA: Full history saved. [2025-10-28T18:24:45.909595] [INFO ] [MAIN ] Update Progress: 669/2366 symbols completed. DVA took 32.9s. Estimated remaining: 3h 34m 53s. Rate: 7.9 symbols/min [2025-10-28T18:24:46.080462] [INFO ] [MAIN ] DXYZ: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:24:46.108842] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-28T18:24:46.147222] [DEBUG] [LOCAL ] DXYZ: Loaded 36706 existing records from primary storage. [2025-10-28T18:24:46.147540] [INFO ] [MAIN ] DXYZ: Loaded 36706 existing records. [2025-10-28T18:24:46.321842] [WARN ] [MAIN ] DXYZ: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:24:46.322057] [INFO ] [MAIN ] DXYZ: Wiping existing primary data before full refresh. [2025-10-28T18:24:46.322105] [INFO ] [LOCAL ] DXYZ: Starting deletion of primary data. [2025-10-28T18:24:46.322995] [DEBUG] [LOCAL ] DXYZ: Deleted primary data file. [2025-10-28T18:24:46.323055] [INFO ] [MAIN ] DXYZ: Starting full primary refresh. [2025-10-28T18:24:46.367180] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-05. [2025-10-28T18:24:46.692043] [INFO ] [REMOTE ] DXYZ: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:24:47.159303] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-09. [2025-10-28T18:24:47.223785] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-28T18:24:47.793559] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-28T18:24:47.959354] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-01. [2025-10-28T18:24:48.639005] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-28T18:24:48.759350] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-06. [2025-10-28T18:24:49.559344] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-07. [2025-10-28T18:24:50.053993] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-10-28T18:24:50.219536] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-28T18:24:50.359315] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-07. [2025-10-28T18:24:51.171927] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-10. [2025-10-28T18:24:51.177750] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-28T18:24:51.729015] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-28T18:24:51.959387] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-08. [2025-10-28T18:24:52.759319] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-08. [2025-10-28T18:24:52.980283] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-28T18:24:52.990903] [INFO ] [REMOTE ] DX: Full fetch complete (75927 records). [2025-10-28T18:24:52.991031] [DEBUG] [VALIDATOR ] DX: Validating primary data. [2025-10-28T18:24:53.384195] [DEBUG] [VALIDATOR ] DX: All expected trading days are present. [2025-10-28T18:24:53.384365] [DEBUG] [VALIDATOR ] DX: Primary data validation passed. [2025-10-28T18:24:53.385322] [INFO ] [MAIN ] DX: Fetched primary data is valid. [2025-10-28T18:24:53.385399] [DEBUG] [LOCAL ] DX: Saving primary data. [2025-10-28T18:24:53.411509] [DEBUG] [LOCAL ] DX: Trimmed 75927 records to 52482 (keeping 200 days of data) [2025-10-28T18:24:53.413212] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-28T18:24:53.591573] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-09. [2025-10-28T18:24:53.737048] [DEBUG] [LOCAL ] DX: Primary data saved (52482 records). [2025-10-28T18:24:53.737179] [INFO ] [MAIN ] DX: Full history saved. [2025-10-28T18:24:53.737249] [INFO ] [MAIN ] Update Progress: 670/2366 symbols completed. DX took 27.1s. Estimated remaining: 3h 34m 46s. Rate: 7.9 symbols/min [2025-10-28T18:24:53.904107] [INFO ] [MAIN ] DY: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:24:53.929205] [DEBUG] [LOCAL ] DY: Loaded 27690 existing records from primary storage. [2025-10-28T18:24:53.929452] [INFO ] [MAIN ] DY: Loaded 27690 existing records. [2025-10-28T18:24:54.105721] [WARN ] [MAIN ] DY: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:24:54.105919] [INFO ] [MAIN ] DY: Wiping existing primary data before full refresh. [2025-10-28T18:24:54.105966] [INFO ] [LOCAL ] DY: Starting deletion of primary data. [2025-10-28T18:24:54.106782] [DEBUG] [LOCAL ] DY: Deleted primary data file. [2025-10-28T18:24:54.106838] [INFO ] [MAIN ] DY: Starting full primary refresh. [2025-10-28T18:24:54.369805] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-02. [2025-10-28T18:24:54.489164] [INFO ] [REMOTE ] DY: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:24:54.519614] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-10-28T18:24:54.889424] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-28T18:24:55.159336] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-01. [2025-10-28T18:24:55.959358] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-09. [2025-10-28T18:24:56.052438] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-28T18:24:56.144469] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-28T18:24:56.759345] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-02. [2025-10-28T18:24:57.569363] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-10. [2025-10-28T18:24:57.601898] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-10-28T18:24:57.810352] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-28T18:24:58.359358] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-03. [2025-10-28T18:24:59.137196] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-28T18:24:59.147127] [INFO ] [REMOTE ] DXC: Full fetch complete (70472 records). [2025-10-28T18:24:59.147282] [DEBUG] [VALIDATOR ] DXC: Validating primary data. [2025-10-28T18:24:59.169534] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-03. [2025-10-28T18:24:59.575069] [DEBUG] [VALIDATOR ] DXC: All expected trading days are present. [2025-10-28T18:24:59.575153] [DEBUG] [VALIDATOR ] DXC: Primary data validation passed. [2025-10-28T18:24:59.576158] [INFO ] [MAIN ] DXC: Fetched primary data is valid. [2025-10-28T18:24:59.576236] [DEBUG] [LOCAL ] DXC: Saving primary data. [2025-10-28T18:24:59.577987] [DEBUG] [LOCAL ] DXC: Trimmed 70472 records to 49802 (keeping 200 days of data) [2025-10-28T18:24:59.879155] [DEBUG] [LOCAL ] DXC: Primary data saved (49802 records). [2025-10-28T18:24:59.879287] [INFO ] [MAIN ] DXC: Full history saved. [2025-10-28T18:24:59.879364] [INFO ] [MAIN ] Update Progress: 671/2366 symbols completed. DXC took 27.9s. Estimated remaining: 3h 34m 35s. Rate: 7.9 symbols/min [2025-10-28T18:24:59.972594] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-10. [2025-10-28T18:25:00.060130] [INFO ] [MAIN ] E: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:25:00.089717] [DEBUG] [LOCAL ] E: Loaded 32833 existing records from primary storage. [2025-10-28T18:25:00.089982] [INFO ] [MAIN ] E: Loaded 32833 existing records. [2025-10-28T18:25:00.269168] [WARN ] [MAIN ] E: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:25:00.269484] [INFO ] [MAIN ] E: Wiping existing primary data before full refresh. [2025-10-28T18:25:00.269563] [INFO ] [LOCAL ] E: Starting deletion of primary data. [2025-10-28T18:25:00.282191] [DEBUG] [LOCAL ] E: Deleted primary data file. [2025-10-28T18:25:00.287398] [INFO ] [MAIN ] E: Starting full primary refresh. [2025-10-28T18:25:00.397397] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-28T18:25:00.692713] [INFO ] [REMOTE ] E: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:25:00.717413] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-28T18:25:00.759375] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-04. [2025-10-28T18:25:01.559331] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-04. [2025-10-28T18:25:01.702157] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-28T18:25:02.003085] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-10 (2.03 seconds). [2025-10-28T18:25:02.015009] [INFO ] [REMOTE ] DVN: Full fetch complete (77879 records). [2025-10-28T18:25:02.015383] [DEBUG] [VALIDATOR ] DVN: Validating primary data. [2025-10-28T18:25:02.365122] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-05. [2025-10-28T18:25:02.425293] [DEBUG] [VALIDATOR ] DVN: All expected trading days are present. [2025-10-28T18:25:02.425412] [DEBUG] [VALIDATOR ] DVN: Primary data validation passed. [2025-10-28T18:25:02.426389] [INFO ] [MAIN ] DVN: Fetched primary data is valid. [2025-10-28T18:25:02.426454] [DEBUG] [LOCAL ] DVN: Saving primary data. [2025-10-28T18:25:02.428141] [DEBUG] [LOCAL ] DVN: Trimmed 77879 records to 53699 (keeping 200 days of data) [2025-10-28T18:25:02.751830] [DEBUG] [LOCAL ] DVN: Primary data saved (53699 records). [2025-10-28T18:25:02.751971] [INFO ] [MAIN ] DVN: Full history saved. [2025-10-28T18:25:02.752048] [INFO ] [MAIN ] Update Progress: 672/2366 symbols completed. DVN took 44.7s. Estimated remaining: 3h 34m 16s. Rate: 7.9 symbols/min [2025-10-28T18:25:02.918790] [INFO ] [MAIN ] EAF: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:25:02.953441] [DEBUG] [LOCAL ] EAF: Loaded 40545 existing records from primary storage. [2025-10-28T18:25:02.953731] [INFO ] [MAIN ] EAF: Loaded 40545 existing records. [2025-10-28T18:25:03.135524] [WARN ] [MAIN ] EAF: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:25:03.135771] [INFO ] [MAIN ] EAF: Wiping existing primary data before full refresh. [2025-10-28T18:25:03.135824] [INFO ] [LOCAL ] EAF: Starting deletion of primary data. [2025-10-28T18:25:03.136415] [DEBUG] [LOCAL ] EAF: Deleted primary data file. [2025-10-28T18:25:03.136474] [INFO ] [MAIN ] EAF: Starting full primary refresh. [2025-10-28T18:25:03.166202] [INFO ] [REMOTE ] E: Fetching primary data for 2025-01. [2025-10-28T18:25:03.532973] [INFO ] [REMOTE ] EAF: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:25:03.534771] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-10-28T18:25:03.563617] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-28T18:25:03.959364] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-06. [2025-10-28T18:25:04.400364] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-28T18:25:04.759352] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-01. [2025-10-28T18:25:04.835097] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-28T18:25:05.559381] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-05. [2025-10-28T18:25:05.903672] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-28T18:25:06.359347] [INFO ] [REMOTE ] E: Fetching primary data for 2025-02. [2025-10-28T18:25:07.159339] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-02. [2025-10-28T18:25:07.213198] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-10-28T18:25:07.260935] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-28T18:25:07.959364] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-06. [2025-10-28T18:25:08.448611] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-28T18:25:08.759372] [INFO ] [REMOTE ] E: Fetching primary data for 2025-03. [2025-10-28T18:25:09.533230] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-28T18:25:09.559308] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-07. [2025-10-28T18:25:09.857271] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-10-28T18:25:10.359379] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-03. [2025-10-28T18:25:11.159317] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-07. [2025-10-28T18:25:11.731448] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-10-28T18:25:11.959340] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-08. [2025-10-28T18:25:12.067666] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-28T18:25:12.534810] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-28T18:25:12.759399] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-04. [2025-10-28T18:25:13.551583] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-28T18:25:13.559219] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-09. [2025-10-28T18:25:14.063147] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-28T18:25:14.359347] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-05. [2025-10-28T18:25:15.159389] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-08. [2025-10-28T18:25:15.254123] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-10-28T18:25:15.819332] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-28T18:25:15.959374] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-06. [2025-10-28T18:25:16.187838] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-28T18:25:16.759350] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-09. [2025-10-28T18:25:17.420503] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-28T18:25:17.559344] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-07. [2025-10-28T18:25:17.792683] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-28T18:25:18.359367] [INFO ] [REMOTE ] E: Fetching primary data for 2025-04. [2025-10-28T18:25:18.973580] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-28T18:25:19.159349] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-08. [2025-10-28T18:25:19.772979] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-28T18:25:19.959339] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-10. [2025-10-28T18:25:20.394887] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-28T18:25:20.759369] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-09. [2025-10-28T18:25:21.559353] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-10. [2025-10-28T18:25:21.616755] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-28T18:25:21.933130] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-10 (1.97 seconds). [2025-10-28T18:25:21.941237] [INFO ] [REMOTE ] DXYZ: Full fetch complete (56186 records). [2025-10-28T18:25:21.941408] [DEBUG] [VALIDATOR ] DXYZ: Validating primary data. [2025-10-28T18:25:22.318109] [DEBUG] [VALIDATOR ] DXYZ: All expected trading days are present. [2025-10-28T18:25:22.318188] [DEBUG] [VALIDATOR ] DXYZ: Primary data validation passed. [2025-10-28T18:25:22.318901] [INFO ] [MAIN ] DXYZ: Fetched primary data is valid. [2025-10-28T18:25:22.318962] [DEBUG] [LOCAL ] DXYZ: Saving primary data. [2025-10-28T18:25:22.320086] [DEBUG] [LOCAL ] DXYZ: Trimmed 56186 records to 36619 (keeping 200 days of data) [2025-10-28T18:25:22.367107] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-10. [2025-10-28T18:25:22.536422] [DEBUG] [LOCAL ] DXYZ: Primary data saved (36619 records). [2025-10-28T18:25:22.536539] [INFO ] [MAIN ] DXYZ: Full history saved. [2025-10-28T18:25:22.536639] [INFO ] [MAIN ] Update Progress: 673/2366 symbols completed. DXYZ took 36.6s. Estimated remaining: 3h 34m 39s. Rate: 7.9 symbols/min [2025-10-28T18:25:22.697152] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-28T18:25:22.725628] [INFO ] [MAIN ] EAI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:25:22.726386] [INFO ] [REMOTE ] DY: Full fetch complete (43187 records). [2025-10-28T18:25:22.726549] [DEBUG] [VALIDATOR ] DY: Validating primary data. [2025-10-28T18:25:22.834679] [DEBUG] [LOCAL ] EAI: Loaded 3807 existing records from primary storage. [2025-10-28T18:25:22.837597] [INFO ] [MAIN ] EAI: Loaded 3807 existing records. [2025-10-28T18:25:23.182943] [INFO ] [REMOTE ] E: Fetching primary data for 2025-05. [2025-10-28T18:25:23.213803] [WARN ] [MAIN ] EAI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:25:23.233593] [INFO ] [MAIN ] EAI: Wiping existing primary data before full refresh. [2025-10-28T18:25:23.239453] [INFO ] [LOCAL ] EAI: Starting deletion of primary data. [2025-10-28T18:25:23.250337] [DEBUG] [LOCAL ] EAI: Deleted primary data file. [2025-10-28T18:25:23.255551] [INFO ] [MAIN ] EAI: Starting full primary refresh. [2025-10-28T18:25:23.443824] [DEBUG] [VALIDATOR ] DY: All expected trading days are present. [2025-10-28T18:25:23.448671] [DEBUG] [VALIDATOR ] DY: Primary data validation passed. [2025-10-28T18:25:23.449461] [INFO ] [MAIN ] DY: Fetched primary data is valid. [2025-10-28T18:25:23.455211] [DEBUG] [LOCAL ] DY: Saving primary data. [2025-10-28T18:25:23.603031] [DEBUG] [LOCAL ] DY: Trimmed 43187 records to 27594 (keeping 200 days of data) [2025-10-28T18:25:23.851455] [INFO ] [REMOTE ] EAI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:25:23.863278] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-28T18:25:23.870972] [INFO ] [REMOTE ] EAF: Full fetch complete (61583 records). [2025-10-28T18:25:23.874983] [DEBUG] [VALIDATOR ] EAF: Validating primary data. [2025-10-28T18:25:23.964682] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-01. [2025-10-28T18:25:24.076969] [DEBUG] [LOCAL ] DY: Primary data saved (27594 records). [2025-10-28T18:25:24.095341] [INFO ] [MAIN ] DY: Full history saved. [2025-10-28T18:25:24.105779] [INFO ] [MAIN ] Update Progress: 674/2366 symbols completed. DY took 30.4s. Estimated remaining: 3h 34m 16s. Rate: 7.9 symbols/min [2025-10-28T18:25:24.504999] [INFO ] [MAIN ] EARN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:25:24.547756] [DEBUG] [VALIDATOR ] EAF: All expected trading days are present. [2025-10-28T18:25:24.555571] [DEBUG] [VALIDATOR ] EAF: Primary data validation passed. [2025-10-28T18:25:24.556592] [INFO ] [MAIN ] EAF: Fetched primary data is valid. [2025-10-28T18:25:24.555487] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-28T18:25:24.568024] [DEBUG] [LOCAL ] EAF: Saving primary data. [2025-10-28T18:25:24.571812] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-28T18:25:24.590701] [DEBUG] [LOCAL ] EAF: Trimmed 61583 records to 40560 (keeping 200 days of data) [2025-10-28T18:25:24.703843] [DEBUG] [LOCAL ] EARN: Loaded 27168 existing records from primary storage. [2025-10-28T18:25:24.712370] [INFO ] [MAIN ] EARN: Loaded 27168 existing records. [2025-10-28T18:25:24.789934] [INFO ] [REMOTE ] E: Fetching primary data for 2025-06. [2025-10-28T18:25:24.986156] [WARN ] [MAIN ] EARN: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:25:24.990017] [INFO ] [MAIN ] EARN: Wiping existing primary data before full refresh. [2025-10-28T18:25:24.990094] [INFO ] [LOCAL ] EARN: Starting deletion of primary data. [2025-10-28T18:25:24.991387] [DEBUG] [LOCAL ] EARN: Deleted primary data file. [2025-10-28T18:25:24.991458] [INFO ] [MAIN ] EARN: Starting full primary refresh. [2025-10-28T18:25:25.161808] [DEBUG] [LOCAL ] EAF: Primary data saved (40560 records). [2025-10-28T18:25:25.172605] [INFO ] [MAIN ] EAF: Full history saved. [2025-10-28T18:25:25.183032] [INFO ] [MAIN ] Update Progress: 675/2366 symbols completed. EAF took 22.4s. Estimated remaining: 3h 33m 52s. Rate: 7.9 symbols/min [2025-10-28T18:25:25.531145] [INFO ] [MAIN ] EAT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:25:25.552266] [INFO ] [REMOTE ] EARN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:25:25.559371] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-01. [2025-10-28T18:25:25.596529] [DEBUG] [LOCAL ] EAT: Loaded 49667 existing records from primary storage. [2025-10-28T18:25:25.596907] [INFO ] [MAIN ] EAT: Loaded 49667 existing records. [2025-10-28T18:25:25.774631] [WARN ] [MAIN ] EAT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:25:25.774842] [INFO ] [MAIN ] EAT: Wiping existing primary data before full refresh. [2025-10-28T18:25:25.774888] [INFO ] [LOCAL ] EAT: Starting deletion of primary data. [2025-10-28T18:25:25.775697] [DEBUG] [LOCAL ] EAT: Deleted primary data file. [2025-10-28T18:25:25.775754] [INFO ] [MAIN ] EAT: Starting full primary refresh. [2025-10-28T18:25:26.150932] [INFO ] [REMOTE ] EAT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:25:26.154583] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-28T18:25:26.359322] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-01. [2025-10-28T18:25:26.743294] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-28T18:25:27.159311] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-02. [2025-10-28T18:25:27.798051] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-28T18:25:27.959351] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-02. [2025-10-28T18:25:28.223334] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-28T18:25:28.759324] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-03. [2025-10-28T18:25:29.353198] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-28T18:25:29.559332] [INFO ] [REMOTE ] E: Fetching primary data for 2025-07. [2025-10-28T18:25:30.086283] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-28T18:25:30.359393] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-02. [2025-10-28T18:25:30.835694] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-28T18:25:30.835458] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-28T18:25:31.159335] [INFO ] [REMOTE ] E: Fetching primary data for 2025-08. [2025-10-28T18:25:31.959342] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-03. [2025-10-28T18:25:32.175887] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-28T18:25:32.759330] [INFO ] [REMOTE ] E: Fetching primary data for 2025-09. [2025-10-28T18:25:33.295614] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-28T18:25:33.559327] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-03. [2025-10-28T18:25:33.832667] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-28T18:25:33.966252] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-10-28T18:25:34.359382] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-04. [2025-10-28T18:25:34.859463] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-28T18:25:35.159397] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-05. [2025-10-28T18:25:35.547789] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-10-28T18:25:35.959369] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-06. [2025-10-28T18:25:36.333169] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-10-28T18:25:36.759365] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-07. [2025-10-28T18:25:37.209674] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-10-28T18:25:37.559346] [INFO ] [REMOTE ] E: Fetching primary data for 2025-10. [2025-10-28T18:25:38.359347] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-04. [2025-10-28T18:25:38.921769] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-28T18:25:38.928221] [INFO ] [REMOTE ] E: Full fetch complete (47560 records). [2025-10-28T18:25:38.928345] [DEBUG] [VALIDATOR ] E: Validating primary data. [2025-10-28T18:25:39.167848] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-04. [2025-10-28T18:25:39.322947] [DEBUG] [VALIDATOR ] E: All expected trading days are present. [2025-10-28T18:25:39.323025] [DEBUG] [VALIDATOR ] E: Primary data validation passed. [2025-10-28T18:25:39.323734] [INFO ] [MAIN ] E: Fetched primary data is valid. [2025-10-28T18:25:39.323798] [DEBUG] [LOCAL ] E: Saving primary data. [2025-10-28T18:25:39.324933] [DEBUG] [LOCAL ] E: Trimmed 47560 records to 32661 (keeping 200 days of data) [2025-10-28T18:25:39.523971] [DEBUG] [LOCAL ] E: Primary data saved (32661 records). [2025-10-28T18:25:39.524109] [INFO ] [MAIN ] E: Full history saved. [2025-10-28T18:25:39.524190] [INFO ] [MAIN ] Update Progress: 676/2366 symbols completed. E took 39.6s. Estimated remaining: 3h 34m 1s. Rate: 7.9 symbols/min [2025-10-28T18:25:39.690109] [INFO ] [MAIN ] EB: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:25:39.719982] [DEBUG] [LOCAL ] EB: Loaded 35786 existing records from primary storage. [2025-10-28T18:25:39.720238] [INFO ] [MAIN ] EB: Loaded 35786 existing records. [2025-10-28T18:25:39.902588] [WARN ] [MAIN ] EB: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:25:39.902996] [INFO ] [MAIN ] EB: Wiping existing primary data before full refresh. [2025-10-28T18:25:39.903160] [INFO ] [LOCAL ] EB: Starting deletion of primary data. [2025-10-28T18:25:39.903815] [DEBUG] [LOCAL ] EB: Deleted primary data file. [2025-10-28T18:25:39.903874] [INFO ] [MAIN ] EB: Starting full primary refresh. [2025-10-28T18:25:39.965964] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-08. [2025-10-28T18:25:40.277230] [INFO ] [REMOTE ] EB: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:25:40.311217] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-10-28T18:25:40.383803] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-10-28T18:25:40.593789] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-10-28T18:25:40.759316] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-05. [2025-10-28T18:25:41.559344] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-01. [2025-10-28T18:25:42.213418] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-28T18:25:42.359318] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-06. [2025-10-28T18:25:42.825384] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-28T18:25:43.159358] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-05. [2025-10-28T18:25:43.810770] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-28T18:25:43.959337] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-02. [2025-10-28T18:25:44.244830] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-28T18:25:44.759386] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-09. [2025-10-28T18:25:44.992630] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-28T18:25:45.224091] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-28T18:25:45.559324] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-03. [2025-10-28T18:25:46.359335] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-10. [2025-10-28T18:25:46.832802] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-28T18:25:46.833988] [INFO ] [REMOTE ] EAI: Full fetch complete (5646 records). [2025-10-28T18:25:46.834055] [DEBUG] [VALIDATOR ] EAI: Validating primary data. [2025-10-28T18:25:46.834389] [FATAL] [VALIDATOR ] EAI: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T18:25:46.834480] [FATAL] [MAIN ] EAI: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:25:46.834560] [WARN ] [MAIN ] EAI: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:25:46.834684] [INFO ] [LOCAL ] EAI: Starting deletion of primary data. [2025-10-28T18:25:46.834765] [DEBUG] [LOCAL ] EAI: No primary data file found to delete. [2025-10-28T18:25:46.834803] [INFO ] [LOCAL ] EAI: Starting deletion of derivative data. [2025-10-28T18:25:46.834949] [DEBUG] [LOCAL ] EAI: Deleted derivative data file. [2025-10-28T18:25:46.835018] [INFO ] [MAIN ] Update Progress: 677/2366 symbols completed. EAI took 24.3s. Estimated remaining: 3h 33m 53s. Rate: 7.9 symbols/min [2025-10-28T18:25:47.005264] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-28T18:25:47.159327] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-07. [2025-10-28T18:25:47.959387] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-04. [2025-10-28T18:25:48.541626] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-28T18:25:48.759381] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-06. [2025-10-28T18:25:49.052394] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-28T18:25:49.564441] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-08. [2025-10-28T18:25:49.576218] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-28T18:25:50.359363] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-07. [2025-10-28T18:25:50.985495] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-28T18:25:51.159320] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-05. [2025-10-28T18:25:51.258916] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-28T18:25:51.959339] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-08. [2025-10-28T18:25:52.272132] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-28T18:25:52.759302] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-06. [2025-10-28T18:25:52.869431] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-28T18:25:53.559322] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-09. [2025-10-28T18:25:53.742690] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-28T18:25:54.359326] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-09. [2025-10-28T18:25:55.036459] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-28T18:25:55.147343] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-28T18:25:55.159300] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-10. [2025-10-28T18:25:55.959330] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-07. [2025-10-28T18:25:56.234540] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-28T18:25:56.240509] [INFO ] [REMOTE ] EARN: Full fetch complete (44741 records). [2025-10-28T18:25:56.240721] [DEBUG] [VALIDATOR ] EARN: Validating primary data. [2025-10-28T18:25:56.241361] [FATAL] [VALIDATOR ] EARN: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T18:25:56.241447] [FATAL] [MAIN ] EARN: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:25:56.241491] [WARN ] [MAIN ] EARN: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:25:56.241563] [INFO ] [LOCAL ] EARN: Starting deletion of primary data. [2025-10-28T18:25:56.241627] [DEBUG] [LOCAL ] EARN: No primary data file found to delete. [2025-10-28T18:25:56.241707] [INFO ] [LOCAL ] EARN: Starting deletion of derivative data. [2025-10-28T18:25:56.241918] [DEBUG] [LOCAL ] EARN: Deleted derivative data file. [2025-10-28T18:25:56.242018] [INFO ] [MAIN ] Update Progress: 678/2366 symbols completed. EARN took 32.1s. Estimated remaining: 3h 33m 50s. Rate: 7.9 symbols/min [2025-10-28T18:25:56.759337] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-10. [2025-10-28T18:25:57.118944] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-28T18:25:57.559319] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-08. [2025-10-28T18:25:58.471909] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-28T18:25:58.481691] [INFO ] [REMOTE ] EAT: Full fetch complete (72477 records). [2025-10-28T18:25:58.481822] [DEBUG] [VALIDATOR ] EAT: Validating primary data. [2025-10-28T18:25:58.841919] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-28T18:25:58.910727] [DEBUG] [VALIDATOR ] EAT: All expected trading days are present. [2025-10-28T18:25:58.910920] [DEBUG] [VALIDATOR ] EAT: Primary data validation passed. [2025-10-28T18:25:58.911775] [INFO ] [MAIN ] EAT: Fetched primary data is valid. [2025-10-28T18:25:58.911851] [DEBUG] [LOCAL ] EAT: Saving primary data. [2025-10-28T18:25:58.912144] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-09. [2025-10-28T18:25:58.914003] [DEBUG] [LOCAL ] EAT: Trimmed 72477 records to 49680 (keeping 200 days of data) [2025-10-28T18:25:59.200829] [DEBUG] [LOCAL ] EAT: Primary data saved (49680 records). [2025-10-28T18:25:59.200947] [INFO ] [MAIN ] EAT: Full history saved. [2025-10-28T18:25:59.201029] [INFO ] [MAIN ] Update Progress: 679/2366 symbols completed. EAT took 34.0s. Estimated remaining: 3h 33m 31s. Rate: 7.9 symbols/min [2025-10-28T18:25:59.949619] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-28T18:25:59.956900] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-10. [2025-10-28T18:26:01.326206] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-28T18:26:01.332704] [INFO ] [REMOTE ] EB: Full fetch complete (54587 records). [2025-10-28T18:26:01.332794] [DEBUG] [VALIDATOR ] EB: Validating primary data. [2025-10-28T18:26:01.701474] [DEBUG] [VALIDATOR ] EB: All expected trading days are present. [2025-10-28T18:26:01.701539] [DEBUG] [VALIDATOR ] EB: Primary data validation passed. [2025-10-28T18:26:01.702365] [INFO ] [MAIN ] EB: Fetched primary data is valid. [2025-10-28T18:26:01.702435] [DEBUG] [LOCAL ] EB: Saving primary data. [2025-10-28T18:26:01.703533] [DEBUG] [LOCAL ] EB: Trimmed 54587 records to 35675 (keeping 200 days of data) [2025-10-28T18:26:01.896112] [DEBUG] [LOCAL ] EB: Primary data saved (35675 records). [2025-10-28T18:26:01.896243] [INFO ] [MAIN ] EB: Full history saved. [2025-10-28T18:26:01.896319] [INFO ] [MAIN ] Update Progress: 680/2366 symbols completed. EB took 22.4s. Estimated remaining: 3h 33m 11s. Rate: 7.9 symbols/min [2025-10-28T18:26:02.502129] [INFO ] [MAIN ] EBF: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:26:02.592163] [INFO ] [MAIN ] EBR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:26:02.617770] [INFO ] [MAIN ] EBS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:26:02.626329] [DEBUG] [LOCAL ] EBR: No existing data file found in primary storage. [2025-10-28T18:26:02.644553] [INFO ] [MAIN ] EC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:26:02.645541] [WARN ] [MAIN ] EBR: No existing data found, performing full refresh instead. [2025-10-28T18:26:02.646468] [INFO ] [MAIN ] EBR: Wiping existing primary data before full refresh. [2025-10-28T18:26:02.646521] [INFO ] [LOCAL ] EBR: Starting deletion of primary data. [2025-10-28T18:26:02.646918] [DEBUG] [LOCAL ] EBR: No primary data file found to delete. [2025-10-28T18:26:02.646997] [INFO ] [MAIN ] EBR: Starting full primary refresh. [2025-10-28T18:26:02.841982] [DEBUG] [LOCAL ] EBF: Loaded 19197 existing records from primary storage. [2025-10-28T18:26:02.859724] [INFO ] [MAIN ] EBF: Loaded 19197 existing records. [2025-10-28T18:26:03.051350] [DEBUG] [LOCAL ] EBS: Loaded 46495 existing records from primary storage. [2025-10-28T18:26:03.105583] [INFO ] [MAIN ] EBS: Loaded 46495 existing records. [2025-10-28T18:26:03.068798] [DEBUG] [LOCAL ] EC: Loaded 48770 existing records from primary storage. [2025-10-28T18:26:03.116233] [INFO ] [MAIN ] EC: Loaded 48770 existing records. [2025-10-28T18:26:03.382968] [WARN ] [MAIN ] EBF: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:26:03.438974] [INFO ] [REMOTE ] EBR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:26:03.442875] [INFO ] [MAIN ] EBF: Wiping existing primary data before full refresh. [2025-10-28T18:26:03.448150] [INFO ] [LOCAL ] EBF: Starting deletion of primary data. [2025-10-28T18:26:03.442779] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-01. [2025-10-28T18:26:03.454836] [DEBUG] [LOCAL ] EBF: Deleted primary data file. [2025-10-28T18:26:03.475904] [INFO ] [MAIN ] EBF: Starting full primary refresh. [2025-10-28T18:26:03.661344] [WARN ] [MAIN ] EC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:26:03.713420] [INFO ] [MAIN ] EC: Wiping existing primary data before full refresh. [2025-10-28T18:26:03.732772] [WARN ] [MAIN ] EBS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:26:03.736197] [INFO ] [LOCAL ] EC: Starting deletion of primary data. [2025-10-28T18:26:03.736313] [INFO ] [MAIN ] EBS: Wiping existing primary data before full refresh. [2025-10-28T18:26:03.736447] [INFO ] [LOCAL ] EBS: Starting deletion of primary data. [2025-10-28T18:26:03.736798] [DEBUG] [LOCAL ] EC: Deleted primary data file. [2025-10-28T18:26:03.736887] [INFO ] [MAIN ] EC: Starting full primary refresh. [2025-10-28T18:26:03.758584] [DEBUG] [LOCAL ] EBS: Deleted primary data file. [2025-10-28T18:26:03.778214] [INFO ] [MAIN ] EBS: Starting full primary refresh. [2025-10-28T18:26:04.594258] [INFO ] [REMOTE ] EBF: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:26:04.612088] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-01. [2025-10-28T18:26:04.735861] [INFO ] [REMOTE ] EC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:26:04.739010] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-01. [2025-10-28T18:26:04.769690] [INFO ] [REMOTE ] EBS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:26:04.770110] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-01. [2025-10-28T18:26:05.131772] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-28T18:26:05.140450] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-02. [2025-10-28T18:26:05.429453] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-28T18:26:05.433557] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-02. [2025-10-28T18:26:06.001484] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-28T18:26:06.010569] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-02. [2025-10-28T18:26:06.195048] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-28T18:26:06.199749] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-03. [2025-10-28T18:26:06.248177] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-28T18:26:06.328266] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-28T18:26:06.359295] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-02. [2025-10-28T18:26:06.939418] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-28T18:26:07.106615] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-28T18:26:07.159323] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-03. [2025-10-28T18:26:07.721345] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-28T18:26:07.959340] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-04. [2025-10-28T18:26:08.509633] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-28T18:26:08.759306] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-03. [2025-10-28T18:26:08.863154] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-28T18:26:09.559324] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-03. [2025-10-28T18:26:09.924442] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-28T18:26:10.359386] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-05. [2025-10-28T18:26:10.948154] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-28T18:26:11.159332] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-04. [2025-10-28T18:26:11.216140] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-28T18:26:11.959331] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-04. [2025-10-28T18:26:12.676988] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-28T18:26:12.759327] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-05. [2025-10-28T18:26:13.350069] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-28T18:26:13.559354] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-06. [2025-10-28T18:26:14.278223] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-28T18:26:14.359308] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-06. [2025-10-28T18:26:14.459298] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-28T18:26:15.159341] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-07. [2025-10-28T18:26:15.713676] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-28T18:26:15.959299] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-07. [2025-10-28T18:26:16.098689] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-28T18:26:16.759315] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-08. [2025-10-28T18:26:17.453331] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-28T18:26:17.481991] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-28T18:26:17.559324] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-05. [2025-10-28T18:26:18.359338] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-04. [2025-10-28T18:26:19.100981] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-28T18:26:19.159333] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-09. [2025-10-28T18:26:19.677733] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-28T18:26:19.845348] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-28T18:26:19.959362] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-08. [2025-10-28T18:26:20.759338] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-05. [2025-10-28T18:26:21.559320] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-06. [2025-10-28T18:26:21.632453] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-28T18:26:21.909185] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-28T18:26:22.359394] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-09. [2025-10-28T18:26:22.813870] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-28T18:26:23.159388] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-07. [2025-10-28T18:26:23.639854] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-28T18:26:23.959363] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-10. [2025-10-28T18:26:24.612638] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-28T18:26:24.759384] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-06. [2025-10-28T18:26:25.054847] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-28T18:26:25.059693] [INFO ] [REMOTE ] EBF: Full fetch complete (28275 records). [2025-10-28T18:26:25.059769] [DEBUG] [VALIDATOR ] EBF: Validating primary data. [2025-10-28T18:26:25.060205] [FATAL] [VALIDATOR ] EBF: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T18:26:25.060282] [FATAL] [MAIN ] EBF: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:26:25.060324] [WARN ] [MAIN ] EBF: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:26:25.060362] [INFO ] [LOCAL ] EBF: Starting deletion of primary data. [2025-10-28T18:26:25.060436] [DEBUG] [LOCAL ] EBF: No primary data file found to delete. [2025-10-28T18:26:25.060471] [INFO ] [LOCAL ] EBF: Starting deletion of derivative data. [2025-10-28T18:26:25.060620] [DEBUG] [LOCAL ] EBF: Deleted derivative data file. [2025-10-28T18:26:25.060723] [INFO ] [MAIN ] Update Progress: 681/2366 symbols completed. EBF took 23.2s. Estimated remaining: 3h 33m 42s. Rate: 7.9 symbols/min [2025-10-28T18:26:25.232061] [INFO ] [MAIN ] ECAT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:26:25.259955] [DEBUG] [LOCAL ] ECAT: Loaded 28876 existing records from primary storage. [2025-10-28T18:26:25.260215] [INFO ] [MAIN ] ECAT: Loaded 28876 existing records. [2025-10-28T18:26:25.431603] [WARN ] [MAIN ] ECAT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:26:25.431825] [INFO ] [MAIN ] ECAT: Wiping existing primary data before full refresh. [2025-10-28T18:26:25.431874] [INFO ] [LOCAL ] ECAT: Starting deletion of primary data. [2025-10-28T18:26:25.432445] [DEBUG] [LOCAL ] ECAT: Deleted primary data file. [2025-10-28T18:26:25.432501] [INFO ] [MAIN ] ECAT: Starting full primary refresh. [2025-10-28T18:26:25.567455] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-08. [2025-10-28T18:26:25.782979] [INFO ] [REMOTE ] ECAT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:26:25.847966] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-28T18:26:26.359344] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-07. [2025-10-28T18:26:26.852361] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-28T18:26:27.159342] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-09. [2025-10-28T18:26:27.549356] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-28T18:26:27.959395] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-01. [2025-10-28T18:26:28.467765] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-28T18:26:28.759307] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-10. [2025-10-28T18:26:28.932613] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-28T18:26:29.559350] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-02. [2025-10-28T18:26:30.359323] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-10. [2025-10-28T18:26:30.387849] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-28T18:26:30.421509] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-28T18:26:30.430541] [INFO ] [REMOTE ] EBS: Full fetch complete (67374 records). [2025-10-28T18:26:30.430704] [DEBUG] [VALIDATOR ] EBS: Validating primary data. [2025-10-28T18:26:30.844700] [DEBUG] [VALIDATOR ] EBS: All expected trading days are present. [2025-10-28T18:26:30.844800] [DEBUG] [VALIDATOR ] EBS: Primary data validation passed. [2025-10-28T18:26:30.845600] [INFO ] [MAIN ] EBS: Fetched primary data is valid. [2025-10-28T18:26:30.845665] [DEBUG] [LOCAL ] EBS: Saving primary data. [2025-10-28T18:26:30.847240] [DEBUG] [LOCAL ] EBS: Trimmed 67374 records to 46486 (keeping 200 days of data) [2025-10-28T18:26:31.101056] [DEBUG] [LOCAL ] EBS: Primary data saved (46486 records). [2025-10-28T18:26:31.101185] [INFO ] [MAIN ] EBS: Full history saved. [2025-10-28T18:26:31.101265] [INFO ] [MAIN ] Update Progress: 682/2366 symbols completed. EBS took 29.2s. Estimated remaining: 3h 33m 31s. Rate: 7.9 symbols/min [2025-10-28T18:26:31.159395] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-03. [2025-10-28T18:26:31.271746] [INFO ] [MAIN ] ECC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:26:31.271938] [DEBUG] [LOCAL ] ECC: No existing data file found in primary storage. [2025-10-28T18:26:31.271980] [WARN ] [MAIN ] ECC: No existing data found, performing full refresh instead. [2025-10-28T18:26:31.272087] [INFO ] [MAIN ] ECC: Wiping existing primary data before full refresh. [2025-10-28T18:26:31.272126] [INFO ] [LOCAL ] ECC: Starting deletion of primary data. [2025-10-28T18:26:31.272165] [DEBUG] [LOCAL ] ECC: No primary data file found to delete. [2025-10-28T18:26:31.272197] [INFO ] [MAIN ] ECC: Starting full primary refresh. [2025-10-28T18:26:31.613665] [INFO ] [REMOTE ] ECC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:26:31.964570] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-01. [2025-10-28T18:26:31.982723] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-28T18:26:31.995722] [INFO ] [REMOTE ] EC: Full fetch complete (71512 records). [2025-10-28T18:26:31.995899] [DEBUG] [VALIDATOR ] EC: Validating primary data. [2025-10-28T18:26:31.996553] [FATAL] [VALIDATOR ] EC: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T18:26:31.996688] [FATAL] [MAIN ] EC: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:26:31.996757] [WARN ] [MAIN ] EC: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:26:31.996840] [INFO ] [LOCAL ] EC: Starting deletion of primary data. [2025-10-28T18:26:31.996927] [DEBUG] [LOCAL ] EC: No primary data file found to delete. [2025-10-28T18:26:31.996967] [INFO ] [LOCAL ] EC: Starting deletion of derivative data. [2025-10-28T18:26:31.997124] [DEBUG] [LOCAL ] EC: Deleted derivative data file. [2025-10-28T18:26:31.997235] [INFO ] [MAIN ] Update Progress: 683/2366 symbols completed. EC took 30.1s. Estimated remaining: 3h 33m 6s. Rate: 7.9 symbols/min [2025-10-28T18:26:32.176969] [INFO ] [MAIN ] ECCC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:26:32.177246] [DEBUG] [LOCAL ] ECCC: No existing data file found in primary storage. [2025-10-28T18:26:32.177296] [WARN ] [MAIN ] ECCC: No existing data found, performing full refresh instead. [2025-10-28T18:26:32.177401] [INFO ] [MAIN ] ECCC: Wiping existing primary data before full refresh. [2025-10-28T18:26:32.177440] [INFO ] [LOCAL ] ECCC: Starting deletion of primary data. [2025-10-28T18:26:32.177480] [DEBUG] [LOCAL ] ECCC: No primary data file found to delete. [2025-10-28T18:26:32.177511] [INFO ] [MAIN ] ECCC: Starting full primary refresh. [2025-10-28T18:26:32.435439] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-28T18:26:32.593297] [INFO ] [REMOTE ] ECCC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:26:32.759381] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-01. [2025-10-28T18:26:33.081808] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-01 (0.32 seconds). [2025-10-28T18:26:33.228547] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-28T18:26:33.559344] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-02. [2025-10-28T18:26:33.783764] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-02 (0.22 seconds). [2025-10-28T18:26:34.359404] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-04. [2025-10-28T18:26:35.159348] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-08. [2025-10-28T18:26:35.232163] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-28T18:26:35.959424] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-02. [2025-10-28T18:26:36.521553] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-28T18:26:36.759386] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-05. [2025-10-28T18:26:37.053737] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-28T18:26:37.559311] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-03. [2025-10-28T18:26:37.619785] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-28T18:26:38.359387] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-09. [2025-10-28T18:26:38.935252] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-28T18:26:39.159326] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-04. [2025-10-28T18:26:39.543490] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-28T18:26:39.959345] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-03. [2025-10-28T18:26:40.192083] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-03 (0.23 seconds). [2025-10-28T18:26:40.524961] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-28T18:26:40.759329] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-05. [2025-10-28T18:26:41.559333] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-04. [2025-10-28T18:26:41.792941] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-04 (0.23 seconds). [2025-10-28T18:26:42.015501] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-28T18:26:42.359336] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-06. [2025-10-28T18:26:43.159352] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-10. [2025-10-28T18:26:43.755026] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-28T18:26:43.959345] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-07. [2025-10-28T18:26:44.463671] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-28T18:26:44.475488] [INFO ] [REMOTE ] EBR: Full fetch complete (62376 records). [2025-10-28T18:26:44.475700] [DEBUG] [VALIDATOR ] EBR: Validating primary data. [2025-10-28T18:26:44.764450] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-05. [2025-10-28T18:26:44.892149] [DEBUG] [VALIDATOR ] EBR: All expected trading days are present. [2025-10-28T18:26:44.892241] [DEBUG] [VALIDATOR ] EBR: Primary data validation passed. [2025-10-28T18:26:44.893027] [INFO ] [MAIN ] EBR: Fetched primary data is valid. [2025-10-28T18:26:44.893091] [DEBUG] [LOCAL ] EBR: Saving primary data. [2025-10-28T18:26:44.894385] [DEBUG] [LOCAL ] EBR: Trimmed 62376 records to 43196 (keeping 200 days of data) [2025-10-28T18:26:45.137109] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-10-28T18:26:45.150224] [DEBUG] [LOCAL ] EBR: Primary data saved (43196 records). [2025-10-28T18:26:45.150555] [INFO ] [MAIN ] EBR: Full history saved. [2025-10-28T18:26:45.150712] [INFO ] [MAIN ] Update Progress: 684/2366 symbols completed. EBR took 43.3s. Estimated remaining: 3h 33m 12s. Rate: 7.9 symbols/min [2025-10-28T18:26:45.345412] [INFO ] [MAIN ] ECCU: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:26:45.347808] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-28T18:26:45.360554] [DEBUG] [LOCAL ] ECCU: Loaded 2087 existing records from primary storage. [2025-10-28T18:26:45.360781] [INFO ] [MAIN ] ECCU: Loaded 2087 existing records. [2025-10-28T18:26:45.539053] [WARN ] [MAIN ] ECCU: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:26:45.539314] [INFO ] [MAIN ] ECCU: Wiping existing primary data before full refresh. [2025-10-28T18:26:45.539373] [INFO ] [LOCAL ] ECCU: Starting deletion of primary data. [2025-10-28T18:26:45.539499] [DEBUG] [LOCAL ] ECCU: Deleted primary data file. [2025-10-28T18:26:45.539537] [INFO ] [MAIN ] ECCU: Starting full primary refresh. [2025-10-28T18:26:45.568721] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-06. [2025-10-28T18:26:45.897686] [INFO ] [REMOTE ] ECCU: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:26:46.359395] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-06. [2025-10-28T18:26:46.608673] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-06 (0.25 seconds). [2025-10-28T18:26:46.721125] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-28T18:26:47.159357] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-08. [2025-10-28T18:26:47.959394] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-01. [2025-10-28T18:26:48.639426] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-28T18:26:48.759407] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-07. [2025-10-28T18:26:48.985495] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-28T18:26:49.559335] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-07. [2025-10-28T18:26:49.788860] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-07 (0.23 seconds). [2025-10-28T18:26:49.865503] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-28T18:26:50.359335] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-02. [2025-10-28T18:26:50.727192] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-10-28T18:26:51.159345] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-08. [2025-10-28T18:26:51.959398] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-09. [2025-10-28T18:26:52.195140] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-28T18:26:52.759332] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-09. [2025-10-28T18:26:53.196236] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-28T18:26:53.559313] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-03. [2025-10-28T18:26:53.686683] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-28T18:26:53.930141] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-10-28T18:26:54.359334] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-10. [2025-10-28T18:26:55.159318] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-04. [2025-10-28T18:26:55.277502] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-28T18:26:55.282902] [INFO ] [REMOTE ] ECAT: Full fetch complete (42600 records). [2025-10-28T18:26:55.283008] [DEBUG] [VALIDATOR ] ECAT: Validating primary data. [2025-10-28T18:26:55.283581] [FATAL] [VALIDATOR ] ECAT: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T18:26:55.283687] [FATAL] [MAIN ] ECAT: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:26:55.283737] [WARN ] [MAIN ] ECAT: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:26:55.283799] [INFO ] [LOCAL ] ECAT: Starting deletion of primary data. [2025-10-28T18:26:55.283862] [DEBUG] [LOCAL ] ECAT: No primary data file found to delete. [2025-10-28T18:26:55.283896] [INFO ] [LOCAL ] ECAT: Starting deletion of derivative data. [2025-10-28T18:26:55.284086] [DEBUG] [LOCAL ] ECAT: Deleted derivative data file. [2025-10-28T18:26:55.284187] [INFO ] [MAIN ] Update Progress: 685/2366 symbols completed. ECAT took 30.2s. Estimated remaining: 3h 33m 11s. Rate: 7.9 symbols/min [2025-10-28T18:26:55.454118] [INFO ] [MAIN ] ECCW: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:26:55.454304] [DEBUG] [LOCAL ] ECCW: No existing data file found in primary storage. [2025-10-28T18:26:55.454342] [WARN ] [MAIN ] ECCW: No existing data found, performing full refresh instead. [2025-10-28T18:26:55.454470] [INFO ] [MAIN ] ECCW: Wiping existing primary data before full refresh. [2025-10-28T18:26:55.454540] [INFO ] [LOCAL ] ECCW: Starting deletion of primary data. [2025-10-28T18:26:55.454632] [DEBUG] [LOCAL ] ECCW: No primary data file found to delete. [2025-10-28T18:26:55.454728] [INFO ] [MAIN ] ECCW: Starting full primary refresh. [2025-10-28T18:26:55.579155] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-28T18:26:55.816718] [INFO ] [REMOTE ] ECCW: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:26:55.959324] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-08. [2025-10-28T18:26:56.291321] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-10-28T18:26:56.759332] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-10. [2025-10-28T18:26:57.559342] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-09. [2025-10-28T18:26:57.845517] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-09 (0.29 seconds). [2025-10-28T18:26:58.359281] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-10. [2025-10-28T18:26:58.407140] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-28T18:26:58.415897] [INFO ] [REMOTE ] ECC: Full fetch complete (61592 records). [2025-10-28T18:26:58.416004] [DEBUG] [VALIDATOR ] ECC: Validating primary data. [2025-10-28T18:26:58.743752] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-10-28T18:26:58.757354] [INFO ] [REMOTE ] ECCC: Full fetch complete (1312 records). [2025-10-28T18:26:58.773585] [DEBUG] [VALIDATOR ] ECCC: Validating primary data. [2025-10-28T18:26:58.855626] [DEBUG] [VALIDATOR ] ECC: All expected trading days are present. [2025-10-28T18:26:58.861150] [DEBUG] [VALIDATOR ] ECC: Primary data validation passed. [2025-10-28T18:26:58.872898] [INFO ] [MAIN ] ECC: Fetched primary data is valid. [2025-10-28T18:26:58.891663] [DEBUG] [LOCAL ] ECC: Saving primary data. [2025-10-28T18:26:58.942935] [DEBUG] [LOCAL ] ECC: Trimmed 61592 records to 43047 (keeping 200 days of data) [2025-10-28T18:26:58.972050] [WARN ] [VALIDATOR ] ECCC: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-10-28T18:26:59.017625] [FATAL] [MAIN ] ECCC: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:26:59.026090] [WARN ] [MAIN ] ECCC: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:26:59.026206] [INFO ] [LOCAL ] ECCC: Starting deletion of primary data. [2025-10-28T18:26:59.052882] [DEBUG] [LOCAL ] ECCC: No primary data file found to delete. [2025-10-28T18:26:59.056517] [INFO ] [LOCAL ] ECCC: Starting deletion of derivative data. [2025-10-28T18:26:59.060727] [DEBUG] [LOCAL ] ECCC: No derivative data file found to delete. [2025-10-28T18:26:59.063711] [INFO ] [MAIN ] Update Progress: 686/2366 symbols completed. ECCC took 27.1s. Estimated remaining: 3h 32m 54s. Rate: 7.9 symbols/min [2025-10-28T18:26:59.164450] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-05. [2025-10-28T18:26:59.356504] [INFO ] [MAIN ] ECCX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:26:59.365780] [DEBUG] [LOCAL ] ECCX: No existing data file found in primary storage. [2025-10-28T18:26:59.369107] [WARN ] [MAIN ] ECCX: No existing data found, performing full refresh instead. [2025-10-28T18:26:59.376819] [INFO ] [MAIN ] ECCX: Wiping existing primary data before full refresh. [2025-10-28T18:26:59.378909] [INFO ] [LOCAL ] ECCX: Starting deletion of primary data. [2025-10-28T18:26:59.378969] [DEBUG] [LOCAL ] ECCX: No primary data file found to delete. [2025-10-28T18:26:59.385519] [INFO ] [MAIN ] ECCX: Starting full primary refresh. [2025-10-28T18:26:59.492924] [DEBUG] [LOCAL ] ECC: Primary data saved (43047 records). [2025-10-28T18:26:59.495251] [INFO ] [MAIN ] ECC: Full history saved. [2025-10-28T18:26:59.495571] [INFO ] [MAIN ] Update Progress: 687/2366 symbols completed. ECC took 28.4s. Estimated remaining: 3h 32m 29s. Rate: 7.9 symbols/min [2025-10-28T18:26:59.666967] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-28T18:26:59.859363] [INFO ] [MAIN ] ECG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:26:59.930981] [INFO ] [REMOTE ] ECCX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:26:59.953116] [DEBUG] [LOCAL ] ECG: Loaded 32450 existing records from primary storage. [2025-10-28T18:26:59.953353] [INFO ] [MAIN ] ECG: Loaded 32450 existing records. [2025-10-28T18:26:59.964530] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-06. [2025-10-28T18:27:00.130450] [WARN ] [MAIN ] ECG: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:27:00.130765] [INFO ] [MAIN ] ECG: Wiping existing primary data before full refresh. [2025-10-28T18:27:00.130826] [INFO ] [LOCAL ] ECG: Starting deletion of primary data. [2025-10-28T18:27:00.131523] [DEBUG] [LOCAL ] ECG: Deleted primary data file. [2025-10-28T18:27:00.131583] [INFO ] [MAIN ] ECG: Starting full primary refresh. [2025-10-28T18:27:00.412357] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-28T18:27:00.490322] [INFO ] [REMOTE ] ECG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:27:00.759302] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-01. [2025-10-28T18:27:01.559379] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-01. [2025-10-28T18:27:01.793710] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-28T18:27:01.967127] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-10-28T18:27:02.359319] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-01. [2025-10-28T18:27:02.587092] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-01 (0.23 seconds). [2025-10-28T18:27:03.159363] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-02. [2025-10-28T18:27:03.959341] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-02. [2025-10-28T18:27:04.183374] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-02 (0.22 seconds). [2025-10-28T18:27:04.313205] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-28T18:27:04.759326] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-03. [2025-10-28T18:27:04.984553] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-03 (0.23 seconds). [2025-10-28T18:27:05.559345] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-02. [2025-10-28T18:27:05.807411] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-02 (0.25 seconds). [2025-10-28T18:27:06.359394] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-03. [2025-10-28T18:27:06.738076] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-10-28T18:27:07.159407] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-03. [2025-10-28T18:27:07.959415] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-04. [2025-10-28T18:27:08.232234] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-04 (0.27 seconds). [2025-10-28T18:27:08.236493] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-28T18:27:08.759358] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-04. [2025-10-28T18:27:09.559337] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-05. [2025-10-28T18:27:09.799016] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-28T18:27:09.892793] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-10-28T18:27:10.359339] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-07. [2025-10-28T18:27:10.744976] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-10-28T18:27:11.159337] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-08. [2025-10-28T18:27:11.440360] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-08 (0.28 seconds). [2025-10-28T18:27:11.959349] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-09. [2025-10-28T18:27:12.238023] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-09 (0.28 seconds). [2025-10-28T18:27:12.759422] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-06. [2025-10-28T18:27:13.119717] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-10-28T18:27:13.559325] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-10. [2025-10-28T18:27:13.896131] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-10 (0.34 seconds). [2025-10-28T18:27:13.897065] [INFO ] [REMOTE ] ECCU: Full fetch complete (3961 records). [2025-10-28T18:27:13.897133] [DEBUG] [VALIDATOR ] ECCU: Validating primary data. [2025-10-28T18:27:14.278054] [DEBUG] [VALIDATOR ] ECCU: All expected trading days are present. [2025-10-28T18:27:14.278128] [DEBUG] [VALIDATOR ] ECCU: Primary data validation passed. [2025-10-28T18:27:14.278260] [INFO ] [MAIN ] ECCU: Fetched primary data is valid. [2025-10-28T18:27:14.278297] [DEBUG] [LOCAL ] ECCU: Saving primary data. [2025-10-28T18:27:14.278621] [DEBUG] [LOCAL ] ECCU: Trimmed 3961 records to 2068 (keeping 200 days of data) [2025-10-28T18:27:14.291304] [DEBUG] [LOCAL ] ECCU: Primary data saved (2068 records). [2025-10-28T18:27:14.291364] [INFO ] [MAIN ] ECCU: Full history saved. [2025-10-28T18:27:14.291427] [INFO ] [MAIN ] Update Progress: 688/2366 symbols completed. ECCU took 29.1s. Estimated remaining: 3h 32m 39s. Rate: 7.9 symbols/min [2025-10-28T18:27:14.364465] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-05. [2025-10-28T18:27:14.460238] [INFO ] [MAIN ] ECL: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:27:14.500014] [DEBUG] [LOCAL ] ECL: Loaded 46631 existing records from primary storage. [2025-10-28T18:27:14.500326] [INFO ] [MAIN ] ECL: Loaded 46631 existing records. [2025-10-28T18:27:14.672352] [WARN ] [MAIN ] ECL: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:27:14.672532] [INFO ] [MAIN ] ECL: Wiping existing primary data before full refresh. [2025-10-28T18:27:14.672578] [INFO ] [LOCAL ] ECL: Starting deletion of primary data. [2025-10-28T18:27:14.673447] [DEBUG] [LOCAL ] ECL: Deleted primary data file. [2025-10-28T18:27:14.673504] [INFO ] [MAIN ] ECL: Starting full primary refresh. [2025-10-28T18:27:15.026055] [INFO ] [REMOTE ] ECL: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:27:15.159347] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-04. [2025-10-28T18:27:15.487837] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-04 (0.33 seconds). [2025-10-28T18:27:15.583721] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-28T18:27:15.959374] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-06. [2025-10-28T18:27:16.739851] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-28T18:27:16.759297] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-07. [2025-10-28T18:27:17.559322] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-01. [2025-10-28T18:27:17.624157] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-28T18:27:18.359346] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-05. [2025-10-28T18:27:18.605904] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-05 (0.25 seconds). [2025-10-28T18:27:19.066499] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-28T18:27:19.159314] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-06. [2025-10-28T18:27:19.351394] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-06 (0.19 seconds). [2025-10-28T18:27:19.959339] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-02. [2025-10-28T18:27:20.759352] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-08. [2025-10-28T18:27:21.354989] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-28T18:27:21.559324] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-03. [2025-10-28T18:27:21.703917] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-28T18:27:22.359331] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-07. [2025-10-28T18:27:22.656015] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-07 (0.30 seconds). [2025-10-28T18:27:22.763919] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-28T18:27:23.159335] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-08. [2025-10-28T18:27:23.472283] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-08 (0.31 seconds). [2025-10-28T18:27:23.959336] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-04. [2025-10-28T18:27:24.759328] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-09. [2025-10-28T18:27:24.989442] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-09 (0.23 seconds). [2025-10-28T18:27:25.320218] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-28T18:27:25.559314] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-05. [2025-10-28T18:27:26.359463] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-10. [2025-10-28T18:27:26.814334] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-28T18:27:26.815263] [INFO ] [REMOTE ] ECCW: Full fetch complete (1424 records). [2025-10-28T18:27:26.815396] [DEBUG] [VALIDATOR ] ECCW: Validating primary data. [2025-10-28T18:27:27.008241] [WARN ] [VALIDATOR ] ECCW: Validation failed - insufficient historical data. Have 191 unique days, need 200 days [2025-10-28T18:27:27.008572] [FATAL] [MAIN ] ECCW: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:27:27.008717] [WARN ] [MAIN ] ECCW: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:27:27.008871] [INFO ] [LOCAL ] ECCW: Starting deletion of primary data. [2025-10-28T18:27:27.008938] [DEBUG] [LOCAL ] ECCW: No primary data file found to delete. [2025-10-28T18:27:27.041037] [INFO ] [LOCAL ] ECCW: Starting deletion of derivative data. [2025-10-28T18:27:27.045133] [DEBUG] [LOCAL ] ECCW: No derivative data file found to delete. [2025-10-28T18:27:27.045261] [INFO ] [MAIN ] Update Progress: 689/2366 symbols completed. ECCW took 31.8s. Estimated remaining: 3h 32m 44s. Rate: 7.9 symbols/min [2025-10-28T18:27:27.071804] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-28T18:27:27.165793] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-06. [2025-10-28T18:27:27.240932] [INFO ] [MAIN ] ECO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:27:27.257665] [DEBUG] [LOCAL ] ECO: Loaded 17789 existing records from primary storage. [2025-10-28T18:27:27.257902] [INFO ] [MAIN ] ECO: Loaded 17789 existing records. [2025-10-28T18:27:27.434418] [WARN ] [MAIN ] ECO: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:27:27.434606] [INFO ] [MAIN ] ECO: Wiping existing primary data before full refresh. [2025-10-28T18:27:27.434701] [INFO ] [LOCAL ] ECO: Starting deletion of primary data. [2025-10-28T18:27:27.435077] [DEBUG] [LOCAL ] ECO: Deleted primary data file. [2025-10-28T18:27:27.435134] [INFO ] [MAIN ] ECO: Starting full primary refresh. [2025-10-28T18:27:27.787701] [INFO ] [REMOTE ] ECO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:27:27.959330] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-01. [2025-10-28T18:27:28.713368] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-28T18:27:28.759362] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-07. [2025-10-28T18:27:28.918801] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-28T18:27:29.559352] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-09. [2025-10-28T18:27:30.063676] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-28T18:27:30.364427] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-02. [2025-10-28T18:27:30.374855] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-28T18:27:31.159334] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-08. [2025-10-28T18:27:31.180631] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-28T18:27:31.959335] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-07. [2025-10-28T18:27:32.323930] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-10-28T18:27:32.326942] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-28T18:27:32.759330] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-08. [2025-10-28T18:27:32.980526] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-08 (0.22 seconds). [2025-10-28T18:27:33.559383] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-09. [2025-10-28T18:27:33.814130] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-09 (0.25 seconds). [2025-10-28T18:27:34.359368] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-10. [2025-10-28T18:27:34.681995] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-10 (0.32 seconds). [2025-10-28T18:27:34.682778] [INFO ] [REMOTE ] ECCX: Full fetch complete (1436 records). [2025-10-28T18:27:34.682845] [DEBUG] [VALIDATOR ] ECCX: Validating primary data. [2025-10-28T18:27:34.876488] [WARN ] [VALIDATOR ] ECCX: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-10-28T18:27:34.876744] [FATAL] [MAIN ] ECCX: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:27:34.876795] [WARN ] [MAIN ] ECCX: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:27:34.876857] [INFO ] [LOCAL ] ECCX: Starting deletion of primary data. [2025-10-28T18:27:34.876918] [DEBUG] [LOCAL ] ECCX: No primary data file found to delete. [2025-10-28T18:27:34.876953] [INFO ] [LOCAL ] ECCX: Starting deletion of derivative data. [2025-10-28T18:27:34.876992] [DEBUG] [LOCAL ] ECCX: No derivative data file found to delete. [2025-10-28T18:27:34.877044] [INFO ] [MAIN ] Update Progress: 690/2366 symbols completed. ECCX took 35.8s. Estimated remaining: 3h 32m 37s. Rate: 7.9 symbols/min [2025-10-28T18:27:35.041316] [INFO ] [MAIN ] ECVT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:27:35.076219] [DEBUG] [LOCAL ] ECVT: Loaded 42785 existing records from primary storage. [2025-10-28T18:27:35.076498] [INFO ] [MAIN ] ECVT: Loaded 42785 existing records. [2025-10-28T18:27:35.164478] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-10. [2025-10-28T18:27:35.251387] [WARN ] [MAIN ] ECVT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:27:35.251588] [INFO ] [MAIN ] ECVT: Wiping existing primary data before full refresh. [2025-10-28T18:27:35.251691] [INFO ] [LOCAL ] ECVT: Starting deletion of primary data. [2025-10-28T18:27:35.252356] [DEBUG] [LOCAL ] ECVT: Deleted primary data file. [2025-10-28T18:27:35.252416] [INFO ] [MAIN ] ECVT: Starting full primary refresh. [2025-10-28T18:27:35.600679] [INFO ] [REMOTE ] ECVT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:27:35.959358] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-09. [2025-10-28T18:27:36.759379] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-03. [2025-10-28T18:27:37.192449] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-10 (2.03 seconds). [2025-10-28T18:27:37.198969] [INFO ] [REMOTE ] ECG: Full fetch complete (50818 records). [2025-10-28T18:27:37.199083] [DEBUG] [VALIDATOR ] ECG: Validating primary data. [2025-10-28T18:27:37.560122] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-01. [2025-10-28T18:27:37.607233] [DEBUG] [VALIDATOR ] ECG: All expected trading days are present. [2025-10-28T18:27:37.607428] [DEBUG] [VALIDATOR ] ECG: Primary data validation passed. [2025-10-28T18:27:37.608509] [INFO ] [MAIN ] ECG: Fetched primary data is valid. [2025-10-28T18:27:37.608704] [DEBUG] [LOCAL ] ECG: Saving primary data. [2025-10-28T18:27:37.610145] [DEBUG] [LOCAL ] ECG: Trimmed 50818 records to 32342 (keeping 200 days of data) [2025-10-28T18:27:37.752727] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-28T18:27:37.851009] [DEBUG] [LOCAL ] ECG: Primary data saved (32342 records). [2025-10-28T18:27:37.851146] [INFO ] [MAIN ] ECG: Full history saved. [2025-10-28T18:27:37.851228] [INFO ] [MAIN ] Update Progress: 691/2366 symbols completed. ECG took 38.4s. Estimated remaining: 3h 32m 18s. Rate: 7.9 symbols/min [2025-10-28T18:27:38.051385] [INFO ] [MAIN ] ED: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:27:38.102940] [DEBUG] [LOCAL ] ED: Loaded 52504 existing records from primary storage. [2025-10-28T18:27:38.103350] [INFO ] [MAIN ] ED: Loaded 52504 existing records. [2025-10-28T18:27:38.310340] [WARN ] [MAIN ] ED: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:27:38.310566] [INFO ] [MAIN ] ED: Wiping existing primary data before full refresh. [2025-10-28T18:27:38.310618] [INFO ] [LOCAL ] ED: Starting deletion of primary data. [2025-10-28T18:27:38.311544] [DEBUG] [LOCAL ] ED: Deleted primary data file. [2025-10-28T18:27:38.311602] [INFO ] [MAIN ] ED: Starting full primary refresh. [2025-10-28T18:27:38.376740] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-10. [2025-10-28T18:27:38.726056] [INFO ] [REMOTE ] ED: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:27:38.746608] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-28T18:27:38.825783] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-10-28T18:27:39.159329] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-02. [2025-10-28T18:27:39.832224] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-28T18:27:39.842514] [INFO ] [REMOTE ] ECL: Full fetch complete (68462 records). [2025-10-28T18:27:39.842665] [DEBUG] [VALIDATOR ] ECL: Validating primary data. [2025-10-28T18:27:39.960981] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-04. [2025-10-28T18:27:40.259877] [DEBUG] [VALIDATOR ] ECL: All expected trading days are present. [2025-10-28T18:27:40.266340] [DEBUG] [VALIDATOR ] ECL: Primary data validation passed. [2025-10-28T18:27:40.278825] [INFO ] [MAIN ] ECL: Fetched primary data is valid. [2025-10-28T18:27:40.280258] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-28T18:27:40.279468] [DEBUG] [LOCAL ] ECL: Saving primary data. [2025-10-28T18:27:40.288718] [DEBUG] [LOCAL ] ECL: Trimmed 68462 records to 46659 (keeping 200 days of data) [2025-10-28T18:27:40.575689] [DEBUG] [LOCAL ] ECL: Primary data saved (46659 records). [2025-10-28T18:27:40.575813] [INFO ] [MAIN ] ECL: Full history saved. [2025-10-28T18:27:40.576278] [INFO ] [MAIN ] Update Progress: 692/2366 symbols completed. ECL took 26.3s. Estimated remaining: 3h 31m 58s. Rate: 7.9 symbols/min [2025-10-28T18:27:40.742866] [INFO ] [MAIN ] EDD: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:27:40.743015] [DEBUG] [LOCAL ] EDD: No existing data file found in primary storage. [2025-10-28T18:27:40.743052] [WARN ] [MAIN ] EDD: No existing data found, performing full refresh instead. [2025-10-28T18:27:40.743156] [INFO ] [MAIN ] EDD: Wiping existing primary data before full refresh. [2025-10-28T18:27:40.743195] [INFO ] [LOCAL ] EDD: Starting deletion of primary data. [2025-10-28T18:27:40.743235] [DEBUG] [LOCAL ] EDD: No primary data file found to delete. [2025-10-28T18:27:40.743266] [INFO ] [MAIN ] EDD: Starting full primary refresh. [2025-10-28T18:27:40.764480] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-01. [2025-10-28T18:27:41.060393] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-28T18:27:41.126131] [INFO ] [REMOTE ] EDD: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:27:41.559319] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-01. [2025-10-28T18:27:42.029765] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-28T18:27:42.359357] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-05. [2025-10-28T18:27:42.433124] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-28T18:27:43.067047] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-10-28T18:27:43.159340] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-02. [2025-10-28T18:27:43.936503] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-28T18:27:43.959297] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-03. [2025-10-28T18:27:44.759329] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-03. [2025-10-28T18:27:44.792436] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-28T18:27:45.559384] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-02. [2025-10-28T18:27:45.740905] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-28T18:27:46.359387] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-04. [2025-10-28T18:27:46.945164] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-28T18:27:47.159331] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-03. [2025-10-28T18:27:47.545071] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-28T18:27:47.959384] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-05. [2025-10-28T18:27:48.511267] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-28T18:27:48.759364] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-04. [2025-10-28T18:27:49.052479] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-28T18:27:49.559327] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-06. [2025-10-28T18:27:50.234587] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-28T18:27:50.359301] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-05. [2025-10-28T18:27:50.658725] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-28T18:27:51.159384] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-04. [2025-10-28T18:27:51.639074] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-28T18:27:51.764724] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-28T18:27:51.959339] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-06. [2025-10-28T18:27:52.759338] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-06. [2025-10-28T18:27:53.309122] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-28T18:27:53.533210] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-28T18:27:53.559296] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-07. [2025-10-28T18:27:54.247539] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-28T18:27:54.359307] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-07. [2025-10-28T18:27:55.159340] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-08. [2025-10-28T18:27:55.451510] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-28T18:27:55.825572] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-28T18:27:55.959348] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-08. [2025-10-28T18:27:56.759340] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-09. [2025-10-28T18:27:57.207418] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-28T18:27:57.492685] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-28T18:27:57.559299] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-09. [2025-10-28T18:27:58.359332] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-10. [2025-10-28T18:27:58.687712] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-28T18:27:59.159301] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-07. [2025-10-28T18:27:59.198858] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-28T18:27:59.202811] [INFO ] [REMOTE ] ECO: Full fetch complete (28156 records). [2025-10-28T18:27:59.202885] [DEBUG] [VALIDATOR ] ECO: Validating primary data. [2025-10-28T18:27:59.575840] [DEBUG] [VALIDATOR ] ECO: All expected trading days are present. [2025-10-28T18:27:59.575916] [DEBUG] [VALIDATOR ] ECO: Primary data validation passed. [2025-10-28T18:27:59.576468] [INFO ] [MAIN ] ECO: Fetched primary data is valid. [2025-10-28T18:27:59.576528] [DEBUG] [LOCAL ] ECO: Saving primary data. [2025-10-28T18:27:59.577217] [DEBUG] [LOCAL ] ECO: Trimmed 28156 records to 17871 (keeping 200 days of data) [2025-10-28T18:27:59.688713] [DEBUG] [LOCAL ] ECO: Primary data saved (17871 records). [2025-10-28T18:27:59.688833] [INFO ] [MAIN ] ECO: Full history saved. [2025-10-28T18:27:59.688956] [INFO ] [MAIN ] Update Progress: 693/2366 symbols completed. ECO took 32.6s. Estimated remaining: 3h 32m 19s. Rate: 7.9 symbols/min [2025-10-28T18:27:59.856353] [INFO ] [MAIN ] EDF: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:27:59.856530] [DEBUG] [LOCAL ] EDF: No existing data file found in primary storage. [2025-10-28T18:27:59.856586] [WARN ] [MAIN ] EDF: No existing data found, performing full refresh instead. [2025-10-28T18:27:59.856735] [INFO ] [MAIN ] EDF: Wiping existing primary data before full refresh. [2025-10-28T18:27:59.856798] [INFO ] [LOCAL ] EDF: Starting deletion of primary data. [2025-10-28T18:27:59.856882] [DEBUG] [LOCAL ] EDF: No primary data file found to delete. [2025-10-28T18:27:59.856927] [INFO ] [MAIN ] EDF: Starting full primary refresh. [2025-10-28T18:27:59.964520] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-05. [2025-10-28T18:28:00.212942] [INFO ] [REMOTE ] EDF: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:28:00.691516] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-28T18:28:00.759294] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-08. [2025-10-28T18:28:00.961345] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-28T18:28:01.559321] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-10. [2025-10-28T18:28:02.227689] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-28T18:28:02.359384] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-09. [2025-10-28T18:28:02.882030] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-28T18:28:02.889954] [INFO ] [REMOTE ] ECVT: Full fetch complete (60149 records). [2025-10-28T18:28:02.890103] [DEBUG] [VALIDATOR ] ECVT: Validating primary data. [2025-10-28T18:28:02.890820] [FATAL] [VALIDATOR ] ECVT: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T18:28:02.890907] [FATAL] [MAIN ] ECVT: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:28:02.890950] [WARN ] [MAIN ] ECVT: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:28:02.890989] [INFO ] [LOCAL ] ECVT: Starting deletion of primary data. [2025-10-28T18:28:02.891045] [DEBUG] [LOCAL ] ECVT: No primary data file found to delete. [2025-10-28T18:28:02.891080] [INFO ] [LOCAL ] ECVT: Starting deletion of derivative data. [2025-10-28T18:28:02.891254] [DEBUG] [LOCAL ] ECVT: Deleted derivative data file. [2025-10-28T18:28:02.891346] [INFO ] [MAIN ] Update Progress: 694/2366 symbols completed. ECVT took 28.0s. Estimated remaining: 3h 32m 0s. Rate: 7.9 symbols/min [2025-10-28T18:28:03.064283] [INFO ] [MAIN ] EDN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:28:03.081884] [DEBUG] [LOCAL ] EDN: Loaded 19576 existing records from primary storage. [2025-10-28T18:28:03.082109] [INFO ] [MAIN ] EDN: Loaded 19576 existing records. [2025-10-28T18:28:03.164556] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-01. [2025-10-28T18:28:03.262099] [WARN ] [MAIN ] EDN: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:28:03.262313] [INFO ] [MAIN ] EDN: Wiping existing primary data before full refresh. [2025-10-28T18:28:03.262362] [INFO ] [LOCAL ] EDN: Starting deletion of primary data. [2025-10-28T18:28:03.262807] [DEBUG] [LOCAL ] EDN: Deleted primary data file. [2025-10-28T18:28:03.262866] [INFO ] [MAIN ] EDN: Starting full primary refresh. [2025-10-28T18:28:03.617410] [INFO ] [REMOTE ] EDN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:28:03.713159] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-28T18:28:03.959304] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-10. [2025-10-28T18:28:04.047464] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-28T18:28:04.759378] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-02. [2025-10-28T18:28:05.474786] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-28T18:28:05.485131] [INFO ] [REMOTE ] ED: Full fetch complete (76294 records). [2025-10-28T18:28:05.490542] [DEBUG] [VALIDATOR ] ED: Validating primary data. [2025-10-28T18:28:05.496231] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-28T18:28:05.564471] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-06. [2025-10-28T18:28:05.887387] [DEBUG] [VALIDATOR ] ED: All expected trading days are present. [2025-10-28T18:28:05.887472] [DEBUG] [VALIDATOR ] ED: Primary data validation passed. [2025-10-28T18:28:05.888360] [INFO ] [MAIN ] ED: Fetched primary data is valid. [2025-10-28T18:28:05.888424] [DEBUG] [LOCAL ] ED: Saving primary data. [2025-10-28T18:28:05.889891] [DEBUG] [LOCAL ] ED: Trimmed 76294 records to 52473 (keeping 200 days of data) [2025-10-28T18:28:06.199995] [DEBUG] [LOCAL ] ED: Primary data saved (52473 records). [2025-10-28T18:28:06.200117] [INFO ] [MAIN ] ED: Full history saved. [2025-10-28T18:28:06.200191] [INFO ] [MAIN ] Update Progress: 695/2366 symbols completed. ED took 28.3s. Estimated remaining: 3h 31m 42s. Rate: 7.9 symbols/min [2025-10-28T18:28:06.365070] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-01. [2025-10-28T18:28:06.373438] [INFO ] [MAIN ] EDU: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:28:06.411809] [DEBUG] [LOCAL ] EDU: Loaded 44629 existing records from primary storage. [2025-10-28T18:28:06.412085] [INFO ] [MAIN ] EDU: Loaded 44629 existing records. [2025-10-28T18:28:06.582356] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-28T18:28:06.602095] [WARN ] [MAIN ] EDU: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:28:06.607617] [INFO ] [MAIN ] EDU: Wiping existing primary data before full refresh. [2025-10-28T18:28:06.607749] [INFO ] [LOCAL ] EDU: Starting deletion of primary data. [2025-10-28T18:28:06.608805] [DEBUG] [LOCAL ] EDU: Deleted primary data file. [2025-10-28T18:28:06.608867] [INFO ] [MAIN ] EDU: Starting full primary refresh. [2025-10-28T18:28:06.956143] [INFO ] [REMOTE ] EDU: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:28:07.159373] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-07. [2025-10-28T18:28:07.456604] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-28T18:28:07.959346] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-01. [2025-10-28T18:28:08.190755] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-28T18:28:08.759366] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-08. [2025-10-28T18:28:09.263410] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-28T18:28:09.559342] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-03. [2025-10-28T18:28:09.599491] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-28T18:28:10.199587] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-28T18:28:10.359336] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-09. [2025-10-28T18:28:11.159331] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-02. [2025-10-28T18:28:11.342163] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-28T18:28:11.959346] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-10. [2025-10-28T18:28:12.466614] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-28T18:28:12.759347] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-04. [2025-10-28T18:28:12.917058] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-28T18:28:12.924077] [INFO ] [REMOTE ] EDD: Full fetch complete (38945 records). [2025-10-28T18:28:12.924255] [DEBUG] [VALIDATOR ] EDD: Validating primary data. [2025-10-28T18:28:13.317614] [DEBUG] [VALIDATOR ] EDD: All expected trading days are present. [2025-10-28T18:28:13.317718] [DEBUG] [VALIDATOR ] EDD: Primary data validation passed. [2025-10-28T18:28:13.318288] [INFO ] [MAIN ] EDD: Fetched primary data is valid. [2025-10-28T18:28:13.318327] [DEBUG] [LOCAL ] EDD: Saving primary data. [2025-10-28T18:28:13.319223] [DEBUG] [LOCAL ] EDD: Trimmed 38945 records to 26837 (keeping 200 days of data) [2025-10-28T18:28:13.474971] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-28T18:28:13.485938] [DEBUG] [LOCAL ] EDD: Primary data saved (26837 records). [2025-10-28T18:28:13.486343] [INFO ] [MAIN ] EDD: Full history saved. [2025-10-28T18:28:13.486417] [INFO ] [MAIN ] Update Progress: 696/2366 symbols completed. EDD took 32.9s. Estimated remaining: 3h 31m 34s. Rate: 7.9 symbols/min [2025-10-28T18:28:13.564403] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-02. [2025-10-28T18:28:13.660628] [INFO ] [MAIN ] EE: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:28:13.691251] [DEBUG] [LOCAL ] EE: Loaded 32366 existing records from primary storage. [2025-10-28T18:28:13.691548] [INFO ] [MAIN ] EE: Loaded 32366 existing records. [2025-10-28T18:28:13.870971] [WARN ] [MAIN ] EE: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:28:13.871232] [INFO ] [MAIN ] EE: Wiping existing primary data before full refresh. [2025-10-28T18:28:13.871278] [INFO ] [LOCAL ] EE: Starting deletion of primary data. [2025-10-28T18:28:13.871924] [DEBUG] [LOCAL ] EE: Deleted primary data file. [2025-10-28T18:28:13.871980] [INFO ] [MAIN ] EE: Starting full primary refresh. [2025-10-28T18:28:14.218545] [INFO ] [REMOTE ] EE: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:28:14.341881] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-28T18:28:14.359301] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-01. [2025-10-28T18:28:15.159311] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-05. [2025-10-28T18:28:15.295951] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-28T18:28:15.930117] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-28T18:28:15.959368] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-02. [2025-10-28T18:28:16.759544] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-03. [2025-10-28T18:28:16.763892] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-28T18:28:17.559303] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-03. [2025-10-28T18:28:17.595953] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-28T18:28:18.359409] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-04. [2025-10-28T18:28:18.921467] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-28T18:28:19.089447] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-28T18:28:19.159310] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-04. [2025-10-28T18:28:19.959339] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-06. [2025-10-28T18:28:20.458402] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-28T18:28:20.475749] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-28T18:28:20.759354] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-07. [2025-10-28T18:28:21.400514] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-28T18:28:21.559291] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-08. [2025-10-28T18:28:22.050277] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-28T18:28:22.359356] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-09. [2025-10-28T18:28:22.892372] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-28T18:28:23.159368] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-10. [2025-10-28T18:28:23.801914] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-28T18:28:23.805257] [INFO ] [REMOTE ] EDF: Full fetch complete (19603 records). [2025-10-28T18:28:23.805367] [DEBUG] [VALIDATOR ] EDF: Validating primary data. [2025-10-28T18:28:23.805921] [FATAL] [VALIDATOR ] EDF: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T18:28:23.806030] [FATAL] [MAIN ] EDF: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:28:23.806110] [WARN ] [MAIN ] EDF: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:28:23.806197] [INFO ] [LOCAL ] EDF: Starting deletion of primary data. [2025-10-28T18:28:23.806271] [DEBUG] [LOCAL ] EDF: No primary data file found to delete. [2025-10-28T18:28:23.806309] [INFO ] [LOCAL ] EDF: Starting deletion of derivative data. [2025-10-28T18:28:23.806348] [DEBUG] [LOCAL ] EDF: No derivative data file found to delete. [2025-10-28T18:28:23.806402] [INFO ] [MAIN ] Update Progress: 697/2366 symbols completed. EDF took 24.1s. Estimated remaining: 3h 31m 33s. Rate: 7.9 symbols/min [2025-10-28T18:28:23.970226] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-05. [2025-10-28T18:28:23.972987] [INFO ] [MAIN ] EEA: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:28:23.974048] [DEBUG] [LOCAL ] EEA: No existing data file found in primary storage. [2025-10-28T18:28:23.974092] [WARN ] [MAIN ] EEA: No existing data found, performing full refresh instead. [2025-10-28T18:28:23.974195] [INFO ] [MAIN ] EEA: Wiping existing primary data before full refresh. [2025-10-28T18:28:23.974235] [INFO ] [LOCAL ] EEA: Starting deletion of primary data. [2025-10-28T18:28:23.974277] [DEBUG] [LOCAL ] EEA: No primary data file found to delete. [2025-10-28T18:28:23.974308] [INFO ] [MAIN ] EEA: Starting full primary refresh. [2025-10-28T18:28:24.401025] [INFO ] [REMOTE ] EEA: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:28:24.759349] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-05. [2025-10-28T18:28:25.035227] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-28T18:28:25.455868] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-28T18:28:25.559340] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-06. [2025-10-28T18:28:26.125036] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-28T18:28:26.359349] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-03. [2025-10-28T18:28:27.159346] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-07. [2025-10-28T18:28:27.331127] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-28T18:28:27.880902] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-28T18:28:27.959360] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-06. [2025-10-28T18:28:28.759351] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-01. [2025-10-28T18:28:28.896417] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-28T18:28:29.182914] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-10-28T18:28:29.559358] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-08. [2025-10-28T18:28:30.221277] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-28T18:28:30.359317] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-07. [2025-10-28T18:28:31.159338] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-04. [2025-10-28T18:28:31.860514] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-28T18:28:31.959335] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-08. [2025-10-28T18:28:32.321078] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-28T18:28:32.759349] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-05. [2025-10-28T18:28:33.084438] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-28T18:28:33.559326] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-09. [2025-10-28T18:28:33.673394] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-28T18:28:34.359336] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-06. [2025-10-28T18:28:34.573987] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-28T18:28:35.159329] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-10. [2025-10-28T18:28:35.229592] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-28T18:28:35.959347] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-09. [2025-10-28T18:28:36.596243] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-28T18:28:36.605621] [INFO ] [REMOTE ] EDU: Full fetch complete (67124 records). [2025-10-28T18:28:36.605774] [DEBUG] [VALIDATOR ] EDU: Validating primary data. [2025-10-28T18:28:36.759532] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-02. [2025-10-28T18:28:36.948735] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-28T18:28:37.027703] [DEBUG] [VALIDATOR ] EDU: All expected trading days are present. [2025-10-28T18:28:37.027783] [DEBUG] [VALIDATOR ] EDU: Primary data validation passed. [2025-10-28T18:28:37.028552] [INFO ] [MAIN ] EDU: Fetched primary data is valid. [2025-10-28T18:28:37.028592] [DEBUG] [LOCAL ] EDU: Saving primary data. [2025-10-28T18:28:37.029807] [DEBUG] [LOCAL ] EDU: Trimmed 67124 records to 44599 (keeping 200 days of data) [2025-10-28T18:28:37.137793] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-10-28T18:28:37.283432] [DEBUG] [LOCAL ] EDU: Primary data saved (44599 records). [2025-10-28T18:28:37.283552] [INFO ] [MAIN ] EDU: Full history saved. [2025-10-28T18:28:37.283625] [INFO ] [MAIN ] Update Progress: 698/2366 symbols completed. EDU took 31.1s. Estimated remaining: 3h 31m 39s. Rate: 7.9 symbols/min [2025-10-28T18:28:37.452703] [INFO ] [MAIN ] EEX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:28:37.452881] [DEBUG] [LOCAL ] EEX: No existing data file found in primary storage. [2025-10-28T18:28:37.452933] [WARN ] [MAIN ] EEX: No existing data found, performing full refresh instead. [2025-10-28T18:28:37.453045] [INFO ] [MAIN ] EEX: Wiping existing primary data before full refresh. [2025-10-28T18:28:37.453086] [INFO ] [LOCAL ] EEX: Starting deletion of primary data. [2025-10-28T18:28:37.453126] [DEBUG] [LOCAL ] EEX: No primary data file found to delete. [2025-10-28T18:28:37.453156] [INFO ] [MAIN ] EEX: Starting full primary refresh. [2025-10-28T18:28:37.564398] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-07. [2025-10-28T18:28:37.820233] [INFO ] [REMOTE ] EEX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:28:38.359338] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-01. [2025-10-28T18:28:38.727833] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-28T18:28:39.159321] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-08. [2025-10-28T18:28:39.266952] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-28T18:28:39.959334] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-10. [2025-10-28T18:28:40.119397] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-28T18:28:40.759363] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-09. [2025-10-28T18:28:41.024120] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-28T18:28:41.029758] [INFO ] [REMOTE ] EDN: Full fetch complete (29664 records). [2025-10-28T18:28:41.029846] [DEBUG] [VALIDATOR ] EDN: Validating primary data. [2025-10-28T18:28:41.390359] [DEBUG] [VALIDATOR ] EDN: All expected trading days are present. [2025-10-28T18:28:41.390436] [DEBUG] [VALIDATOR ] EDN: Primary data validation passed. [2025-10-28T18:28:41.390987] [INFO ] [MAIN ] EDN: Fetched primary data is valid. [2025-10-28T18:28:41.391048] [DEBUG] [LOCAL ] EDN: Saving primary data. [2025-10-28T18:28:41.391746] [DEBUG] [LOCAL ] EDN: Trimmed 29664 records to 19707 (keeping 200 days of data) [2025-10-28T18:28:41.514235] [DEBUG] [LOCAL ] EDN: Primary data saved (19707 records). [2025-10-28T18:28:41.514383] [INFO ] [MAIN ] EDN: Full history saved. [2025-10-28T18:28:41.514544] [INFO ] [MAIN ] Update Progress: 699/2366 symbols completed. EDN took 38.6s. Estimated remaining: 3h 31m 24s. Rate: 7.9 symbols/min [2025-10-28T18:28:41.561828] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-03. [2025-10-28T18:28:41.712444] [INFO ] [MAIN ] EFC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:28:41.710141] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-28T18:28:41.760820] [DEBUG] [LOCAL ] EFC: Loaded 46165 existing records from primary storage. [2025-10-28T18:28:41.761144] [INFO ] [MAIN ] EFC: Loaded 46165 existing records. [2025-10-28T18:28:41.959991] [WARN ] [MAIN ] EFC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:28:41.960223] [INFO ] [MAIN ] EFC: Wiping existing primary data before full refresh. [2025-10-28T18:28:41.960273] [INFO ] [LOCAL ] EFC: Starting deletion of primary data. [2025-10-28T18:28:41.960826] [DEBUG] [LOCAL ] EFC: Deleted primary data file. [2025-10-28T18:28:41.960885] [INFO ] [MAIN ] EFC: Starting full primary refresh. [2025-10-28T18:28:42.315745] [INFO ] [REMOTE ] EFC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:28:42.359296] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-01. [2025-10-28T18:28:42.522769] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-28T18:28:43.159348] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-04. [2025-10-28T18:28:43.528066] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-10-28T18:28:43.959308] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-05. [2025-10-28T18:28:44.147779] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-10-28T18:28:44.341395] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-10-28T18:28:44.759368] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-02. [2025-10-28T18:28:45.379958] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-28T18:28:45.559361] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-03. [2025-10-28T18:28:46.304945] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-28T18:28:46.359303] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-04. [2025-10-28T18:28:47.039578] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-28T18:28:47.159374] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-05. [2025-10-28T18:28:47.684143] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-28T18:28:47.959304] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-06. [2025-10-28T18:28:48.601427] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-28T18:28:48.759340] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-06. [2025-10-28T18:28:49.091035] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-10-28T18:28:49.559332] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-10. [2025-10-28T18:28:50.359335] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-07. [2025-10-28T18:28:50.707766] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-10-28T18:28:50.707600] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-28T18:28:50.716822] [INFO ] [REMOTE ] EE: Full fetch complete (44682 records). [2025-10-28T18:28:50.716962] [DEBUG] [VALIDATOR ] EE: Validating primary data. [2025-10-28T18:28:51.109477] [DEBUG] [VALIDATOR ] EE: All expected trading days are present. [2025-10-28T18:28:51.109558] [DEBUG] [VALIDATOR ] EE: Primary data validation passed. [2025-10-28T18:28:51.110196] [INFO ] [MAIN ] EE: Fetched primary data is valid. [2025-10-28T18:28:51.110259] [DEBUG] [LOCAL ] EE: Saving primary data. [2025-10-28T18:28:51.111408] [DEBUG] [LOCAL ] EE: Trimmed 44682 records to 32418 (keeping 200 days of data) [2025-10-28T18:28:51.163438] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-08. [2025-10-28T18:28:51.311595] [DEBUG] [LOCAL ] EE: Primary data saved (32418 records). [2025-10-28T18:28:51.311791] [INFO ] [MAIN ] EE: Full history saved. [2025-10-28T18:28:51.311904] [INFO ] [MAIN ] Update Progress: 700/2366 symbols completed. EE took 37.8s. Estimated remaining: 3h 31m 21s. Rate: 7.9 symbols/min [2025-10-28T18:28:51.480031] [INFO ] [MAIN ] EFR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:28:51.494697] [DEBUG] [LOCAL ] EFR: Loaded 14825 existing records from primary storage. [2025-10-28T18:28:51.494912] [INFO ] [MAIN ] EFR: Loaded 14825 existing records. [2025-10-28T18:28:51.598415] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-28T18:28:51.677812] [WARN ] [MAIN ] EFR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:28:51.677983] [INFO ] [MAIN ] EFR: Wiping existing primary data before full refresh. [2025-10-28T18:28:51.678029] [INFO ] [LOCAL ] EFR: Starting deletion of primary data. [2025-10-28T18:28:51.678414] [DEBUG] [LOCAL ] EFR: Deleted primary data file. [2025-10-28T18:28:51.678471] [INFO ] [MAIN ] EFR: Starting full primary refresh. [2025-10-28T18:28:51.964501] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-09. [2025-10-28T18:28:52.036429] [INFO ] [REMOTE ] EFR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:28:52.313299] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-10-28T18:28:52.759323] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-10. [2025-10-28T18:28:53.253847] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-28T18:28:53.254851] [INFO ] [REMOTE ] EEA: Full fetch complete (3749 records). [2025-10-28T18:28:53.254941] [DEBUG] [VALIDATOR ] EEA: Validating primary data. [2025-10-28T18:28:53.439023] [WARN ] [VALIDATOR ] EEA: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-28T18:28:53.439236] [FATAL] [MAIN ] EEA: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:28:53.439303] [WARN ] [MAIN ] EEA: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:28:53.439373] [INFO ] [LOCAL ] EEA: Starting deletion of primary data. [2025-10-28T18:28:53.439436] [DEBUG] [LOCAL ] EEA: No primary data file found to delete. [2025-10-28T18:28:53.439472] [INFO ] [LOCAL ] EEA: Starting deletion of derivative data. [2025-10-28T18:28:53.439513] [DEBUG] [LOCAL ] EEA: No derivative data file found to delete. [2025-10-28T18:28:53.439568] [INFO ] [MAIN ] Update Progress: 701/2366 symbols completed. EEA took 29.6s. Estimated remaining: 3h 31m 1s. Rate: 7.9 symbols/min [2025-10-28T18:28:53.564411] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-01. [2025-10-28T18:28:53.608273] [INFO ] [MAIN ] EFT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:28:53.623312] [DEBUG] [LOCAL ] EFT: Loaded 12689 existing records from primary storage. [2025-10-28T18:28:53.623542] [INFO ] [MAIN ] EFT: Loaded 12689 existing records. [2025-10-28T18:28:53.800946] [WARN ] [MAIN ] EFT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:28:53.801168] [INFO ] [MAIN ] EFT: Wiping existing primary data before full refresh. [2025-10-28T18:28:53.801216] [INFO ] [LOCAL ] EFT: Starting deletion of primary data. [2025-10-28T18:28:53.801429] [DEBUG] [LOCAL ] EFT: Deleted primary data file. [2025-10-28T18:28:53.801486] [INFO ] [MAIN ] EFT: Starting full primary refresh. [2025-10-28T18:28:54.156170] [INFO ] [REMOTE ] EFT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:28:54.168905] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-28T18:28:54.359353] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-01. [2025-10-28T18:28:54.974310] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-28T18:28:55.159322] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-07. [2025-10-28T18:28:55.706435] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-28T18:28:55.959351] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-02. [2025-10-28T18:28:56.759348] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-08. [2025-10-28T18:28:57.131441] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-28T18:28:57.234681] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-28T18:28:57.559337] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-02. [2025-10-28T18:28:57.987754] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-28T18:28:58.359337] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-09. [2025-10-28T18:28:58.798170] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-28T18:28:59.159329] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-02. [2025-10-28T18:28:59.575623] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-28T18:28:59.959344] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-10. [2025-10-28T18:29:00.623435] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-28T18:29:00.627421] [INFO ] [REMOTE ] EEX: Full fetch complete (18095 records). [2025-10-28T18:29:00.627684] [DEBUG] [VALIDATOR ] EEX: Validating primary data. [2025-10-28T18:29:00.760777] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-03. [2025-10-28T18:29:01.056270] [DEBUG] [VALIDATOR ] EEX: All expected trading days are present. [2025-10-28T18:29:01.056357] [DEBUG] [VALIDATOR ] EEX: Primary data validation passed. [2025-10-28T18:29:01.056886] [INFO ] [MAIN ] EEX: Fetched primary data is valid. [2025-10-28T18:29:01.056986] [DEBUG] [LOCAL ] EEX: Saving primary data. [2025-10-28T18:29:01.057610] [DEBUG] [LOCAL ] EEX: Trimmed 18095 records to 9325 (keeping 200 days of data) [2025-10-28T18:29:01.113039] [DEBUG] [LOCAL ] EEX: Primary data saved (9325 records). [2025-10-28T18:29:01.113176] [INFO ] [MAIN ] EEX: Full history saved. [2025-10-28T18:29:01.113250] [INFO ] [MAIN ] Update Progress: 702/2366 symbols completed. EEX took 23.8s. Estimated remaining: 3h 30m 53s. Rate: 7.9 symbols/min [2025-10-28T18:29:01.289361] [INFO ] [MAIN ] EFX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:29:01.341086] [DEBUG] [LOCAL ] EFX: Loaded 44559 existing records from primary storage. [2025-10-28T18:29:01.341371] [INFO ] [MAIN ] EFX: Loaded 44559 existing records. [2025-10-28T18:29:01.526987] [WARN ] [MAIN ] EFX: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:29:01.527329] [INFO ] [MAIN ] EFX: Wiping existing primary data before full refresh. [2025-10-28T18:29:01.527428] [INFO ] [LOCAL ] EFX: Starting deletion of primary data. [2025-10-28T18:29:01.527967] [DEBUG] [LOCAL ] EFX: Deleted primary data file. [2025-10-28T18:29:01.528035] [INFO ] [MAIN ] EFX: Starting full primary refresh. [2025-10-28T18:29:01.561973] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-03. [2025-10-28T18:29:01.677849] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-28T18:29:01.928821] [INFO ] [REMOTE ] EFX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:29:02.359362] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-03. [2025-10-28T18:29:02.973271] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-28T18:29:02.982113] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-28T18:29:03.159345] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-01. [2025-10-28T18:29:03.959383] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-04. [2025-10-28T18:29:04.596970] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-28T18:29:04.640964] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-28T18:29:04.759361] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-02. [2025-10-28T18:29:05.559355] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-04. [2025-10-28T18:29:05.878116] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-28T18:29:06.359398] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-04. [2025-10-28T18:29:06.998967] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-28T18:29:07.159304] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-05. [2025-10-28T18:29:07.212285] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-28T18:29:07.913116] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-28T18:29:07.959298] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-06. [2025-10-28T18:29:08.474829] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-28T18:29:08.759346] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-05. [2025-10-28T18:29:09.175601] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-28T18:29:09.559350] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-03. [2025-10-28T18:29:10.359333] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-07. [2025-10-28T18:29:10.852823] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-28T18:29:10.936823] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-28T18:29:11.159411] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-08. [2025-10-28T18:29:11.678723] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-28T18:29:11.959362] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-09. [2025-10-28T18:29:12.525751] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-28T18:29:12.759369] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-06. [2025-10-28T18:29:13.393462] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-28T18:29:13.559331] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-07. [2025-10-28T18:29:14.103244] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-28T18:29:14.359332] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-04. [2025-10-28T18:29:15.159347] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-08. [2025-10-28T18:29:15.762024] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-28T18:29:15.959295] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-05. [2025-10-28T18:29:15.979388] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-28T18:29:16.759334] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-05. [2025-10-28T18:29:17.288466] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-28T18:29:17.559331] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-09. [2025-10-28T18:29:17.884248] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-28T18:29:18.228708] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-28T18:29:18.359367] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-10. [2025-10-28T18:29:19.159481] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-06. [2025-10-28T18:29:19.217438] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-28T18:29:19.220498] [INFO ] [REMOTE ] EFT: Full fetch complete (17798 records). [2025-10-28T18:29:19.220579] [DEBUG] [VALIDATOR ] EFT: Validating primary data. [2025-10-28T18:29:19.573369] [DEBUG] [VALIDATOR ] EFT: All expected trading days are present. [2025-10-28T18:29:19.573444] [DEBUG] [VALIDATOR ] EFT: Primary data validation passed. [2025-10-28T18:29:19.573829] [INFO ] [MAIN ] EFT: Fetched primary data is valid. [2025-10-28T18:29:19.573893] [DEBUG] [LOCAL ] EFT: Saving primary data. [2025-10-28T18:29:19.574401] [DEBUG] [LOCAL ] EFT: Trimmed 17798 records to 12569 (keeping 200 days of data) [2025-10-28T18:29:19.648667] [DEBUG] [LOCAL ] EFT: Primary data saved (12569 records). [2025-10-28T18:29:19.648802] [INFO ] [MAIN ] EFT: Full history saved. [2025-10-28T18:29:19.648877] [INFO ] [MAIN ] Update Progress: 703/2366 symbols completed. EFT took 26.2s. Estimated remaining: 3h 31m 12s. Rate: 7.9 symbols/min [2025-10-28T18:29:19.814451] [INFO ] [MAIN ] EFXT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:29:19.843073] [DEBUG] [LOCAL ] EFXT: Loaded 29414 existing records from primary storage. [2025-10-28T18:29:19.843356] [INFO ] [MAIN ] EFXT: Loaded 29414 existing records. [2025-10-28T18:29:19.964525] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-10. [2025-10-28T18:29:20.019664] [WARN ] [MAIN ] EFXT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:29:20.019998] [INFO ] [MAIN ] EFXT: Wiping existing primary data before full refresh. [2025-10-28T18:29:20.020050] [INFO ] [LOCAL ] EFXT: Starting deletion of primary data. [2025-10-28T18:29:20.020678] [DEBUG] [LOCAL ] EFXT: Deleted primary data file. [2025-10-28T18:29:20.020741] [INFO ] [MAIN ] EFXT: Starting full primary refresh. [2025-10-28T18:29:20.390401] [INFO ] [REMOTE ] EFXT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:29:20.415872] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-28T18:29:20.759307] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-07. [2025-10-28T18:29:20.796011] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-28T18:29:20.799754] [INFO ] [REMOTE ] EFR: Full fetch complete (19752 records). [2025-10-28T18:29:20.799828] [DEBUG] [VALIDATOR ] EFR: Validating primary data. [2025-10-28T18:29:21.165617] [DEBUG] [VALIDATOR ] EFR: All expected trading days are present. [2025-10-28T18:29:21.165740] [DEBUG] [VALIDATOR ] EFR: Primary data validation passed. [2025-10-28T18:29:21.166162] [INFO ] [MAIN ] EFR: Fetched primary data is valid. [2025-10-28T18:29:21.166202] [DEBUG] [LOCAL ] EFR: Saving primary data. [2025-10-28T18:29:21.169854] [DEBUG] [LOCAL ] EFR: Trimmed 19752 records to 14666 (keeping 200 days of data) [2025-10-28T18:29:21.258072] [DEBUG] [LOCAL ] EFR: Primary data saved (14666 records). [2025-10-28T18:29:21.258223] [INFO ] [MAIN ] EFR: Full history saved. [2025-10-28T18:29:21.258303] [INFO ] [MAIN ] Update Progress: 704/2366 symbols completed. EFR took 29.9s. Estimated remaining: 3h 30m 50s. Rate: 7.9 symbols/min [2025-10-28T18:29:21.428898] [INFO ] [MAIN ] EG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:29:21.454242] [DEBUG] [LOCAL ] EG: Loaded 27095 existing records from primary storage. [2025-10-28T18:29:21.454503] [INFO ] [MAIN ] EG: Loaded 27095 existing records. [2025-10-28T18:29:21.564544] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-01. [2025-10-28T18:29:21.634292] [WARN ] [MAIN ] EG: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:29:21.634481] [INFO ] [MAIN ] EG: Wiping existing primary data before full refresh. [2025-10-28T18:29:21.634527] [INFO ] [LOCAL ] EG: Starting deletion of primary data. [2025-10-28T18:29:21.635116] [DEBUG] [LOCAL ] EG: Deleted primary data file. [2025-10-28T18:29:21.635175] [INFO ] [MAIN ] EG: Starting full primary refresh. [2025-10-28T18:29:21.994631] [INFO ] [REMOTE ] EG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:29:22.038335] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-28T18:29:22.359330] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-01. [2025-10-28T18:29:22.680322] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-28T18:29:23.159321] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-06. [2025-10-28T18:29:23.545699] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-28T18:29:23.959387] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-08. [2025-10-28T18:29:24.382222] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-28T18:29:24.759421] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-02. [2025-10-28T18:29:25.222347] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-28T18:29:25.548072] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-28T18:29:25.559290] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-03. [2025-10-28T18:29:26.359316] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-07. [2025-10-28T18:29:26.492270] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-28T18:29:27.159358] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-02. [2025-10-28T18:29:27.636130] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-28T18:29:27.959375] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-08. [2025-10-28T18:29:28.103772] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-28T18:29:28.759369] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-03. [2025-10-28T18:29:29.154145] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-28T18:29:29.559311] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-09. [2025-10-28T18:29:29.735983] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-28T18:29:30.359316] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-09. [2025-10-28T18:29:31.159418] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-04. [2025-10-28T18:29:31.558814] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-28T18:29:31.606815] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-28T18:29:31.959303] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-10. [2025-10-28T18:29:32.094049] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-10-28T18:29:32.759363] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-10. [2025-10-28T18:29:33.314548] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-28T18:29:33.324164] [INFO ] [REMOTE ] EFC: Full fetch complete (66843 records). [2025-10-28T18:29:33.324287] [DEBUG] [VALIDATOR ] EFC: Validating primary data. [2025-10-28T18:29:33.568410] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-05. [2025-10-28T18:29:33.719416] [DEBUG] [VALIDATOR ] EFC: All expected trading days are present. [2025-10-28T18:29:33.719495] [DEBUG] [VALIDATOR ] EFC: Primary data validation passed. [2025-10-28T18:29:33.720308] [INFO ] [MAIN ] EFC: Fetched primary data is valid. [2025-10-28T18:29:33.720370] [DEBUG] [LOCAL ] EFC: Saving primary data. [2025-10-28T18:29:33.721786] [DEBUG] [LOCAL ] EFC: Trimmed 66843 records to 46143 (keeping 200 days of data) [2025-10-28T18:29:33.999419] [DEBUG] [LOCAL ] EFC: Primary data saved (46143 records). [2025-10-28T18:29:33.999582] [INFO ] [MAIN ] EFC: Full history saved. [2025-10-28T18:29:33.999771] [INFO ] [MAIN ] Update Progress: 705/2366 symbols completed. EFC took 52.5s. Estimated remaining: 3h 30m 54s. Rate: 7.9 symbols/min [2025-10-28T18:29:34.172631] [INFO ] [MAIN ] EGO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:29:34.172845] [DEBUG] [LOCAL ] EGO: No existing data file found in primary storage. [2025-10-28T18:29:34.172913] [WARN ] [MAIN ] EGO: No existing data found, performing full refresh instead. [2025-10-28T18:29:34.173055] [INFO ] [MAIN ] EGO: Wiping existing primary data before full refresh. [2025-10-28T18:29:34.173121] [INFO ] [LOCAL ] EGO: Starting deletion of primary data. [2025-10-28T18:29:34.173227] [DEBUG] [LOCAL ] EGO: No primary data file found to delete. [2025-10-28T18:29:34.173272] [INFO ] [MAIN ] EGO: Starting full primary refresh. [2025-10-28T18:29:34.335859] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-28T18:29:34.362601] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-04. [2025-10-28T18:29:34.365340] [INFO ] [REMOTE ] EFX: Full fetch complete (65053 records). [2025-10-28T18:29:34.397333] [DEBUG] [VALIDATOR ] EFX: Validating primary data. [2025-10-28T18:29:34.677941] [INFO ] [REMOTE ] EGO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:29:34.867880] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-28T18:29:35.004909] [DEBUG] [VALIDATOR ] EFX: All expected trading days are present. [2025-10-28T18:29:35.004993] [DEBUG] [VALIDATOR ] EFX: Primary data validation passed. [2025-10-28T18:29:35.006037] [INFO ] [MAIN ] EFX: Fetched primary data is valid. [2025-10-28T18:29:35.006103] [DEBUG] [LOCAL ] EFX: Saving primary data. [2025-10-28T18:29:35.007673] [DEBUG] [LOCAL ] EFX: Trimmed 65053 records to 44475 (keeping 200 days of data) [2025-10-28T18:29:35.187791] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-01. [2025-10-28T18:29:35.285425] [DEBUG] [LOCAL ] EFX: Primary data saved (44475 records). [2025-10-28T18:29:35.285539] [INFO ] [MAIN ] EFX: Full history saved. [2025-10-28T18:29:35.285614] [INFO ] [MAIN ] Update Progress: 706/2366 symbols completed. EFX took 34.2s. Estimated remaining: 3h 30m 32s. Rate: 7.9 symbols/min [2025-10-28T18:29:35.456580] [INFO ] [MAIN ] EGP: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:29:35.456836] [DEBUG] [LOCAL ] EGP: No existing data file found in primary storage. [2025-10-28T18:29:35.456935] [WARN ] [MAIN ] EGP: No existing data found, performing full refresh instead. [2025-10-28T18:29:35.457120] [INFO ] [MAIN ] EGP: Wiping existing primary data before full refresh. [2025-10-28T18:29:35.457221] [INFO ] [LOCAL ] EGP: Starting deletion of primary data. [2025-10-28T18:29:35.457343] [DEBUG] [LOCAL ] EGP: No primary data file found to delete. [2025-10-28T18:29:35.457439] [INFO ] [MAIN ] EGP: Starting full primary refresh. [2025-10-28T18:29:35.623638] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-28T18:29:35.856151] [INFO ] [REMOTE ] EGP: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:29:35.959349] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-01. [2025-10-28T18:29:36.658239] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-28T18:29:36.759321] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-02. [2025-10-28T18:29:37.008527] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-28T18:29:37.559340] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-05. [2025-10-28T18:29:37.853375] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-28T18:29:38.359332] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-03. [2025-10-28T18:29:38.690477] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-28T18:29:39.159321] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-06. [2025-10-28T18:29:39.495955] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-28T18:29:39.934508] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-28T18:29:39.959309] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-07. [2025-10-28T18:29:40.759362] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-04. [2025-10-28T18:29:40.785003] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-28T18:29:41.559369] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-08. [2025-10-28T18:29:42.118365] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-28T18:29:42.335130] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-28T18:29:42.359341] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-05. [2025-10-28T18:29:43.159330] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-09. [2025-10-28T18:29:43.471826] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-28T18:29:43.959325] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-02. [2025-10-28T18:29:44.014322] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-28T18:29:44.759338] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-06. [2025-10-28T18:29:45.008964] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-28T18:29:45.559341] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-03. [2025-10-28T18:29:45.892142] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-28T18:29:46.359357] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-06. [2025-10-28T18:29:46.665590] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-28T18:29:47.159345] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-10. [2025-10-28T18:29:47.325978] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-28T18:29:47.959344] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-04. [2025-10-28T18:29:48.182691] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-28T18:29:48.189623] [INFO ] [REMOTE ] EFXT: Full fetch complete (44318 records). [2025-10-28T18:29:48.189769] [DEBUG] [VALIDATOR ] EFXT: Validating primary data. [2025-10-28T18:29:48.581957] [DEBUG] [VALIDATOR ] EFXT: All expected trading days are present. [2025-10-28T18:29:48.582034] [DEBUG] [VALIDATOR ] EFXT: Primary data validation passed. [2025-10-28T18:29:48.582666] [INFO ] [MAIN ] EFXT: Fetched primary data is valid. [2025-10-28T18:29:48.582726] [DEBUG] [LOCAL ] EFXT: Saving primary data. [2025-10-28T18:29:48.583811] [DEBUG] [LOCAL ] EFXT: Trimmed 44318 records to 29387 (keeping 200 days of data) [2025-10-28T18:29:48.752349] [DEBUG] [LOCAL ] EFXT: Primary data saved (29387 records). [2025-10-28T18:29:48.752482] [INFO ] [MAIN ] EFXT: Full history saved. [2025-10-28T18:29:48.752584] [INFO ] [MAIN ] Update Progress: 707/2366 symbols completed. EFXT took 29.1s. Estimated remaining: 3h 30m 38s. Rate: 7.9 symbols/min [2025-10-28T18:29:48.760694] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-07. [2025-10-28T18:29:48.926760] [INFO ] [MAIN ] EGY: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:29:48.964142] [DEBUG] [LOCAL ] EGY: Loaded 40974 existing records from primary storage. [2025-10-28T18:29:48.964422] [INFO ] [MAIN ] EGY: Loaded 40974 existing records. [2025-10-28T18:29:49.162604] [WARN ] [MAIN ] EGY: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:29:49.163146] [INFO ] [MAIN ] EGY: Wiping existing primary data before full refresh. [2025-10-28T18:29:49.163269] [INFO ] [LOCAL ] EGY: Starting deletion of primary data. [2025-10-28T18:29:49.163930] [DEBUG] [LOCAL ] EGY: Deleted primary data file. [2025-10-28T18:29:49.163988] [INFO ] [MAIN ] EGY: Starting full primary refresh. [2025-10-28T18:29:49.360053] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-28T18:29:49.549118] [INFO ] [REMOTE ] EGY: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:29:49.559306] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-01. [2025-10-28T18:29:50.158386] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-28T18:29:50.359375] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-07. [2025-10-28T18:29:50.424361] [DEBUG] [REMOTE ] EG: Error fetching primary data for 2025-07: 'API call returned an empty response.' [2025-10-28T18:29:50.424755] [WARN ] [REMOTE ] EG: No data returned for month 2025-07 [2025-10-28T18:29:50.424841] [FATAL] [REMOTE ] EG: API call failed - aborting fetch to avoid wasting further API calls [2025-10-28T18:29:50.424918] [FATAL] [MAIN ] EG: Failed to fetch primary data. [2025-10-28T18:29:50.424980] [WARN ] [MAIN ] EG: Deleting existing primary and derivative data due to fetch failure. [2025-10-28T18:29:50.425049] [INFO ] [LOCAL ] EG: Starting deletion of primary data. [2025-10-28T18:29:50.425147] [DEBUG] [LOCAL ] EG: No primary data file found to delete. [2025-10-28T18:29:50.425189] [INFO ] [LOCAL ] EG: Starting deletion of derivative data. [2025-10-28T18:29:50.425362] [DEBUG] [LOCAL ] EG: Deleted derivative data file. [2025-10-28T18:29:50.425444] [INFO ] [MAIN ] Update Progress: 708/2366 symbols completed. EG took 29.2s. Estimated remaining: 3h 30m 16s. Rate: 7.9 symbols/min [2025-10-28T18:29:50.600877] [INFO ] [MAIN ] EHAB: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:29:50.629754] [DEBUG] [LOCAL ] EHAB: Loaded 29072 existing records from primary storage. [2025-10-28T18:29:50.630063] [INFO ] [MAIN ] EHAB: Loaded 29072 existing records. [2025-10-28T18:29:50.818205] [WARN ] [MAIN ] EHAB: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:29:50.818639] [INFO ] [MAIN ] EHAB: Wiping existing primary data before full refresh. [2025-10-28T18:29:50.818738] [INFO ] [LOCAL ] EHAB: Starting deletion of primary data. [2025-10-28T18:29:50.819032] [DEBUG] [LOCAL ] EHAB: Deleted primary data file. [2025-10-28T18:29:50.819084] [INFO ] [MAIN ] EHAB: Starting full primary refresh. [2025-10-28T18:29:50.957177] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-28T18:29:51.166186] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-05. [2025-10-28T18:29:51.205152] [INFO ] [REMOTE ] EHAB: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:29:51.959309] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-01. [2025-10-28T18:29:52.089608] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-28T18:29:52.759381] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-02. [2025-10-28T18:29:52.810132] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-28T18:29:53.559369] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-08. [2025-10-28T18:29:53.724136] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-28T18:29:54.359353] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-03. [2025-10-28T18:29:54.776374] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-28T18:29:55.159347] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-09. [2025-10-28T18:29:55.715249] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-28T18:29:55.959343] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-02. [2025-10-28T18:29:56.488148] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-28T18:29:56.659296] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-28T18:29:56.759325] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-06. [2025-10-28T18:29:57.559318] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-03. [2025-10-28T18:29:57.601784] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-28T18:29:58.359327] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-04. [2025-10-28T18:29:58.526228] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-28T18:29:59.159370] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-04. [2025-10-28T18:29:59.509124] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-28T18:29:59.964915] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-07. [2025-10-28T18:29:59.969593] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-28T18:30:00.759353] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-05. [2025-10-28T18:30:01.192097] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-28T18:30:01.559358] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-08. [2025-10-28T18:30:02.259972] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-28T18:30:02.359349] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-10. [2025-10-28T18:30:02.710142] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-28T18:30:03.159391] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-06. [2025-10-28T18:30:03.955128] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-28T18:30:03.964734] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-09. [2025-10-28T18:30:03.967051] [INFO ] [REMOTE ] EGO: Full fetch complete (74736 records). [2025-10-28T18:30:03.967155] [DEBUG] [VALIDATOR ] EGO: Validating primary data. [2025-10-28T18:30:04.370725] [DEBUG] [VALIDATOR ] EGO: All expected trading days are present. [2025-10-28T18:30:04.370908] [DEBUG] [VALIDATOR ] EGO: Primary data validation passed. [2025-10-28T18:30:04.371923] [INFO ] [MAIN ] EGO: Fetched primary data is valid. [2025-10-28T18:30:04.372013] [DEBUG] [LOCAL ] EGO: Saving primary data. [2025-10-28T18:30:04.394707] [DEBUG] [LOCAL ] EGO: Trimmed 74736 records to 51705 (keeping 200 days of data) [2025-10-28T18:30:04.400918] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-28T18:30:04.700275] [DEBUG] [LOCAL ] EGO: Primary data saved (51705 records). [2025-10-28T18:30:04.700414] [INFO ] [MAIN ] EGO: Full history saved. [2025-10-28T18:30:04.700488] [INFO ] [MAIN ] Update Progress: 709/2366 symbols completed. EGO took 30.7s. Estimated remaining: 3h 30m 24s. Rate: 7.9 symbols/min [2025-10-28T18:30:04.765435] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-05. [2025-10-28T18:30:04.880586] [INFO ] [MAIN ] EHC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:30:04.900678] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-28T18:30:04.942144] [DEBUG] [LOCAL ] EHC: Loaded 40655 existing records from primary storage. [2025-10-28T18:30:04.942450] [INFO ] [MAIN ] EHC: Loaded 40655 existing records. [2025-10-28T18:30:05.117947] [WARN ] [MAIN ] EHC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:30:05.118091] [INFO ] [MAIN ] EHC: Wiping existing primary data before full refresh. [2025-10-28T18:30:05.118137] [INFO ] [LOCAL ] EHC: Starting deletion of primary data. [2025-10-28T18:30:05.118497] [DEBUG] [LOCAL ] EHC: Deleted primary data file. [2025-10-28T18:30:05.118540] [INFO ] [MAIN ] EHC: Starting full primary refresh. [2025-10-28T18:30:05.461905] [INFO ] [REMOTE ] EHC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:30:05.559306] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-01. [2025-10-28T18:30:05.962994] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-28T18:30:06.359381] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-10. [2025-10-28T18:30:06.955313] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-28T18:30:07.159343] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-06. [2025-10-28T18:30:07.517501] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-28T18:30:07.523314] [INFO ] [REMOTE ] EGP: Full fetch complete (45425 records). [2025-10-28T18:30:07.523443] [DEBUG] [VALIDATOR ] EGP: Validating primary data. [2025-10-28T18:30:07.524091] [FATAL] [VALIDATOR ] EGP: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T18:30:07.524175] [FATAL] [MAIN ] EGP: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:30:07.524218] [WARN ] [MAIN ] EGP: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:30:07.524256] [INFO ] [LOCAL ] EGP: Starting deletion of primary data. [2025-10-28T18:30:07.524382] [DEBUG] [LOCAL ] EGP: No primary data file found to delete. [2025-10-28T18:30:07.524438] [INFO ] [LOCAL ] EGP: Starting deletion of derivative data. [2025-10-28T18:30:07.524480] [DEBUG] [LOCAL ] EGP: No derivative data file found to delete. [2025-10-28T18:30:07.524536] [INFO ] [MAIN ] Update Progress: 710/2366 symbols completed. EGP took 32.2s. Estimated remaining: 3h 30m 5s. Rate: 7.9 symbols/min [2025-10-28T18:30:07.694439] [INFO ] [MAIN ] EHI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:30:07.706113] [DEBUG] [LOCAL ] EHI: Loaded 10481 existing records from primary storage. [2025-10-28T18:30:07.706342] [INFO ] [MAIN ] EHI: Loaded 10481 existing records. [2025-10-28T18:30:07.885958] [WARN ] [MAIN ] EHI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:30:07.886260] [INFO ] [MAIN ] EHI: Wiping existing primary data before full refresh. [2025-10-28T18:30:07.886335] [INFO ] [LOCAL ] EHI: Starting deletion of primary data. [2025-10-28T18:30:07.913436] [DEBUG] [LOCAL ] EHI: Deleted primary data file. [2025-10-28T18:30:07.924290] [INFO ] [MAIN ] EHI: Starting full primary refresh. [2025-10-28T18:30:07.957074] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-28T18:30:07.964427] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-07. [2025-10-28T18:30:08.314195] [INFO ] [REMOTE ] EHI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:30:08.759359] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-01. [2025-10-28T18:30:09.139363] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-28T18:30:09.559310] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-08. [2025-10-28T18:30:09.745203] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-28T18:30:10.359395] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-02. [2025-10-28T18:30:10.685524] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-28T18:30:11.159483] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-09. [2025-10-28T18:30:11.498932] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-28T18:30:11.959406] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-03. [2025-10-28T18:30:12.759340] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-07. [2025-10-28T18:30:12.982161] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-28T18:30:13.559358] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-02. [2025-10-28T18:30:13.892413] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-28T18:30:14.284581] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-09 (3.13 seconds). [2025-10-28T18:30:14.359345] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-08. [2025-10-28T18:30:14.585109] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-28T18:30:15.159353] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-04. [2025-10-28T18:30:15.612568] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-28T18:30:15.959359] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-09. [2025-10-28T18:30:16.504249] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-28T18:30:16.759358] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-03. [2025-10-28T18:30:17.149887] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-28T18:30:17.272077] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-28T18:30:17.559333] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-05. [2025-10-28T18:30:18.359331] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-04. [2025-10-28T18:30:18.842028] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-28T18:30:18.970911] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-28T18:30:19.159331] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-10. [2025-10-28T18:30:19.959358] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-05. [2025-10-28T18:30:20.348623] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-28T18:30:20.353816] [INFO ] [REMOTE ] EHAB: Full fetch complete (40901 records). [2025-10-28T18:30:20.353949] [DEBUG] [VALIDATOR ] EHAB: Validating primary data. [2025-10-28T18:30:20.354554] [FATAL] [VALIDATOR ] EHAB: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T18:30:20.354686] [FATAL] [MAIN ] EHAB: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:30:20.354760] [WARN ] [MAIN ] EHAB: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:30:20.354860] [INFO ] [LOCAL ] EHAB: Starting deletion of primary data. [2025-10-28T18:30:20.354940] [DEBUG] [LOCAL ] EHAB: No primary data file found to delete. [2025-10-28T18:30:20.354996] [INFO ] [LOCAL ] EHAB: Starting deletion of derivative data. [2025-10-28T18:30:20.355198] [DEBUG] [LOCAL ] EHAB: Deleted derivative data file. [2025-10-28T18:30:20.355287] [INFO ] [MAIN ] Update Progress: 711/2366 symbols completed. EHAB took 29.9s. Estimated remaining: 3h 30m 10s. Rate: 7.9 symbols/min [2025-10-28T18:30:20.523496] [INFO ] [MAIN ] EIC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:30:20.523683] [DEBUG] [LOCAL ] EIC: No existing data file found in primary storage. [2025-10-28T18:30:20.523734] [WARN ] [MAIN ] EIC: No existing data found, performing full refresh instead. [2025-10-28T18:30:20.523844] [INFO ] [MAIN ] EIC: Wiping existing primary data before full refresh. [2025-10-28T18:30:20.523884] [INFO ] [LOCAL ] EIC: Starting deletion of primary data. [2025-10-28T18:30:20.523923] [DEBUG] [LOCAL ] EIC: No primary data file found to delete. [2025-10-28T18:30:20.523954] [INFO ] [MAIN ] EIC: Starting full primary refresh. [2025-10-28T18:30:20.764490] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-06. [2025-10-28T18:30:20.880865] [INFO ] [REMOTE ] EIC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:30:21.102539] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-28T18:30:21.559333] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-10. [2025-10-28T18:30:21.675341] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-28T18:30:22.359370] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-01. [2025-10-28T18:30:23.062820] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-28T18:30:23.070628] [INFO ] [REMOTE ] EGY: Full fetch complete (60302 records). [2025-10-28T18:30:23.070837] [DEBUG] [VALIDATOR ] EGY: Validating primary data. [2025-10-28T18:30:23.071575] [FATAL] [VALIDATOR ] EGY: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T18:30:23.071706] [FATAL] [MAIN ] EGY: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:30:23.071755] [WARN ] [MAIN ] EGY: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:30:23.071823] [INFO ] [LOCAL ] EGY: Starting deletion of primary data. [2025-10-28T18:30:23.071889] [DEBUG] [LOCAL ] EGY: No primary data file found to delete. [2025-10-28T18:30:23.071925] [INFO ] [LOCAL ] EGY: Starting deletion of derivative data. [2025-10-28T18:30:23.072112] [DEBUG] [LOCAL ] EGY: Deleted derivative data file. [2025-10-28T18:30:23.072210] [INFO ] [MAIN ] Update Progress: 712/2366 symbols completed. EGY took 34.3s. Estimated remaining: 3h 29m 51s. Rate: 7.9 symbols/min [2025-10-28T18:30:23.166317] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-06. [2025-10-28T18:30:23.253882] [INFO ] [MAIN ] EICA: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:30:23.254060] [DEBUG] [LOCAL ] EICA: No existing data file found in primary storage. [2025-10-28T18:30:23.254145] [WARN ] [MAIN ] EICA: No existing data found, performing full refresh instead. [2025-10-28T18:30:23.254227] [INFO ] [MAIN ] EICA: Wiping existing primary data before full refresh. [2025-10-28T18:30:23.254263] [INFO ] [LOCAL ] EICA: Starting deletion of primary data. [2025-10-28T18:30:23.254302] [DEBUG] [LOCAL ] EICA: No primary data file found to delete. [2025-10-28T18:30:23.254333] [INFO ] [MAIN ] EICA: Starting full primary refresh. [2025-10-28T18:30:23.613187] [INFO ] [REMOTE ] EICA: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:30:23.636034] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-28T18:30:23.637821] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-28T18:30:23.959374] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-01. [2025-10-28T18:30:24.679375] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-28T18:30:24.759335] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-07. [2025-10-28T18:30:25.559402] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-07. [2025-10-28T18:30:26.070191] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-28T18:30:26.088141] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-28T18:30:26.359330] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-08. [2025-10-28T18:30:27.159344] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-02. [2025-10-28T18:30:27.913363] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-28T18:30:27.961669] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-02. [2025-10-28T18:30:27.966606] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-28T18:30:28.202448] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-02 (0.24 seconds). [2025-10-28T18:30:28.759359] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-03. [2025-10-28T18:30:29.559409] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-03. [2025-10-28T18:30:29.635583] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-28T18:30:29.794348] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-03 (0.23 seconds). [2025-10-28T18:30:30.359396] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-04. [2025-10-28T18:30:30.591806] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-04 (0.23 seconds). [2025-10-28T18:30:31.159341] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-05. [2025-10-28T18:30:31.687600] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-28T18:30:31.959382] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-04. [2025-10-28T18:30:32.759418] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-06. [2025-10-28T18:30:33.263185] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-28T18:30:33.480999] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-28T18:30:33.559331] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-07. [2025-10-28T18:30:34.132499] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-28T18:30:34.359368] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-09. [2025-10-28T18:30:35.159374] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-08. [2025-10-28T18:30:35.468416] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-08 (0.31 seconds). [2025-10-28T18:30:35.608298] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-28T18:30:35.959337] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-08. [2025-10-28T18:30:36.759327] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-09. [2025-10-28T18:30:37.010127] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-09 (0.25 seconds). [2025-10-28T18:30:37.559371] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-10. [2025-10-28T18:30:37.640875] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-28T18:30:37.905666] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-10 (0.35 seconds). [2025-10-28T18:30:37.906396] [INFO ] [REMOTE ] EICA: Full fetch complete (1154 records). [2025-10-28T18:30:37.906462] [DEBUG] [VALIDATOR ] EICA: Validating primary data. [2025-10-28T18:30:37.906865] [FATAL] [VALIDATOR ] EICA: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T18:30:37.906966] [FATAL] [MAIN ] EICA: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:30:37.907035] [WARN ] [MAIN ] EICA: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:30:37.907105] [INFO ] [LOCAL ] EICA: Starting deletion of primary data. [2025-10-28T18:30:37.907167] [DEBUG] [LOCAL ] EICA: No primary data file found to delete. [2025-10-28T18:30:37.907202] [INFO ] [LOCAL ] EICA: Starting deletion of derivative data. [2025-10-28T18:30:37.907241] [DEBUG] [LOCAL ] EICA: No derivative data file found to delete. [2025-10-28T18:30:37.907291] [INFO ] [MAIN ] Update Progress: 713/2366 symbols completed. EICA took 14.8s. Estimated remaining: 3h 30m 0s. Rate: 7.9 symbols/min [2025-10-28T18:30:38.071994] [INFO ] [MAIN ] EICB: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:30:38.072179] [DEBUG] [LOCAL ] EICB: No existing data file found in primary storage. [2025-10-28T18:30:38.072215] [WARN ] [MAIN ] EICB: No existing data found, performing full refresh instead. [2025-10-28T18:30:38.072326] [INFO ] [MAIN ] EICB: Wiping existing primary data before full refresh. [2025-10-28T18:30:38.072367] [INFO ] [LOCAL ] EICB: Starting deletion of primary data. [2025-10-28T18:30:38.072413] [DEBUG] [LOCAL ] EICB: No primary data file found to delete. [2025-10-28T18:30:38.072444] [INFO ] [MAIN ] EICB: Starting full primary refresh. [2025-10-28T18:30:38.364419] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-09. [2025-10-28T18:30:38.421975] [INFO ] [REMOTE ] EICB: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:30:39.159338] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-10. [2025-10-28T18:30:39.339588] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-28T18:30:39.959341] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-10. [2025-10-28T18:30:40.357296] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-28T18:30:40.360017] [INFO ] [REMOTE ] EHI: Full fetch complete (15659 records). [2025-10-28T18:30:40.360118] [DEBUG] [VALIDATOR ] EHI: Validating primary data. [2025-10-28T18:30:40.717054] [DEBUG] [VALIDATOR ] EHI: All expected trading days are present. [2025-10-28T18:30:40.717135] [DEBUG] [VALIDATOR ] EHI: Primary data validation passed. [2025-10-28T18:30:40.717472] [INFO ] [MAIN ] EHI: Fetched primary data is valid. [2025-10-28T18:30:40.717512] [DEBUG] [LOCAL ] EHI: Saving primary data. [2025-10-28T18:30:40.718137] [DEBUG] [LOCAL ] EHI: Trimmed 15659 records to 10489 (keeping 200 days of data) [2025-10-28T18:30:40.760777] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-05. [2025-10-28T18:30:40.780922] [DEBUG] [LOCAL ] EHI: Primary data saved (10489 records). [2025-10-28T18:30:40.781019] [INFO ] [MAIN ] EHI: Full history saved. [2025-10-28T18:30:40.781105] [INFO ] [MAIN ] Update Progress: 714/2366 symbols completed. EHI took 33.3s. Estimated remaining: 3h 29m 42s. Rate: 7.9 symbols/min [2025-10-28T18:30:40.957792] [INFO ] [MAIN ] EICC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:30:40.958036] [DEBUG] [LOCAL ] EICC: No existing data file found in primary storage. [2025-10-28T18:30:40.958078] [WARN ] [MAIN ] EICC: No existing data found, performing full refresh instead. [2025-10-28T18:30:40.958149] [INFO ] [MAIN ] EICC: Wiping existing primary data before full refresh. [2025-10-28T18:30:40.958184] [INFO ] [LOCAL ] EICC: Starting deletion of primary data. [2025-10-28T18:30:40.958223] [DEBUG] [LOCAL ] EICC: No primary data file found to delete. [2025-10-28T18:30:40.958254] [INFO ] [MAIN ] EICC: Starting full primary refresh. [2025-10-28T18:30:41.314341] [INFO ] [REMOTE ] EICC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:30:41.486063] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-28T18:30:41.493831] [INFO ] [REMOTE ] EHC: Full fetch complete (58700 records). [2025-10-28T18:30:41.493977] [DEBUG] [VALIDATOR ] EHC: Validating primary data. [2025-10-28T18:30:41.567716] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-01. [2025-10-28T18:30:41.890709] [DEBUG] [VALIDATOR ] EHC: All expected trading days are present. [2025-10-28T18:30:41.890795] [DEBUG] [VALIDATOR ] EHC: Primary data validation passed. [2025-10-28T18:30:41.891509] [INFO ] [MAIN ] EHC: Fetched primary data is valid. [2025-10-28T18:30:41.891548] [DEBUG] [LOCAL ] EHC: Saving primary data. [2025-10-28T18:30:41.892779] [DEBUG] [LOCAL ] EHC: Trimmed 58700 records to 40562 (keeping 200 days of data) [2025-10-28T18:30:42.016877] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-28T18:30:42.156821] [DEBUG] [LOCAL ] EHC: Primary data saved (40562 records). [2025-10-28T18:30:42.157005] [INFO ] [MAIN ] EHC: Full history saved. [2025-10-28T18:30:42.157970] [INFO ] [MAIN ] Update Progress: 715/2366 symbols completed. EHC took 37.5s. Estimated remaining: 3h 29m 20s. Rate: 7.9 symbols/min [2025-10-28T18:30:42.278850] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-28T18:30:42.346606] [INFO ] [MAIN ] EIG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:30:42.359563] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-02. [2025-10-28T18:30:42.368405] [DEBUG] [LOCAL ] EIG: Loaded 19836 existing records from primary storage. [2025-10-28T18:30:42.368688] [INFO ] [MAIN ] EIG: Loaded 19836 existing records. [2025-10-28T18:30:42.544722] [WARN ] [MAIN ] EIG: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:30:42.544923] [INFO ] [MAIN ] EIG: Wiping existing primary data before full refresh. [2025-10-28T18:30:42.544969] [INFO ] [LOCAL ] EIG: Starting deletion of primary data. [2025-10-28T18:30:42.545169] [DEBUG] [LOCAL ] EIG: Deleted primary data file. [2025-10-28T18:30:42.545225] [INFO ] [MAIN ] EIG: Starting full primary refresh. [2025-10-28T18:30:42.825290] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-28T18:30:42.907125] [INFO ] [REMOTE ] EIG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:30:43.159367] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-01. [2025-10-28T18:30:43.959342] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-06. [2025-10-28T18:30:44.036329] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-28T18:30:44.759323] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-02. [2025-10-28T18:30:44.814099] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-28T18:30:45.429600] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-28T18:30:45.559396] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-07. [2025-10-28T18:30:46.359317] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-03. [2025-10-28T18:30:46.445959] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-28T18:30:47.105472] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-28T18:30:47.159356] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-03. [2025-10-28T18:30:47.603086] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-28T18:30:47.959351] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-08. [2025-10-28T18:30:48.703837] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-28T18:30:48.759336] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-01. [2025-10-28T18:30:49.261357] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-10-28T18:30:49.559350] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-04. [2025-10-28T18:30:50.352598] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-28T18:30:50.359292] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-09. [2025-10-28T18:30:50.957356] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-28T18:30:51.159345] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-10. [2025-10-28T18:30:51.959341] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-04. [2025-10-28T18:30:52.222928] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-28T18:30:52.228457] [INFO ] [REMOTE ] EIC: Full fetch complete (33676 records). [2025-10-28T18:30:52.228667] [DEBUG] [VALIDATOR ] EIC: Validating primary data. [2025-10-28T18:30:52.229406] [FATAL] [VALIDATOR ] EIC: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T18:30:52.229523] [FATAL] [MAIN ] EIC: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:30:52.229612] [WARN ] [MAIN ] EIC: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:30:52.229727] [INFO ] [LOCAL ] EIC: Starting deletion of primary data. [2025-10-28T18:30:52.229817] [DEBUG] [LOCAL ] EIC: No primary data file found to delete. [2025-10-28T18:30:52.229875] [INFO ] [LOCAL ] EIC: Starting deletion of derivative data. [2025-10-28T18:30:52.229943] [DEBUG] [LOCAL ] EIC: No derivative data file found to delete. [2025-10-28T18:30:52.230029] [INFO ] [MAIN ] Update Progress: 716/2366 symbols completed. EIC took 31.9s. Estimated remaining: 3h 29m 18s. Rate: 7.9 symbols/min [2025-10-28T18:30:52.414923] [INFO ] [MAIN ] EIX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:30:52.445980] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-28T18:30:52.467173] [DEBUG] [LOCAL ] EIX: Loaded 53339 existing records from primary storage. [2025-10-28T18:30:52.467520] [INFO ] [MAIN ] EIX: Loaded 53339 existing records. [2025-10-28T18:30:52.643733] [WARN ] [MAIN ] EIX: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:30:52.643943] [INFO ] [MAIN ] EIX: Wiping existing primary data before full refresh. [2025-10-28T18:30:52.643990] [INFO ] [LOCAL ] EIX: Starting deletion of primary data. [2025-10-28T18:30:52.644881] [DEBUG] [LOCAL ] EIX: Deleted primary data file. [2025-10-28T18:30:52.644939] [INFO ] [MAIN ] EIX: Starting full primary refresh. [2025-10-28T18:30:52.764434] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-05. [2025-10-28T18:30:53.007465] [INFO ] [REMOTE ] EIX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:30:53.183224] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-28T18:30:53.559332] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-01. [2025-10-28T18:30:54.359336] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-06. [2025-10-28T18:30:54.750728] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-10-28T18:30:55.159343] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-05. [2025-10-28T18:30:55.779945] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-01 (2.22 seconds). [2025-10-28T18:30:55.959314] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-02. [2025-10-28T18:30:56.232882] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-28T18:30:56.759368] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-06. [2025-10-28T18:30:57.217213] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-28T18:30:57.387053] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-28T18:30:57.559341] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-02. [2025-10-28T18:30:57.827812] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-02 (0.27 seconds). [2025-10-28T18:30:58.359386] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-07. [2025-10-28T18:30:58.843508] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-28T18:30:59.159346] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-08. [2025-10-28T18:30:59.565402] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-10-28T18:30:59.959361] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-07. [2025-10-28T18:31:00.678817] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-28T18:31:00.759350] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-09. [2025-10-28T18:31:01.404882] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-28T18:31:01.559377] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-08. [2025-10-28T18:31:02.359374] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-03. [2025-10-28T18:31:02.861120] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-28T18:31:03.159368] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-10. [2025-10-28T18:31:03.598198] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-28T18:31:03.630624] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-28T18:31:03.633597] [INFO ] [REMOTE ] EICC: Full fetch complete (8451 records). [2025-10-28T18:31:03.633800] [DEBUG] [VALIDATOR ] EICC: Validating primary data. [2025-10-28T18:31:03.634495] [FATAL] [VALIDATOR ] EICC: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T18:31:03.634608] [FATAL] [MAIN ] EICC: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:31:03.634707] [WARN ] [MAIN ] EICC: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:31:03.634804] [INFO ] [LOCAL ] EICC: Starting deletion of primary data. [2025-10-28T18:31:03.634906] [DEBUG] [LOCAL ] EICC: No primary data file found to delete. [2025-10-28T18:31:03.634965] [INFO ] [LOCAL ] EICC: Starting deletion of derivative data. [2025-10-28T18:31:03.635032] [DEBUG] [LOCAL ] EICC: No derivative data file found to delete. [2025-10-28T18:31:03.635119] [INFO ] [MAIN ] Update Progress: 717/2366 symbols completed. EICC took 22.9s. Estimated remaining: 3h 29m 19s. Rate: 7.9 symbols/min [2025-10-28T18:31:03.959552] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-09. [2025-10-28T18:31:04.727932] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-28T18:31:04.759292] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-10. [2025-10-28T18:31:05.559313] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-03. [2025-10-28T18:31:05.578406] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-28T18:31:05.582431] [INFO ] [REMOTE ] EIG: Full fetch complete (27217 records). [2025-10-28T18:31:05.582534] [DEBUG] [VALIDATOR ] EIG: Validating primary data. [2025-10-28T18:31:05.583082] [FATAL] [VALIDATOR ] EIG: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T18:31:05.583162] [FATAL] [MAIN ] EIG: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:31:05.583207] [WARN ] [MAIN ] EIG: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:31:05.583274] [INFO ] [LOCAL ] EIG: Starting deletion of primary data. [2025-10-28T18:31:05.583356] [DEBUG] [LOCAL ] EIG: No primary data file found to delete. [2025-10-28T18:31:05.583393] [INFO ] [LOCAL ] EIG: Starting deletion of derivative data. [2025-10-28T18:31:05.583554] [DEBUG] [LOCAL ] EIG: Deleted derivative data file. [2025-10-28T18:31:05.583682] [INFO ] [MAIN ] Update Progress: 718/2366 symbols completed. EIG took 23.4s. Estimated remaining: 3h 28m 58s. Rate: 7.9 symbols/min [2025-10-28T18:31:06.199460] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-28T18:31:06.359375] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-04. [2025-10-28T18:31:07.159376] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-04. [2025-10-28T18:31:07.452218] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-04 (0.29 seconds). [2025-10-28T18:31:07.959386] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-05. [2025-10-28T18:31:08.429981] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-28T18:31:08.698583] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-04 (2.34 seconds). [2025-10-28T18:31:08.759409] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-06. [2025-10-28T18:31:09.559397] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-05. [2025-10-28T18:31:09.696172] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-28T18:31:10.359393] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-07. [2025-10-28T18:31:10.673045] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-07 (0.31 seconds). [2025-10-28T18:31:10.822039] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-28T18:31:11.159398] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-08. [2025-10-28T18:31:11.496506] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-10-28T18:31:11.959394] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-09. [2025-10-28T18:31:12.248483] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-09 (0.29 seconds). [2025-10-28T18:31:12.759340] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-10. [2025-10-28T18:31:13.110801] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-10 (0.35 seconds). [2025-10-28T18:31:13.111773] [INFO ] [REMOTE ] EICB: Full fetch complete (2631 records). [2025-10-28T18:31:13.111843] [DEBUG] [VALIDATOR ] EICB: Validating primary data. [2025-10-28T18:31:13.293757] [WARN ] [VALIDATOR ] EICB: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-10-28T18:31:13.293933] [FATAL] [MAIN ] EICB: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:31:13.294007] [WARN ] [MAIN ] EICB: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:31:13.294072] [INFO ] [LOCAL ] EICB: Starting deletion of primary data. [2025-10-28T18:31:13.294133] [DEBUG] [LOCAL ] EICB: No primary data file found to delete. [2025-10-28T18:31:13.294168] [INFO ] [LOCAL ] EICB: Starting deletion of derivative data. [2025-10-28T18:31:13.294207] [DEBUG] [LOCAL ] EICB: No derivative data file found to delete. [2025-10-28T18:31:13.294261] [INFO ] [MAIN ] Update Progress: 719/2366 symbols completed. EICB took 35.4s. Estimated remaining: 3h 28m 51s. Rate: 7.9 symbols/min [2025-10-28T18:31:13.559349] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-06. [2025-10-28T18:31:15.217283] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-10-28T18:31:15.229335] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-07. [2025-10-28T18:31:16.838876] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-28T18:31:16.851330] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-08. [2025-10-28T18:31:18.256014] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-28T18:31:18.267185] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-09. [2025-10-28T18:31:20.265152] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-10-28T18:31:20.277018] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-10. [2025-10-28T18:31:21.222722] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-28T18:31:21.233514] [INFO ] [REMOTE ] EIX: Full fetch complete (77450 records). [2025-10-28T18:31:21.233709] [DEBUG] [VALIDATOR ] EIX: Validating primary data. [2025-10-28T18:31:21.636813] [DEBUG] [VALIDATOR ] EIX: All expected trading days are present. [2025-10-28T18:31:21.636937] [DEBUG] [VALIDATOR ] EIX: Primary data validation passed. [2025-10-28T18:31:21.637875] [INFO ] [MAIN ] EIX: Fetched primary data is valid. [2025-10-28T18:31:21.637937] [DEBUG] [LOCAL ] EIX: Saving primary data. [2025-10-28T18:31:21.639358] [DEBUG] [LOCAL ] EIX: Trimmed 77450 records to 53339 (keeping 200 days of data) [2025-10-28T18:31:21.961104] [DEBUG] [LOCAL ] EIX: Primary data saved (53339 records). [2025-10-28T18:31:21.961243] [INFO ] [MAIN ] EIX: Full history saved. [2025-10-28T18:31:21.961338] [INFO ] [MAIN ] Update Progress: 720/2366 symbols completed. EIX took 29.7s. Estimated remaining: 3h 28m 46s. Rate: 7.9 symbols/min [2025-10-28T18:31:22.600153] [INFO ] [MAIN ] ELC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:31:22.587403] [INFO ] [MAIN ] EL: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:31:22.757307] [INFO ] [MAIN ] ELF: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:31:22.756160] [INFO ] [MAIN ] ELAN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:31:22.733157] [DEBUG] [LOCAL ] ELC: Loaded 3391 existing records from primary storage. [2025-10-28T18:31:22.758517] [INFO ] [MAIN ] ELC: Loaded 3391 existing records. [2025-10-28T18:31:23.008875] [WARN ] [MAIN ] ELC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:31:23.009785] [INFO ] [MAIN ] ELC: Wiping existing primary data before full refresh. [2025-10-28T18:31:23.009841] [INFO ] [LOCAL ] ELC: Starting deletion of primary data. [2025-10-28T18:31:23.010057] [DEBUG] [LOCAL ] ELC: Deleted primary data file. [2025-10-28T18:31:23.010114] [INFO ] [MAIN ] ELC: Starting full primary refresh. [2025-10-28T18:31:23.144185] [DEBUG] [LOCAL ] ELAN: Loaded 53308 existing records from primary storage. [2025-10-28T18:31:23.157304] [DEBUG] [LOCAL ] EL: Loaded 53370 existing records from primary storage. [2025-10-28T18:31:23.184811] [INFO ] [MAIN ] EL: Loaded 53370 existing records. [2025-10-28T18:31:23.179336] [DEBUG] [LOCAL ] ELF: Loaded 51744 existing records from primary storage. [2025-10-28T18:31:23.199289] [INFO ] [MAIN ] ELF: Loaded 51744 existing records. [2025-10-28T18:31:23.199110] [INFO ] [MAIN ] ELAN: Loaded 53308 existing records. [2025-10-28T18:31:23.949274] [WARN ] [MAIN ] EL: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:31:23.945507] [WARN ] [MAIN ] ELF: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:31:23.956051] [INFO ] [MAIN ] EL: Wiping existing primary data before full refresh. [2025-10-28T18:31:23.961502] [INFO ] [MAIN ] ELF: Wiping existing primary data before full refresh. [2025-10-28T18:31:23.961323] [INFO ] [LOCAL ] EL: Starting deletion of primary data. [2025-10-28T18:31:23.977215] [INFO ] [LOCAL ] ELF: Starting deletion of primary data. [2025-10-28T18:31:24.008770] [DEBUG] [LOCAL ] ELF: Deleted primary data file. [2025-10-28T18:31:24.008668] [DEBUG] [LOCAL ] EL: Deleted primary data file. [2025-10-28T18:31:24.059211] [INFO ] [MAIN ] ELF: Starting full primary refresh. [2025-10-28T18:31:24.110187] [WARN ] [MAIN ] ELAN: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:31:24.125728] [INFO ] [MAIN ] EL: Starting full primary refresh. [2025-10-28T18:31:24.147526] [INFO ] [MAIN ] ELAN: Wiping existing primary data before full refresh. [2025-10-28T18:31:24.159140] [INFO ] [LOCAL ] ELAN: Starting deletion of primary data. [2025-10-28T18:31:24.163270] [INFO ] [REMOTE ] ELC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:31:24.202522] [DEBUG] [LOCAL ] ELAN: Deleted primary data file. [2025-10-28T18:31:24.228705] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-01. [2025-10-28T18:31:24.202722] [INFO ] [MAIN ] ELAN: Starting full primary refresh. [2025-10-28T18:31:25.023400] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-28T18:31:25.193213] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-02. [2025-10-28T18:31:25.191766] [INFO ] [REMOTE ] ELF: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:31:25.199073] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-01. [2025-10-28T18:31:25.389154] [INFO ] [REMOTE ] EL: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:31:25.389866] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-01. [2025-10-28T18:31:25.392827] [INFO ] [REMOTE ] ELAN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:31:25.393776] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-01. [2025-10-28T18:31:25.552912] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-10-28T18:31:25.554828] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-03. [2025-10-28T18:31:25.910602] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-10-28T18:31:25.912024] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-04. [2025-10-28T18:31:26.602928] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-28T18:31:26.604405] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-05. [2025-10-28T18:31:26.695566] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-28T18:31:26.706820] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-02. [2025-10-28T18:31:26.895590] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-28T18:31:26.908854] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-02. [2025-10-28T18:31:26.947839] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-10-28T18:31:26.950813] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-06. [2025-10-28T18:31:27.115195] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-28T18:31:27.125022] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-02. [2025-10-28T18:31:27.308119] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-10-28T18:31:27.309557] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-07. [2025-10-28T18:31:27.605772] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-07 (0.30 seconds). [2025-10-28T18:31:27.920024] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-28T18:31:27.959294] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-03. [2025-10-28T18:31:28.485997] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-28T18:31:28.726893] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-10-28T18:31:28.759324] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-03. [2025-10-28T18:31:29.225527] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-28T18:31:29.559326] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-08. [2025-10-28T18:31:29.887044] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-10-28T18:31:30.146539] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-28T18:31:30.359325] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-03. [2025-10-28T18:31:31.159380] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-09. [2025-10-28T18:31:31.453828] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-09 (0.29 seconds). [2025-10-28T18:31:31.959408] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-04. [2025-10-28T18:31:32.265349] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-28T18:31:32.759325] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-04. [2025-10-28T18:31:33.198817] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-28T18:31:33.559338] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-10. [2025-10-28T18:31:34.031291] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-10 (0.47 seconds). [2025-10-28T18:31:34.032529] [INFO ] [REMOTE ] ELC: Full fetch complete (4899 records). [2025-10-28T18:31:34.032600] [DEBUG] [VALIDATOR ] ELC: Validating primary data. [2025-10-28T18:31:34.363694] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-05. [2025-10-28T18:31:34.435578] [DEBUG] [VALIDATOR ] ELC: All expected trading days are present. [2025-10-28T18:31:34.435779] [DEBUG] [VALIDATOR ] ELC: Primary data validation passed. [2025-10-28T18:31:34.436006] [INFO ] [MAIN ] ELC: Fetched primary data is valid. [2025-10-28T18:31:34.436151] [DEBUG] [LOCAL ] ELC: Saving primary data. [2025-10-28T18:31:34.436810] [DEBUG] [LOCAL ] ELC: Trimmed 4899 records to 3405 (keeping 200 days of data) [2025-10-28T18:31:34.459107] [DEBUG] [LOCAL ] ELC: Primary data saved (3405 records). [2025-10-28T18:31:34.459342] [INFO ] [MAIN ] ELC: Full history saved. [2025-10-28T18:31:34.459457] [INFO ] [MAIN ] Update Progress: 721/2366 symbols completed. ELC took 12.5s. Estimated remaining: 3h 28m 49s. Rate: 7.9 symbols/min [2025-10-28T18:31:34.612979] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-10-28T18:31:34.692982] [INFO ] [MAIN ] ELME: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:31:34.693193] [DEBUG] [LOCAL ] ELME: No existing data file found in primary storage. [2025-10-28T18:31:34.693233] [WARN ] [MAIN ] ELME: No existing data found, performing full refresh instead. [2025-10-28T18:31:34.693348] [INFO ] [MAIN ] ELME: Wiping existing primary data before full refresh. [2025-10-28T18:31:34.693391] [INFO ] [LOCAL ] ELME: Starting deletion of primary data. [2025-10-28T18:31:34.693432] [DEBUG] [LOCAL ] ELME: No primary data file found to delete. [2025-10-28T18:31:34.693465] [INFO ] [MAIN ] ELME: Starting full primary refresh. [2025-10-28T18:31:35.060522] [INFO ] [REMOTE ] ELME: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:31:35.159330] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-01. [2025-10-28T18:31:35.620950] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-28T18:31:35.959372] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-05. [2025-10-28T18:31:36.439125] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-28T18:31:36.759381] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-02. [2025-10-28T18:31:37.551222] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-28T18:31:37.561840] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-04. [2025-10-28T18:31:37.822727] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-28T18:31:38.359384] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-06. [2025-10-28T18:31:39.159327] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-06. [2025-10-28T18:31:39.811220] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-04 (2.25 seconds). [2025-10-28T18:31:39.963017] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-05. [2025-10-28T18:31:39.968709] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-10-28T18:31:40.646504] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-10-28T18:31:40.759361] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-07. [2025-10-28T18:31:41.498201] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-28T18:31:41.559325] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-03. [2025-10-28T18:31:42.140826] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-28T18:31:42.359391] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-07. [2025-10-28T18:31:42.724488] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-28T18:31:43.159339] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-04. [2025-10-28T18:31:43.959318] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-08. [2025-10-28T18:31:44.061270] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-28T18:31:44.220052] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-28T18:31:44.759345] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-05. [2025-10-28T18:31:45.069902] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-28T18:31:45.559337] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-08. [2025-10-28T18:31:45.868955] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-28T18:31:46.359348] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-06. [2025-10-28T18:31:47.098300] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-28T18:31:47.159300] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-09. [2025-10-28T18:31:47.748757] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-28T18:31:47.959333] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-09. [2025-10-28T18:31:48.546473] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-28T18:31:48.759338] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-07. [2025-10-28T18:31:49.241586] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-28T18:31:49.559334] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-10. [2025-10-28T18:31:50.359340] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-06. [2025-10-28T18:31:50.619516] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-10-28T18:31:51.159502] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-10. [2025-10-28T18:31:51.394759] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-28T18:31:51.576626] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-10 (2.02 seconds). [2025-10-28T18:31:51.589688] [INFO ] [REMOTE ] ELAN: Full fetch complete (77089 records). [2025-10-28T18:31:51.589911] [DEBUG] [VALIDATOR ] ELAN: Validating primary data. [2025-10-28T18:31:51.967353] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-07. [2025-10-28T18:31:52.086191] [DEBUG] [VALIDATOR ] ELAN: All expected trading days are present. [2025-10-28T18:31:52.086303] [DEBUG] [VALIDATOR ] ELAN: Primary data validation passed. [2025-10-28T18:31:52.087507] [INFO ] [MAIN ] ELAN: Fetched primary data is valid. [2025-10-28T18:31:52.087589] [DEBUG] [LOCAL ] ELAN: Saving primary data. [2025-10-28T18:31:52.089297] [DEBUG] [LOCAL ] ELAN: Trimmed 77089 records to 53301 (keeping 200 days of data) [2025-10-28T18:31:52.437078] [DEBUG] [LOCAL ] ELAN: Primary data saved (53301 records). [2025-10-28T18:31:52.437183] [INFO ] [MAIN ] ELAN: Full history saved. [2025-10-28T18:31:52.438811] [INFO ] [MAIN ] Update Progress: 722/2366 symbols completed. ELAN took 30.5s. Estimated remaining: 3h 29m 5s. Rate: 7.9 symbols/min [2025-10-28T18:31:52.571949] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-28T18:31:52.604122] [INFO ] [REMOTE ] EL: Full fetch complete (77431 records). [2025-10-28T18:31:52.621433] [DEBUG] [VALIDATOR ] EL: Validating primary data. [2025-10-28T18:31:52.732212] [INFO ] [MAIN ] ELP: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:31:52.759064] [DEBUG] [LOCAL ] ELP: No existing data file found in primary storage. [2025-10-28T18:31:52.759449] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-08. [2025-10-28T18:31:52.759798] [WARN ] [MAIN ] ELP: No existing data found, performing full refresh instead. [2025-10-28T18:31:52.760060] [INFO ] [MAIN ] ELP: Wiping existing primary data before full refresh. [2025-10-28T18:31:52.761307] [INFO ] [LOCAL ] ELP: Starting deletion of primary data. [2025-10-28T18:31:52.761407] [DEBUG] [LOCAL ] ELP: No primary data file found to delete. [2025-10-28T18:31:52.767312] [INFO ] [MAIN ] ELP: Starting full primary refresh. [2025-10-28T18:31:53.391886] [DEBUG] [VALIDATOR ] EL: All expected trading days are present. [2025-10-28T18:31:53.397113] [DEBUG] [VALIDATOR ] EL: Primary data validation passed. [2025-10-28T18:31:53.426745] [INFO ] [MAIN ] EL: Fetched primary data is valid. [2025-10-28T18:31:53.447428] [DEBUG] [LOCAL ] EL: Saving primary data. [2025-10-28T18:31:53.467736] [INFO ] [REMOTE ] ELP: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:31:53.484060] [DEBUG] [LOCAL ] EL: Trimmed 77431 records to 53368 (keeping 200 days of data) [2025-10-28T18:31:53.496818] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-28T18:31:53.562186] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-01. [2025-10-28T18:31:53.858319] [DEBUG] [LOCAL ] EL: Primary data saved (53368 records). [2025-10-28T18:31:53.858470] [INFO ] [MAIN ] EL: Full history saved. [2025-10-28T18:31:53.858552] [INFO ] [MAIN ] Update Progress: 723/2366 symbols completed. EL took 31.9s. Estimated remaining: 3h 28m 43s. Rate: 7.9 symbols/min [2025-10-28T18:31:54.041739] [INFO ] [MAIN ] ELPC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:31:54.041940] [DEBUG] [LOCAL ] ELPC: No existing data file found in primary storage. [2025-10-28T18:31:54.041977] [WARN ] [MAIN ] ELPC: No existing data found, performing full refresh instead. [2025-10-28T18:31:54.042095] [INFO ] [MAIN ] ELPC: Wiping existing primary data before full refresh. [2025-10-28T18:31:54.042137] [INFO ] [LOCAL ] ELPC: Starting deletion of primary data. [2025-10-28T18:31:54.042179] [DEBUG] [LOCAL ] ELPC: No primary data file found to delete. [2025-10-28T18:31:54.042211] [INFO ] [MAIN ] ELPC: Starting full primary refresh. [2025-10-28T18:31:54.361160] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-08. [2025-10-28T18:31:54.431981] [INFO ] [REMOTE ] ELPC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:31:54.465505] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-28T18:31:54.947065] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-28T18:31:55.159346] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-09. [2025-10-28T18:31:55.632214] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-28T18:31:55.959424] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-01. [2025-10-28T18:31:56.623567] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-28T18:31:56.645730] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-28T18:31:56.759398] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-10. [2025-10-28T18:31:57.559430] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-02. [2025-10-28T18:31:58.321493] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-28T18:31:58.359327] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-03. [2025-10-28T18:31:58.800536] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-10 (2.04 seconds). [2025-10-28T18:31:58.810022] [INFO ] [REMOTE ] ELF: Full fetch complete (75109 records). [2025-10-28T18:31:58.810173] [DEBUG] [VALIDATOR ] ELF: Validating primary data. [2025-10-28T18:31:58.810876] [FATAL] [VALIDATOR ] ELF: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T18:31:58.810977] [FATAL] [MAIN ] ELF: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:31:58.811021] [WARN ] [MAIN ] ELF: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:31:58.811083] [INFO ] [LOCAL ] ELF: Starting deletion of primary data. [2025-10-28T18:31:58.811147] [DEBUG] [LOCAL ] ELF: No primary data file found to delete. [2025-10-28T18:31:58.811183] [INFO ] [LOCAL ] ELF: Starting deletion of derivative data. [2025-10-28T18:31:58.811371] [DEBUG] [LOCAL ] ELF: Deleted derivative data file. [2025-10-28T18:31:58.811475] [INFO ] [MAIN ] Update Progress: 724/2366 symbols completed. ELF took 36.8s. Estimated remaining: 3h 28m 30s. Rate: 7.9 symbols/min [2025-10-28T18:31:58.988251] [INFO ] [MAIN ] ELS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:31:59.034384] [DEBUG] [LOCAL ] ELS: Loaded 49837 existing records from primary storage. [2025-10-28T18:31:59.034704] [INFO ] [MAIN ] ELS: Loaded 49837 existing records. [2025-10-28T18:31:59.163507] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-02. [2025-10-28T18:31:59.232930] [WARN ] [MAIN ] ELS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:31:59.234054] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-28T18:31:59.239009] [INFO ] [MAIN ] ELS: Wiping existing primary data before full refresh. [2025-10-28T18:31:59.239356] [INFO ] [LOCAL ] ELS: Starting deletion of primary data. [2025-10-28T18:31:59.240100] [DEBUG] [LOCAL ] ELS: Deleted primary data file. [2025-10-28T18:31:59.240158] [INFO ] [MAIN ] ELS: Starting full primary refresh. [2025-10-28T18:31:59.509852] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-10-28T18:31:59.598433] [INFO ] [REMOTE ] ELS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:31:59.959308] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-03. [2025-10-28T18:32:00.181265] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-03 (0.22 seconds). [2025-10-28T18:32:00.759335] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-01. [2025-10-28T18:32:01.559331] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-04. [2025-10-28T18:32:02.359336] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-04. [2025-10-28T18:32:02.398206] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-28T18:32:02.562951] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-28T18:32:02.642014] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-04 (0.28 seconds). [2025-10-28T18:32:03.159334] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-05. [2025-10-28T18:32:03.959350] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-02. [2025-10-28T18:32:04.211772] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-28T18:32:04.759444] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-09. [2025-10-28T18:32:05.120195] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-28T18:32:05.559360] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-03. [2025-10-28T18:32:06.176098] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-28T18:32:06.359366] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-05. [2025-10-28T18:32:06.615712] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-05 (0.26 seconds). [2025-10-28T18:32:06.830569] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-28T18:32:07.159390] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-06. [2025-10-28T18:32:07.486703] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-10-28T18:32:07.959346] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-07. [2025-10-28T18:32:08.204403] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-07 (0.25 seconds). [2025-10-28T18:32:08.759400] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-10. [2025-10-28T18:32:09.559338] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-04. [2025-10-28T18:32:09.913494] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-28T18:32:09.921352] [INFO ] [REMOTE ] ELME: Full fetch complete (55844 records). [2025-10-28T18:32:09.921461] [DEBUG] [VALIDATOR ] ELME: Validating primary data. [2025-10-28T18:32:09.922194] [FATAL] [VALIDATOR ] ELME: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T18:32:09.922274] [FATAL] [MAIN ] ELME: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:32:09.922316] [WARN ] [MAIN ] ELME: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:32:09.922354] [INFO ] [LOCAL ] ELME: Starting deletion of primary data. [2025-10-28T18:32:09.922409] [DEBUG] [LOCAL ] ELME: No primary data file found to delete. [2025-10-28T18:32:09.922442] [INFO ] [LOCAL ] ELME: Starting deletion of derivative data. [2025-10-28T18:32:09.922480] [DEBUG] [LOCAL ] ELME: No derivative data file found to delete. [2025-10-28T18:32:09.922533] [INFO ] [MAIN ] Update Progress: 725/2366 symbols completed. ELME took 35.5s. Estimated remaining: 3h 28m 30s. Rate: 7.9 symbols/min [2025-10-28T18:32:10.099683] [INFO ] [MAIN ] ELV: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:32:10.099856] [DEBUG] [LOCAL ] ELV: No existing data file found in primary storage. [2025-10-28T18:32:10.099898] [WARN ] [MAIN ] ELV: No existing data found, performing full refresh instead. [2025-10-28T18:32:10.100006] [INFO ] [MAIN ] ELV: Wiping existing primary data before full refresh. [2025-10-28T18:32:10.100048] [INFO ] [LOCAL ] ELV: Starting deletion of primary data. [2025-10-28T18:32:10.100089] [DEBUG] [LOCAL ] ELV: No primary data file found to delete. [2025-10-28T18:32:10.100122] [INFO ] [MAIN ] ELV: Starting full primary refresh. [2025-10-28T18:32:10.364559] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-06. [2025-10-28T18:32:10.534504] [INFO ] [REMOTE ] ELV: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:32:10.735207] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-28T18:32:11.159358] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-05. [2025-10-28T18:32:11.430458] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-28T18:32:11.959346] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-01. [2025-10-28T18:32:12.337744] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-28T18:32:12.759361] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-07. [2025-10-28T18:32:13.401747] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-28T18:32:13.559353] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-06. [2025-10-28T18:32:13.635872] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-28T18:32:14.359409] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-08. [2025-10-28T18:32:14.603126] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-08 (0.24 seconds). [2025-10-28T18:32:14.740488] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-28T18:32:15.159410] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-09. [2025-10-28T18:32:15.374917] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-09 (0.22 seconds). [2025-10-28T18:32:15.959366] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-10. [2025-10-28T18:32:16.407340] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-28T18:32:16.408124] [INFO ] [REMOTE ] ELPC: Full fetch complete (1266 records). [2025-10-28T18:32:16.408194] [DEBUG] [VALIDATOR ] ELPC: Validating primary data. [2025-10-28T18:32:16.596165] [WARN ] [VALIDATOR ] ELPC: Validation failed - insufficient historical data. Have 190 unique days, need 200 days [2025-10-28T18:32:16.596292] [FATAL] [MAIN ] ELPC: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:32:16.596372] [WARN ] [MAIN ] ELPC: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:32:16.596437] [INFO ] [LOCAL ] ELPC: Starting deletion of primary data. [2025-10-28T18:32:16.596495] [DEBUG] [LOCAL ] ELPC: No primary data file found to delete. [2025-10-28T18:32:16.596531] [INFO ] [LOCAL ] ELPC: Starting deletion of derivative data. [2025-10-28T18:32:16.596622] [DEBUG] [LOCAL ] ELPC: No derivative data file found to delete. [2025-10-28T18:32:16.596720] [INFO ] [MAIN ] Update Progress: 726/2366 symbols completed. ELPC took 22.7s. Estimated remaining: 3h 28m 20s. Rate: 7.9 symbols/min [2025-10-28T18:32:16.764672] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-08. [2025-10-28T18:32:16.766801] [INFO ] [MAIN ] EMA: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:32:16.767609] [DEBUG] [LOCAL ] EMA: No existing data file found in primary storage. [2025-10-28T18:32:16.767691] [WARN ] [MAIN ] EMA: No existing data found, performing full refresh instead. [2025-10-28T18:32:16.767823] [INFO ] [MAIN ] EMA: Wiping existing primary data before full refresh. [2025-10-28T18:32:16.767886] [INFO ] [LOCAL ] EMA: Starting deletion of primary data. [2025-10-28T18:32:16.767935] [DEBUG] [LOCAL ] EMA: No primary data file found to delete. [2025-10-28T18:32:16.767969] [INFO ] [MAIN ] EMA: Starting full primary refresh. [2025-10-28T18:32:17.123492] [INFO ] [REMOTE ] EMA: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:32:17.559340] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-07. [2025-10-28T18:32:17.677143] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-28T18:32:18.359383] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-01. [2025-10-28T18:32:18.558134] [DEBUG] [REMOTE ] EMA: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-28T18:32:18.558464] [WARN ] [REMOTE ] EMA: No data returned for month 2025-01 [2025-10-28T18:32:18.558552] [FATAL] [REMOTE ] EMA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-28T18:32:18.558664] [FATAL] [MAIN ] EMA: Failed to fetch primary data. [2025-10-28T18:32:18.558736] [WARN ] [MAIN ] EMA: Deleting existing primary and derivative data due to fetch failure. [2025-10-28T18:32:18.558807] [INFO ] [LOCAL ] EMA: Starting deletion of primary data. [2025-10-28T18:32:18.558870] [DEBUG] [LOCAL ] EMA: No primary data file found to delete. [2025-10-28T18:32:18.558905] [INFO ] [LOCAL ] EMA: Starting deletion of derivative data. [2025-10-28T18:32:18.558944] [DEBUG] [LOCAL ] EMA: No derivative data file found to delete. [2025-10-28T18:32:18.558988] [INFO ] [MAIN ] Update Progress: 727/2366 symbols completed. EMA took 2.0s. Estimated remaining: 3h 27m 60s. Rate: 7.9 symbols/min [2025-10-28T18:32:18.737614] [INFO ] [MAIN ] EMD: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:32:18.737867] [DEBUG] [LOCAL ] EMD: No existing data file found in primary storage. [2025-10-28T18:32:18.737922] [WARN ] [MAIN ] EMD: No existing data found, performing full refresh instead. [2025-10-28T18:32:18.738178] [INFO ] [MAIN ] EMD: Wiping existing primary data before full refresh. [2025-10-28T18:32:18.738244] [INFO ] [LOCAL ] EMD: Starting deletion of primary data. [2025-10-28T18:32:18.738334] [DEBUG] [LOCAL ] EMD: No primary data file found to delete. [2025-10-28T18:32:18.738432] [INFO ] [MAIN ] EMD: Starting full primary refresh. [2025-10-28T18:32:19.110152] [INFO ] [REMOTE ] EMD: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:32:19.141143] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-28T18:32:19.159296] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-08. [2025-10-28T18:32:19.959386] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-02. [2025-10-28T18:32:20.352389] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-28T18:32:20.759388] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-09. [2025-10-28T18:32:21.155125] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-28T18:32:21.559341] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-03. [2025-10-28T18:32:21.941508] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-28T18:32:22.359400] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-09. [2025-10-28T18:32:22.817529] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-28T18:32:23.158322] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-28T18:32:23.162548] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-10. [2025-10-28T18:32:23.959388] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-01. [2025-10-28T18:32:24.661166] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-28T18:32:24.672442] [INFO ] [REMOTE ] ELS: Full fetch complete (71406 records). [2025-10-28T18:32:24.672594] [DEBUG] [VALIDATOR ] ELS: Validating primary data. [2025-10-28T18:32:24.764460] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-10. [2025-10-28T18:32:24.980222] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-28T18:32:25.149946] [DEBUG] [VALIDATOR ] ELS: All expected trading days are present. [2025-10-28T18:32:25.150036] [DEBUG] [VALIDATOR ] ELS: Primary data validation passed. [2025-10-28T18:32:25.150880] [INFO ] [MAIN ] ELS: Fetched primary data is valid. [2025-10-28T18:32:25.150943] [DEBUG] [LOCAL ] ELS: Saving primary data. [2025-10-28T18:32:25.152378] [DEBUG] [LOCAL ] ELS: Trimmed 71406 records to 49824 (keeping 200 days of data) [2025-10-28T18:32:25.457815] [DEBUG] [LOCAL ] ELS: Primary data saved (49824 records). [2025-10-28T18:32:25.457991] [INFO ] [MAIN ] ELS: Full history saved. [2025-10-28T18:32:25.458088] [INFO ] [MAIN ] Update Progress: 728/2366 symbols completed. ELS took 26.6s. Estimated remaining: 3h 27m 51s. Rate: 7.9 symbols/min [2025-10-28T18:32:25.559304] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-02. [2025-10-28T18:32:25.631469] [INFO ] [MAIN ] EME: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:32:25.660757] [DEBUG] [LOCAL ] EME: Loaded 30529 existing records from primary storage. [2025-10-28T18:32:25.660985] [INFO ] [MAIN ] EME: Loaded 30529 existing records. [2025-10-28T18:32:25.837495] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-28T18:32:25.860242] [WARN ] [MAIN ] EME: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:32:25.860546] [INFO ] [MAIN ] EME: Wiping existing primary data before full refresh. [2025-10-28T18:32:25.860608] [INFO ] [LOCAL ] EME: Starting deletion of primary data. [2025-10-28T18:32:25.865821] [INFO ] [REMOTE ] ELP: Full fetch complete (36679 records). [2025-10-28T18:32:25.865921] [DEBUG] [VALIDATOR ] ELP: Validating primary data. [2025-10-28T18:32:25.866209] [DEBUG] [LOCAL ] EME: Deleted primary data file. [2025-10-28T18:32:25.871753] [INFO ] [MAIN ] EME: Starting full primary refresh. [2025-10-28T18:32:26.393729] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-04. [2025-10-28T18:32:26.657751] [DEBUG] [VALIDATOR ] ELP: All expected trading days are present. [2025-10-28T18:32:26.651224] [INFO ] [REMOTE ] EME: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:32:26.663243] [DEBUG] [VALIDATOR ] ELP: Primary data validation passed. [2025-10-28T18:32:26.663829] [INFO ] [MAIN ] ELP: Fetched primary data is valid. [2025-10-28T18:32:26.664042] [DEBUG] [LOCAL ] ELP: Saving primary data. [2025-10-28T18:32:26.665152] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-28T18:32:26.671332] [DEBUG] [LOCAL ] ELP: Trimmed 36679 records to 25193 (keeping 200 days of data) [2025-10-28T18:32:26.816900] [DEBUG] [LOCAL ] ELP: Primary data saved (25193 records). [2025-10-28T18:32:26.817025] [INFO ] [MAIN ] ELP: Full history saved. [2025-10-28T18:32:26.817097] [INFO ] [MAIN ] Update Progress: 729/2366 symbols completed. ELP took 34.4s. Estimated remaining: 3h 27m 29s. Rate: 7.9 symbols/min [2025-10-28T18:32:26.993214] [INFO ] [MAIN ] EMF: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:32:26.998375] [DEBUG] [LOCAL ] EMF: Loaded 3001 existing records from primary storage. [2025-10-28T18:32:26.998556] [INFO ] [MAIN ] EMF: Loaded 3001 existing records. [2025-10-28T18:32:27.164422] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-03. [2025-10-28T18:32:27.212262] [WARN ] [MAIN ] EMF: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:32:27.212752] [INFO ] [MAIN ] EMF: Wiping existing primary data before full refresh. [2025-10-28T18:32:27.212814] [INFO ] [LOCAL ] EMF: Starting deletion of primary data. [2025-10-28T18:32:27.213048] [DEBUG] [LOCAL ] EMF: Deleted primary data file. [2025-10-28T18:32:27.213119] [INFO ] [MAIN ] EMF: Starting full primary refresh. [2025-10-28T18:32:27.578326] [INFO ] [REMOTE ] EMF: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:32:27.877415] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-28T18:32:27.959315] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-01. [2025-10-28T18:32:28.031952] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-28T18:32:28.759350] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-05. [2025-10-28T18:32:29.020199] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-28T18:32:29.559355] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-04. [2025-10-28T18:32:30.049823] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-28T18:32:30.359346] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-02. [2025-10-28T18:32:30.403276] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-28T18:32:31.159357] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-06. [2025-10-28T18:32:31.660972] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-28T18:32:31.959386] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-01. [2025-10-28T18:32:32.193302] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-28T18:32:32.526602] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-28T18:32:32.759387] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-02. [2025-10-28T18:32:33.131114] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-10-28T18:32:33.559346] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-05. [2025-10-28T18:32:34.242150] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-28T18:32:34.359356] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-03. [2025-10-28T18:32:35.159397] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-06. [2025-10-28T18:32:35.425867] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-28T18:32:35.959325] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-04. [2025-10-28T18:32:36.099947] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-28T18:32:36.759338] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-03. [2025-10-28T18:32:37.108227] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-28T18:32:37.259480] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-10-28T18:32:37.559324] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-07. [2025-10-28T18:32:38.359332] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-04. [2025-10-28T18:32:38.778039] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-28T18:32:39.159321] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-07. [2025-10-28T18:32:39.444132] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-10-28T18:32:39.894227] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-28T18:32:39.959326] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-05. [2025-10-28T18:32:40.759314] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-05. [2025-10-28T18:32:41.016435] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-28T18:32:41.100165] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-10-28T18:32:41.559385] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-06. [2025-10-28T18:32:41.913359] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-28T18:32:42.359335] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-08. [2025-10-28T18:32:43.099860] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-28T18:32:43.159342] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-08. [2025-10-28T18:32:43.959344] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-06. [2025-10-28T18:32:44.708991] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-28T18:32:44.759332] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-09. [2025-10-28T18:32:44.933169] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-28T18:32:45.559347] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-07. [2025-10-28T18:32:46.033669] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-28T18:32:46.346201] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-28T18:32:46.359297] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-10. [2025-10-28T18:32:47.159332] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-07. [2025-10-28T18:32:47.824469] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-28T18:32:47.834532] [INFO ] [REMOTE ] ELV: Full fetch complete (73308 records). [2025-10-28T18:32:47.834706] [DEBUG] [VALIDATOR ] ELV: Validating primary data. [2025-10-28T18:32:47.963692] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-09. [2025-10-28T18:32:48.233295] [DEBUG] [VALIDATOR ] ELV: All expected trading days are present. [2025-10-28T18:32:48.233397] [DEBUG] [VALIDATOR ] ELV: Primary data validation passed. [2025-10-28T18:32:48.234353] [INFO ] [MAIN ] ELV: Fetched primary data is valid. [2025-10-28T18:32:48.234434] [DEBUG] [LOCAL ] ELV: Saving primary data. [2025-10-28T18:32:48.253041] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-28T18:32:48.252207] [DEBUG] [LOCAL ] ELV: Trimmed 73308 records to 50655 (keeping 200 days of data) [2025-10-28T18:32:48.567429] [DEBUG] [LOCAL ] ELV: Primary data saved (50655 records). [2025-10-28T18:32:48.567579] [INFO ] [MAIN ] ELV: Full history saved. [2025-10-28T18:32:48.567675] [INFO ] [MAIN ] Update Progress: 730/2366 symbols completed. ELV took 38.6s. Estimated remaining: 3h 27m 53s. Rate: 7.9 symbols/min [2025-10-28T18:32:48.735856] [INFO ] [MAIN ] EMN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:32:48.749468] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-28T18:32:48.759308] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-10. [2025-10-28T18:32:48.796010] [DEBUG] [LOCAL ] EMN: Loaded 50796 existing records from primary storage. [2025-10-28T18:32:48.796297] [INFO ] [MAIN ] EMN: Loaded 50796 existing records. [2025-10-28T18:32:48.974198] [WARN ] [MAIN ] EMN: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:32:48.974390] [INFO ] [MAIN ] EMN: Wiping existing primary data before full refresh. [2025-10-28T18:32:48.974437] [INFO ] [LOCAL ] EMN: Starting deletion of primary data. [2025-10-28T18:32:48.975445] [DEBUG] [LOCAL ] EMN: Deleted primary data file. [2025-10-28T18:32:48.975503] [INFO ] [MAIN ] EMN: Starting full primary refresh. [2025-10-28T18:32:49.334750] [INFO ] [REMOTE ] EMN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:32:49.559343] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-01. [2025-10-28T18:32:49.773984] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-28T18:32:49.778166] [INFO ] [REMOTE ] EMD: Full fetch complete (31795 records). [2025-10-28T18:32:49.778239] [DEBUG] [VALIDATOR ] EMD: Validating primary data. [2025-10-28T18:32:50.146993] [DEBUG] [VALIDATOR ] EMD: All expected trading days are present. [2025-10-28T18:32:50.147081] [DEBUG] [VALIDATOR ] EMD: Primary data validation passed. [2025-10-28T18:32:50.147797] [INFO ] [MAIN ] EMD: Fetched primary data is valid. [2025-10-28T18:32:50.147860] [DEBUG] [LOCAL ] EMD: Saving primary data. [2025-10-28T18:32:50.148765] [DEBUG] [LOCAL ] EMD: Trimmed 31795 records to 20344 (keeping 200 days of data) [2025-10-28T18:32:50.268563] [DEBUG] [LOCAL ] EMD: Primary data saved (20344 records). [2025-10-28T18:32:50.268711] [INFO ] [MAIN ] EMD: Full history saved. [2025-10-28T18:32:50.268792] [INFO ] [MAIN ] Update Progress: 731/2366 symbols completed. EMD took 31.7s. Estimated remaining: 3h 27m 32s. Rate: 7.9 symbols/min [2025-10-28T18:32:50.369147] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-08. [2025-10-28T18:32:50.444837] [INFO ] [MAIN ] EMO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:32:50.445038] [DEBUG] [LOCAL ] EMO: No existing data file found in primary storage. [2025-10-28T18:32:50.445079] [WARN ] [MAIN ] EMO: No existing data found, performing full refresh instead. [2025-10-28T18:32:50.445150] [INFO ] [MAIN ] EMO: Wiping existing primary data before full refresh. [2025-10-28T18:32:50.445188] [INFO ] [LOCAL ] EMO: Starting deletion of primary data. [2025-10-28T18:32:50.445242] [DEBUG] [LOCAL ] EMO: No primary data file found to delete. [2025-10-28T18:32:50.445296] [INFO ] [MAIN ] EMO: Starting full primary refresh. [2025-10-28T18:32:50.814912] [INFO ] [REMOTE ] EMO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:32:51.159355] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-08. [2025-10-28T18:32:51.371273] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-28T18:32:51.584507] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-28T18:32:51.959388] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-09. [2025-10-28T18:32:52.074501] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-28T18:32:52.355106] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-10-28T18:32:52.759364] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-01. [2025-10-28T18:32:53.526786] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-28T18:32:53.559346] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-02. [2025-10-28T18:32:54.359321] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-09. [2025-10-28T18:32:55.159356] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-10. [2025-10-28T18:32:55.356403] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-10-28T18:32:55.635845] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-28T18:32:55.637074] [INFO ] [REMOTE ] EMF: Full fetch complete (5945 records). [2025-10-28T18:32:55.637143] [DEBUG] [VALIDATOR ] EMF: Validating primary data. [2025-10-28T18:32:55.964474] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-02. [2025-10-28T18:32:56.005966] [DEBUG] [VALIDATOR ] EMF: All expected trading days are present. [2025-10-28T18:32:56.006036] [DEBUG] [VALIDATOR ] EMF: Primary data validation passed. [2025-10-28T18:32:56.006218] [INFO ] [MAIN ] EMF: Fetched primary data is valid. [2025-10-28T18:32:56.006278] [DEBUG] [LOCAL ] EMF: Saving primary data. [2025-10-28T18:32:56.006719] [DEBUG] [LOCAL ] EMF: Trimmed 5945 records to 2985 (keeping 200 days of data) [2025-10-28T18:32:56.025575] [DEBUG] [LOCAL ] EMF: Primary data saved (2985 records). [2025-10-28T18:32:56.026137] [INFO ] [MAIN ] EMF: Full history saved. [2025-10-28T18:32:56.026233] [INFO ] [MAIN ] Update Progress: 732/2366 symbols completed. EMF took 29.2s. Estimated remaining: 3h 27m 20s. Rate: 7.9 symbols/min [2025-10-28T18:32:56.219315] [INFO ] [MAIN ] EMP: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:32:56.224396] [DEBUG] [LOCAL ] EMP: Loaded 2836 existing records from primary storage. [2025-10-28T18:32:56.224545] [INFO ] [MAIN ] EMP: Loaded 2836 existing records. [2025-10-28T18:32:56.406674] [WARN ] [MAIN ] EMP: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:32:56.406962] [INFO ] [MAIN ] EMP: Wiping existing primary data before full refresh. [2025-10-28T18:32:56.407035] [INFO ] [LOCAL ] EMP: Starting deletion of primary data. [2025-10-28T18:32:56.407303] [DEBUG] [LOCAL ] EMP: Deleted primary data file. [2025-10-28T18:32:56.407432] [INFO ] [MAIN ] EMP: Starting full primary refresh. [2025-10-28T18:32:56.585878] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-09 (2.23 seconds). [2025-10-28T18:32:56.786627] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-10. [2025-10-28T18:32:56.791148] [INFO ] [REMOTE ] EMP: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:32:57.128521] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-28T18:32:57.559337] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-03. [2025-10-28T18:32:58.011257] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-28T18:32:58.359315] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-01. [2025-10-28T18:32:58.448714] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-28T18:32:58.455602] [INFO ] [REMOTE ] EME: Full fetch complete (47025 records). [2025-10-28T18:32:58.455769] [DEBUG] [VALIDATOR ] EME: Validating primary data. [2025-10-28T18:32:58.765615] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-10-28T18:32:58.856405] [DEBUG] [VALIDATOR ] EME: All expected trading days are present. [2025-10-28T18:32:58.856485] [DEBUG] [VALIDATOR ] EME: Primary data validation passed. [2025-10-28T18:32:58.857273] [INFO ] [MAIN ] EME: Fetched primary data is valid. [2025-10-28T18:32:58.857337] [DEBUG] [LOCAL ] EME: Saving primary data. [2025-10-28T18:32:58.858373] [DEBUG] [LOCAL ] EME: Trimmed 47025 records to 30406 (keeping 200 days of data) [2025-10-28T18:32:59.046923] [DEBUG] [LOCAL ] EME: Primary data saved (30406 records). [2025-10-28T18:32:59.047062] [INFO ] [MAIN ] EME: Full history saved. [2025-10-28T18:32:59.047138] [INFO ] [MAIN ] Update Progress: 733/2366 symbols completed. EME took 33.6s. Estimated remaining: 3h 27m 3s. Rate: 7.9 symbols/min [2025-10-28T18:32:59.164449] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-04. [2025-10-28T18:32:59.221160] [INFO ] [MAIN ] EMR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:32:59.272684] [DEBUG] [LOCAL ] EMR: Loaded 53121 existing records from primary storage. [2025-10-28T18:32:59.273448] [INFO ] [MAIN ] EMR: Loaded 53121 existing records. [2025-10-28T18:32:59.471979] [WARN ] [MAIN ] EMR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:32:59.472196] [INFO ] [MAIN ] EMR: Wiping existing primary data before full refresh. [2025-10-28T18:32:59.472244] [INFO ] [LOCAL ] EMR: Starting deletion of primary data. [2025-10-28T18:32:59.473169] [DEBUG] [LOCAL ] EMR: Deleted primary data file. [2025-10-28T18:32:59.473229] [INFO ] [MAIN ] EMR: Starting full primary refresh. [2025-10-28T18:32:59.964790] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-02. [2025-10-28T18:32:59.971981] [INFO ] [REMOTE ] EMR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:33:00.057162] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-28T18:33:00.278759] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-10-28T18:33:00.759331] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-05. [2025-10-28T18:33:01.334482] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-28T18:33:01.559353] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-03. [2025-10-28T18:33:02.359392] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-01. [2025-10-28T18:33:02.893292] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-28T18:33:03.159375] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-06. [2025-10-28T18:33:03.760267] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-28T18:33:03.761260] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-28T18:33:03.959314] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-07. [2025-10-28T18:33:04.587593] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-28T18:33:04.759356] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-02. [2025-10-28T18:33:05.559344] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-03. [2025-10-28T18:33:05.865745] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-03 (0.31 seconds). [2025-10-28T18:33:06.191607] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-10-28T18:33:06.359302] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-03. [2025-10-28T18:33:07.159384] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-08. [2025-10-28T18:33:07.621973] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-28T18:33:07.777148] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-28T18:33:07.959343] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-04. [2025-10-28T18:33:08.759341] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-09. [2025-10-28T18:33:09.373367] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-28T18:33:09.406639] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-28T18:33:09.559311] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-04. [2025-10-28T18:33:10.359449] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-10. [2025-10-28T18:33:10.963131] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-28T18:33:10.983367] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-28T18:33:10.986896] [INFO ] [REMOTE ] EMO: Full fetch complete (17791 records). [2025-10-28T18:33:10.986965] [DEBUG] [VALIDATOR ] EMO: Validating primary data. [2025-10-28T18:33:11.169359] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-04. [2025-10-28T18:33:11.354314] [DEBUG] [VALIDATOR ] EMO: All expected trading days are present. [2025-10-28T18:33:11.354388] [DEBUG] [VALIDATOR ] EMO: Primary data validation passed. [2025-10-28T18:33:11.354771] [INFO ] [MAIN ] EMO: Fetched primary data is valid. [2025-10-28T18:33:11.354831] [DEBUG] [LOCAL ] EMO: Saving primary data. [2025-10-28T18:33:11.355329] [DEBUG] [LOCAL ] EMO: Trimmed 17791 records to 13310 (keeping 200 days of data) [2025-10-28T18:33:11.434451] [DEBUG] [LOCAL ] EMO: Primary data saved (13310 records). [2025-10-28T18:33:11.434586] [INFO ] [MAIN ] EMO: Full history saved. [2025-10-28T18:33:11.434679] [INFO ] [MAIN ] Update Progress: 734/2366 symbols completed. EMO took 21.2s. Estimated remaining: 3h 27m 6s. Rate: 7.9 symbols/min [2025-10-28T18:33:11.598611] [INFO ] [MAIN ] ENB: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:33:11.645257] [DEBUG] [LOCAL ] ENB: Loaded 53511 existing records from primary storage. [2025-10-28T18:33:11.645552] [INFO ] [MAIN ] ENB: Loaded 53511 existing records. [2025-10-28T18:33:11.746815] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-28T18:33:11.827354] [WARN ] [MAIN ] ENB: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:33:11.827557] [INFO ] [MAIN ] ENB: Wiping existing primary data before full refresh. [2025-10-28T18:33:11.827603] [INFO ] [LOCAL ] ENB: Starting deletion of primary data. [2025-10-28T18:33:11.828457] [DEBUG] [LOCAL ] ENB: Deleted primary data file. [2025-10-28T18:33:11.828514] [INFO ] [MAIN ] ENB: Starting full primary refresh. [2025-10-28T18:33:11.967767] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-05. [2025-10-28T18:33:12.178410] [INFO ] [REMOTE ] ENB: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:33:12.406494] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-28T18:33:12.759336] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-05. [2025-10-28T18:33:13.559337] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-06. [2025-10-28T18:33:13.926435] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-10-28T18:33:14.114890] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-28T18:33:14.359333] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-01. [2025-10-28T18:33:15.159349] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-05. [2025-10-28T18:33:15.739603] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-28T18:33:15.959347] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-07. [2025-10-28T18:33:16.298062] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-10-28T18:33:16.524790] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-28T18:33:16.759392] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-06. [2025-10-28T18:33:17.559339] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-08. [2025-10-28T18:33:17.925904] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-10-28T18:33:17.975747] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-28T18:33:18.359452] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-02. [2025-10-28T18:33:19.159324] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-07. [2025-10-28T18:33:19.931345] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-28T18:33:19.959297] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-03. [2025-10-28T18:33:20.720289] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-28T18:33:20.759292] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-08. [2025-10-28T18:33:21.311706] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-28T18:33:21.559314] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-04. [2025-10-28T18:33:22.098630] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-28T18:33:22.359326] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-06. [2025-10-28T18:33:22.939801] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-28T18:33:23.159317] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-09. [2025-10-28T18:33:23.741006] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-28T18:33:23.959380] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-07. [2025-10-28T18:33:24.765329] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-05. [2025-10-28T18:33:24.771119] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-28T18:33:25.270467] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-28T18:33:25.559359] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-09. [2025-10-28T18:33:26.359458] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-08. [2025-10-28T18:33:26.361510] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-28T18:33:26.379440] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-28T18:33:27.159353] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-10. [2025-10-28T18:33:27.549216] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-10-28T18:33:27.550480] [INFO ] [REMOTE ] EMP: Full fetch complete (4036 records). [2025-10-28T18:33:27.550816] [DEBUG] [VALIDATOR ] EMP: Validating primary data. [2025-10-28T18:33:27.955220] [DEBUG] [VALIDATOR ] EMP: All expected trading days are present. [2025-10-28T18:33:27.955340] [DEBUG] [VALIDATOR ] EMP: Primary data validation passed. [2025-10-28T18:33:27.955570] [INFO ] [MAIN ] EMP: Fetched primary data is valid. [2025-10-28T18:33:27.955616] [DEBUG] [LOCAL ] EMP: Saving primary data. [2025-10-28T18:33:27.956120] [DEBUG] [LOCAL ] EMP: Trimmed 4036 records to 2819 (keeping 200 days of data) [2025-10-28T18:33:27.963875] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-06. [2025-10-28T18:33:28.005429] [DEBUG] [LOCAL ] EMP: Primary data saved (2819 records). [2025-10-28T18:33:28.007420] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-28T18:33:28.007727] [INFO ] [MAIN ] EMP: Full history saved. [2025-10-28T18:33:28.008331] [INFO ] [MAIN ] Update Progress: 735/2366 symbols completed. EMP took 32.0s. Estimated remaining: 3h 27m 18s. Rate: 7.9 symbols/min [2025-10-28T18:33:28.202883] [INFO ] [MAIN ] ENIC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:33:28.203152] [DEBUG] [LOCAL ] ENIC: No existing data file found in primary storage. [2025-10-28T18:33:28.203192] [WARN ] [MAIN ] ENIC: No existing data found, performing full refresh instead. [2025-10-28T18:33:28.203342] [INFO ] [MAIN ] ENIC: Wiping existing primary data before full refresh. [2025-10-28T18:33:28.203383] [INFO ] [LOCAL ] ENIC: Starting deletion of primary data. [2025-10-28T18:33:28.203424] [DEBUG] [LOCAL ] ENIC: No primary data file found to delete. [2025-10-28T18:33:28.203457] [INFO ] [MAIN ] ENIC: Starting full primary refresh. [2025-10-28T18:33:28.584923] [INFO ] [REMOTE ] ENIC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:33:28.759364] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-10. [2025-10-28T18:33:29.512883] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-28T18:33:29.559342] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-07. [2025-10-28T18:33:30.359344] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-09. [2025-10-28T18:33:30.424283] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-28T18:33:30.434547] [INFO ] [REMOTE ] EMR: Full fetch complete (76788 records). [2025-10-28T18:33:30.434708] [DEBUG] [VALIDATOR ] EMR: Validating primary data. [2025-10-28T18:33:30.435519] [FATAL] [VALIDATOR ] EMR: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T18:33:30.435622] [FATAL] [MAIN ] EMR: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:33:30.435722] [WARN ] [MAIN ] EMR: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:33:30.435816] [INFO ] [LOCAL ] EMR: Starting deletion of primary data. [2025-10-28T18:33:30.435899] [DEBUG] [LOCAL ] EMR: No primary data file found to delete. [2025-10-28T18:33:30.435936] [INFO ] [LOCAL ] EMR: Starting deletion of derivative data. [2025-10-28T18:33:30.436129] [DEBUG] [LOCAL ] EMR: Deleted derivative data file. [2025-10-28T18:33:30.436728] [INFO ] [MAIN ] Update Progress: 736/2366 symbols completed. EMR took 31.4s. Estimated remaining: 3h 26m 59s. Rate: 7.9 symbols/min [2025-10-28T18:33:30.608848] [INFO ] [MAIN ] ENO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:33:30.609031] [DEBUG] [LOCAL ] ENO: No existing data file found in primary storage. [2025-10-28T18:33:30.609067] [WARN ] [MAIN ] ENO: No existing data found, performing full refresh instead. [2025-10-28T18:33:30.609202] [INFO ] [MAIN ] ENO: Wiping existing primary data before full refresh. [2025-10-28T18:33:30.609272] [INFO ] [LOCAL ] ENO: Starting deletion of primary data. [2025-10-28T18:33:30.609331] [DEBUG] [LOCAL ] ENO: No primary data file found to delete. [2025-10-28T18:33:30.609386] [INFO ] [MAIN ] ENO: Starting full primary refresh. [2025-10-28T18:33:30.975734] [INFO ] [REMOTE ] ENO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:33:31.123969] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-28T18:33:31.159314] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-08. [2025-10-28T18:33:31.811862] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-28T18:33:31.959338] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-10. [2025-10-28T18:33:32.759315] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-01. [2025-10-28T18:33:33.559334] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-01. [2025-10-28T18:33:33.599001] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-28T18:33:33.609343] [INFO ] [REMOTE ] EMN: Full fetch complete (72486 records). [2025-10-28T18:33:33.609481] [DEBUG] [VALIDATOR ] EMN: Validating primary data. [2025-10-28T18:33:33.749265] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-08 (2.59 seconds). [2025-10-28T18:33:34.058107] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-10-28T18:33:34.059736] [DEBUG] [VALIDATOR ] EMN: All expected trading days are present. [2025-10-28T18:33:34.059825] [DEBUG] [VALIDATOR ] EMN: Primary data validation passed. [2025-10-28T18:33:34.060724] [INFO ] [MAIN ] EMN: Fetched primary data is valid. [2025-10-28T18:33:34.060842] [DEBUG] [LOCAL ] EMN: Saving primary data. [2025-10-28T18:33:34.081143] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-28T18:33:34.088242] [DEBUG] [LOCAL ] EMN: Trimmed 72486 records to 50800 (keeping 200 days of data) [2025-10-28T18:33:34.359435] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-02. [2025-10-28T18:33:34.398302] [DEBUG] [LOCAL ] EMN: Primary data saved (50800 records). [2025-10-28T18:33:34.398428] [INFO ] [MAIN ] EMN: Full history saved. [2025-10-28T18:33:34.399110] [INFO ] [MAIN ] Update Progress: 737/2366 symbols completed. EMN took 45.8s. Estimated remaining: 3h 26m 43s. Rate: 7.9 symbols/min [2025-10-28T18:33:34.573151] [INFO ] [MAIN ] ENOV: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:33:34.574066] [DEBUG] [LOCAL ] ENOV: No existing data file found in primary storage. [2025-10-28T18:33:34.574119] [WARN ] [MAIN ] ENOV: No existing data found, performing full refresh instead. [2025-10-28T18:33:34.574304] [INFO ] [MAIN ] ENOV: Wiping existing primary data before full refresh. [2025-10-28T18:33:34.574360] [INFO ] [LOCAL ] ENOV: Starting deletion of primary data. [2025-10-28T18:33:34.574405] [DEBUG] [LOCAL ] ENOV: No primary data file found to delete. [2025-10-28T18:33:34.574438] [INFO ] [MAIN ] ENOV: Starting full primary refresh. [2025-10-28T18:33:34.921019] [INFO ] [REMOTE ] ENOV: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:33:35.159302] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-09. [2025-10-28T18:33:35.312684] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-28T18:33:35.959351] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-01. [2025-10-28T18:33:36.687308] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-28T18:33:36.759302] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-10. [2025-10-28T18:33:37.107754] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-28T18:33:37.559327] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-02. [2025-10-28T18:33:38.243820] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-28T18:33:38.254183] [INFO ] [REMOTE ] ENB: Full fetch complete (77273 records). [2025-10-28T18:33:38.254302] [DEBUG] [VALIDATOR ] ENB: Validating primary data. [2025-10-28T18:33:38.255091] [FATAL] [VALIDATOR ] ENB: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T18:33:38.255201] [FATAL] [MAIN ] ENB: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:33:38.255271] [WARN ] [MAIN ] ENB: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:33:38.255369] [INFO ] [LOCAL ] ENB: Starting deletion of primary data. [2025-10-28T18:33:38.255450] [DEBUG] [LOCAL ] ENB: No primary data file found to delete. [2025-10-28T18:33:38.255487] [INFO ] [LOCAL ] ENB: Starting deletion of derivative data. [2025-10-28T18:33:38.255909] [DEBUG] [LOCAL ] ENB: Deleted derivative data file. [2025-10-28T18:33:38.256004] [INFO ] [MAIN ] Update Progress: 738/2366 symbols completed. ENB took 26.8s. Estimated remaining: 3h 26m 27s. Rate: 7.9 symbols/min [2025-10-28T18:33:38.364259] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-03. [2025-10-28T18:33:38.434983] [INFO ] [MAIN ] ENR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:33:38.471407] [DEBUG] [LOCAL ] ENR: Loaded 43645 existing records from primary storage. [2025-10-28T18:33:38.471736] [INFO ] [MAIN ] ENR: Loaded 43645 existing records. [2025-10-28T18:33:38.651722] [WARN ] [MAIN ] ENR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:33:38.651975] [INFO ] [MAIN ] ENR: Wiping existing primary data before full refresh. [2025-10-28T18:33:38.652024] [INFO ] [LOCAL ] ENR: Starting deletion of primary data. [2025-10-28T18:33:38.652754] [DEBUG] [LOCAL ] ENR: Deleted primary data file. [2025-10-28T18:33:38.652810] [INFO ] [MAIN ] ENR: Starting full primary refresh. [2025-10-28T18:33:39.030403] [INFO ] [REMOTE ] ENR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:33:39.025226] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-28T18:33:39.159357] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-03. [2025-10-28T18:33:39.447146] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-28T18:33:39.959335] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-01. [2025-10-28T18:33:40.337949] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-28T18:33:40.759341] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-04. [2025-10-28T18:33:41.106762] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-28T18:33:41.559350] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-02. [2025-10-28T18:33:41.872553] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-10-28T18:33:42.040453] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-28T18:33:42.359337] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-02. [2025-10-28T18:33:43.159347] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-03. [2025-10-28T18:33:43.378150] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-28T18:33:43.474955] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-10-28T18:33:43.959340] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-05. [2025-10-28T18:33:44.759359] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-03. [2025-10-28T18:33:45.259822] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-28T18:33:45.559329] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-06. [2025-10-28T18:33:46.127379] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-28T18:33:46.359337] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-04. [2025-10-28T18:33:47.079529] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-28T18:33:47.159403] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-04. [2025-10-28T18:33:47.170412] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-28T18:33:47.959335] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-04. [2025-10-28T18:33:48.367541] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-28T18:33:48.759319] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-05. [2025-10-28T18:33:49.134127] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-28T18:33:49.559340] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-05. [2025-10-28T18:33:49.682309] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-28T18:33:49.843297] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-05 (0.28 seconds). [2025-10-28T18:33:50.359363] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-05. [2025-10-28T18:33:51.159356] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-07. [2025-10-28T18:33:51.573956] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-28T18:33:51.959349] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-06. [2025-10-28T18:33:52.323254] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-10-28T18:33:52.759357] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-06. [2025-10-28T18:33:52.868206] [DEBUG] [REMOTE ] ENR: Error fetching primary data for 2025-06: 'API call returned an empty response.' [2025-10-28T18:33:52.871224] [WARN ] [REMOTE ] ENR: No data returned for month 2025-06 [2025-10-28T18:33:52.872850] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-28T18:33:52.882981] [FATAL] [REMOTE ] ENR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-28T18:33:52.883555] [FATAL] [MAIN ] ENR: Failed to fetch primary data. [2025-10-28T18:33:52.883665] [WARN ] [MAIN ] ENR: Deleting existing primary and derivative data due to fetch failure. [2025-10-28T18:33:52.883771] [INFO ] [LOCAL ] ENR: Starting deletion of primary data. [2025-10-28T18:33:52.884179] [DEBUG] [LOCAL ] ENR: No primary data file found to delete. [2025-10-28T18:33:52.884231] [INFO ] [LOCAL ] ENR: Starting deletion of derivative data. [2025-10-28T18:33:52.884419] [DEBUG] [LOCAL ] ENR: Deleted derivative data file. [2025-10-28T18:33:52.884506] [INFO ] [MAIN ] Update Progress: 739/2366 symbols completed. ENR took 14.6s. Estimated remaining: 3h 26m 35s. Rate: 7.9 symbols/min [2025-10-28T18:33:53.052484] [INFO ] [MAIN ] ENS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:33:53.081793] [DEBUG] [LOCAL ] ENS: Loaded 29376 existing records from primary storage. [2025-10-28T18:33:53.082049] [INFO ] [MAIN ] ENS: Loaded 29376 existing records. [2025-10-28T18:33:53.264253] [WARN ] [MAIN ] ENS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:33:53.264493] [INFO ] [MAIN ] ENS: Wiping existing primary data before full refresh. [2025-10-28T18:33:53.264555] [INFO ] [LOCAL ] ENS: Starting deletion of primary data. [2025-10-28T18:33:53.264957] [DEBUG] [LOCAL ] ENS: Deleted primary data file. [2025-10-28T18:33:53.265016] [INFO ] [MAIN ] ENS: Starting full primary refresh. [2025-10-28T18:33:53.564432] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-08. [2025-10-28T18:33:53.629851] [INFO ] [REMOTE ] ENS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:33:54.359331] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-07. [2025-10-28T18:33:54.635335] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-07 (0.28 seconds). [2025-10-28T18:33:54.750107] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-28T18:33:55.159411] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-08. [2025-10-28T18:33:55.448279] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-08 (0.29 seconds). [2025-10-28T18:33:55.959378] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-09. [2025-10-28T18:33:56.298718] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-10-28T18:33:56.759354] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-10. [2025-10-28T18:33:57.104238] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-10 (0.34 seconds). [2025-10-28T18:33:57.105112] [INFO ] [REMOTE ] ENO: Full fetch complete (2953 records). [2025-10-28T18:33:57.105180] [DEBUG] [VALIDATOR ] ENO: Validating primary data. [2025-10-28T18:33:57.483170] [DEBUG] [VALIDATOR ] ENO: All expected trading days are present. [2025-10-28T18:33:57.483245] [DEBUG] [VALIDATOR ] ENO: Primary data validation passed. [2025-10-28T18:33:57.483367] [INFO ] [MAIN ] ENO: Fetched primary data is valid. [2025-10-28T18:33:57.483431] [DEBUG] [LOCAL ] ENO: Saving primary data. [2025-10-28T18:33:57.483806] [DEBUG] [LOCAL ] ENO: Trimmed 2953 records to 1587 (keeping 200 days of data) [2025-10-28T18:33:57.493927] [DEBUG] [LOCAL ] ENO: Primary data saved (1587 records). [2025-10-28T18:33:57.493991] [INFO ] [MAIN ] ENO: Full history saved. [2025-10-28T18:33:57.494050] [INFO ] [MAIN ] Update Progress: 740/2366 symbols completed. ENO took 27.1s. Estimated remaining: 3h 26m 21s. Rate: 7.9 symbols/min [2025-10-28T18:33:57.564617] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-09. [2025-10-28T18:33:57.675994] [INFO ] [MAIN ] ENVA: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:33:57.701672] [DEBUG] [LOCAL ] ENVA: Loaded 25041 existing records from primary storage. [2025-10-28T18:33:57.701944] [INFO ] [MAIN ] ENVA: Loaded 25041 existing records. [2025-10-28T18:33:57.886190] [WARN ] [MAIN ] ENVA: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:33:57.886392] [INFO ] [MAIN ] ENVA: Wiping existing primary data before full refresh. [2025-10-28T18:33:57.886441] [INFO ] [LOCAL ] ENVA: Starting deletion of primary data. [2025-10-28T18:33:57.886826] [DEBUG] [LOCAL ] ENVA: Deleted primary data file. [2025-10-28T18:33:57.886884] [INFO ] [MAIN ] ENVA: Starting full primary refresh. [2025-10-28T18:33:58.236719] [INFO ] [REMOTE ] ENVA: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:33:58.359370] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-01. [2025-10-28T18:33:58.921492] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-28T18:33:59.159326] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-06. [2025-10-28T18:33:59.959317] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-01. [2025-10-28T18:34:00.239917] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-10-28T18:34:00.245535] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-28T18:34:00.759353] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-10. [2025-10-28T18:34:01.427754] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-28T18:34:01.559373] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-02. [2025-10-28T18:34:02.359313] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-07. [2025-10-28T18:34:02.478923] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-10-28T18:34:03.049172] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-10 (2.29 seconds). [2025-10-28T18:34:03.056843] [INFO ] [REMOTE ] ENOV: Full fetch complete (62908 records). [2025-10-28T18:34:03.056959] [DEBUG] [VALIDATOR ] ENOV: Validating primary data. [2025-10-28T18:34:03.057612] [FATAL] [VALIDATOR ] ENOV: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T18:34:03.057722] [FATAL] [MAIN ] ENOV: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:34:03.057764] [WARN ] [MAIN ] ENOV: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:34:03.057829] [INFO ] [LOCAL ] ENOV: Starting deletion of primary data. [2025-10-28T18:34:03.057895] [DEBUG] [LOCAL ] ENOV: No primary data file found to delete. [2025-10-28T18:34:03.057929] [INFO ] [LOCAL ] ENOV: Starting deletion of derivative data. [2025-10-28T18:34:03.057969] [DEBUG] [LOCAL ] ENOV: No derivative data file found to delete. [2025-10-28T18:34:03.058023] [INFO ] [MAIN ] Update Progress: 741/2366 symbols completed. ENOV took 28.7s. Estimated remaining: 3h 26m 9s. Rate: 7.9 symbols/min [2025-10-28T18:34:03.164488] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-03. [2025-10-28T18:34:03.226844] [INFO ] [MAIN ] EOD: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:34:03.242434] [DEBUG] [LOCAL ] EOD: Loaded 14650 existing records from primary storage. [2025-10-28T18:34:03.242775] [INFO ] [MAIN ] EOD: Loaded 14650 existing records. [2025-10-28T18:34:03.438605] [WARN ] [MAIN ] EOD: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:34:03.438885] [INFO ] [MAIN ] EOD: Wiping existing primary data before full refresh. [2025-10-28T18:34:03.438930] [INFO ] [LOCAL ] EOD: Starting deletion of primary data. [2025-10-28T18:34:03.439212] [DEBUG] [LOCAL ] EOD: Deleted primary data file. [2025-10-28T18:34:03.439268] [INFO ] [MAIN ] EOD: Starting full primary refresh. [2025-10-28T18:34:03.795713] [INFO ] [REMOTE ] EOD: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:34:03.959303] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-01. [2025-10-28T18:34:04.335695] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-10-28T18:34:04.359954] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-28T18:34:04.759329] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-08. [2025-10-28T18:34:04.890404] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-28T18:34:05.559304] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-02. [2025-10-28T18:34:05.699801] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-28T18:34:06.344270] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-28T18:34:06.359295] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-03. [2025-10-28T18:34:07.159342] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-09. [2025-10-28T18:34:07.292564] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-28T18:34:07.959348] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-02. [2025-10-28T18:34:08.199966] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-28T18:34:08.759314] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-04. [2025-10-28T18:34:08.972251] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-28T18:34:09.559329] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-03. [2025-10-28T18:34:09.726196] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-28T18:34:10.080456] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-28T18:34:10.359351] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-04. [2025-10-28T18:34:11.159337] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-04. [2025-10-28T18:34:11.465701] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-28T18:34:11.959360] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-10. [2025-10-28T18:34:12.151976] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-28T18:34:12.759348] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-05. [2025-10-28T18:34:13.219069] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-28T18:34:13.225589] [INFO ] [REMOTE ] ENIC: Full fetch complete (51123 records). [2025-10-28T18:34:13.225722] [DEBUG] [VALIDATOR ] ENIC: Validating primary data. [2025-10-28T18:34:13.568387] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-05. [2025-10-28T18:34:13.611705] [DEBUG] [VALIDATOR ] ENIC: All expected trading days are present. [2025-10-28T18:34:13.611795] [DEBUG] [VALIDATOR ] ENIC: Primary data validation passed. [2025-10-28T18:34:13.612464] [INFO ] [MAIN ] ENIC: Fetched primary data is valid. [2025-10-28T18:34:13.612504] [DEBUG] [LOCAL ] ENIC: Saving primary data. [2025-10-28T18:34:13.613774] [DEBUG] [LOCAL ] ENIC: Trimmed 51123 records to 35951 (keeping 200 days of data) [2025-10-28T18:34:13.818196] [DEBUG] [LOCAL ] ENIC: Primary data saved (35951 records). [2025-10-28T18:34:13.818331] [INFO ] [MAIN ] ENIC: Full history saved. [2025-10-28T18:34:13.818401] [INFO ] [MAIN ] Update Progress: 742/2366 symbols completed. ENIC took 45.8s. Estimated remaining: 3h 26m 8s. Rate: 7.9 symbols/min [2025-10-28T18:34:13.996426] [INFO ] [MAIN ] EOG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:34:14.015250] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-28T18:34:14.070870] [DEBUG] [LOCAL ] EOG: Loaded 53389 existing records from primary storage. [2025-10-28T18:34:14.071173] [INFO ] [MAIN ] EOG: Loaded 53389 existing records. [2025-10-28T18:34:14.258182] [WARN ] [MAIN ] EOG: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:34:14.258447] [INFO ] [MAIN ] EOG: Wiping existing primary data before full refresh. [2025-10-28T18:34:14.258503] [INFO ] [LOCAL ] EOG: Starting deletion of primary data. [2025-10-28T18:34:14.259362] [DEBUG] [LOCAL ] EOG: Deleted primary data file. [2025-10-28T18:34:14.259421] [INFO ] [MAIN ] EOG: Starting full primary refresh. [2025-10-28T18:34:14.364492] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-05. [2025-10-28T18:34:14.631954] [INFO ] [REMOTE ] EOG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:34:15.159311] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-06. [2025-10-28T18:34:15.210289] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-28T18:34:15.342117] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-10-28T18:34:15.959331] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-06. [2025-10-28T18:34:16.166770] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-28T18:34:16.756337] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-28T18:34:16.761494] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-06. [2025-10-28T18:34:17.437812] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-28T18:34:17.559392] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-07. [2025-10-28T18:34:18.359370] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-07. [2025-10-28T18:34:18.418520] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-28T18:34:19.159340] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-07. [2025-10-28T18:34:19.372141] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-28T18:34:19.959363] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-08. [2025-10-28T18:34:20.011878] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-28T18:34:20.759325] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-01. [2025-10-28T18:34:20.813016] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-28T18:34:21.559372] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-08. [2025-10-28T18:34:22.161787] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-28T18:34:22.359304] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-09. [2025-10-28T18:34:23.094828] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-28T18:34:23.159309] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-08. [2025-10-28T18:34:23.469183] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-01 (2.71 seconds). [2025-10-28T18:34:23.959375] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-10. [2025-10-28T18:34:24.022705] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-28T18:34:24.759305] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-09. [2025-10-28T18:34:25.099099] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-28T18:34:25.102534] [INFO ] [REMOTE ] EOD: Full fetch complete (20682 records). [2025-10-28T18:34:25.102619] [DEBUG] [VALIDATOR ] EOD: Validating primary data. [2025-10-28T18:34:25.103096] [FATAL] [VALIDATOR ] EOD: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T18:34:25.103178] [FATAL] [MAIN ] EOD: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:34:25.103237] [WARN ] [MAIN ] EOD: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:34:25.103320] [INFO ] [LOCAL ] EOD: Starting deletion of primary data. [2025-10-28T18:34:25.103396] [DEBUG] [LOCAL ] EOD: No primary data file found to delete. [2025-10-28T18:34:25.103447] [INFO ] [LOCAL ] EOD: Starting deletion of derivative data. [2025-10-28T18:34:25.103684] [DEBUG] [LOCAL ] EOD: Deleted derivative data file. [2025-10-28T18:34:25.103796] [INFO ] [MAIN ] Update Progress: 743/2366 symbols completed. EOD took 22.0s. Estimated remaining: 3h 26m 8s. Rate: 7.9 symbols/min [2025-10-28T18:34:25.282485] [INFO ] [MAIN ] EOI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:34:25.294339] [DEBUG] [LOCAL ] EOI: Loaded 9956 existing records from primary storage. [2025-10-28T18:34:25.294556] [INFO ] [MAIN ] EOI: Loaded 9956 existing records. [2025-10-28T18:34:25.475908] [WARN ] [MAIN ] EOI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:34:25.476125] [INFO ] [MAIN ] EOI: Wiping existing primary data before full refresh. [2025-10-28T18:34:25.476172] [INFO ] [LOCAL ] EOI: Starting deletion of primary data. [2025-10-28T18:34:25.476403] [DEBUG] [LOCAL ] EOI: Deleted primary data file. [2025-10-28T18:34:25.476460] [INFO ] [MAIN ] EOI: Starting full primary refresh. [2025-10-28T18:34:25.564562] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-09. [2025-10-28T18:34:25.831581] [INFO ] [REMOTE ] EOI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:34:26.019515] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-28T18:34:26.333453] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-28T18:34:26.359325] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-10. [2025-10-28T18:34:27.159344] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-01. [2025-10-28T18:34:27.959383] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-10. [2025-10-28T18:34:28.050600] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-28T18:34:28.068108] [INFO ] [REMOTE ] ENS: Full fetch complete (42864 records). [2025-10-28T18:34:28.068857] [DEBUG] [VALIDATOR ] ENS: Validating primary data. [2025-10-28T18:34:28.069252] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-28T18:34:28.472148] [DEBUG] [VALIDATOR ] ENS: All expected trading days are present. [2025-10-28T18:34:28.472232] [DEBUG] [VALIDATOR ] ENS: Primary data validation passed. [2025-10-28T18:34:28.472874] [INFO ] [MAIN ] ENS: Fetched primary data is valid. [2025-10-28T18:34:28.472961] [DEBUG] [LOCAL ] ENS: Saving primary data. [2025-10-28T18:34:28.473843] [DEBUG] [LOCAL ] ENS: Trimmed 42864 records to 29403 (keeping 200 days of data) [2025-10-28T18:34:28.647319] [DEBUG] [LOCAL ] ENS: Primary data saved (29403 records). [2025-10-28T18:34:28.647449] [INFO ] [MAIN ] ENS: Full history saved. [2025-10-28T18:34:28.647527] [INFO ] [MAIN ] Update Progress: 744/2366 symbols completed. ENS took 35.8s. Estimated remaining: 3h 25m 52s. Rate: 7.9 symbols/min [2025-10-28T18:34:28.764535] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-02. [2025-10-28T18:34:28.821999] [INFO ] [MAIN ] EOS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:34:28.837311] [DEBUG] [LOCAL ] EOS: Loaded 14302 existing records from primary storage. [2025-10-28T18:34:28.837516] [INFO ] [MAIN ] EOS: Loaded 14302 existing records. [2025-10-28T18:34:29.015597] [WARN ] [MAIN ] EOS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:34:29.015993] [INFO ] [MAIN ] EOS: Wiping existing primary data before full refresh. [2025-10-28T18:34:29.016197] [INFO ] [LOCAL ] EOS: Starting deletion of primary data. [2025-10-28T18:34:29.016474] [DEBUG] [LOCAL ] EOS: Deleted primary data file. [2025-10-28T18:34:29.016575] [INFO ] [MAIN ] EOS: Starting full primary refresh. [2025-10-28T18:34:29.121151] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-28T18:34:29.142524] [INFO ] [REMOTE ] ENVA: Full fetch complete (36684 records). [2025-10-28T18:34:29.152913] [DEBUG] [VALIDATOR ] ENVA: Validating primary data. [2025-10-28T18:34:29.177234] [FATAL] [VALIDATOR ] ENVA: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T18:34:29.195889] [FATAL] [MAIN ] ENVA: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:34:29.213218] [WARN ] [MAIN ] ENVA: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:34:29.247588] [INFO ] [LOCAL ] ENVA: Starting deletion of primary data. [2025-10-28T18:34:29.271299] [DEBUG] [LOCAL ] ENVA: No primary data file found to delete. [2025-10-28T18:34:29.280388] [INFO ] [LOCAL ] ENVA: Starting deletion of derivative data. [2025-10-28T18:34:29.296970] [DEBUG] [LOCAL ] ENVA: Deleted derivative data file. [2025-10-28T18:34:29.316072] [INFO ] [MAIN ] Update Progress: 745/2366 symbols completed. ENVA took 31.8s. Estimated remaining: 3h 25m 29s. Rate: 7.9 symbols/min [2025-10-28T18:34:29.504861] [INFO ] [REMOTE ] EOS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:34:29.520545] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-28T18:34:29.564868] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-02. [2025-10-28T18:34:29.592816] [INFO ] [MAIN ] EOT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:34:29.593050] [DEBUG] [LOCAL ] EOT: No existing data file found in primary storage. [2025-10-28T18:34:29.593117] [WARN ] [MAIN ] EOT: No existing data found, performing full refresh instead. [2025-10-28T18:34:29.593237] [INFO ] [MAIN ] EOT: Wiping existing primary data before full refresh. [2025-10-28T18:34:29.593290] [INFO ] [LOCAL ] EOT: Starting deletion of primary data. [2025-10-28T18:34:29.593345] [DEBUG] [LOCAL ] EOT: No primary data file found to delete. [2025-10-28T18:34:29.593389] [INFO ] [MAIN ] EOT: Starting full primary refresh. [2025-10-28T18:34:29.962424] [INFO ] [REMOTE ] EOT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:34:30.359339] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-01. [2025-10-28T18:34:31.159374] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-03. [2025-10-28T18:34:31.535236] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-28T18:34:31.764284] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-28T18:34:31.959363] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-04. [2025-10-28T18:34:32.626729] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-28T18:34:32.759322] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-05. [2025-10-28T18:34:33.559380] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-02. [2025-10-28T18:34:33.593102] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-28T18:34:33.800381] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-02 (4.24 seconds). [2025-10-28T18:34:34.088583] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-28T18:34:34.359427] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-01. [2025-10-28T18:34:35.159350] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-06. [2025-10-28T18:34:35.431045] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-28T18:34:35.549040] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-10-28T18:34:35.959371] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-03. [2025-10-28T18:34:36.574058] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-28T18:34:36.759344] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-02. [2025-10-28T18:34:37.559372] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-07. [2025-10-28T18:34:37.776132] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-28T18:34:38.173425] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-28T18:34:38.359335] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-04. [2025-10-28T18:34:39.141377] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-28T18:34:39.159336] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-05. [2025-10-28T18:34:39.959408] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-08. [2025-10-28T18:34:39.990994] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-10-28T18:34:40.759346] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-03. [2025-10-28T18:34:40.925552] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-28T18:34:41.465124] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-28T18:34:41.559335] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-04. [2025-10-28T18:34:42.335212] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-28T18:34:42.359382] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-03. [2025-10-28T18:34:43.159321] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-05. [2025-10-28T18:34:43.816008] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-28T18:34:43.939974] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-10-28T18:34:43.959313] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-04. [2025-10-28T18:34:44.759331] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-09. [2025-10-28T18:34:45.281960] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-28T18:34:45.364327] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-28T18:34:45.559340] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-06. [2025-10-28T18:34:46.202614] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-28T18:34:46.359402] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-10. [2025-10-28T18:34:47.062275] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-28T18:34:47.064911] [INFO ] [REMOTE ] EOI: Full fetch complete (15848 records). [2025-10-28T18:34:47.064993] [DEBUG] [VALIDATOR ] EOI: Validating primary data. [2025-10-28T18:34:47.164435] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-07. [2025-10-28T18:34:47.447322] [DEBUG] [VALIDATOR ] EOI: All expected trading days are present. [2025-10-28T18:34:47.447399] [DEBUG] [VALIDATOR ] EOI: Primary data validation passed. [2025-10-28T18:34:47.447822] [INFO ] [MAIN ] EOI: Fetched primary data is valid. [2025-10-28T18:34:47.447885] [DEBUG] [LOCAL ] EOI: Saving primary data. [2025-10-28T18:34:47.448392] [DEBUG] [LOCAL ] EOI: Trimmed 15848 records to 9917 (keeping 200 days of data) [2025-10-28T18:34:47.507171] [DEBUG] [LOCAL ] EOI: Primary data saved (9917 records). [2025-10-28T18:34:47.507296] [INFO ] [MAIN ] EOI: Full history saved. [2025-10-28T18:34:47.507372] [INFO ] [MAIN ] Update Progress: 746/2366 symbols completed. EOI took 22.4s. Estimated remaining: 3h 25m 44s. Rate: 7.9 symbols/min [2025-10-28T18:34:47.687358] [INFO ] [MAIN ] EPAC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:34:47.712157] [DEBUG] [LOCAL ] EPAC: Loaded 26063 existing records from primary storage. [2025-10-28T18:34:47.712370] [INFO ] [MAIN ] EPAC: Loaded 26063 existing records. [2025-10-28T18:34:47.900830] [WARN ] [MAIN ] EPAC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:34:47.910691] [INFO ] [MAIN ] EPAC: Wiping existing primary data before full refresh. [2025-10-28T18:34:47.911698] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-28T18:34:47.911316] [INFO ] [LOCAL ] EPAC: Starting deletion of primary data. [2025-10-28T18:34:47.916353] [DEBUG] [LOCAL ] EPAC: Deleted primary data file. [2025-10-28T18:34:47.916412] [INFO ] [MAIN ] EPAC: Starting full primary refresh. [2025-10-28T18:34:47.968428] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-06. [2025-10-28T18:34:48.281117] [INFO ] [REMOTE ] EPAC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:34:48.468038] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-28T18:34:48.759357] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-08. [2025-10-28T18:34:49.559310] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-05. [2025-10-28T18:34:49.680901] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-28T18:34:50.359365] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-07. [2025-10-28T18:34:50.803844] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-28T18:34:51.159328] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-09. [2025-10-28T18:34:51.759077] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-28T18:34:51.959369] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-01. [2025-10-28T18:34:52.536408] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-05 (2.98 seconds). [2025-10-28T18:34:52.759355] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-06. [2025-10-28T18:34:53.084988] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-28T18:34:53.559403] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-02. [2025-10-28T18:34:54.314022] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-28T18:34:54.338702] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-28T18:34:54.359302] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-03. [2025-10-28T18:34:55.159305] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-07. [2025-10-28T18:34:55.265379] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-28T18:34:55.959436] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-08. [2025-10-28T18:34:56.426344] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-10-28T18:34:56.584684] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-28T18:34:56.759351] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-10. [2025-10-28T18:34:57.559355] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-09. [2025-10-28T18:34:57.597879] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-28T18:34:57.601535] [INFO ] [REMOTE ] EOS: Full fetch complete (22757 records). [2025-10-28T18:34:57.601637] [DEBUG] [VALIDATOR ] EOS: Validating primary data. [2025-10-28T18:34:57.971415] [DEBUG] [VALIDATOR ] EOS: All expected trading days are present. [2025-10-28T18:34:57.971565] [DEBUG] [VALIDATOR ] EOS: Primary data validation passed. [2025-10-28T18:34:57.972068] [INFO ] [MAIN ] EOS: Fetched primary data is valid. [2025-10-28T18:34:57.972129] [DEBUG] [LOCAL ] EOS: Saving primary data. [2025-10-28T18:34:57.972776] [DEBUG] [LOCAL ] EOS: Trimmed 22757 records to 14269 (keeping 200 days of data) [2025-10-28T18:34:58.049228] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-28T18:34:58.067341] [DEBUG] [LOCAL ] EOS: Primary data saved (14269 records). [2025-10-28T18:34:58.067434] [INFO ] [MAIN ] EOS: Full history saved. [2025-10-28T18:34:58.067503] [INFO ] [MAIN ] Update Progress: 747/2366 symbols completed. EOS took 29.4s. Estimated remaining: 3h 25m 43s. Rate: 7.9 symbols/min [2025-10-28T18:34:58.240197] [INFO ] [MAIN ] EPAM: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:34:58.240368] [DEBUG] [LOCAL ] EPAM: No existing data file found in primary storage. [2025-10-28T18:34:58.240406] [WARN ] [MAIN ] EPAM: No existing data found, performing full refresh instead. [2025-10-28T18:34:58.240516] [INFO ] [MAIN ] EPAM: Wiping existing primary data before full refresh. [2025-10-28T18:34:58.240557] [INFO ] [LOCAL ] EPAM: Starting deletion of primary data. [2025-10-28T18:34:58.240599] [DEBUG] [LOCAL ] EPAM: No primary data file found to delete. [2025-10-28T18:34:58.240632] [INFO ] [MAIN ] EPAM: Starting full primary refresh. [2025-10-28T18:34:58.364496] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-10. [2025-10-28T18:34:58.612182] [INFO ] [REMOTE ] EPAM: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:34:59.159297] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-04. [2025-10-28T18:34:59.227137] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-28T18:34:59.229327] [INFO ] [REMOTE ] EOT: Full fetch complete (10713 records). [2025-10-28T18:34:59.229395] [DEBUG] [VALIDATOR ] EOT: Validating primary data. [2025-10-28T18:34:59.584028] [DEBUG] [VALIDATOR ] EOT: All expected trading days are present. [2025-10-28T18:34:59.584101] [DEBUG] [VALIDATOR ] EOT: Primary data validation passed. [2025-10-28T18:34:59.584346] [INFO ] [MAIN ] EOT: Fetched primary data is valid. [2025-10-28T18:34:59.584383] [DEBUG] [LOCAL ] EOT: Saving primary data. [2025-10-28T18:34:59.584859] [DEBUG] [LOCAL ] EOT: Trimmed 10713 records to 6982 (keeping 200 days of data) [2025-10-28T18:34:59.626429] [DEBUG] [LOCAL ] EOT: Primary data saved (6982 records). [2025-10-28T18:34:59.626591] [INFO ] [MAIN ] EOT: Full history saved. [2025-10-28T18:34:59.626689] [INFO ] [MAIN ] Update Progress: 748/2366 symbols completed. EOT took 30.3s. Estimated remaining: 3h 25m 22s. Rate: 7.9 symbols/min [2025-10-28T18:34:59.837708] [INFO ] [MAIN ] EPC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:34:59.837920] [DEBUG] [LOCAL ] EPC: No existing data file found in primary storage. [2025-10-28T18:34:59.837980] [WARN ] [MAIN ] EPC: No existing data found, performing full refresh instead. [2025-10-28T18:34:59.838096] [INFO ] [MAIN ] EPC: Wiping existing primary data before full refresh. [2025-10-28T18:34:59.838137] [INFO ] [LOCAL ] EPC: Starting deletion of primary data. [2025-10-28T18:34:59.838179] [DEBUG] [LOCAL ] EPC: No primary data file found to delete. [2025-10-28T18:34:59.838216] [INFO ] [MAIN ] EPC: Starting full primary refresh. [2025-10-28T18:34:59.964515] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-08. [2025-10-28T18:35:00.211349] [INFO ] [REMOTE ] EPC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:35:00.231961] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-28T18:35:00.759363] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-05. [2025-10-28T18:35:01.544557] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-28T18:35:01.559321] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-09. [2025-10-28T18:35:01.920946] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-28T18:35:02.359400] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-01. [2025-10-28T18:35:03.159328] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-06. [2025-10-28T18:35:03.749310] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-28T18:35:03.959357] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-02. [2025-10-28T18:35:04.128748] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-09 (2.57 seconds). [2025-10-28T18:35:04.206285] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-28T18:35:04.759356] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-07. [2025-10-28T18:35:04.963855] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-28T18:35:05.559313] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-01. [2025-10-28T18:35:05.752767] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-28T18:35:06.359356] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-03. [2025-10-28T18:35:06.831473] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-28T18:35:07.159401] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-08. [2025-10-28T18:35:07.373232] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-28T18:35:07.959341] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-02. [2025-10-28T18:35:08.021842] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-28T18:35:08.759360] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-10. [2025-10-28T18:35:09.059289] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-28T18:35:09.559354] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-03. [2025-10-28T18:35:10.359307] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-04. [2025-10-28T18:35:10.548756] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-10 (1.79 seconds). [2025-10-28T18:35:10.559592] [INFO ] [REMOTE ] EOG: Full fetch complete (77470 records). [2025-10-28T18:35:10.559772] [DEBUG] [VALIDATOR ] EOG: Validating primary data. [2025-10-28T18:35:10.976104] [DEBUG] [VALIDATOR ] EOG: All expected trading days are present. [2025-10-28T18:35:10.976251] [DEBUG] [VALIDATOR ] EOG: Primary data validation passed. [2025-10-28T18:35:10.977265] [INFO ] [MAIN ] EOG: Fetched primary data is valid. [2025-10-28T18:35:10.977389] [DEBUG] [LOCAL ] EOG: Saving primary data. [2025-10-28T18:35:11.003559] [DEBUG] [LOCAL ] EOG: Trimmed 77470 records to 53388 (keeping 200 days of data) [2025-10-28T18:35:11.005632] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-28T18:35:11.199353] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-04. [2025-10-28T18:35:11.386078] [DEBUG] [LOCAL ] EOG: Primary data saved (53388 records). [2025-10-28T18:35:11.386221] [INFO ] [MAIN ] EOG: Full history saved. [2025-10-28T18:35:11.386299] [INFO ] [MAIN ] Update Progress: 749/2366 symbols completed. EOG took 57.6s. Estimated remaining: 3h 25m 24s. Rate: 7.9 symbols/min [2025-10-28T18:35:11.559620] [INFO ] [MAIN ] EPD: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:35:11.582364] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-28T18:35:11.636358] [DEBUG] [LOCAL ] EPD: Loaded 53606 existing records from primary storage. [2025-10-28T18:35:11.636795] [INFO ] [MAIN ] EPD: Loaded 53606 existing records. [2025-10-28T18:35:11.812244] [WARN ] [MAIN ] EPD: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:35:11.812457] [INFO ] [MAIN ] EPD: Wiping existing primary data before full refresh. [2025-10-28T18:35:11.812504] [INFO ] [LOCAL ] EPD: Starting deletion of primary data. [2025-10-28T18:35:11.813031] [DEBUG] [LOCAL ] EPD: Deleted primary data file. [2025-10-28T18:35:11.813089] [INFO ] [MAIN ] EPD: Starting full primary refresh. [2025-10-28T18:35:11.970284] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-09. [2025-10-28T18:35:12.201118] [INFO ] [REMOTE ] EPD: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:35:12.338240] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-28T18:35:12.759335] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-05. [2025-10-28T18:35:12.907728] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-28T18:35:13.559348] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-10. [2025-10-28T18:35:14.048508] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-28T18:35:14.359349] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-05. [2025-10-28T18:35:15.159388] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-06. [2025-10-28T18:35:15.292447] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-28T18:35:15.297837] [INFO ] [REMOTE ] EPAC: Full fetch complete (38710 records). [2025-10-28T18:35:15.297915] [DEBUG] [VALIDATOR ] EPAC: Validating primary data. [2025-10-28T18:35:15.668482] [DEBUG] [VALIDATOR ] EPAC: All expected trading days are present. [2025-10-28T18:35:15.668577] [DEBUG] [VALIDATOR ] EPAC: Primary data validation passed. [2025-10-28T18:35:15.669229] [INFO ] [MAIN ] EPAC: Fetched primary data is valid. [2025-10-28T18:35:15.669300] [DEBUG] [LOCAL ] EPAC: Saving primary data. [2025-10-28T18:35:15.670317] [DEBUG] [LOCAL ] EPAC: Trimmed 38710 records to 25996 (keeping 200 days of data) [2025-10-28T18:35:15.779118] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-28T18:35:15.856971] [DEBUG] [LOCAL ] EPAC: Primary data saved (25996 records). [2025-10-28T18:35:15.857123] [INFO ] [MAIN ] EPAC: Full history saved. [2025-10-28T18:35:15.857235] [INFO ] [MAIN ] Update Progress: 750/2366 symbols completed. EPAC took 28.3s. Estimated remaining: 3h 25m 9s. Rate: 7.9 symbols/min [2025-10-28T18:35:15.964738] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-06. [2025-10-28T18:35:16.025248] [INFO ] [MAIN ] EPR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:35:16.025393] [DEBUG] [LOCAL ] EPR: No existing data file found in primary storage. [2025-10-28T18:35:16.025446] [WARN ] [MAIN ] EPR: No existing data found, performing full refresh instead. [2025-10-28T18:35:16.025548] [INFO ] [MAIN ] EPR: Wiping existing primary data before full refresh. [2025-10-28T18:35:16.025587] [INFO ] [LOCAL ] EPR: Starting deletion of primary data. [2025-10-28T18:35:16.025627] [DEBUG] [LOCAL ] EPR: No primary data file found to delete. [2025-10-28T18:35:16.025692] [INFO ] [MAIN ] EPR: Starting full primary refresh. [2025-10-28T18:35:16.379061] [INFO ] [REMOTE ] EPR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:35:16.759380] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-01. [2025-10-28T18:35:17.388812] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-06 (2.23 seconds). [2025-10-28T18:35:17.559303] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-07. [2025-10-28T18:35:18.359325] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-01. [2025-10-28T18:35:18.441696] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-06 (2.48 seconds). [2025-10-28T18:35:19.159367] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-07. [2025-10-28T18:35:19.372101] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-01 (2.61 seconds). [2025-10-28T18:35:19.449540] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-28T18:35:19.583404] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-10-28T18:35:19.959337] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-02. [2025-10-28T18:35:20.759374] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-02. [2025-10-28T18:35:21.071889] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-28T18:35:21.559353] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-08. [2025-10-28T18:35:22.096341] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-07 (2.94 seconds). [2025-10-28T18:35:22.359299] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-08. [2025-10-28T18:35:22.724167] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-10-28T18:35:23.159361] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-03. [2025-10-28T18:35:23.685189] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-10-28T18:35:23.959322] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-03. [2025-10-28T18:35:24.489395] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-10-28T18:35:24.759312] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-09. [2025-10-28T18:35:25.550075] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-28T18:35:25.561124] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-09. [2025-10-28T18:35:25.904852] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-28T18:35:26.365441] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-10. [2025-10-28T18:35:26.372415] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-03 (3.21 seconds). [2025-10-28T18:35:27.159375] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-04. [2025-10-28T18:35:27.350840] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-28T18:35:27.643795] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-28T18:35:27.651391] [INFO ] [REMOTE ] EPAM: Full fetch complete (56755 records). [2025-10-28T18:35:27.651560] [DEBUG] [VALIDATOR ] EPAM: Validating primary data. [2025-10-28T18:35:27.964514] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-10. [2025-10-28T18:35:28.047886] [DEBUG] [VALIDATOR ] EPAM: All expected trading days are present. [2025-10-28T18:35:28.047969] [DEBUG] [VALIDATOR ] EPAM: Primary data validation passed. [2025-10-28T18:35:28.048717] [INFO ] [MAIN ] EPAM: Fetched primary data is valid. [2025-10-28T18:35:28.048780] [DEBUG] [LOCAL ] EPAM: Saving primary data. [2025-10-28T18:35:28.049972] [DEBUG] [LOCAL ] EPAM: Trimmed 56755 records to 38976 (keeping 200 days of data) [2025-10-28T18:35:28.279703] [DEBUG] [LOCAL ] EPAM: Primary data saved (38976 records). [2025-10-28T18:35:28.279833] [INFO ] [MAIN ] EPAM: Full history saved. [2025-10-28T18:35:28.279903] [INFO ] [MAIN ] Update Progress: 751/2366 symbols completed. EPAM took 30.2s. Estimated remaining: 3h 25m 12s. Rate: 7.9 symbols/min [2025-10-28T18:35:28.458826] [INFO ] [MAIN ] EPRT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:35:28.503864] [DEBUG] [LOCAL ] EPRT: Loaded 48434 existing records from primary storage. [2025-10-28T18:35:28.504182] [INFO ] [MAIN ] EPRT: Loaded 48434 existing records. [2025-10-28T18:35:28.694112] [WARN ] [MAIN ] EPRT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:35:28.694327] [INFO ] [MAIN ] EPRT: Wiping existing primary data before full refresh. [2025-10-28T18:35:28.694377] [INFO ] [LOCAL ] EPRT: Starting deletion of primary data. [2025-10-28T18:35:28.694836] [DEBUG] [LOCAL ] EPRT: Deleted primary data file. [2025-10-28T18:35:28.694894] [INFO ] [MAIN ] EPRT: Starting full primary refresh. [2025-10-28T18:35:28.762612] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-04. [2025-10-28T18:35:29.062599] [INFO ] [REMOTE ] EPRT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:35:29.559347] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-01. [2025-10-28T18:35:29.682034] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-04 (2.52 seconds). [2025-10-28T18:35:30.359418] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-05. [2025-10-28T18:35:30.415988] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-28T18:35:30.625297] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-10 (2.66 seconds). [2025-10-28T18:35:30.632916] [INFO ] [REMOTE ] EPC: Full fetch complete (57413 records). [2025-10-28T18:35:30.633039] [DEBUG] [VALIDATOR ] EPC: Validating primary data. [2025-10-28T18:35:31.052573] [DEBUG] [VALIDATOR ] EPC: All expected trading days are present. [2025-10-28T18:35:31.053164] [DEBUG] [VALIDATOR ] EPC: Primary data validation passed. [2025-10-28T18:35:31.053970] [INFO ] [MAIN ] EPC: Fetched primary data is valid. [2025-10-28T18:35:31.055078] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-28T18:35:31.055229] [DEBUG] [LOCAL ] EPC: Saving primary data. [2025-10-28T18:35:31.065171] [DEBUG] [LOCAL ] EPC: Trimmed 57413 records to 39562 (keeping 200 days of data) [2025-10-28T18:35:31.159396] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-02. [2025-10-28T18:35:31.298967] [DEBUG] [LOCAL ] EPC: Primary data saved (39562 records). [2025-10-28T18:35:31.299099] [INFO ] [MAIN ] EPC: Full history saved. [2025-10-28T18:35:31.299245] [INFO ] [MAIN ] Update Progress: 752/2366 symbols completed. EPC took 31.7s. Estimated remaining: 3h 24m 55s. Rate: 7.9 symbols/min [2025-10-28T18:35:31.500686] [INFO ] [MAIN ] EQBK: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:35:31.500904] [DEBUG] [LOCAL ] EQBK: No existing data file found in primary storage. [2025-10-28T18:35:31.500985] [WARN ] [MAIN ] EQBK: No existing data found, performing full refresh instead. [2025-10-28T18:35:31.501116] [INFO ] [MAIN ] EQBK: Wiping existing primary data before full refresh. [2025-10-28T18:35:31.501180] [INFO ] [LOCAL ] EQBK: Starting deletion of primary data. [2025-10-28T18:35:31.501357] [DEBUG] [LOCAL ] EQBK: No primary data file found to delete. [2025-10-28T18:35:31.501418] [INFO ] [MAIN ] EQBK: Starting full primary refresh. [2025-10-28T18:35:31.849594] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-28T18:35:31.937987] [INFO ] [REMOTE ] EQBK: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:35:31.959316] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-06. [2025-10-28T18:35:32.212783] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-28T18:35:32.759341] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-03. [2025-10-28T18:35:33.559319] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-05. [2025-10-28T18:35:34.147998] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-28T18:35:34.359331] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-01. [2025-10-28T18:35:34.543962] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-06 (2.58 seconds). [2025-10-28T18:35:35.159332] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-07. [2025-10-28T18:35:35.169925] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-28T18:35:35.218720] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-28T18:35:35.959340] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-04. [2025-10-28T18:35:36.349850] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-28T18:35:36.759374] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-02. [2025-10-28T18:35:37.246490] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-28T18:35:37.419399] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-28T18:35:37.559330] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-05. [2025-10-28T18:35:38.359342] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-08. [2025-10-28T18:35:38.873241] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-28T18:35:39.159348] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-06. [2025-10-28T18:35:39.677988] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-28T18:35:39.959341] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-09. [2025-10-28T18:35:40.347541] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-28T18:35:40.759341] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-03. [2025-10-28T18:35:41.109299] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-28T18:35:41.392294] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-28T18:35:41.559339] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-06. [2025-10-28T18:35:42.359335] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-07. [2025-10-28T18:35:43.134793] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-28T18:35:43.159296] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-07. [2025-10-28T18:35:43.623280] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-28T18:35:43.959337] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-10. [2025-10-28T18:35:44.720868] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-28T18:35:44.759307] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-04. [2025-10-28T18:35:45.467969] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-28T18:35:45.476613] [INFO ] [REMOTE ] EPR: Full fetch complete (63264 records). [2025-10-28T18:35:45.476782] [DEBUG] [VALIDATOR ] EPR: Validating primary data. [2025-10-28T18:35:45.559910] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-08. [2025-10-28T18:35:45.603622] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-28T18:35:45.884243] [DEBUG] [VALIDATOR ] EPR: All expected trading days are present. [2025-10-28T18:35:45.884330] [DEBUG] [VALIDATOR ] EPR: Primary data validation passed. [2025-10-28T18:35:45.885139] [INFO ] [MAIN ] EPR: Fetched primary data is valid. [2025-10-28T18:35:45.885201] [DEBUG] [LOCAL ] EPR: Saving primary data. [2025-10-28T18:35:45.886446] [DEBUG] [LOCAL ] EPR: Trimmed 63264 records to 43440 (keeping 200 days of data) [2025-10-28T18:35:46.144221] [DEBUG] [LOCAL ] EPR: Primary data saved (43440 records). [2025-10-28T18:35:46.144344] [INFO ] [MAIN ] EPR: Full history saved. [2025-10-28T18:35:46.144416] [INFO ] [MAIN ] Update Progress: 753/2366 symbols completed. EPR took 30.3s. Estimated remaining: 3h 25m 2s. Rate: 7.9 symbols/min [2025-10-28T18:35:46.326442] [INFO ] [MAIN ] EQH: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:35:46.359327] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-05. [2025-10-28T18:35:46.376630] [DEBUG] [LOCAL ] EQH: Loaded 52653 existing records from primary storage. [2025-10-28T18:35:46.376970] [INFO ] [MAIN ] EQH: Loaded 52653 existing records. [2025-10-28T18:35:46.568310] [WARN ] [MAIN ] EQH: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:35:46.568577] [INFO ] [MAIN ] EQH: Wiping existing primary data before full refresh. [2025-10-28T18:35:46.568639] [INFO ] [LOCAL ] EQH: Starting deletion of primary data. [2025-10-28T18:35:46.569199] [DEBUG] [LOCAL ] EQH: Deleted primary data file. [2025-10-28T18:35:46.569258] [INFO ] [MAIN ] EQH: Starting full primary refresh. [2025-10-28T18:35:46.941171] [INFO ] [REMOTE ] EQH: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:35:46.947920] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-28T18:35:47.159329] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-01. [2025-10-28T18:35:47.662214] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-10-28T18:35:47.959350] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-09. [2025-10-28T18:35:48.450375] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-28T18:35:48.759332] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-02. [2025-10-28T18:35:49.142995] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-28T18:35:49.559319] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-08. [2025-10-28T18:35:50.359331] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-06. [2025-10-28T18:35:50.877167] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-28T18:35:51.047925] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-28T18:35:51.159314] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-10. [2025-10-28T18:35:51.738515] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-02 (2.98 seconds). [2025-10-28T18:35:51.959321] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-03. [2025-10-28T18:35:52.759313] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-07. [2025-10-28T18:35:53.331385] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-28T18:35:53.559357] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-04. [2025-10-28T18:35:54.359387] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-09. [2025-10-28T18:35:55.081960] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-28T18:35:55.159315] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-05. [2025-10-28T18:35:55.234268] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-10 (4.07 seconds). [2025-10-28T18:35:55.244728] [INFO ] [REMOTE ] EPRT: Full fetch complete (69698 records). [2025-10-28T18:35:55.244867] [DEBUG] [VALIDATOR ] EPRT: Validating primary data. [2025-10-28T18:35:55.641393] [DEBUG] [VALIDATOR ] EPRT: All expected trading days are present. [2025-10-28T18:35:55.641518] [DEBUG] [VALIDATOR ] EPRT: Primary data validation passed. [2025-10-28T18:35:55.650611] [INFO ] [MAIN ] EPRT: Fetched primary data is valid. [2025-10-28T18:35:55.651449] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-07 (2.89 seconds). [2025-10-28T18:35:55.651140] [DEBUG] [LOCAL ] EPRT: Saving primary data. [2025-10-28T18:35:55.656224] [DEBUG] [LOCAL ] EPRT: Trimmed 69698 records to 48419 (keeping 200 days of data) [2025-10-28T18:35:55.948972] [DEBUG] [LOCAL ] EPRT: Primary data saved (48419 records). [2025-10-28T18:35:55.949097] [INFO ] [MAIN ] EPRT: Full history saved. [2025-10-28T18:35:55.949173] [INFO ] [MAIN ] Update Progress: 754/2366 symbols completed. EPRT took 27.7s. Estimated remaining: 3h 24m 59s. Rate: 7.9 symbols/min [2025-10-28T18:35:55.980499] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-08. [2025-10-28T18:35:56.119428] [INFO ] [MAIN ] EQNR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:35:56.167757] [DEBUG] [LOCAL ] EQNR: Loaded 53043 existing records from primary storage. [2025-10-28T18:35:56.168050] [INFO ] [MAIN ] EQNR: Loaded 53043 existing records. [2025-10-28T18:35:56.346606] [WARN ] [MAIN ] EQNR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:35:56.346817] [INFO ] [MAIN ] EQNR: Wiping existing primary data before full refresh. [2025-10-28T18:35:56.346863] [INFO ] [LOCAL ] EQNR: Starting deletion of primary data. [2025-10-28T18:35:56.347595] [DEBUG] [LOCAL ] EQNR: Deleted primary data file. [2025-10-28T18:35:56.347685] [INFO ] [MAIN ] EQNR: Starting full primary refresh. [2025-10-28T18:35:56.712622] [INFO ] [REMOTE ] EQNR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:35:56.742876] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-28T18:35:56.759302] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-06. [2025-10-28T18:35:57.329428] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-28T18:35:57.559315] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-09. [2025-10-28T18:35:58.003769] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-28T18:35:58.059943] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-09 (3.70 seconds). [2025-10-28T18:35:58.174888] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-28T18:35:58.359348] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-10. [2025-10-28T18:35:59.159319] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-07. [2025-10-28T18:35:59.959351] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-01. [2025-10-28T18:36:00.759466] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-10. [2025-10-28T18:36:01.669627] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-28T18:36:01.672613] [INFO ] [REMOTE ] EQBK: Full fetch complete (15554 records). [2025-10-28T18:36:01.672734] [DEBUG] [VALIDATOR ] EQBK: Validating primary data. [2025-10-28T18:36:01.673138] [FATAL] [VALIDATOR ] EQBK: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T18:36:01.673220] [FATAL] [MAIN ] EQBK: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:36:01.673266] [WARN ] [MAIN ] EQBK: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:36:01.673306] [INFO ] [LOCAL ] EQBK: Starting deletion of primary data. [2025-10-28T18:36:01.673363] [DEBUG] [LOCAL ] EQBK: No primary data file found to delete. [2025-10-28T18:36:01.673399] [INFO ] [LOCAL ] EQBK: Starting deletion of derivative data. [2025-10-28T18:36:01.673440] [DEBUG] [LOCAL ] EQBK: No derivative data file found to delete. [2025-10-28T18:36:01.673492] [INFO ] [MAIN ] Update Progress: 755/2366 symbols completed. EQBK took 30.4s. Estimated remaining: 3h 24m 48s. Rate: 7.9 symbols/min [2025-10-28T18:36:01.880952] [INFO ] [MAIN ] EQR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:36:01.936479] [DEBUG] [LOCAL ] EQR: Loaded 51787 existing records from primary storage. [2025-10-28T18:36:01.936880] [INFO ] [MAIN ] EQR: Loaded 51787 existing records. [2025-10-28T18:36:02.139614] [WARN ] [MAIN ] EQR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:36:02.139879] [INFO ] [MAIN ] EQR: Wiping existing primary data before full refresh. [2025-10-28T18:36:02.139955] [INFO ] [LOCAL ] EQR: Starting deletion of primary data. [2025-10-28T18:36:02.140413] [DEBUG] [LOCAL ] EQR: Deleted primary data file. [2025-10-28T18:36:02.140473] [INFO ] [MAIN ] EQR: Starting full primary refresh. [2025-10-28T18:36:02.350702] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-01 (2.39 seconds). [2025-10-28T18:36:02.429426] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-02. [2025-10-28T18:36:02.567341] [INFO ] [REMOTE ] EQR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:36:02.581398] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-01. [2025-10-28T18:36:02.585077] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-10 (4.23 seconds). [2025-10-28T18:36:02.597162] [INFO ] [REMOTE ] EPD: Full fetch complete (77775 records). [2025-10-28T18:36:02.597357] [DEBUG] [VALIDATOR ] EPD: Validating primary data. [2025-10-28T18:36:03.013633] [DEBUG] [VALIDATOR ] EPD: All expected trading days are present. [2025-10-28T18:36:03.013745] [DEBUG] [VALIDATOR ] EPD: Primary data validation passed. [2025-10-28T18:36:03.014635] [INFO ] [MAIN ] EPD: Fetched primary data is valid. [2025-10-28T18:36:03.014721] [DEBUG] [LOCAL ] EPD: Saving primary data. [2025-10-28T18:36:03.016194] [DEBUG] [LOCAL ] EPD: Trimmed 77775 records to 53606 (keeping 200 days of data) [2025-10-28T18:36:03.328774] [DEBUG] [LOCAL ] EPD: Primary data saved (53606 records). [2025-10-28T18:36:03.329025] [INFO ] [MAIN ] EPD: Full history saved. [2025-10-28T18:36:03.329173] [INFO ] [MAIN ] Update Progress: 756/2366 symbols completed. EPD took 51.9s. Estimated remaining: 3h 24m 27s. Rate: 7.9 symbols/min [2025-10-28T18:36:03.494884] [INFO ] [MAIN ] EQS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:36:03.495090] [DEBUG] [LOCAL ] EQS: No existing data file found in primary storage. [2025-10-28T18:36:03.495141] [WARN ] [MAIN ] EQS: No existing data found, performing full refresh instead. [2025-10-28T18:36:03.495245] [INFO ] [MAIN ] EQS: Wiping existing primary data before full refresh. [2025-10-28T18:36:03.495303] [INFO ] [LOCAL ] EQS: Starting deletion of primary data. [2025-10-28T18:36:03.495344] [DEBUG] [LOCAL ] EQS: No primary data file found to delete. [2025-10-28T18:36:03.495390] [INFO ] [MAIN ] EQS: Starting full primary refresh. [2025-10-28T18:36:03.855403] [INFO ] [REMOTE ] EQS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:36:03.855945] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-01. [2025-10-28T18:36:03.885855] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-28T18:36:03.959318] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-03. [2025-10-28T18:36:04.487388] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-28T18:36:04.759376] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-02. [2025-10-28T18:36:05.080800] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-10-28T18:36:05.470764] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-07 (6.31 seconds). [2025-10-28T18:36:05.559338] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-08. [2025-10-28T18:36:06.359388] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-03. [2025-10-28T18:36:06.653958] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-03 (0.29 seconds). [2025-10-28T18:36:07.159371] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-04. [2025-10-28T18:36:07.442386] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-04 (0.28 seconds). [2025-10-28T18:36:07.506304] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-01 (4.92 seconds). [2025-10-28T18:36:07.959335] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-02. [2025-10-28T18:36:08.759371] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-05. [2025-10-28T18:36:09.050716] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-05 (0.29 seconds). [2025-10-28T18:36:09.200680] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-28T18:36:09.559307] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-06. [2025-10-28T18:36:09.800700] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-06 (0.24 seconds). [2025-10-28T18:36:10.050197] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-03 (6.09 seconds). [2025-10-28T18:36:10.359382] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-07. [2025-10-28T18:36:10.732881] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-10-28T18:36:11.159313] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-08. [2025-10-28T18:36:11.737097] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-28T18:36:11.959321] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-03. [2025-10-28T18:36:12.759326] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-04. [2025-10-28T18:36:13.267639] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-28T18:36:13.323595] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-08 (7.76 seconds). [2025-10-28T18:36:13.559345] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-04. [2025-10-28T18:36:14.249735] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-28T18:36:14.359308] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-09. [2025-10-28T18:36:14.872054] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-28T18:36:15.159314] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-05. [2025-10-28T18:36:15.959322] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-10. [2025-10-28T18:36:16.376789] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-04 (2.82 seconds). [2025-10-28T18:36:16.389618] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-28T18:36:16.390722] [INFO ] [REMOTE ] EQS: Full fetch complete (2354 records). [2025-10-28T18:36:16.390790] [DEBUG] [VALIDATOR ] EQS: Validating primary data. [2025-10-28T18:36:16.578555] [WARN ] [VALIDATOR ] EQS: Validation failed - insufficient historical data. Have 189 unique days, need 200 days [2025-10-28T18:36:16.578876] [FATAL] [MAIN ] EQS: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:36:16.578953] [WARN ] [MAIN ] EQS: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:36:16.579112] [INFO ] [LOCAL ] EQS: Starting deletion of primary data. [2025-10-28T18:36:16.579258] [DEBUG] [LOCAL ] EQS: No primary data file found to delete. [2025-10-28T18:36:16.579318] [INFO ] [LOCAL ] EQS: Starting deletion of derivative data. [2025-10-28T18:36:16.579443] [DEBUG] [LOCAL ] EQS: No derivative data file found to delete. [2025-10-28T18:36:16.579536] [INFO ] [MAIN ] Update Progress: 757/2366 symbols completed. EQS took 13.3s. Estimated remaining: 3h 24m 32s. Rate: 7.9 symbols/min [2025-10-28T18:36:16.609750] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-10-28T18:36:16.759307] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-09. [2025-10-28T18:36:17.559400] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-06. [2025-10-28T18:36:18.191949] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-28T18:36:18.359334] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-05. [2025-10-28T18:36:18.990335] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-28T18:36:19.159327] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-10. [2025-10-28T18:36:19.697180] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-28T18:36:19.959340] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-06. [2025-10-28T18:36:20.514881] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-28T18:36:20.525388] [INFO ] [REMOTE ] EQH: Full fetch complete (76596 records). [2025-10-28T18:36:20.525538] [DEBUG] [VALIDATOR ] EQH: Validating primary data. [2025-10-28T18:36:20.764740] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-07. [2025-10-28T18:36:20.917353] [DEBUG] [VALIDATOR ] EQH: All expected trading days are present. [2025-10-28T18:36:20.917434] [DEBUG] [VALIDATOR ] EQH: Primary data validation passed. [2025-10-28T18:36:20.918322] [INFO ] [MAIN ] EQH: Fetched primary data is valid. [2025-10-28T18:36:20.918384] [DEBUG] [LOCAL ] EQH: Saving primary data. [2025-10-28T18:36:20.919924] [DEBUG] [LOCAL ] EQH: Trimmed 76596 records to 52655 (keeping 200 days of data) [2025-10-28T18:36:21.233605] [DEBUG] [LOCAL ] EQH: Primary data saved (52655 records). [2025-10-28T18:36:21.233795] [INFO ] [MAIN ] EQH: Full history saved. [2025-10-28T18:36:21.234572] [INFO ] [MAIN ] Update Progress: 758/2366 symbols completed. EQH took 35.1s. Estimated remaining: 3h 24m 18s. Rate: 7.9 symbols/min [2025-10-28T18:36:22.537910] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-10-28T18:36:22.550237] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-08. [2025-10-28T18:36:23.998554] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-28T18:36:24.010245] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-09. [2025-10-28T18:36:25.269681] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-06 (5.31 seconds). [2025-10-28T18:36:25.281197] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-07. [2025-10-28T18:36:28.144611] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-09 (4.13 seconds). [2025-10-28T18:36:28.156866] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-10. [2025-10-28T18:36:31.387724] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-07 (6.11 seconds). [2025-10-28T18:36:31.399394] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-08. [2025-10-28T18:36:32.556814] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-10 (4.40 seconds). [2025-10-28T18:36:32.567923] [INFO ] [REMOTE ] EQNR: Full fetch complete (77018 records). [2025-10-28T18:36:32.568162] [DEBUG] [VALIDATOR ] EQNR: Validating primary data. [2025-10-28T18:36:32.702785] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-28T18:36:32.775253] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-09. [2025-10-28T18:36:33.018927] [DEBUG] [VALIDATOR ] EQNR: All expected trading days are present. [2025-10-28T18:36:33.019032] [DEBUG] [VALIDATOR ] EQNR: Primary data validation passed. [2025-10-28T18:36:33.020005] [INFO ] [MAIN ] EQNR: Fetched primary data is valid. [2025-10-28T18:36:33.020079] [DEBUG] [LOCAL ] EQNR: Saving primary data. [2025-10-28T18:36:33.021553] [DEBUG] [LOCAL ] EQNR: Trimmed 77018 records to 53041 (keeping 200 days of data) [2025-10-28T18:36:33.356530] [DEBUG] [LOCAL ] EQNR: Primary data saved (53041 records). [2025-10-28T18:36:33.356695] [INFO ] [MAIN ] EQNR: Full history saved. [2025-10-28T18:36:33.356785] [INFO ] [MAIN ] Update Progress: 759/2366 symbols completed. EQNR took 37.4s. Estimated remaining: 3h 24m 20s. Rate: 7.9 symbols/min [2025-10-28T18:36:34.108675] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-28T18:36:34.123115] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-10. [2025-10-28T18:36:39.144362] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-10 (5.02 seconds). [2025-10-28T18:36:39.154697] [INFO ] [REMOTE ] EQR: Full fetch complete (74257 records). [2025-10-28T18:36:39.154850] [DEBUG] [VALIDATOR ] EQR: Validating primary data. [2025-10-28T18:36:39.155528] [FATAL] [VALIDATOR ] EQR: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T18:36:39.155628] [FATAL] [MAIN ] EQR: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:36:39.155732] [WARN ] [MAIN ] EQR: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:36:39.155816] [INFO ] [LOCAL ] EQR: Starting deletion of primary data. [2025-10-28T18:36:39.155917] [DEBUG] [LOCAL ] EQR: No primary data file found to delete. [2025-10-28T18:36:39.155972] [INFO ] [LOCAL ] EQR: Starting deletion of derivative data. [2025-10-28T18:36:39.156152] [DEBUG] [LOCAL ] EQR: Deleted derivative data file. [2025-10-28T18:36:39.156248] [INFO ] [MAIN ] Update Progress: 760/2366 symbols completed. EQR took 37.5s. Estimated remaining: 3h 24m 8s. Rate: 7.9 symbols/min [2025-10-28T18:36:39.901013] [INFO ] [MAIN ] ERO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:36:39.900090] [INFO ] [MAIN ] EQV: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:36:39.974617] [INFO ] [MAIN ] EQT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:36:39.995311] [INFO ] [MAIN ] ERJ: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:36:39.998736] [DEBUG] [LOCAL ] EQV: Loaded 2764 existing records from primary storage. [2025-10-28T18:36:39.999912] [INFO ] [MAIN ] EQV: Loaded 2764 existing records. [2025-10-28T18:36:40.201706] [WARN ] [MAIN ] EQV: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:36:40.202112] [INFO ] [MAIN ] EQV: Wiping existing primary data before full refresh. [2025-10-28T18:36:40.202171] [INFO ] [LOCAL ] EQV: Starting deletion of primary data. [2025-10-28T18:36:40.215139] [DEBUG] [LOCAL ] EQV: Deleted primary data file. [2025-10-28T18:36:40.238915] [INFO ] [MAIN ] EQV: Starting full primary refresh. [2025-10-28T18:36:40.240499] [DEBUG] [LOCAL ] ERO: Loaded 42023 existing records from primary storage. [2025-10-28T18:36:40.288840] [INFO ] [MAIN ] ERO: Loaded 42023 existing records. [2025-10-28T18:36:40.384323] [DEBUG] [LOCAL ] ERJ: Loaded 50207 existing records from primary storage. [2025-10-28T18:36:40.431372] [DEBUG] [LOCAL ] EQT: Loaded 53684 existing records from primary storage. [2025-10-28T18:36:40.430676] [INFO ] [MAIN ] ERJ: Loaded 50207 existing records. [2025-10-28T18:36:40.512801] [INFO ] [MAIN ] EQT: Loaded 53684 existing records. [2025-10-28T18:36:41.031161] [WARN ] [MAIN ] ERJ: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:36:41.082768] [WARN ] [MAIN ] ERO: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:36:41.108784] [INFO ] [MAIN ] ERJ: Wiping existing primary data before full refresh. [2025-10-28T18:36:41.126810] [INFO ] [LOCAL ] ERJ: Starting deletion of primary data. [2025-10-28T18:36:41.132073] [INFO ] [MAIN ] ERO: Wiping existing primary data before full refresh. [2025-10-28T18:36:41.158251] [INFO ] [LOCAL ] ERO: Starting deletion of primary data. [2025-10-28T18:36:41.190766] [DEBUG] [LOCAL ] ERO: Deleted primary data file. [2025-10-28T18:36:41.188966] [DEBUG] [LOCAL ] ERJ: Deleted primary data file. [2025-10-28T18:36:41.195297] [INFO ] [MAIN ] ERO: Starting full primary refresh. [2025-10-28T18:36:41.198467] [WARN ] [MAIN ] EQT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:36:41.198892] [INFO ] [MAIN ] EQT: Wiping existing primary data before full refresh. [2025-10-28T18:36:41.204129] [INFO ] [LOCAL ] EQT: Starting deletion of primary data. [2025-10-28T18:36:41.204206] [INFO ] [MAIN ] ERJ: Starting full primary refresh. [2025-10-28T18:36:41.261612] [DEBUG] [LOCAL ] EQT: Deleted primary data file. [2025-10-28T18:36:41.352763] [INFO ] [MAIN ] EQT: Starting full primary refresh. [2025-10-28T18:36:41.460988] [INFO ] [REMOTE ] EQV: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:36:41.580201] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-01. [2025-10-28T18:36:42.364371] [INFO ] [REMOTE ] ERO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:36:42.403471] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-01. [2025-10-28T18:36:42.438344] [INFO ] [REMOTE ] ERJ: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:36:42.448911] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-01. [2025-10-28T18:36:42.450441] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-28T18:36:42.442554] [INFO ] [REMOTE ] EQT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:36:42.452971] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-02. [2025-10-28T18:36:42.453228] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-01. [2025-10-28T18:36:42.868802] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-28T18:36:42.870427] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-03. [2025-10-28T18:36:43.249168] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-10-28T18:36:43.250491] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-04. [2025-10-28T18:36:43.549108] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-04 (0.30 seconds). [2025-10-28T18:36:43.550440] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-05. [2025-10-28T18:36:43.612238] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-28T18:36:43.620631] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-02. [2025-10-28T18:36:43.831821] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-28T18:36:43.842510] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-02. [2025-10-28T18:36:43.946010] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-10-28T18:36:43.947780] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-06. [2025-10-28T18:36:43.973764] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-28T18:36:43.983575] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-02. [2025-10-28T18:36:44.446387] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-28T18:36:44.448022] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-07. [2025-10-28T18:36:44.674817] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-28T18:36:44.683134] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-03. [2025-10-28T18:36:44.812423] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-10-28T18:36:44.813600] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-08. [2025-10-28T18:36:45.170339] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-10-28T18:36:45.172181] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-09. [2025-10-28T18:36:45.341177] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-28T18:36:45.351617] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-03. [2025-10-28T18:36:45.470558] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-09 (0.30 seconds). [2025-10-28T18:36:45.471844] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-10. [2025-10-28T18:36:45.722607] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-28T18:36:45.732023] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-04. [2025-10-28T18:36:46.075548] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-10-28T18:36:46.085631] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-03. [2025-10-28T18:36:46.220550] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-28T18:36:46.221889] [INFO ] [REMOTE ] EQV: Full fetch complete (4815 records). [2025-10-28T18:36:46.221966] [DEBUG] [VALIDATOR ] EQV: Validating primary data. [2025-10-28T18:36:46.590347] [DEBUG] [VALIDATOR ] EQV: All expected trading days are present. [2025-10-28T18:36:46.590432] [DEBUG] [VALIDATOR ] EQV: Primary data validation passed. [2025-10-28T18:36:46.590595] [INFO ] [MAIN ] EQV: Fetched primary data is valid. [2025-10-28T18:36:46.590760] [DEBUG] [LOCAL ] EQV: Saving primary data. [2025-10-28T18:36:46.591125] [DEBUG] [LOCAL ] EQV: Trimmed 4815 records to 2819 (keeping 200 days of data) [2025-10-28T18:36:46.607263] [DEBUG] [LOCAL ] EQV: Primary data saved (2819 records). [2025-10-28T18:36:46.607345] [INFO ] [MAIN ] EQV: Full history saved. [2025-10-28T18:36:46.607495] [INFO ] [MAIN ] Update Progress: 761/2366 symbols completed. EQV took 7.5s. Estimated remaining: 3h 24m 0s. Rate: 7.9 symbols/min [2025-10-28T18:36:46.784097] [INFO ] [MAIN ] ES: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:36:46.809743] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-28T18:36:46.819465] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-05. [2025-10-28T18:36:46.856878] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-28T18:36:46.869365] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-04. [2025-10-28T18:36:46.906432] [DEBUG] [LOCAL ] ES: Loaded 52682 existing records from primary storage. [2025-10-28T18:36:46.906780] [INFO ] [MAIN ] ES: Loaded 52682 existing records. [2025-10-28T18:36:47.089191] [WARN ] [MAIN ] ES: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:36:47.089410] [INFO ] [MAIN ] ES: Wiping existing primary data before full refresh. [2025-10-28T18:36:47.089493] [INFO ] [LOCAL ] ES: Starting deletion of primary data. [2025-10-28T18:36:47.090100] [DEBUG] [LOCAL ] ES: Deleted primary data file. [2025-10-28T18:36:47.090177] [INFO ] [MAIN ] ES: Starting full primary refresh. [2025-10-28T18:36:47.447017] [INFO ] [REMOTE ] ES: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:36:47.447415] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-01. [2025-10-28T18:36:47.479320] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-10-28T18:36:47.490253] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-04. [2025-10-28T18:36:47.885403] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-28T18:36:47.893594] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-06. [2025-10-28T18:36:48.313326] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-28T18:36:48.324427] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-05. [2025-10-28T18:36:48.685274] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-28T18:36:48.696469] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-05. [2025-10-28T18:36:48.944958] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-28T18:36:48.955968] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-02. [2025-10-28T18:36:49.473243] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-28T18:36:49.559291] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-07. [2025-10-28T18:36:49.613856] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-28T18:36:50.188048] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-28T18:36:50.359347] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-03. [2025-10-28T18:36:50.737141] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-10-28T18:36:50.821202] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-28T18:36:51.159348] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-08. [2025-10-28T18:36:51.509888] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-28T18:36:51.959334] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-04. [2025-10-28T18:36:52.195533] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-28T18:36:52.759344] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-06. [2025-10-28T18:36:53.133446] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-28T18:36:53.559366] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-05. [2025-10-28T18:36:54.061311] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-28T18:36:54.359368] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-09. [2025-10-28T18:36:54.902688] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-28T18:36:55.159334] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-07. [2025-10-28T18:36:55.959329] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-06. [2025-10-28T18:36:56.685928] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-09 (2.33 seconds). [2025-10-28T18:36:56.759315] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-10. [2025-10-28T18:36:57.134164] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-28T18:36:57.559417] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-06. [2025-10-28T18:36:58.359404] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-07. [2025-10-28T18:36:58.411447] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-07 (3.25 seconds). [2025-10-28T18:36:59.063260] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-28T18:36:59.159333] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-08. [2025-10-28T18:36:59.827723] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-28T18:36:59.959309] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-08. [2025-10-28T18:37:00.113435] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-10 (3.35 seconds). [2025-10-28T18:37:00.123018] [INFO ] [REMOTE ] ERO: Full fetch complete (60713 records). [2025-10-28T18:37:00.123127] [DEBUG] [VALIDATOR ] ERO: Validating primary data. [2025-10-28T18:37:00.500508] [DEBUG] [VALIDATOR ] ERO: All expected trading days are present. [2025-10-28T18:37:00.500579] [DEBUG] [VALIDATOR ] ERO: Primary data validation passed. [2025-10-28T18:37:00.501347] [INFO ] [MAIN ] ERO: Fetched primary data is valid. [2025-10-28T18:37:00.501409] [DEBUG] [LOCAL ] ERO: Saving primary data. [2025-10-28T18:37:00.502520] [DEBUG] [LOCAL ] ERO: Trimmed 60713 records to 41989 (keeping 200 days of data) [2025-10-28T18:37:00.739725] [DEBUG] [LOCAL ] ERO: Primary data saved (41989 records). [2025-10-28T18:37:00.739888] [INFO ] [MAIN ] ERO: Full history saved. [2025-10-28T18:37:00.739981] [INFO ] [MAIN ] Update Progress: 762/2366 symbols completed. ERO took 21.6s. Estimated remaining: 3h 24m 6s. Rate: 7.9 symbols/min [2025-10-28T18:37:00.770945] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-07. [2025-10-28T18:37:00.910515] [INFO ] [MAIN ] ESAB: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:37:00.934845] [DEBUG] [LOCAL ] ESAB: Loaded 25775 existing records from primary storage. [2025-10-28T18:37:00.935082] [INFO ] [MAIN ] ESAB: Loaded 25775 existing records. [2025-10-28T18:37:01.109213] [WARN ] [MAIN ] ESAB: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:37:01.109401] [INFO ] [MAIN ] ESAB: Wiping existing primary data before full refresh. [2025-10-28T18:37:01.109447] [INFO ] [LOCAL ] ESAB: Starting deletion of primary data. [2025-10-28T18:37:01.110047] [DEBUG] [LOCAL ] ESAB: Deleted primary data file. [2025-10-28T18:37:01.110104] [INFO ] [MAIN ] ESAB: Starting full primary refresh. [2025-10-28T18:37:01.473547] [INFO ] [REMOTE ] ESAB: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:37:01.514916] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-28T18:37:01.559377] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-01. [2025-10-28T18:37:01.868471] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-08 (2.71 seconds). [2025-10-28T18:37:02.359369] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-09. [2025-10-28T18:37:02.681738] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-10-28T18:37:03.159396] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-09. [2025-10-28T18:37:03.365815] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-10-28T18:37:03.694313] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-28T18:37:03.959350] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-08. [2025-10-28T18:37:04.520118] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-28T18:37:04.759392] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-10. [2025-10-28T18:37:05.545767] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-28T18:37:05.559293] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-09. [2025-10-28T18:37:06.308226] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-28T18:37:06.318715] [INFO ] [REMOTE ] ES: Full fetch complete (76476 records). [2025-10-28T18:37:06.318846] [DEBUG] [VALIDATOR ] ES: Validating primary data. [2025-10-28T18:37:06.364433] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-10. [2025-10-28T18:37:06.706234] [DEBUG] [VALIDATOR ] ES: All expected trading days are present. [2025-10-28T18:37:06.706331] [DEBUG] [VALIDATOR ] ES: Primary data validation passed. [2025-10-28T18:37:06.707442] [INFO ] [MAIN ] ES: Fetched primary data is valid. [2025-10-28T18:37:06.707519] [DEBUG] [LOCAL ] ES: Saving primary data. [2025-10-28T18:37:06.708929] [DEBUG] [LOCAL ] ES: Trimmed 76476 records to 52680 (keeping 200 days of data) [2025-10-28T18:37:07.025586] [DEBUG] [LOCAL ] ES: Primary data saved (52680 records). [2025-10-28T18:37:07.025762] [INFO ] [MAIN ] ES: Full history saved. [2025-10-28T18:37:07.026318] [INFO ] [MAIN ] Update Progress: 763/2366 symbols completed. ES took 20.4s. Estimated remaining: 3h 23m 56s. Rate: 7.9 symbols/min [2025-10-28T18:37:07.160399] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-02. [2025-10-28T18:37:07.170958] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-28T18:37:07.250178] [INFO ] [MAIN ] ESE: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:37:07.268387] [DEBUG] [LOCAL ] ESE: Loaded 16199 existing records from primary storage. [2025-10-28T18:37:07.268617] [INFO ] [MAIN ] ESE: Loaded 16199 existing records. [2025-10-28T18:37:07.441451] [WARN ] [MAIN ] ESE: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:37:07.441639] [INFO ] [MAIN ] ESE: Wiping existing primary data before full refresh. [2025-10-28T18:37:07.441718] [INFO ] [LOCAL ] ESE: Starting deletion of primary data. [2025-10-28T18:37:07.442092] [DEBUG] [LOCAL ] ESE: Deleted primary data file. [2025-10-28T18:37:07.442147] [INFO ] [MAIN ] ESE: Starting full primary refresh. [2025-10-28T18:37:07.786062] [INFO ] [REMOTE ] ESE: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:37:07.959360] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-10. [2025-10-28T18:37:08.055971] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-28T18:37:08.066534] [INFO ] [REMOTE ] ERJ: Full fetch complete (73173 records). [2025-10-28T18:37:08.066698] [DEBUG] [VALIDATOR ] ERJ: Validating primary data. [2025-10-28T18:37:08.460595] [DEBUG] [VALIDATOR ] ERJ: All expected trading days are present. [2025-10-28T18:37:08.460712] [DEBUG] [VALIDATOR ] ERJ: Primary data validation passed. [2025-10-28T18:37:08.461575] [INFO ] [MAIN ] ERJ: Fetched primary data is valid. [2025-10-28T18:37:08.461619] [DEBUG] [LOCAL ] ERJ: Saving primary data. [2025-10-28T18:37:08.463053] [DEBUG] [LOCAL ] ERJ: Trimmed 73173 records to 50209 (keeping 200 days of data) [2025-10-28T18:37:08.673380] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-28T18:37:08.767867] [DEBUG] [LOCAL ] ERJ: Primary data saved (50209 records). [2025-10-28T18:37:08.763973] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-03. [2025-10-28T18:37:08.768006] [INFO ] [MAIN ] ERJ: Full history saved. [2025-10-28T18:37:08.768584] [INFO ] [MAIN ] Update Progress: 764/2366 symbols completed. ERJ took 29.6s. Estimated remaining: 3h 23m 36s. Rate: 7.9 symbols/min [2025-10-28T18:37:08.939144] [INFO ] [MAIN ] ESI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:37:08.992468] [DEBUG] [LOCAL ] ESI: Loaded 50575 existing records from primary storage. [2025-10-28T18:37:08.992794] [INFO ] [MAIN ] ESI: Loaded 50575 existing records. [2025-10-28T18:37:09.194397] [WARN ] [MAIN ] ESI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:37:09.194616] [INFO ] [MAIN ] ESI: Wiping existing primary data before full refresh. [2025-10-28T18:37:09.194695] [INFO ] [LOCAL ] ESI: Starting deletion of primary data. [2025-10-28T18:37:09.195171] [DEBUG] [LOCAL ] ESI: Deleted primary data file. [2025-10-28T18:37:09.195231] [INFO ] [MAIN ] ESI: Starting full primary refresh. [2025-10-28T18:37:09.568457] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-01. [2025-10-28T18:37:09.572179] [INFO ] [REMOTE ] ESI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:37:09.655141] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-28T18:37:09.666448] [INFO ] [REMOTE ] EQT: Full fetch complete (77469 records). [2025-10-28T18:37:09.666857] [DEBUG] [VALIDATOR ] EQT: Validating primary data. [2025-10-28T18:37:09.668006] [FATAL] [VALIDATOR ] EQT: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T18:37:09.668163] [FATAL] [MAIN ] EQT: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:37:09.668295] [WARN ] [MAIN ] EQT: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:37:09.677582] [INFO ] [LOCAL ] EQT: Starting deletion of primary data. [2025-10-28T18:37:09.683590] [DEBUG] [LOCAL ] EQT: No primary data file found to delete. [2025-10-28T18:37:09.683897] [INFO ] [LOCAL ] EQT: Starting deletion of derivative data. [2025-10-28T18:37:09.684857] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-28T18:37:09.691103] [DEBUG] [LOCAL ] EQT: Deleted derivative data file. [2025-10-28T18:37:09.691515] [INFO ] [MAIN ] Update Progress: 765/2366 symbols completed. EQT took 30.5s. Estimated remaining: 3h 23m 14s. Rate: 7.9 symbols/min [2025-10-28T18:37:09.854558] [INFO ] [MAIN ] ESNT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:37:09.886351] [DEBUG] [LOCAL ] ESNT: Loaded 37618 existing records from primary storage. [2025-10-28T18:37:09.886666] [INFO ] [MAIN ] ESNT: Loaded 37618 existing records. [2025-10-28T18:37:10.068075] [WARN ] [MAIN ] ESNT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:37:10.068253] [INFO ] [MAIN ] ESNT: Wiping existing primary data before full refresh. [2025-10-28T18:37:10.068299] [INFO ] [LOCAL ] ESNT: Starting deletion of primary data. [2025-10-28T18:37:10.068981] [DEBUG] [LOCAL ] ESNT: Deleted primary data file. [2025-10-28T18:37:10.069037] [INFO ] [MAIN ] ESNT: Starting full primary refresh. [2025-10-28T18:37:10.362448] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-01. [2025-10-28T18:37:10.442023] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-28T18:37:10.441001] [INFO ] [REMOTE ] ESNT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:37:11.159326] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-01. [2025-10-28T18:37:11.658601] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-28T18:37:11.959334] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-04. [2025-10-28T18:37:12.537393] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-28T18:37:12.759347] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-02. [2025-10-28T18:37:12.948522] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-28T18:37:13.559331] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-02. [2025-10-28T18:37:13.808084] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-28T18:37:14.359321] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-05. [2025-10-28T18:37:14.779248] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-28T18:37:15.091828] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-28T18:37:15.159440] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-02. [2025-10-28T18:37:15.959313] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-03. [2025-10-28T18:37:16.731060] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-10-28T18:37:16.759291] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-03. [2025-10-28T18:37:16.841088] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-28T18:37:17.559351] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-04. [2025-10-28T18:37:18.359373] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-03. [2025-10-28T18:37:18.533678] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-28T18:37:18.675406] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-28T18:37:19.097166] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-28T18:37:19.159304] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-04. [2025-10-28T18:37:19.829732] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-28T18:37:19.959372] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-06. [2025-10-28T18:37:20.704139] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-28T18:37:20.759307] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-07. [2025-10-28T18:37:21.559306] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-05. [2025-10-28T18:37:21.625403] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-28T18:37:22.359313] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-04. [2025-10-28T18:37:22.637102] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-28T18:37:23.159417] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-08. [2025-10-28T18:37:23.511567] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-28T18:37:23.959438] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-05. [2025-10-28T18:37:24.210788] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-28T18:37:24.759361] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-09. [2025-10-28T18:37:25.102753] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-28T18:37:25.559325] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-06. [2025-10-28T18:37:25.622673] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-28T18:37:26.239349] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-28T18:37:26.359371] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-07. [2025-10-28T18:37:27.091230] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-28T18:37:27.159378] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-08. [2025-10-28T18:37:27.959316] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-10. [2025-10-28T18:37:27.984193] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-28T18:37:28.759307] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-06. [2025-10-28T18:37:28.950266] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-28T18:37:28.955825] [INFO ] [REMOTE ] ESAB: Full fetch complete (36562 records). [2025-10-28T18:37:28.955908] [DEBUG] [VALIDATOR ] ESAB: Validating primary data. [2025-10-28T18:37:29.340383] [DEBUG] [VALIDATOR ] ESAB: All expected trading days are present. [2025-10-28T18:37:29.340450] [DEBUG] [VALIDATOR ] ESAB: Primary data validation passed. [2025-10-28T18:37:29.341023] [INFO ] [MAIN ] ESAB: Fetched primary data is valid. [2025-10-28T18:37:29.341085] [DEBUG] [LOCAL ] ESAB: Saving primary data. [2025-10-28T18:37:29.341868] [DEBUG] [LOCAL ] ESAB: Trimmed 36562 records to 25690 (keeping 200 days of data) [2025-10-28T18:37:29.497893] [DEBUG] [LOCAL ] ESAB: Primary data saved (25690 records). [2025-10-28T18:37:29.498029] [INFO ] [MAIN ] ESAB: Full history saved. [2025-10-28T18:37:29.498158] [INFO ] [MAIN ] Update Progress: 766/2366 symbols completed. ESAB took 28.8s. Estimated remaining: 3h 23m 32s. Rate: 7.9 symbols/min [2025-10-28T18:37:29.563132] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-09. [2025-10-28T18:37:29.677878] [INFO ] [MAIN ] ESRT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:37:29.716459] [DEBUG] [LOCAL ] ESRT: Loaded 46460 existing records from primary storage. [2025-10-28T18:37:29.717011] [INFO ] [MAIN ] ESRT: Loaded 46460 existing records. [2025-10-28T18:37:29.811392] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-28T18:37:29.920341] [WARN ] [MAIN ] ESRT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:37:29.920554] [INFO ] [MAIN ] ESRT: Wiping existing primary data before full refresh. [2025-10-28T18:37:29.920602] [INFO ] [LOCAL ] ESRT: Starting deletion of primary data. [2025-10-28T18:37:29.921372] [DEBUG] [LOCAL ] ESRT: Deleted primary data file. [2025-10-28T18:37:29.921429] [INFO ] [MAIN ] ESRT: Starting full primary refresh. [2025-10-28T18:37:30.276066] [INFO ] [REMOTE ] ESRT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:37:30.288103] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-28T18:37:30.359295] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-10. [2025-10-28T18:37:31.120601] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-28T18:37:31.123808] [INFO ] [REMOTE ] ESE: Full fetch complete (22954 records). [2025-10-28T18:37:31.123882] [DEBUG] [VALIDATOR ] ESE: Validating primary data. [2025-10-28T18:37:31.164493] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-01. [2025-10-28T18:37:31.488507] [DEBUG] [VALIDATOR ] ESE: All expected trading days are present. [2025-10-28T18:37:31.488578] [DEBUG] [VALIDATOR ] ESE: Primary data validation passed. [2025-10-28T18:37:31.489044] [INFO ] [MAIN ] ESE: Fetched primary data is valid. [2025-10-28T18:37:31.489104] [DEBUG] [LOCAL ] ESE: Saving primary data. [2025-10-28T18:37:31.489760] [DEBUG] [LOCAL ] ESE: Trimmed 22954 records to 16155 (keeping 200 days of data) [2025-10-28T18:37:31.588087] [DEBUG] [LOCAL ] ESE: Primary data saved (16155 records). [2025-10-28T18:37:31.588212] [INFO ] [MAIN ] ESE: Full history saved. [2025-10-28T18:37:31.588284] [INFO ] [MAIN ] Update Progress: 767/2366 symbols completed. ESE took 24.6s. Estimated remaining: 3h 23m 13s. Rate: 7.9 symbols/min [2025-10-28T18:37:31.774576] [INFO ] [MAIN ] ESS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:37:31.812520] [DEBUG] [LOCAL ] ESS: Loaded 29996 existing records from primary storage. [2025-10-28T18:37:31.812877] [INFO ] [MAIN ] ESS: Loaded 29996 existing records. [2025-10-28T18:37:31.964435] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-07. [2025-10-28T18:37:31.992532] [WARN ] [MAIN ] ESS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:37:31.992702] [INFO ] [MAIN ] ESS: Wiping existing primary data before full refresh. [2025-10-28T18:37:31.992755] [INFO ] [LOCAL ] ESS: Starting deletion of primary data. [2025-10-28T18:37:31.993300] [DEBUG] [LOCAL ] ESS: Deleted primary data file. [2025-10-28T18:37:31.993355] [INFO ] [MAIN ] ESS: Starting full primary refresh. [2025-10-28T18:37:32.338856] [INFO ] [REMOTE ] ESS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:37:32.549925] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-28T18:37:32.759395] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-05. [2025-10-28T18:37:33.334852] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-28T18:37:33.559332] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-08. [2025-10-28T18:37:34.177267] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-28T18:37:34.359308] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-02. [2025-10-28T18:37:34.612857] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-28T18:37:35.159325] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-09. [2025-10-28T18:37:35.346351] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-28T18:37:35.959369] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-03. [2025-10-28T18:37:36.267727] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-28T18:37:36.759328] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-01. [2025-10-28T18:37:37.160904] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-28T18:37:37.559372] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-10. [2025-10-28T18:37:37.806592] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-28T18:37:38.359340] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-02. [2025-10-28T18:37:38.801854] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-28T18:37:38.812291] [INFO ] [REMOTE ] ESNT: Full fetch complete (56641 records). [2025-10-28T18:37:38.812436] [DEBUG] [VALIDATOR ] ESNT: Validating primary data. [2025-10-28T18:37:38.813136] [FATAL] [VALIDATOR ] ESNT: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T18:37:38.813234] [FATAL] [MAIN ] ESNT: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:37:38.813301] [WARN ] [MAIN ] ESNT: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:37:38.813396] [INFO ] [LOCAL ] ESNT: Starting deletion of primary data. [2025-10-28T18:37:38.813497] [DEBUG] [LOCAL ] ESNT: No primary data file found to delete. [2025-10-28T18:37:38.813568] [INFO ] [LOCAL ] ESNT: Starting deletion of derivative data. [2025-10-28T18:37:38.813890] [DEBUG] [LOCAL ] ESNT: Deleted derivative data file. [2025-10-28T18:37:38.814028] [INFO ] [MAIN ] Update Progress: 768/2366 symbols completed. ESNT took 29.1s. Estimated remaining: 3h 23m 4s. Rate: 7.9 symbols/min [2025-10-28T18:37:38.980962] [INFO ] [MAIN ] ESTC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:37:39.022087] [DEBUG] [LOCAL ] ESTC: Loaded 50185 existing records from primary storage. [2025-10-28T18:37:39.022404] [INFO ] [MAIN ] ESTC: Loaded 50185 existing records. [2025-10-28T18:37:39.164453] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-04. [2025-10-28T18:37:39.200904] [WARN ] [MAIN ] ESTC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:37:39.201074] [INFO ] [MAIN ] ESTC: Wiping existing primary data before full refresh. [2025-10-28T18:37:39.201133] [INFO ] [LOCAL ] ESTC: Starting deletion of primary data. [2025-10-28T18:37:39.202022] [DEBUG] [LOCAL ] ESTC: Deleted primary data file. [2025-10-28T18:37:39.202078] [INFO ] [MAIN ] ESTC: Starting full primary refresh. [2025-10-28T18:37:39.565218] [INFO ] [REMOTE ] ESTC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:37:39.581237] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-28T18:37:39.959334] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-03. [2025-10-28T18:37:40.418534] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-28T18:37:40.752745] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-28T18:37:40.759289] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-04. [2025-10-28T18:37:41.559314] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-01. [2025-10-28T18:37:41.711574] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-28T18:37:42.359395] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-05. [2025-10-28T18:37:43.049977] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-28T18:37:43.159316] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-02. [2025-10-28T18:37:43.361443] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-28T18:37:43.959376] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-05. [2025-10-28T18:37:44.296133] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-28T18:37:44.759317] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-03. [2025-10-28T18:37:44.857009] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-28T18:37:45.559329] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-06. [2025-10-28T18:37:45.978740] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-28T18:37:46.359340] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-06. [2025-10-28T18:37:46.807255] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-28T18:37:47.159293] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-06. [2025-10-28T18:37:47.293507] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-28T18:37:47.959342] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-07. [2025-10-28T18:37:48.277928] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-28T18:37:48.759350] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-04. [2025-10-28T18:37:49.138875] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-28T18:37:49.559350] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-07. [2025-10-28T18:37:50.014065] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-28T18:37:50.359340] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-08. [2025-10-28T18:37:50.916284] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-28T18:37:51.159348] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-07. [2025-10-28T18:37:51.442052] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-28T18:37:51.959330] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-05. [2025-10-28T18:37:52.423440] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-28T18:37:52.759396] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-09. [2025-10-28T18:37:53.419501] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-10-28T18:37:53.559345] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-08. [2025-10-28T18:37:54.055338] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-28T18:37:54.359341] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-10. [2025-10-28T18:37:54.584901] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-28T18:37:55.159340] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-06. [2025-10-28T18:37:55.611721] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-28T18:37:55.621115] [INFO ] [REMOTE ] ESRT: Full fetch complete (66753 records). [2025-10-28T18:37:55.621228] [DEBUG] [VALIDATOR ] ESRT: Validating primary data. [2025-10-28T18:37:55.961301] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-09. [2025-10-28T18:37:56.008098] [DEBUG] [VALIDATOR ] ESRT: All expected trading days are present. [2025-10-28T18:37:56.008173] [DEBUG] [VALIDATOR ] ESRT: Primary data validation passed. [2025-10-28T18:37:56.009084] [INFO ] [MAIN ] ESRT: Fetched primary data is valid. [2025-10-28T18:37:56.009251] [DEBUG] [LOCAL ] ESRT: Saving primary data. [2025-10-28T18:37:56.010615] [DEBUG] [LOCAL ] ESRT: Trimmed 66753 records to 46380 (keeping 200 days of data) [2025-10-28T18:37:56.270264] [DEBUG] [LOCAL ] ESRT: Primary data saved (46380 records). [2025-10-28T18:37:56.270390] [INFO ] [MAIN ] ESRT: Full history saved. [2025-10-28T18:37:56.270464] [INFO ] [MAIN ] Update Progress: 769/2366 symbols completed. ESRT took 26.8s. Estimated remaining: 3h 23m 17s. Rate: 7.9 symbols/min [2025-10-28T18:37:56.444237] [INFO ] [MAIN ] ET: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:37:56.492794] [DEBUG] [LOCAL ] ET: Loaded 53789 existing records from primary storage. [2025-10-28T18:37:56.493086] [INFO ] [MAIN ] ET: Loaded 53789 existing records. [2025-10-28T18:37:56.672085] [WARN ] [MAIN ] ET: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:37:56.672373] [INFO ] [MAIN ] ET: Wiping existing primary data before full refresh. [2025-10-28T18:37:56.672478] [INFO ] [LOCAL ] ET: Starting deletion of primary data. [2025-10-28T18:37:56.673625] [DEBUG] [LOCAL ] ET: Deleted primary data file. [2025-10-28T18:37:56.673711] [INFO ] [MAIN ] ET: Starting full primary refresh. [2025-10-28T18:37:56.766327] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-08. [2025-10-28T18:37:56.975798] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-10-28T18:37:57.079723] [INFO ] [REMOTE ] ET: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:37:57.098191] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-28T18:37:57.559387] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-01. [2025-10-28T18:37:58.194577] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-28T18:37:58.359349] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-07. [2025-10-28T18:37:59.159328] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-09. [2025-10-28T18:37:59.409544] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-28T18:37:59.618173] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-28T18:37:59.959332] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-02. [2025-10-28T18:38:00.350410] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-28T18:38:00.759344] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-08. [2025-10-28T18:38:01.564479] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-10. [2025-10-28T18:38:01.579393] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-28T18:38:02.073073] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-28T18:38:02.359366] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-09. [2025-10-28T18:38:03.013624] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-28T18:38:03.024186] [INFO ] [REMOTE ] ESI: Full fetch complete (73294 records). [2025-10-28T18:38:03.024349] [DEBUG] [VALIDATOR ] ESI: Validating primary data. [2025-10-28T18:38:03.168217] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-03. [2025-10-28T18:38:03.419216] [DEBUG] [VALIDATOR ] ESI: All expected trading days are present. [2025-10-28T18:38:03.419288] [DEBUG] [VALIDATOR ] ESI: Primary data validation passed. [2025-10-28T18:38:03.420124] [INFO ] [MAIN ] ESI: Fetched primary data is valid. [2025-10-28T18:38:03.420185] [DEBUG] [LOCAL ] ESI: Saving primary data. [2025-10-28T18:38:03.421552] [DEBUG] [LOCAL ] ESI: Trimmed 73294 records to 50572 (keeping 200 days of data) [2025-10-28T18:38:03.719726] [DEBUG] [LOCAL ] ESI: Primary data saved (50572 records). [2025-10-28T18:38:03.719848] [INFO ] [MAIN ] ESI: Full history saved. [2025-10-28T18:38:03.719923] [INFO ] [MAIN ] Update Progress: 770/2366 symbols completed. ESI took 55.0s. Estimated remaining: 3h 23m 9s. Rate: 7.9 symbols/min [2025-10-28T18:38:03.893082] [INFO ] [MAIN ] ETB: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:38:03.926967] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-28T18:38:03.942129] [DEBUG] [LOCAL ] ETB: Loaded 11479 existing records from primary storage. [2025-10-28T18:38:03.942474] [INFO ] [MAIN ] ETB: Loaded 11479 existing records. [2025-10-28T18:38:03.964408] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-10. [2025-10-28T18:38:04.118165] [WARN ] [MAIN ] ETB: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:38:04.118318] [INFO ] [MAIN ] ETB: Wiping existing primary data before full refresh. [2025-10-28T18:38:04.118364] [INFO ] [LOCAL ] ETB: Starting deletion of primary data. [2025-10-28T18:38:04.118556] [DEBUG] [LOCAL ] ETB: Deleted primary data file. [2025-10-28T18:38:04.118612] [INFO ] [MAIN ] ETB: Starting full primary refresh. [2025-10-28T18:38:04.478067] [INFO ] [REMOTE ] ETB: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:38:04.759312] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-10. [2025-10-28T18:38:04.912859] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-10-28T18:38:05.181852] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-28T18:38:05.188722] [INFO ] [REMOTE ] ESS: Full fetch complete (43831 records). [2025-10-28T18:38:05.188886] [DEBUG] [VALIDATOR ] ESS: Validating primary data. [2025-10-28T18:38:05.564905] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-04. [2025-10-28T18:38:05.567331] [DEBUG] [VALIDATOR ] ESS: All expected trading days are present. [2025-10-28T18:38:05.567405] [DEBUG] [VALIDATOR ] ESS: Primary data validation passed. [2025-10-28T18:38:05.568843] [INFO ] [MAIN ] ESS: Fetched primary data is valid. [2025-10-28T18:38:05.568907] [DEBUG] [LOCAL ] ESS: Saving primary data. [2025-10-28T18:38:05.569992] [DEBUG] [LOCAL ] ESS: Trimmed 43831 records to 29980 (keeping 200 days of data) [2025-10-28T18:38:05.753684] [DEBUG] [LOCAL ] ESS: Primary data saved (29980 records). [2025-10-28T18:38:05.753813] [INFO ] [MAIN ] ESS: Full history saved. [2025-10-28T18:38:05.753905] [INFO ] [MAIN ] Update Progress: 771/2366 symbols completed. ESS took 34.2s. Estimated remaining: 3h 22m 50s. Rate: 7.9 symbols/min [2025-10-28T18:38:05.933178] [INFO ] [MAIN ] ETD: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:38:05.958434] [DEBUG] [LOCAL ] ETD: Loaded 26664 existing records from primary storage. [2025-10-28T18:38:05.958704] [INFO ] [MAIN ] ETD: Loaded 26664 existing records. [2025-10-28T18:38:06.139937] [WARN ] [MAIN ] ETD: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:38:06.140171] [INFO ] [MAIN ] ETD: Wiping existing primary data before full refresh. [2025-10-28T18:38:06.140268] [INFO ] [LOCAL ] ETD: Starting deletion of primary data. [2025-10-28T18:38:06.140873] [DEBUG] [LOCAL ] ETD: Deleted primary data file. [2025-10-28T18:38:06.140940] [INFO ] [MAIN ] ETD: Starting full primary refresh. [2025-10-28T18:38:06.370033] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-01. [2025-10-28T18:38:06.496043] [INFO ] [REMOTE ] ETD: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:38:06.530982] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-28T18:38:06.545234] [INFO ] [REMOTE ] ESTC: Full fetch complete (72501 records). [2025-10-28T18:38:06.545435] [DEBUG] [VALIDATOR ] ESTC: Validating primary data. [2025-10-28T18:38:06.948887] [DEBUG] [VALIDATOR ] ESTC: All expected trading days are present. [2025-10-28T18:38:06.949093] [DEBUG] [VALIDATOR ] ESTC: Primary data validation passed. [2025-10-28T18:38:06.949984] [INFO ] [MAIN ] ESTC: Fetched primary data is valid. [2025-10-28T18:38:06.950045] [DEBUG] [LOCAL ] ESTC: Saving primary data. [2025-10-28T18:38:06.951354] [DEBUG] [LOCAL ] ESTC: Trimmed 72501 records to 50182 (keeping 200 days of data) [2025-10-28T18:38:07.049099] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-28T18:38:07.166186] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-02. [2025-10-28T18:38:07.255517] [DEBUG] [LOCAL ] ESTC: Primary data saved (50182 records). [2025-10-28T18:38:07.255878] [INFO ] [MAIN ] ESTC: Full history saved. [2025-10-28T18:38:07.255998] [INFO ] [MAIN ] Update Progress: 772/2366 symbols completed. ESTC took 28.4s. Estimated remaining: 3h 22m 30s. Rate: 7.9 symbols/min [2025-10-28T18:38:07.429036] [INFO ] [MAIN ] ETG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:38:07.473247] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-28T18:38:07.479044] [DEBUG] [LOCAL ] ETG: Loaded 16250 existing records from primary storage. [2025-10-28T18:38:07.491215] [INFO ] [MAIN ] ETG: Loaded 16250 existing records. [2025-10-28T18:38:07.667604] [WARN ] [MAIN ] ETG: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:38:07.667871] [INFO ] [MAIN ] ETG: Wiping existing primary data before full refresh. [2025-10-28T18:38:07.667924] [INFO ] [LOCAL ] ETG: Starting deletion of primary data. [2025-10-28T18:38:07.668275] [DEBUG] [LOCAL ] ETG: Deleted primary data file. [2025-10-28T18:38:07.668333] [INFO ] [MAIN ] ETG: Starting full primary refresh. [2025-10-28T18:38:07.962162] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-05. [2025-10-28T18:38:08.068402] [INFO ] [REMOTE ] ETG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:38:08.070332] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-28T18:38:08.759350] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-01. [2025-10-28T18:38:09.559356] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-01. [2025-10-28T18:38:09.911020] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-28T18:38:10.203913] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-05 (2.24 seconds). [2025-10-28T18:38:10.359338] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-03. [2025-10-28T18:38:10.676813] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-28T18:38:10.992453] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-28T18:38:11.159386] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-06. [2025-10-28T18:38:11.959335] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-04. [2025-10-28T18:38:12.577566] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-28T18:38:12.708614] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-28T18:38:12.759357] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-02. [2025-10-28T18:38:13.409234] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-28T18:38:13.559324] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-02. [2025-10-28T18:38:14.218365] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-28T18:38:14.359332] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-03. [2025-10-28T18:38:15.055608] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-28T18:38:15.159352] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-03. [2025-10-28T18:38:15.959388] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-07. [2025-10-28T18:38:16.063849] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-28T18:38:16.759354] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-04. [2025-10-28T18:38:17.416798] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-28T18:38:17.560580] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-05. [2025-10-28T18:38:17.566234] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-28T18:38:18.302784] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-28T18:38:18.359298] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-06. [2025-10-28T18:38:18.914426] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-28T18:38:19.159377] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-07. [2025-10-28T18:38:19.693610] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-28T18:38:19.959352] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-08. [2025-10-28T18:38:20.759338] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-04. [2025-10-28T18:38:21.559354] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-08. [2025-10-28T18:38:21.824258] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-10-28T18:38:21.910675] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-28T18:38:21.934184] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-10-28T18:38:22.359372] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-05. [2025-10-28T18:38:23.117677] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-28T18:38:23.159379] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-09. [2025-10-28T18:38:23.669609] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-28T18:38:23.959354] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-05. [2025-10-28T18:38:24.759333] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-10. [2025-10-28T18:38:24.901599] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-28T18:38:25.323034] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-28T18:38:25.326294] [INFO ] [REMOTE ] ETB: Full fetch complete (18471 records). [2025-10-28T18:38:25.326429] [DEBUG] [VALIDATOR ] ETB: Validating primary data. [2025-10-28T18:38:25.564435] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-06. [2025-10-28T18:38:25.713272] [DEBUG] [VALIDATOR ] ETB: All expected trading days are present. [2025-10-28T18:38:25.713381] [DEBUG] [VALIDATOR ] ETB: Primary data validation passed. [2025-10-28T18:38:25.714298] [INFO ] [MAIN ] ETB: Fetched primary data is valid. [2025-10-28T18:38:25.714365] [DEBUG] [LOCAL ] ETB: Saving primary data. [2025-10-28T18:38:25.715083] [DEBUG] [LOCAL ] ETB: Trimmed 18471 records to 11398 (keeping 200 days of data) [2025-10-28T18:38:25.790430] [DEBUG] [LOCAL ] ETB: Primary data saved (11398 records). [2025-10-28T18:38:25.790618] [INFO ] [MAIN ] ETB: Full history saved. [2025-10-28T18:38:25.790765] [INFO ] [MAIN ] Update Progress: 773/2366 symbols completed. ETB took 22.1s. Estimated remaining: 3h 22m 44s. Rate: 7.9 symbols/min [2025-10-28T18:38:25.966130] [INFO ] [MAIN ] ETJ: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:38:25.983885] [DEBUG] [LOCAL ] ETJ: Loaded 15848 existing records from primary storage. [2025-10-28T18:38:25.984244] [INFO ] [MAIN ] ETJ: Loaded 15848 existing records. [2025-10-28T18:38:26.169129] [WARN ] [MAIN ] ETJ: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:38:26.169411] [INFO ] [MAIN ] ETJ: Wiping existing primary data before full refresh. [2025-10-28T18:38:26.169462] [INFO ] [LOCAL ] ETJ: Starting deletion of primary data. [2025-10-28T18:38:26.169942] [DEBUG] [LOCAL ] ETJ: Deleted primary data file. [2025-10-28T18:38:26.170003] [INFO ] [MAIN ] ETJ: Starting full primary refresh. [2025-10-28T18:38:26.364129] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-06. [2025-10-28T18:38:26.468675] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-28T18:38:26.580807] [INFO ] [REMOTE ] ETJ: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:38:27.159383] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-01. [2025-10-28T18:38:27.243605] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-28T18:38:27.959351] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-07. [2025-10-28T18:38:28.010525] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-28T18:38:28.699220] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-28T18:38:28.759300] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-08. [2025-10-28T18:38:29.559308] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-02. [2025-10-28T18:38:29.619440] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-28T18:38:30.258861] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-28T18:38:30.359305] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-03. [2025-10-28T18:38:31.036316] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-28T18:38:31.159351] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-09. [2025-10-28T18:38:31.959315] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-09. [2025-10-28T18:38:32.056130] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-28T18:38:32.759347] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-07. [2025-10-28T18:38:33.499631] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-28T18:38:33.518147] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-28T18:38:33.559308] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-10. [2025-10-28T18:38:34.359322] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-04. [2025-10-28T18:38:35.052779] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-28T18:38:35.159339] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-10. [2025-10-28T18:38:35.373045] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-28T18:38:35.384623] [INFO ] [REMOTE ] ET: Full fetch complete (77969 records). [2025-10-28T18:38:35.384887] [DEBUG] [VALIDATOR ] ET: Validating primary data. [2025-10-28T18:38:35.818417] [DEBUG] [VALIDATOR ] ET: All expected trading days are present. [2025-10-28T18:38:35.818569] [DEBUG] [VALIDATOR ] ET: Primary data validation passed. [2025-10-28T18:38:35.820225] [INFO ] [MAIN ] ET: Fetched primary data is valid. [2025-10-28T18:38:35.820310] [DEBUG] [LOCAL ] ET: Saving primary data. [2025-10-28T18:38:35.822699] [DEBUG] [LOCAL ] ET: Trimmed 77969 records to 53789 (keeping 200 days of data) [2025-10-28T18:38:35.962019] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-05. [2025-10-28T18:38:36.192090] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-10 (1.03 seconds). [2025-10-28T18:38:36.199865] [INFO ] [REMOTE ] ETD: Full fetch complete (38328 records). [2025-10-28T18:38:36.200907] [DEBUG] [VALIDATOR ] ETD: Validating primary data. [2025-10-28T18:38:36.336282] [DEBUG] [LOCAL ] ET: Primary data saved (53789 records). [2025-10-28T18:38:36.346858] [INFO ] [MAIN ] ET: Full history saved. [2025-10-28T18:38:36.359082] [INFO ] [MAIN ] Update Progress: 774/2366 symbols completed. ET took 40.1s. Estimated remaining: 3h 22m 43s. Rate: 7.9 symbols/min [2025-10-28T18:38:36.736446] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-28T18:38:36.730404] [INFO ] [MAIN ] ETN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:38:36.763451] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-08. [2025-10-28T18:38:36.838458] [DEBUG] [VALIDATOR ] ETD: All expected trading days are present. [2025-10-28T18:38:36.838585] [DEBUG] [VALIDATOR ] ETD: Primary data validation passed. [2025-10-28T18:38:36.839764] [INFO ] [MAIN ] ETD: Fetched primary data is valid. [2025-10-28T18:38:36.841171] [DEBUG] [LOCAL ] ETD: Saving primary data. [2025-10-28T18:38:36.843448] [DEBUG] [LOCAL ] ETD: Trimmed 38328 records to 26545 (keeping 200 days of data) [2025-10-28T18:38:37.007279] [DEBUG] [LOCAL ] ETN: Loaded 52514 existing records from primary storage. [2025-10-28T18:38:37.027977] [INFO ] [MAIN ] ETN: Loaded 52514 existing records. [2025-10-28T18:38:37.216774] [DEBUG] [LOCAL ] ETD: Primary data saved (26545 records). [2025-10-28T18:38:37.236462] [INFO ] [MAIN ] ETD: Full history saved. [2025-10-28T18:38:37.236695] [INFO ] [MAIN ] Update Progress: 775/2366 symbols completed. ETD took 31.5s. Estimated remaining: 3h 22m 21s. Rate: 7.9 symbols/min [2025-10-28T18:38:37.236361] [WARN ] [MAIN ] ETN: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:38:37.236928] [INFO ] [MAIN ] ETN: Wiping existing primary data before full refresh. [2025-10-28T18:38:37.237015] [INFO ] [LOCAL ] ETN: Starting deletion of primary data. [2025-10-28T18:38:37.254892] [DEBUG] [LOCAL ] ETN: Deleted primary data file. [2025-10-28T18:38:37.278988] [INFO ] [MAIN ] ETN: Starting full primary refresh. [2025-10-28T18:38:37.546569] [INFO ] [MAIN ] ETO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:38:37.579458] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-06. [2025-10-28T18:38:37.692424] [DEBUG] [LOCAL ] ETO: Loaded 6726 existing records from primary storage. [2025-10-28T18:38:37.703608] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-28T18:38:37.712380] [INFO ] [MAIN ] ETO: Loaded 6726 existing records. [2025-10-28T18:38:38.109088] [INFO ] [REMOTE ] ETN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:38:38.132781] [WARN ] [MAIN ] ETO: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:38:38.132998] [INFO ] [MAIN ] ETO: Wiping existing primary data before full refresh. [2025-10-28T18:38:38.133044] [INFO ] [LOCAL ] ETO: Starting deletion of primary data. [2025-10-28T18:38:38.133267] [DEBUG] [LOCAL ] ETO: Deleted primary data file. [2025-10-28T18:38:38.133308] [INFO ] [MAIN ] ETO: Starting full primary refresh. [2025-10-28T18:38:38.367472] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-01. [2025-10-28T18:38:38.408976] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-10-28T18:38:38.543085] [INFO ] [REMOTE ] ETO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:38:39.159332] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-01. [2025-10-28T18:38:39.959323] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-07. [2025-10-28T18:38:40.050756] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-28T18:38:40.124152] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-28T18:38:40.596572] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-28T18:38:40.759361] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-02. [2025-10-28T18:38:41.559348] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-09. [2025-10-28T18:38:42.109040] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-28T18:38:42.129177] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-28T18:38:42.359373] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-10. [2025-10-28T18:38:43.124465] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-28T18:38:43.128241] [INFO ] [REMOTE ] ETG: Full fetch complete (24372 records). [2025-10-28T18:38:43.128327] [DEBUG] [VALIDATOR ] ETG: Validating primary data. [2025-10-28T18:38:43.164539] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-03. [2025-10-28T18:38:43.511628] [DEBUG] [VALIDATOR ] ETG: All expected trading days are present. [2025-10-28T18:38:43.511732] [DEBUG] [VALIDATOR ] ETG: Primary data validation passed. [2025-10-28T18:38:43.512246] [INFO ] [MAIN ] ETG: Fetched primary data is valid. [2025-10-28T18:38:43.512304] [DEBUG] [LOCAL ] ETG: Saving primary data. [2025-10-28T18:38:43.512982] [DEBUG] [LOCAL ] ETG: Trimmed 24372 records to 16124 (keeping 200 days of data) [2025-10-28T18:38:43.610237] [DEBUG] [LOCAL ] ETG: Primary data saved (16124 records). [2025-10-28T18:38:43.610382] [INFO ] [MAIN ] ETG: Full history saved. [2025-10-28T18:38:43.610460] [INFO ] [MAIN ] Update Progress: 776/2366 symbols completed. ETG took 36.4s. Estimated remaining: 3h 22m 11s. Rate: 7.9 symbols/min [2025-10-28T18:38:43.784704] [INFO ] [MAIN ] ETR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:38:43.829961] [DEBUG] [LOCAL ] ETR: Loaded 53171 existing records from primary storage. [2025-10-28T18:38:43.830282] [INFO ] [MAIN ] ETR: Loaded 53171 existing records. [2025-10-28T18:38:43.969761] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-02. [2025-10-28T18:38:44.010091] [WARN ] [MAIN ] ETR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:38:44.010542] [INFO ] [MAIN ] ETR: Wiping existing primary data before full refresh. [2025-10-28T18:38:44.010620] [INFO ] [LOCAL ] ETR: Starting deletion of primary data. [2025-10-28T18:38:44.011679] [DEBUG] [LOCAL ] ETR: Deleted primary data file. [2025-10-28T18:38:44.011738] [INFO ] [MAIN ] ETR: Starting full primary refresh. [2025-10-28T18:38:44.371291] [INFO ] [REMOTE ] ETR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:38:44.441128] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-28T18:38:44.734843] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-28T18:38:44.759304] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-04. [2025-10-28T18:38:45.559334] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-08. [2025-10-28T18:38:46.103411] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-28T18:38:46.359339] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-03. [2025-10-28T18:38:46.411064] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-28T18:38:46.741538] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-10-28T18:38:47.159339] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-04. [2025-10-28T18:38:47.609373] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-28T18:38:47.959340] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-05. [2025-10-28T18:38:48.414940] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-28T18:38:48.759413] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-06. [2025-10-28T18:38:49.284080] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-28T18:38:49.559411] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-09. [2025-10-28T18:38:50.278992] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-28T18:38:50.359301] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-10. [2025-10-28T18:38:51.058874] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-28T18:38:51.062250] [INFO ] [REMOTE ] ETJ: Full fetch complete (25167 records). [2025-10-28T18:38:51.062326] [DEBUG] [VALIDATOR ] ETJ: Validating primary data. [2025-10-28T18:38:51.159333] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-05. [2025-10-28T18:38:51.423320] [DEBUG] [VALIDATOR ] ETJ: All expected trading days are present. [2025-10-28T18:38:51.423388] [DEBUG] [VALIDATOR ] ETJ: Primary data validation passed. [2025-10-28T18:38:51.423809] [INFO ] [MAIN ] ETJ: Fetched primary data is valid. [2025-10-28T18:38:51.423869] [DEBUG] [LOCAL ] ETJ: Saving primary data. [2025-10-28T18:38:51.424431] [DEBUG] [LOCAL ] ETJ: Trimmed 25167 records to 15711 (keeping 200 days of data) [2025-10-28T18:38:51.512866] [DEBUG] [LOCAL ] ETJ: Primary data saved (15711 records). [2025-10-28T18:38:51.512986] [INFO ] [MAIN ] ETJ: Full history saved. [2025-10-28T18:38:51.513058] [INFO ] [MAIN ] Update Progress: 777/2366 symbols completed. ETJ took 25.7s. Estimated remaining: 3h 22m 4s. Rate: 7.9 symbols/min [2025-10-28T18:38:51.678700] [INFO ] [MAIN ] ETSY: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:38:51.724311] [DEBUG] [LOCAL ] ETSY: Loaded 53555 existing records from primary storage. [2025-10-28T18:38:51.724594] [INFO ] [MAIN ] ETSY: Loaded 53555 existing records. [2025-10-28T18:38:51.900206] [WARN ] [MAIN ] ETSY: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:38:51.900372] [INFO ] [MAIN ] ETSY: Wiping existing primary data before full refresh. [2025-10-28T18:38:51.900416] [INFO ] [LOCAL ] ETSY: Starting deletion of primary data. [2025-10-28T18:38:51.901220] [DEBUG] [LOCAL ] ETSY: Deleted primary data file. [2025-10-28T18:38:51.901292] [INFO ] [MAIN ] ETSY: Starting full primary refresh. [2025-10-28T18:38:51.964539] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-01. [2025-10-28T18:38:52.247907] [INFO ] [REMOTE ] ETSY: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:38:52.654991] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-28T18:38:52.759339] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-07. [2025-10-28T18:38:53.175120] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-10-28T18:38:53.265956] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-28T18:38:53.559329] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-06. [2025-10-28T18:38:54.359443] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-02. [2025-10-28T18:38:54.830793] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-28T18:38:55.159397] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-08. [2025-10-28T18:38:55.591097] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-28T18:38:55.612300] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-28T18:38:55.959337] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-03. [2025-10-28T18:38:56.759388] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-01. [2025-10-28T18:38:57.262704] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-28T18:38:57.559386] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-09. [2025-10-28T18:38:57.952348] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-10-28T18:38:58.162232] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-28T18:38:58.359350] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-10. [2025-10-28T18:38:59.004903] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-28T18:38:59.007097] [INFO ] [REMOTE ] ETO: Full fetch complete (9676 records). [2025-10-28T18:38:59.007169] [DEBUG] [VALIDATOR ] ETO: Validating primary data. [2025-10-28T18:38:59.161240] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-07. [2025-10-28T18:38:59.373289] [DEBUG] [VALIDATOR ] ETO: All expected trading days are present. [2025-10-28T18:38:59.373362] [DEBUG] [VALIDATOR ] ETO: Primary data validation passed. [2025-10-28T18:38:59.373593] [INFO ] [MAIN ] ETO: Fetched primary data is valid. [2025-10-28T18:38:59.373629] [DEBUG] [LOCAL ] ETO: Saving primary data. [2025-10-28T18:38:59.374066] [DEBUG] [LOCAL ] ETO: Trimmed 9676 records to 6682 (keeping 200 days of data) [2025-10-28T18:38:59.414707] [DEBUG] [LOCAL ] ETO: Primary data saved (6682 records). [2025-10-28T18:38:59.414810] [INFO ] [MAIN ] ETO: Full history saved. [2025-10-28T18:38:59.414887] [INFO ] [MAIN ] Update Progress: 778/2366 symbols completed. ETO took 22.2s. Estimated remaining: 3h 21m 57s. Rate: 7.9 symbols/min [2025-10-28T18:38:59.590315] [INFO ] [MAIN ] ETV: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:38:59.610783] [DEBUG] [LOCAL ] ETV: Loaded 21341 existing records from primary storage. [2025-10-28T18:38:59.611037] [INFO ] [MAIN ] ETV: Loaded 21341 existing records. [2025-10-28T18:38:59.787116] [WARN ] [MAIN ] ETV: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:38:59.787306] [INFO ] [MAIN ] ETV: Wiping existing primary data before full refresh. [2025-10-28T18:38:59.787353] [INFO ] [LOCAL ] ETV: Starting deletion of primary data. [2025-10-28T18:38:59.787844] [DEBUG] [LOCAL ] ETV: Deleted primary data file. [2025-10-28T18:38:59.787902] [INFO ] [MAIN ] ETV: Starting full primary refresh. [2025-10-28T18:38:59.971111] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-02. [2025-10-28T18:39:00.151805] [INFO ] [REMOTE ] ETV: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:39:00.734556] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-10-28T18:39:00.759296] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-08. [2025-10-28T18:39:01.433886] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-10-28T18:39:01.559334] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-03. [2025-10-28T18:39:02.359399] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-01. [2025-10-28T18:39:02.762292] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-10-28T18:39:03.159409] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-04. [2025-10-28T18:39:03.358544] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-10-28T18:39:03.552452] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-28T18:39:03.959350] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-02. [2025-10-28T18:39:04.479660] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-28T18:39:04.664046] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-28T18:39:04.759316] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-03. [2025-10-28T18:39:05.550892] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-28T18:39:05.559290] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-04. [2025-10-28T18:39:06.359358] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-09. [2025-10-28T18:39:06.500835] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-28T18:39:07.159344] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-05. [2025-10-28T18:39:07.855779] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-28T18:39:07.856758] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-28T18:39:07.959302] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-06. [2025-10-28T18:39:08.660112] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-28T18:39:08.759318] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-10. [2025-10-28T18:39:09.559338] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-04. [2025-10-28T18:39:10.373478] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-07. [2025-10-28T18:39:10.376575] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-28T18:39:10.387480] [INFO ] [REMOTE ] ETN: Full fetch complete (76597 records). [2025-10-28T18:39:10.387609] [DEBUG] [VALIDATOR ] ETN: Validating primary data. [2025-10-28T18:39:10.805128] [DEBUG] [VALIDATOR ] ETN: All expected trading days are present. [2025-10-28T18:39:10.805213] [DEBUG] [VALIDATOR ] ETN: Primary data validation passed. [2025-10-28T18:39:10.806095] [INFO ] [MAIN ] ETN: Fetched primary data is valid. [2025-10-28T18:39:10.806157] [DEBUG] [LOCAL ] ETN: Saving primary data. [2025-10-28T18:39:10.807612] [DEBUG] [LOCAL ] ETN: Trimmed 76597 records to 52498 (keeping 200 days of data) [2025-10-28T18:39:11.165497] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-28T18:39:11.163133] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-05. [2025-10-28T18:39:11.187980] [DEBUG] [LOCAL ] ETN: Primary data saved (52498 records). [2025-10-28T18:39:11.189352] [INFO ] [MAIN ] ETN: Full history saved. [2025-10-28T18:39:11.189479] [INFO ] [MAIN ] Update Progress: 779/2366 symbols completed. ETN took 34.8s. Estimated remaining: 3h 21m 58s. Rate: 7.9 symbols/min [2025-10-28T18:39:11.331479] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-28T18:39:11.391171] [INFO ] [MAIN ] ETW: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:39:11.391358] [DEBUG] [LOCAL ] ETW: No existing data file found in primary storage. [2025-10-28T18:39:11.391394] [WARN ] [MAIN ] ETW: No existing data found, performing full refresh instead. [2025-10-28T18:39:11.391502] [INFO ] [MAIN ] ETW: Wiping existing primary data before full refresh. [2025-10-28T18:39:11.391543] [INFO ] [LOCAL ] ETW: Starting deletion of primary data. [2025-10-28T18:39:11.391584] [DEBUG] [LOCAL ] ETW: No primary data file found to delete. [2025-10-28T18:39:11.391615] [INFO ] [MAIN ] ETW: Starting full primary refresh. [2025-10-28T18:39:11.757965] [INFO ] [REMOTE ] ETW: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:39:11.959329] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-01. [2025-10-28T18:39:12.504830] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-28T18:39:12.759401] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-08. [2025-10-28T18:39:13.001858] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-28T18:39:13.559381] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-06. [2025-10-28T18:39:13.612981] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-28T18:39:14.359348] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-02. [2025-10-28T18:39:14.889596] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-28T18:39:15.049444] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-28T18:39:15.159303] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-03. [2025-10-28T18:39:15.959357] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-09. [2025-10-28T18:39:16.019066] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-28T18:39:16.708247] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-28T18:39:16.759306] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-10. [2025-10-28T18:39:17.559303] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-05. [2025-10-28T18:39:17.682241] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-28T18:39:17.687456] [INFO ] [REMOTE ] ETV: Full fetch complete (32083 records). [2025-10-28T18:39:17.687583] [DEBUG] [VALIDATOR ] ETV: Validating primary data. [2025-10-28T18:39:18.057864] [DEBUG] [VALIDATOR ] ETV: All expected trading days are present. [2025-10-28T18:39:18.057939] [DEBUG] [VALIDATOR ] ETV: Primary data validation passed. [2025-10-28T18:39:18.058472] [INFO ] [MAIN ] ETV: Fetched primary data is valid. [2025-10-28T18:39:18.058510] [DEBUG] [LOCAL ] ETV: Saving primary data. [2025-10-28T18:39:18.059268] [DEBUG] [LOCAL ] ETV: Trimmed 32083 records to 21314 (keeping 200 days of data) [2025-10-28T18:39:18.183685] [DEBUG] [LOCAL ] ETV: Primary data saved (21314 records). [2025-10-28T18:39:18.183811] [INFO ] [MAIN ] ETV: Full history saved. [2025-10-28T18:39:18.183899] [INFO ] [MAIN ] Update Progress: 780/2366 symbols completed. ETV took 18.8s. Estimated remaining: 3h 21m 49s. Rate: 7.9 symbols/min [2025-10-28T18:39:18.349586] [INFO ] [MAIN ] ETX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:39:18.349767] [DEBUG] [LOCAL ] ETX: No existing data file found in primary storage. [2025-10-28T18:39:18.349810] [WARN ] [MAIN ] ETX: No existing data found, performing full refresh instead. [2025-10-28T18:39:18.349917] [INFO ] [MAIN ] ETX: Wiping existing primary data before full refresh. [2025-10-28T18:39:18.349957] [INFO ] [LOCAL ] ETX: Starting deletion of primary data. [2025-10-28T18:39:18.349997] [DEBUG] [LOCAL ] ETX: No primary data file found to delete. [2025-10-28T18:39:18.350028] [INFO ] [MAIN ] ETX: Starting full primary refresh. [2025-10-28T18:39:18.369797] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-07. [2025-10-28T18:39:18.716283] [INFO ] [REMOTE ] ETX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:39:18.854054] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-28T18:39:19.159332] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-06. [2025-10-28T18:39:19.769118] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-28T18:39:19.959354] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-04. [2025-10-28T18:39:20.438340] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-28T18:39:20.759399] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-07. [2025-10-28T18:39:21.045040] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-28T18:39:21.559362] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-08. [2025-10-28T18:39:22.305037] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-28T18:39:22.359333] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-08. [2025-10-28T18:39:22.761174] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-28T18:39:23.159343] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-05. [2025-10-28T18:39:23.685049] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-28T18:39:23.959324] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-01. [2025-10-28T18:39:23.996019] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-28T18:39:24.691707] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-28T18:39:24.759358] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-06. [2025-10-28T18:39:25.447187] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-28T18:39:25.559325] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-07. [2025-10-28T18:39:26.359353] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-09. [2025-10-28T18:39:26.379762] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-28T18:39:27.159373] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-08. [2025-10-28T18:39:27.890285] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-28T18:39:27.928877] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-10-28T18:39:27.959308] [INFO ] [REMOTE ] ETSY: Fetching primary data for 2025-10. [2025-10-28T18:39:28.759337] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-09. [2025-10-28T18:39:29.486690] [INFO ] [REMOTE ] ETSY: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-28T18:39:29.497061] [INFO ] [REMOTE ] ETSY: Full fetch complete (77267 records). [2025-10-28T18:39:29.497210] [DEBUG] [VALIDATOR ] ETSY: Validating primary data. [2025-10-28T18:39:29.498081] [FATAL] [VALIDATOR ] ETSY: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T18:39:29.498172] [FATAL] [MAIN ] ETSY: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:39:29.498216] [WARN ] [MAIN ] ETSY: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:39:29.498280] [INFO ] [LOCAL ] ETSY: Starting deletion of primary data. [2025-10-28T18:39:29.498347] [DEBUG] [LOCAL ] ETSY: No primary data file found to delete. [2025-10-28T18:39:29.498385] [INFO ] [LOCAL ] ETSY: Starting deletion of derivative data. [2025-10-28T18:39:29.498924] [DEBUG] [LOCAL ] ETSY: Deleted derivative data file. [2025-10-28T18:39:29.499252] [INFO ] [MAIN ] Update Progress: 781/2366 symbols completed. ETSY took 38.0s. Estimated remaining: 3h 21m 49s. Rate: 7.9 symbols/min [2025-10-28T18:39:29.564455] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-09. [2025-10-28T18:39:29.677078] [INFO ] [MAIN ] ETY: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:39:29.677370] [DEBUG] [LOCAL ] ETY: No existing data file found in primary storage. [2025-10-28T18:39:29.677415] [WARN ] [MAIN ] ETY: No existing data found, performing full refresh instead. [2025-10-28T18:39:29.677543] [INFO ] [MAIN ] ETY: Wiping existing primary data before full refresh. [2025-10-28T18:39:29.677586] [INFO ] [LOCAL ] ETY: Starting deletion of primary data. [2025-10-28T18:39:29.677630] [DEBUG] [LOCAL ] ETY: No primary data file found to delete. [2025-10-28T18:39:29.677703] [INFO ] [MAIN ] ETY: Starting full primary refresh. [2025-10-28T18:39:30.089304] [INFO ] [REMOTE ] ETY: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:39:30.232025] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-28T18:39:30.360214] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-02. [2025-10-28T18:39:30.362354] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-28T18:39:30.760968] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-28T18:39:31.159351] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-10. [2025-10-28T18:39:31.959342] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-03. [2025-10-28T18:39:32.021020] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-28T18:39:32.027164] [INFO ] [REMOTE ] ETW: Full fetch complete (36417 records). [2025-10-28T18:39:32.027276] [DEBUG] [VALIDATOR ] ETW: Validating primary data. [2025-10-28T18:39:32.319489] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-10-28T18:39:32.418083] [DEBUG] [VALIDATOR ] ETW: All expected trading days are present. [2025-10-28T18:39:32.418162] [DEBUG] [VALIDATOR ] ETW: Primary data validation passed. [2025-10-28T18:39:32.418843] [INFO ] [MAIN ] ETW: Fetched primary data is valid. [2025-10-28T18:39:32.418905] [DEBUG] [LOCAL ] ETW: Saving primary data. [2025-10-28T18:39:32.419699] [DEBUG] [LOCAL ] ETW: Trimmed 36417 records to 24557 (keeping 200 days of data) [2025-10-28T18:39:32.559397] [DEBUG] [LOCAL ] ETW: Primary data saved (24557 records). [2025-10-28T18:39:32.559529] [INFO ] [MAIN ] ETW: Full history saved. [2025-10-28T18:39:32.559598] [INFO ] [MAIN ] Update Progress: 782/2366 symbols completed. ETW took 21.4s. Estimated remaining: 3h 21m 32s. Rate: 7.9 symbols/min [2025-10-28T18:39:32.723152] [INFO ] [MAIN ] EVC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:39:32.739136] [DEBUG] [LOCAL ] EVC: Loaded 17464 existing records from primary storage. [2025-10-28T18:39:32.739361] [INFO ] [MAIN ] EVC: Loaded 17464 existing records. [2025-10-28T18:39:32.767700] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-04. [2025-10-28T18:39:32.918948] [WARN ] [MAIN ] EVC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:39:32.920144] [INFO ] [MAIN ] EVC: Wiping existing primary data before full refresh. [2025-10-28T18:39:32.920204] [INFO ] [LOCAL ] EVC: Starting deletion of primary data. [2025-10-28T18:39:32.921149] [DEBUG] [LOCAL ] EVC: Deleted primary data file. [2025-10-28T18:39:32.921244] [INFO ] [MAIN ] EVC: Starting full primary refresh. [2025-10-28T18:39:33.251436] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-28T18:39:33.279297] [INFO ] [REMOTE ] EVC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:39:33.559380] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-05. [2025-10-28T18:39:33.941586] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-10-28T18:39:34.359345] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-01. [2025-10-28T18:39:35.159359] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-10. [2025-10-28T18:39:35.490015] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-28T18:39:35.959345] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-06. [2025-10-28T18:39:36.520880] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-28T18:39:36.633671] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-28T18:39:36.644593] [INFO ] [REMOTE ] ETR: Full fetch complete (77261 records). [2025-10-28T18:39:36.644755] [DEBUG] [VALIDATOR ] ETR: Validating primary data. [2025-10-28T18:39:36.764445] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-02. [2025-10-28T18:39:37.058149] [DEBUG] [VALIDATOR ] ETR: All expected trading days are present. [2025-10-28T18:39:37.058245] [DEBUG] [VALIDATOR ] ETR: Primary data validation passed. [2025-10-28T18:39:37.059231] [INFO ] [MAIN ] ETR: Fetched primary data is valid. [2025-10-28T18:39:37.059294] [DEBUG] [LOCAL ] ETR: Saving primary data. [2025-10-28T18:39:37.060808] [DEBUG] [LOCAL ] ETR: Trimmed 77261 records to 53167 (keeping 200 days of data) [2025-10-28T18:39:37.373581] [DEBUG] [LOCAL ] ETR: Primary data saved (53167 records). [2025-10-28T18:39:37.373728] [INFO ] [MAIN ] ETR: Full history saved. [2025-10-28T18:39:37.373822] [INFO ] [MAIN ] Update Progress: 783/2366 symbols completed. ETR took 53.8s. Estimated remaining: 3h 21m 18s. Rate: 7.9 symbols/min [2025-10-28T18:39:37.547490] [INFO ] [MAIN ] EVEX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:39:37.563702] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-07. [2025-10-28T18:39:37.578180] [DEBUG] [LOCAL ] EVEX: Loaded 33243 existing records from primary storage. [2025-10-28T18:39:37.578427] [INFO ] [MAIN ] EVEX: Loaded 33243 existing records. [2025-10-28T18:39:37.772079] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-28T18:39:37.771193] [WARN ] [MAIN ] EVEX: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:39:37.777776] [INFO ] [MAIN ] EVEX: Wiping existing primary data before full refresh. [2025-10-28T18:39:37.777835] [INFO ] [LOCAL ] EVEX: Starting deletion of primary data. [2025-10-28T18:39:37.778277] [DEBUG] [LOCAL ] EVEX: Deleted primary data file. [2025-10-28T18:39:37.778334] [INFO ] [MAIN ] EVEX: Starting full primary refresh. [2025-10-28T18:39:38.059949] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-10-28T18:39:38.136931] [INFO ] [REMOTE ] EVEX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:39:38.359326] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-01. [2025-10-28T18:39:39.159314] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-03. [2025-10-28T18:39:39.380252] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-28T18:39:39.910241] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-28T18:39:39.959319] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-01. [2025-10-28T18:39:40.759330] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-02. [2025-10-28T18:39:41.288123] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-28T18:39:41.529101] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-28T18:39:41.559307] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-03. [2025-10-28T18:39:42.316461] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-28T18:39:42.359301] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-04. [2025-10-28T18:39:43.050713] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-28T18:39:43.159350] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-05. [2025-10-28T18:39:43.925820] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-28T18:39:43.959298] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-06. [2025-10-28T18:39:44.739949] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-28T18:39:44.759293] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-02. [2025-10-28T18:39:45.509611] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-28T18:39:45.559335] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-08. [2025-10-28T18:39:46.008299] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-28T18:39:46.359332] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-07. [2025-10-28T18:39:47.159303] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-09. [2025-10-28T18:39:47.296681] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-10-28T18:39:47.606434] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-28T18:39:47.959345] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-04. [2025-10-28T18:39:48.759337] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-03. [2025-10-28T18:39:48.973920] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-28T18:39:49.559298] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-10. [2025-10-28T18:39:49.629252] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-28T18:39:50.022175] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-10 (0.46 seconds). [2025-10-28T18:39:50.023559] [INFO ] [REMOTE ] ETX: Full fetch complete (6742 records). [2025-10-28T18:39:50.023630] [DEBUG] [VALIDATOR ] ETX: Validating primary data. [2025-10-28T18:39:50.024019] [FATAL] [VALIDATOR ] ETX: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T18:39:50.024096] [FATAL] [MAIN ] ETX: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:39:50.024138] [WARN ] [MAIN ] ETX: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:39:50.024201] [INFO ] [LOCAL ] ETX: Starting deletion of primary data. [2025-10-28T18:39:50.024261] [DEBUG] [LOCAL ] ETX: No primary data file found to delete. [2025-10-28T18:39:50.024295] [INFO ] [LOCAL ] ETX: Starting deletion of derivative data. [2025-10-28T18:39:50.024332] [DEBUG] [LOCAL ] ETX: No derivative data file found to delete. [2025-10-28T18:39:50.024382] [INFO ] [MAIN ] Update Progress: 784/2366 symbols completed. ETX took 31.8s. Estimated remaining: 3h 21m 21s. Rate: 7.9 symbols/min [2025-10-28T18:39:50.193707] [INFO ] [MAIN ] EVF: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:39:50.203639] [DEBUG] [LOCAL ] EVF: Loaded 9436 existing records from primary storage. [2025-10-28T18:39:50.203873] [INFO ] [MAIN ] EVF: Loaded 9436 existing records. [2025-10-28T18:39:50.372534] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-04. [2025-10-28T18:39:50.378087] [WARN ] [MAIN ] EVF: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:39:50.378954] [INFO ] [MAIN ] EVF: Wiping existing primary data before full refresh. [2025-10-28T18:39:50.379039] [INFO ] [LOCAL ] EVF: Starting deletion of primary data. [2025-10-28T18:39:50.379276] [DEBUG] [LOCAL ] EVF: Deleted primary data file. [2025-10-28T18:39:50.379318] [INFO ] [MAIN ] EVF: Starting full primary refresh. [2025-10-28T18:39:50.724060] [INFO ] [REMOTE ] EVF: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:39:51.119161] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-28T18:39:51.159307] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-05. [2025-10-28T18:39:51.959323] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-08. [2025-10-28T18:39:52.029980] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-28T18:39:52.759324] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-06. [2025-10-28T18:39:53.057365] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-28T18:39:53.481213] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-28T18:39:53.559328] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-01. [2025-10-28T18:39:54.359312] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-09. [2025-10-28T18:39:54.389213] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-28T18:39:55.159341] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-02. [2025-10-28T18:39:55.516345] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-10-28T18:39:55.627048] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-28T18:39:55.959341] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-10. [2025-10-28T18:39:56.759394] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-05. [2025-10-28T18:39:56.814375] [DEBUG] [REMOTE ] ETY: Error fetching primary data for 2025-05: 'API call returned an empty response.' [2025-10-28T18:39:56.814704] [WARN ] [REMOTE ] ETY: No data returned for month 2025-05 [2025-10-28T18:39:56.814794] [FATAL] [REMOTE ] ETY: API call failed - aborting fetch to avoid wasting further API calls [2025-10-28T18:39:56.814870] [FATAL] [MAIN ] ETY: Failed to fetch primary data. [2025-10-28T18:39:56.814933] [WARN ] [MAIN ] ETY: Deleting existing primary and derivative data due to fetch failure. [2025-10-28T18:39:56.815003] [INFO ] [LOCAL ] ETY: Starting deletion of primary data. [2025-10-28T18:39:56.815066] [DEBUG] [LOCAL ] ETY: No primary data file found to delete. [2025-10-28T18:39:56.815102] [INFO ] [LOCAL ] ETY: Starting deletion of derivative data. [2025-10-28T18:39:56.815142] [DEBUG] [LOCAL ] ETY: No derivative data file found to delete. [2025-10-28T18:39:56.815189] [INFO ] [MAIN ] Update Progress: 785/2366 symbols completed. ETY took 27.3s. Estimated remaining: 3h 21m 12s. Rate: 7.9 symbols/min [2025-10-28T18:39:56.983775] [INFO ] [MAIN ] EVG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:39:56.990901] [DEBUG] [LOCAL ] EVG: Loaded 5652 existing records from primary storage. [2025-10-28T18:39:56.991098] [INFO ] [MAIN ] EVG: Loaded 5652 existing records. [2025-10-28T18:39:57.169065] [WARN ] [MAIN ] EVG: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:39:57.169426] [INFO ] [MAIN ] EVG: Wiping existing primary data before full refresh. [2025-10-28T18:39:57.169486] [INFO ] [LOCAL ] EVG: Starting deletion of primary data. [2025-10-28T18:39:57.169771] [DEBUG] [LOCAL ] EVG: Deleted primary data file. [2025-10-28T18:39:57.169828] [INFO ] [MAIN ] EVG: Starting full primary refresh. [2025-10-28T18:39:57.530526] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-28T18:39:57.563197] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-07. [2025-10-28T18:39:57.568903] [INFO ] [REMOTE ] EVG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:39:57.570418] [INFO ] [REMOTE ] EVEX: Full fetch complete (44338 records). [2025-10-28T18:39:57.570493] [DEBUG] [VALIDATOR ] EVEX: Validating primary data. [2025-10-28T18:39:57.940784] [DEBUG] [VALIDATOR ] EVEX: All expected trading days are present. [2025-10-28T18:39:57.940862] [DEBUG] [VALIDATOR ] EVEX: Primary data validation passed. [2025-10-28T18:39:57.941480] [INFO ] [MAIN ] EVEX: Fetched primary data is valid. [2025-10-28T18:39:57.941518] [DEBUG] [LOCAL ] EVEX: Saving primary data. [2025-10-28T18:39:57.942401] [DEBUG] [LOCAL ] EVEX: Trimmed 44338 records to 33359 (keeping 200 days of data) [2025-10-28T18:39:58.118104] [DEBUG] [LOCAL ] EVEX: Primary data saved (33359 records). [2025-10-28T18:39:58.118229] [INFO ] [MAIN ] EVEX: Full history saved. [2025-10-28T18:39:58.118303] [INFO ] [MAIN ] Update Progress: 786/2366 symbols completed. EVEX took 20.7s. Estimated remaining: 3h 20m 51s. Rate: 7.9 symbols/min [2025-10-28T18:39:58.284383] [INFO ] [MAIN ] EVH: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:39:58.284546] [DEBUG] [LOCAL ] EVH: No existing data file found in primary storage. [2025-10-28T18:39:58.284585] [WARN ] [MAIN ] EVH: No existing data found, performing full refresh instead. [2025-10-28T18:39:58.284715] [INFO ] [MAIN ] EVH: Wiping existing primary data before full refresh. [2025-10-28T18:39:58.284767] [INFO ] [LOCAL ] EVH: Starting deletion of primary data. [2025-10-28T18:39:58.284809] [DEBUG] [LOCAL ] EVH: No primary data file found to delete. [2025-10-28T18:39:58.284840] [INFO ] [MAIN ] EVH: Starting full primary refresh. [2025-10-28T18:39:58.360350] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-01. [2025-10-28T18:39:58.556732] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-28T18:39:58.663974] [INFO ] [REMOTE ] EVH: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:39:59.155033] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-28T18:39:59.159286] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-02. [2025-10-28T18:39:59.519255] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-10-28T18:39:59.959336] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-03. [2025-10-28T18:40:00.290540] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-10-28T18:40:00.759344] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-01. [2025-10-28T18:40:01.559369] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-03. [2025-10-28T18:40:02.118930] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-28T18:40:02.359318] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-08. [2025-10-28T18:40:02.515463] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-28T18:40:03.159328] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-02. [2025-10-28T18:40:03.179004] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-28T18:40:03.959346] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-04. [2025-10-28T18:40:04.392623] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-28T18:40:04.406940] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-10-28T18:40:04.759342] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-05. [2025-10-28T18:40:05.159410] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-10-28T18:40:05.559344] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-03. [2025-10-28T18:40:06.359352] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-04. [2025-10-28T18:40:06.788859] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-28T18:40:06.915022] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-28T18:40:07.159342] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-05. [2025-10-28T18:40:07.576025] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-28T18:40:07.959333] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-06. [2025-10-28T18:40:08.651507] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-28T18:40:08.759400] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-04. [2025-10-28T18:40:09.559348] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-06. [2025-10-28T18:40:09.952822] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-28T18:40:10.165544] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-28T18:40:10.359358] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-07. [2025-10-28T18:40:10.818506] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-28T18:40:11.159364] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-05. [2025-10-28T18:40:11.959359] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-07. [2025-10-28T18:40:12.463165] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-10-28T18:40:12.514304] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-28T18:40:12.759360] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-08. [2025-10-28T18:40:13.110126] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-10-28T18:40:13.559337] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-09. [2025-10-28T18:40:14.246981] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-28T18:40:14.359348] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-10. [2025-10-28T18:40:15.159377] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-08. [2025-10-28T18:40:15.627301] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-28T18:40:15.630840] [INFO ] [REMOTE ] EVC: Full fetch complete (28206 records). [2025-10-28T18:40:15.630915] [DEBUG] [VALIDATOR ] EVC: Validating primary data. [2025-10-28T18:40:15.741579] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-28T18:40:15.970632] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-09. [2025-10-28T18:40:16.017456] [DEBUG] [VALIDATOR ] EVC: All expected trading days are present. [2025-10-28T18:40:16.017527] [DEBUG] [VALIDATOR ] EVC: Primary data validation passed. [2025-10-28T18:40:16.018072] [INFO ] [MAIN ] EVC: Fetched primary data is valid. [2025-10-28T18:40:16.018132] [DEBUG] [LOCAL ] EVC: Saving primary data. [2025-10-28T18:40:16.018774] [DEBUG] [LOCAL ] EVC: Trimmed 28206 records to 17402 (keeping 200 days of data) [2025-10-28T18:40:16.114846] [DEBUG] [LOCAL ] EVC: Primary data saved (17402 records). [2025-10-28T18:40:16.114969] [INFO ] [MAIN ] EVC: Full history saved. [2025-10-28T18:40:16.115046] [INFO ] [MAIN ] Update Progress: 787/2366 symbols completed. EVC took 43.6s. Estimated remaining: 3h 21m 4s. Rate: 7.9 symbols/min [2025-10-28T18:40:16.281533] [INFO ] [MAIN ] EVN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:40:16.292497] [DEBUG] [LOCAL ] EVN: Loaded 10881 existing records from primary storage. [2025-10-28T18:40:16.292720] [INFO ] [MAIN ] EVN: Loaded 10881 existing records. [2025-10-28T18:40:16.466412] [WARN ] [MAIN ] EVN: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:40:16.466626] [INFO ] [MAIN ] EVN: Wiping existing primary data before full refresh. [2025-10-28T18:40:16.466707] [INFO ] [LOCAL ] EVN: Starting deletion of primary data. [2025-10-28T18:40:16.467014] [DEBUG] [LOCAL ] EVN: Deleted primary data file. [2025-10-28T18:40:16.467070] [INFO ] [MAIN ] EVN: Starting full primary refresh. [2025-10-28T18:40:16.603613] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-28T18:40:16.766385] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-09. [2025-10-28T18:40:16.856165] [INFO ] [REMOTE ] EVN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:40:17.239260] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-28T18:40:17.559398] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-10. [2025-10-28T18:40:18.359354] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-10. [2025-10-28T18:40:18.443734] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-10 (0.88 seconds). [2025-10-28T18:40:18.445966] [INFO ] [REMOTE ] EVG: Full fetch complete (8133 records). [2025-10-28T18:40:18.446068] [DEBUG] [VALIDATOR ] EVG: Validating primary data. [2025-10-28T18:40:18.804459] [DEBUG] [VALIDATOR ] EVG: All expected trading days are present. [2025-10-28T18:40:18.804556] [DEBUG] [VALIDATOR ] EVG: Primary data validation passed. [2025-10-28T18:40:18.804765] [INFO ] [MAIN ] EVG: Fetched primary data is valid. [2025-10-28T18:40:18.804824] [DEBUG] [LOCAL ] EVG: Saving primary data. [2025-10-28T18:40:18.805213] [DEBUG] [LOCAL ] EVG: Trimmed 8133 records to 5672 (keeping 200 days of data) [2025-10-28T18:40:18.839050] [DEBUG] [LOCAL ] EVG: Primary data saved (5672 records). [2025-10-28T18:40:18.839174] [INFO ] [MAIN ] EVG: Full history saved. [2025-10-28T18:40:18.839250] [INFO ] [MAIN ] Update Progress: 788/2366 symbols completed. EVG took 22.0s. Estimated remaining: 3h 20m 47s. Rate: 7.9 symbols/min [2025-10-28T18:40:19.007255] [INFO ] [MAIN ] EVR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:40:19.040228] [DEBUG] [LOCAL ] EVR: Loaded 32984 existing records from primary storage. [2025-10-28T18:40:19.040497] [INFO ] [MAIN ] EVR: Loaded 32984 existing records. [2025-10-28T18:40:19.164468] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-06. [2025-10-28T18:40:19.220996] [WARN ] [MAIN ] EVR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:40:19.221376] [INFO ] [MAIN ] EVR: Wiping existing primary data before full refresh. [2025-10-28T18:40:19.221455] [INFO ] [LOCAL ] EVR: Starting deletion of primary data. [2025-10-28T18:40:19.222150] [DEBUG] [LOCAL ] EVR: Deleted primary data file. [2025-10-28T18:40:19.222207] [INFO ] [MAIN ] EVR: Starting full primary refresh. [2025-10-28T18:40:19.597691] [INFO ] [REMOTE ] EVR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:40:19.698826] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-28T18:40:19.702004] [INFO ] [REMOTE ] EVF: Full fetch complete (12906 records). [2025-10-28T18:40:19.702107] [DEBUG] [VALIDATOR ] EVF: Validating primary data. [2025-10-28T18:40:19.964472] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-01. [2025-10-28T18:40:20.073866] [DEBUG] [VALIDATOR ] EVF: All expected trading days are present. [2025-10-28T18:40:20.073947] [DEBUG] [VALIDATOR ] EVF: Primary data validation passed. [2025-10-28T18:40:20.074231] [INFO ] [MAIN ] EVF: Fetched primary data is valid. [2025-10-28T18:40:20.074269] [DEBUG] [LOCAL ] EVF: Saving primary data. [2025-10-28T18:40:20.074808] [DEBUG] [LOCAL ] EVF: Trimmed 12906 records to 9375 (keeping 200 days of data) [2025-10-28T18:40:20.128959] [DEBUG] [LOCAL ] EVF: Primary data saved (9375 records). [2025-10-28T18:40:20.129092] [INFO ] [MAIN ] EVF: Full history saved. [2025-10-28T18:40:20.129171] [INFO ] [MAIN ] Update Progress: 789/2366 symbols completed. EVF took 30.1s. Estimated remaining: 3h 20m 27s. Rate: 7.9 symbols/min [2025-10-28T18:40:20.297632] [INFO ] [MAIN ] EVT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:40:20.312938] [DEBUG] [LOCAL ] EVT: Loaded 16213 existing records from primary storage. [2025-10-28T18:40:20.313192] [INFO ] [MAIN ] EVT: Loaded 16213 existing records. [2025-10-28T18:40:20.494032] [WARN ] [MAIN ] EVT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:40:20.494312] [INFO ] [MAIN ] EVT: Wiping existing primary data before full refresh. [2025-10-28T18:40:20.494374] [INFO ] [LOCAL ] EVT: Starting deletion of primary data. [2025-10-28T18:40:20.494831] [DEBUG] [LOCAL ] EVT: Deleted primary data file. [2025-10-28T18:40:20.494889] [INFO ] [MAIN ] EVT: Starting full primary refresh. [2025-10-28T18:40:20.767279] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-01. [2025-10-28T18:40:20.805403] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-28T18:40:20.896431] [INFO ] [REMOTE ] EVT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:40:21.178611] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-28T18:40:21.559381] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-01. [2025-10-28T18:40:21.943669] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-28T18:40:22.359386] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-07. [2025-10-28T18:40:22.741046] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-28T18:40:23.159353] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-02. [2025-10-28T18:40:23.593805] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-28T18:40:23.693628] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-28T18:40:23.959356] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-08. [2025-10-28T18:40:24.759408] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-03. [2025-10-28T18:40:25.090047] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-28T18:40:25.365190] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-28T18:40:25.559353] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-04. [2025-10-28T18:40:26.133425] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-28T18:40:26.359345] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-02. [2025-10-28T18:40:27.159391] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-09. [2025-10-28T18:40:27.420289] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-28T18:40:27.959364] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-03. [2025-10-28T18:40:28.444318] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-28T18:40:28.759341] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-05. [2025-10-28T18:40:29.087286] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-28T18:40:29.228855] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-28T18:40:29.559354] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-02. [2025-10-28T18:40:30.218620] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-28T18:40:30.359394] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-03. [2025-10-28T18:40:31.159318] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-04. [2025-10-28T18:40:31.217455] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-28T18:40:31.959334] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-06. [2025-10-28T18:40:32.532609] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-28T18:40:32.759343] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-05. [2025-10-28T18:40:32.835152] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-28T18:40:33.559334] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-04. [2025-10-28T18:40:33.746976] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-28T18:40:34.359368] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-10. [2025-10-28T18:40:34.476972] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-28T18:40:35.159357] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-05. [2025-10-28T18:40:35.839816] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-28T18:40:35.959314] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-06. [2025-10-28T18:40:36.000750] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-28T18:40:36.010624] [INFO ] [REMOTE ] EVH: Full fetch complete (71934 records). [2025-10-28T18:40:36.010808] [DEBUG] [VALIDATOR ] EVH: Validating primary data. [2025-10-28T18:40:36.403272] [DEBUG] [VALIDATOR ] EVH: All expected trading days are present. [2025-10-28T18:40:36.403348] [DEBUG] [VALIDATOR ] EVH: Primary data validation passed. [2025-10-28T18:40:36.404193] [INFO ] [MAIN ] EVH: Fetched primary data is valid. [2025-10-28T18:40:36.404255] [DEBUG] [LOCAL ] EVH: Saving primary data. [2025-10-28T18:40:36.405521] [DEBUG] [LOCAL ] EVH: Trimmed 71934 records to 49543 (keeping 200 days of data) [2025-10-28T18:40:36.696871] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-28T18:40:36.704140] [DEBUG] [LOCAL ] EVH: Primary data saved (49543 records). [2025-10-28T18:40:36.704214] [INFO ] [MAIN ] EVH: Full history saved. [2025-10-28T18:40:36.704276] [INFO ] [MAIN ] Update Progress: 790/2366 symbols completed. EVH took 38.6s. Estimated remaining: 3h 20m 37s. Rate: 7.9 symbols/min [2025-10-28T18:40:36.766857] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-07. [2025-10-28T18:40:36.878388] [INFO ] [MAIN ] EVTC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:40:36.901125] [DEBUG] [LOCAL ] EVTC: Loaded 26579 existing records from primary storage. [2025-10-28T18:40:36.901346] [INFO ] [MAIN ] EVTC: Loaded 26579 existing records. [2025-10-28T18:40:37.075430] [WARN ] [MAIN ] EVTC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:40:37.075626] [INFO ] [MAIN ] EVTC: Wiping existing primary data before full refresh. [2025-10-28T18:40:37.075707] [INFO ] [LOCAL ] EVTC: Starting deletion of primary data. [2025-10-28T18:40:37.076232] [DEBUG] [LOCAL ] EVTC: Deleted primary data file. [2025-10-28T18:40:37.076290] [INFO ] [MAIN ] EVTC: Starting full primary refresh. [2025-10-28T18:40:37.432151] [INFO ] [REMOTE ] EVTC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:40:37.443020] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-10-28T18:40:37.559299] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-01. [2025-10-28T18:40:38.359369] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-06. [2025-10-28T18:40:38.834775] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-28T18:40:39.159295] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-08. [2025-10-28T18:40:39.304681] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-28T18:40:39.791702] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-28T18:40:39.959307] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-02. [2025-10-28T18:40:40.691404] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-28T18:40:40.759301] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-03. [2025-10-28T18:40:41.559300] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-07. [2025-10-28T18:40:41.667486] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-28T18:40:42.359392] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-04. [2025-10-28T18:40:42.792974] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-28T18:40:43.159288] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-08. [2025-10-28T18:40:43.213557] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-28T18:40:43.959355] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-07. [2025-10-28T18:40:44.079150] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-28T18:40:44.759333] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-09. [2025-10-28T18:40:44.836039] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-10-28T18:40:45.559350] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-09. [2025-10-28T18:40:45.720246] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-28T18:40:46.359302] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-05. [2025-10-28T18:40:46.495508] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-28T18:40:47.159323] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-10. [2025-10-28T18:40:47.228158] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-28T18:40:47.959329] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-06. [2025-10-28T18:40:48.406281] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-28T18:40:48.412269] [INFO ] [REMOTE ] EVR: Full fetch complete (50338 records). [2025-10-28T18:40:48.412427] [DEBUG] [VALIDATOR ] EVR: Validating primary data. [2025-10-28T18:40:48.760419] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-10. [2025-10-28T18:40:48.802460] [DEBUG] [VALIDATOR ] EVR: All expected trading days are present. [2025-10-28T18:40:48.802548] [DEBUG] [VALIDATOR ] EVR: Primary data validation passed. [2025-10-28T18:40:48.803328] [INFO ] [MAIN ] EVR: Fetched primary data is valid. [2025-10-28T18:40:48.808518] [DEBUG] [LOCAL ] EVR: Saving primary data. [2025-10-28T18:40:48.817894] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-28T18:40:48.823995] [DEBUG] [LOCAL ] EVR: Trimmed 50338 records to 32859 (keeping 200 days of data) [2025-10-28T18:40:49.023802] [DEBUG] [LOCAL ] EVR: Primary data saved (32859 records). [2025-10-28T18:40:49.023956] [INFO ] [MAIN ] EVR: Full history saved. [2025-10-28T18:40:49.024050] [INFO ] [MAIN ] Update Progress: 791/2366 symbols completed. EVR took 30.2s. Estimated remaining: 3h 20m 39s. Rate: 7.8 symbols/min [2025-10-28T18:40:49.188131] [INFO ] [MAIN ] EVTL: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:40:49.225507] [DEBUG] [LOCAL ] EVTL: Loaded 41802 existing records from primary storage. [2025-10-28T18:40:49.225825] [INFO ] [MAIN ] EVTL: Loaded 41802 existing records. [2025-10-28T18:40:49.398264] [WARN ] [MAIN ] EVTL: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:40:49.398468] [INFO ] [MAIN ] EVTL: Wiping existing primary data before full refresh. [2025-10-28T18:40:49.398515] [INFO ] [LOCAL ] EVTL: Starting deletion of primary data. [2025-10-28T18:40:49.399015] [DEBUG] [LOCAL ] EVTL: Deleted primary data file. [2025-10-28T18:40:49.399075] [INFO ] [MAIN ] EVTL: Starting full primary refresh. [2025-10-28T18:40:49.571483] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-08. [2025-10-28T18:40:49.770544] [INFO ] [REMOTE ] EVTL: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:40:49.779041] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-28T18:40:49.782229] [INFO ] [REMOTE ] EVT: Full fetch complete (24805 records). [2025-10-28T18:40:49.782297] [DEBUG] [VALIDATOR ] EVT: Validating primary data. [2025-10-28T18:40:50.139575] [DEBUG] [VALIDATOR ] EVT: All expected trading days are present. [2025-10-28T18:40:50.139691] [DEBUG] [VALIDATOR ] EVT: Primary data validation passed. [2025-10-28T18:40:50.140258] [INFO ] [MAIN ] EVT: Fetched primary data is valid. [2025-10-28T18:40:50.140300] [DEBUG] [LOCAL ] EVT: Saving primary data. [2025-10-28T18:40:50.141076] [DEBUG] [LOCAL ] EVT: Trimmed 24805 records to 16162 (keeping 200 days of data) [2025-10-28T18:40:50.257406] [DEBUG] [LOCAL ] EVT: Primary data saved (16162 records). [2025-10-28T18:40:50.258058] [INFO ] [MAIN ] EVT: Full history saved. [2025-10-28T18:40:50.258355] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-28T18:40:50.258493] [INFO ] [MAIN ] Update Progress: 792/2366 symbols completed. EVT took 30.1s. Estimated remaining: 3h 20m 18s. Rate: 7.9 symbols/min [2025-10-28T18:40:50.361746] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-07. [2025-10-28T18:40:50.432107] [INFO ] [MAIN ] EVTR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:40:50.457328] [DEBUG] [LOCAL ] EVTR: Loaded 25721 existing records from primary storage. [2025-10-28T18:40:50.457567] [INFO ] [MAIN ] EVTR: Loaded 25721 existing records. [2025-10-28T18:40:50.631985] [WARN ] [MAIN ] EVTR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:40:50.632177] [INFO ] [MAIN ] EVTR: Wiping existing primary data before full refresh. [2025-10-28T18:40:50.632221] [INFO ] [LOCAL ] EVTR: Starting deletion of primary data. [2025-10-28T18:40:50.632577] [DEBUG] [LOCAL ] EVTR: Deleted primary data file. [2025-10-28T18:40:50.632634] [INFO ] [MAIN ] EVTR: Starting full primary refresh. [2025-10-28T18:40:51.034362] [INFO ] [REMOTE ] EVTR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:40:51.159331] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-01. [2025-10-28T18:40:51.460959] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-28T18:40:51.959458] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-08. [2025-10-28T18:40:52.478131] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-28T18:40:52.721844] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-28T18:40:52.759298] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-09. [2025-10-28T18:40:53.559298] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-01. [2025-10-28T18:40:53.596047] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-28T18:40:54.343003] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-28T18:40:54.359305] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-09. [2025-10-28T18:40:54.910771] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-28T18:40:55.159355] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-02. [2025-10-28T18:40:55.959387] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-10. [2025-10-28T18:40:56.169847] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-28T18:40:56.725083] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-28T18:40:56.728091] [INFO ] [REMOTE ] EVN: Full fetch complete (16845 records). [2025-10-28T18:40:56.728192] [DEBUG] [VALIDATOR ] EVN: Validating primary data. [2025-10-28T18:40:56.764463] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-10. [2025-10-28T18:40:57.092302] [DEBUG] [VALIDATOR ] EVN: All expected trading days are present. [2025-10-28T18:40:57.092376] [DEBUG] [VALIDATOR ] EVN: Primary data validation passed. [2025-10-28T18:40:57.092698] [INFO ] [MAIN ] EVN: Fetched primary data is valid. [2025-10-28T18:40:57.092758] [DEBUG] [LOCAL ] EVN: Saving primary data. [2025-10-28T18:40:57.093223] [DEBUG] [LOCAL ] EVN: Trimmed 16845 records to 10875 (keeping 200 days of data) [2025-10-28T18:40:57.157425] [DEBUG] [LOCAL ] EVN: Primary data saved (10875 records). [2025-10-28T18:40:57.157561] [INFO ] [MAIN ] EVN: Full history saved. [2025-10-28T18:40:57.157661] [INFO ] [MAIN ] Update Progress: 793/2366 symbols completed. EVN took 41.0s. Estimated remaining: 3h 20m 9s. Rate: 7.9 symbols/min [2025-10-28T18:40:57.326943] [INFO ] [MAIN ] EW: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:40:57.375000] [DEBUG] [LOCAL ] EW: Loaded 53386 existing records from primary storage. [2025-10-28T18:40:57.375344] [INFO ] [MAIN ] EW: Loaded 53386 existing records. [2025-10-28T18:40:57.546718] [WARN ] [MAIN ] EW: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:40:57.546959] [INFO ] [MAIN ] EW: Wiping existing primary data before full refresh. [2025-10-28T18:40:57.547005] [INFO ] [LOCAL ] EW: Starting deletion of primary data. [2025-10-28T18:40:57.547539] [DEBUG] [LOCAL ] EW: Deleted primary data file. [2025-10-28T18:40:57.547595] [INFO ] [MAIN ] EW: Starting full primary refresh. [2025-10-28T18:40:57.567720] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-03. [2025-10-28T18:40:57.916422] [INFO ] [REMOTE ] EW: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:40:57.939755] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-28T18:40:57.946759] [INFO ] [REMOTE ] EVTC: Full fetch complete (38482 records). [2025-10-28T18:40:57.946955] [DEBUG] [VALIDATOR ] EVTC: Validating primary data. [2025-10-28T18:40:58.364556] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-01. [2025-10-28T18:40:58.640148] [DEBUG] [VALIDATOR ] EVTC: All expected trading days are present. [2025-10-28T18:40:58.640562] [DEBUG] [VALIDATOR ] EVTC: Primary data validation passed. [2025-10-28T18:40:58.644138] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-28T18:40:58.642520] [INFO ] [MAIN ] EVTC: Fetched primary data is valid. [2025-10-28T18:40:58.652496] [DEBUG] [LOCAL ] EVTC: Saving primary data. [2025-10-28T18:40:58.654679] [DEBUG] [LOCAL ] EVTC: Trimmed 38482 records to 26510 (keeping 200 days of data) [2025-10-28T18:40:58.854755] [DEBUG] [LOCAL ] EVTC: Primary data saved (26510 records). [2025-10-28T18:40:58.854937] [INFO ] [MAIN ] EVTC: Full history saved. [2025-10-28T18:40:58.855056] [INFO ] [MAIN ] Update Progress: 794/2366 symbols completed. EVTC took 22.2s. Estimated remaining: 3h 19m 50s. Rate: 7.9 symbols/min [2025-10-28T18:40:59.034300] [INFO ] [MAIN ] EXG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:40:59.066069] [DEBUG] [LOCAL ] EXG: Loaded 33130 existing records from primary storage. [2025-10-28T18:40:59.066364] [INFO ] [MAIN ] EXG: Loaded 33130 existing records. [2025-10-28T18:40:59.165762] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-04. [2025-10-28T18:40:59.253577] [WARN ] [MAIN ] EXG: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:40:59.253810] [INFO ] [MAIN ] EXG: Wiping existing primary data before full refresh. [2025-10-28T18:40:59.253858] [INFO ] [LOCAL ] EXG: Starting deletion of primary data. [2025-10-28T18:40:59.254142] [DEBUG] [LOCAL ] EXG: Deleted primary data file. [2025-10-28T18:40:59.254199] [INFO ] [MAIN ] EXG: Starting full primary refresh. [2025-10-28T18:40:59.653163] [INFO ] [REMOTE ] EXG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:40:59.920071] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-28T18:40:59.959314] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-01. [2025-10-28T18:40:59.991006] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-10-28T18:41:00.759338] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-05. [2025-10-28T18:41:01.538187] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-28T18:41:01.559343] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-02. [2025-10-28T18:41:01.880475] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-28T18:41:02.359322] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-02. [2025-10-28T18:41:02.522894] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-28T18:41:02.946182] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-28T18:41:03.159352] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-03. [2025-10-28T18:41:03.959338] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-06. [2025-10-28T18:41:04.112267] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-28T18:41:04.759377] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-02. [2025-10-28T18:41:05.168101] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-28T18:41:05.559324] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-04. [2025-10-28T18:41:05.872676] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-28T18:41:06.359367] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-03. [2025-10-28T18:41:06.617240] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-28T18:41:07.167150] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-07. [2025-10-28T18:41:07.170479] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-28T18:41:07.959373] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-04. [2025-10-28T18:41:08.759357] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-03. [2025-10-28T18:41:09.182347] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-28T18:41:09.316942] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-10-28T18:41:09.559334] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-05. [2025-10-28T18:41:10.022541] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-28T18:41:10.359331] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-05. [2025-10-28T18:41:10.764381] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-28T18:41:11.159337] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-06. [2025-10-28T18:41:11.370499] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-28T18:41:11.905890] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-28T18:41:11.959343] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-07. [2025-10-28T18:41:12.680598] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-28T18:41:12.759341] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-04. [2025-10-28T18:41:13.559334] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-08. [2025-10-28T18:41:14.149288] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-28T18:41:14.290592] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-28T18:41:14.359354] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-05. [2025-10-28T18:41:15.159397] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-09. [2025-10-28T18:41:15.641460] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-28T18:41:15.959399] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-06. [2025-10-28T18:41:16.169820] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-28T18:41:16.759398] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-10. [2025-10-28T18:41:17.030304] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-28T18:41:17.559397] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-08. [2025-10-28T18:41:18.172753] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-28T18:41:18.180343] [INFO ] [REMOTE ] EVTR: Full fetch complete (34542 records). [2025-10-28T18:41:18.180505] [DEBUG] [VALIDATOR ] EVTR: Validating primary data. [2025-10-28T18:41:18.364796] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-07. [2025-10-28T18:41:18.548733] [DEBUG] [VALIDATOR ] EVTR: All expected trading days are present. [2025-10-28T18:41:18.548807] [DEBUG] [VALIDATOR ] EVTR: Primary data validation passed. [2025-10-28T18:41:18.549365] [INFO ] [MAIN ] EVTR: Fetched primary data is valid. [2025-10-28T18:41:18.549403] [DEBUG] [LOCAL ] EVTR: Saving primary data. [2025-10-28T18:41:18.550156] [DEBUG] [LOCAL ] EVTR: Trimmed 34542 records to 25713 (keeping 200 days of data) [2025-10-28T18:41:18.698717] [DEBUG] [LOCAL ] EVTR: Primary data saved (25713 records). [2025-10-28T18:41:18.698838] [INFO ] [MAIN ] EVTR: Full history saved. [2025-10-28T18:41:18.698911] [INFO ] [MAIN ] Update Progress: 795/2366 symbols completed. EVTR took 28.4s. Estimated remaining: 3h 20m 6s. Rate: 7.9 symbols/min [2025-10-28T18:41:18.875016] [INFO ] [MAIN ] EXK: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:41:18.929482] [DEBUG] [LOCAL ] EXK: Loaded 53188 existing records from primary storage. [2025-10-28T18:41:18.929795] [INFO ] [MAIN ] EXK: Loaded 53188 existing records. [2025-10-28T18:41:19.137798] [WARN ] [MAIN ] EXK: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:41:19.138056] [INFO ] [MAIN ] EXK: Wiping existing primary data before full refresh. [2025-10-28T18:41:19.138721] [INFO ] [LOCAL ] EXK: Starting deletion of primary data. [2025-10-28T18:41:19.140140] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-28T18:41:19.149963] [DEBUG] [LOCAL ] EXK: Deleted primary data file. [2025-10-28T18:41:19.150034] [INFO ] [MAIN ] EXK: Starting full primary refresh. [2025-10-28T18:41:19.164430] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-06. [2025-10-28T18:41:19.506980] [INFO ] [REMOTE ] EXK: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:41:19.526735] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-28T18:41:19.959336] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-01. [2025-10-28T18:41:20.636469] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-10-28T18:41:20.759387] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-07. [2025-10-28T18:41:21.100851] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-28T18:41:21.559367] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-02. [2025-10-28T18:41:22.020355] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-28T18:41:22.359397] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-08. [2025-10-28T18:41:23.026121] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-28T18:41:23.159302] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-03. [2025-10-28T18:41:23.566343] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-28T18:41:23.959363] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-08. [2025-10-28T18:41:24.465595] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-28T18:41:24.765117] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-09. [2025-10-28T18:41:24.779774] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-28T18:41:25.559393] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-09. [2025-10-28T18:41:26.179918] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-28T18:41:26.359337] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-10. [2025-10-28T18:41:26.394323] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-28T18:41:27.159341] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-04. [2025-10-28T18:41:27.966626] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-10. [2025-10-28T18:41:27.974837] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-10 (1.62 seconds). [2025-10-28T18:41:27.986391] [INFO ] [REMOTE ] EVTL: Full fetch complete (55151 records). [2025-10-28T18:41:27.986937] [DEBUG] [VALIDATOR ] EVTL: Validating primary data. [2025-10-28T18:41:27.988523] [FATAL] [VALIDATOR ] EVTL: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T18:41:27.988676] [FATAL] [MAIN ] EVTL: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:41:27.988735] [WARN ] [MAIN ] EVTL: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:41:27.988781] [INFO ] [LOCAL ] EVTL: Starting deletion of primary data. [2025-10-28T18:41:27.988984] [DEBUG] [LOCAL ] EVTL: No primary data file found to delete. [2025-10-28T18:41:27.989029] [INFO ] [LOCAL ] EVTL: Starting deletion of derivative data. [2025-10-28T18:41:27.989216] [DEBUG] [LOCAL ] EVTL: Deleted derivative data file. [2025-10-28T18:41:27.989321] [INFO ] [MAIN ] Update Progress: 796/2366 symbols completed. EVTL took 39.0s. Estimated remaining: 3h 20m 2s. Rate: 7.8 symbols/min [2025-10-28T18:41:28.163027] [INFO ] [MAIN ] EXP: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:41:28.163231] [DEBUG] [LOCAL ] EXP: No existing data file found in primary storage. [2025-10-28T18:41:28.163287] [WARN ] [MAIN ] EXP: No existing data found, performing full refresh instead. [2025-10-28T18:41:28.163405] [INFO ] [MAIN ] EXP: Wiping existing primary data before full refresh. [2025-10-28T18:41:28.163448] [INFO ] [LOCAL ] EXP: Starting deletion of primary data. [2025-10-28T18:41:28.163508] [DEBUG] [LOCAL ] EXP: No primary data file found to delete. [2025-10-28T18:41:28.163540] [INFO ] [MAIN ] EXP: Starting full primary refresh. [2025-10-28T18:41:28.520634] [INFO ] [REMOTE ] EXP: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:41:28.561728] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-28T18:41:28.759324] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-01. [2025-10-28T18:41:29.242399] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-28T18:41:29.248866] [INFO ] [REMOTE ] EXG: Full fetch complete (49211 records). [2025-10-28T18:41:29.249004] [DEBUG] [VALIDATOR ] EXG: Validating primary data. [2025-10-28T18:41:29.564568] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-09. [2025-10-28T18:41:29.641820] [DEBUG] [VALIDATOR ] EXG: All expected trading days are present. [2025-10-28T18:41:29.641900] [DEBUG] [VALIDATOR ] EXG: Primary data validation passed. [2025-10-28T18:41:29.642589] [INFO ] [MAIN ] EXG: Fetched primary data is valid. [2025-10-28T18:41:29.642628] [DEBUG] [LOCAL ] EXG: Saving primary data. [2025-10-28T18:41:29.643599] [DEBUG] [LOCAL ] EXG: Trimmed 49211 records to 32985 (keeping 200 days of data) [2025-10-28T18:41:29.857918] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-28T18:41:29.857269] [DEBUG] [LOCAL ] EXG: Primary data saved (32985 records). [2025-10-28T18:41:29.864138] [INFO ] [MAIN ] EXG: Full history saved. [2025-10-28T18:41:29.864213] [INFO ] [MAIN ] Update Progress: 797/2366 symbols completed. EXG took 31.0s. Estimated remaining: 3h 19m 43s. Rate: 7.9 symbols/min [2025-10-28T18:41:30.359409] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-02. [2025-10-28T18:41:30.954099] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-28T18:41:31.159335] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-05. [2025-10-28T18:41:31.284576] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-28T18:41:31.959339] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-10. [2025-10-28T18:41:32.464886] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-28T18:41:32.759328] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-03. [2025-10-28T18:41:33.499360] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-28T18:41:33.510526] [INFO ] [REMOTE ] EW: Full fetch complete (77504 records). [2025-10-28T18:41:33.510762] [DEBUG] [VALIDATOR ] EW: Validating primary data. [2025-10-28T18:41:33.571581] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-06. [2025-10-28T18:41:33.937252] [DEBUG] [VALIDATOR ] EW: All expected trading days are present. [2025-10-28T18:41:33.937365] [DEBUG] [VALIDATOR ] EW: Primary data validation passed. [2025-10-28T18:41:33.945573] [INFO ] [MAIN ] EW: Fetched primary data is valid. [2025-10-28T18:41:33.960786] [DEBUG] [LOCAL ] EW: Saving primary data. [2025-10-28T18:41:33.965415] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-28T18:41:33.972079] [DEBUG] [LOCAL ] EW: Trimmed 77504 records to 53386 (keeping 200 days of data) [2025-10-28T18:41:34.275425] [DEBUG] [LOCAL ] EW: Primary data saved (53386 records). [2025-10-28T18:41:34.275546] [INFO ] [MAIN ] EW: Full history saved. [2025-10-28T18:41:34.276318] [INFO ] [MAIN ] Update Progress: 798/2366 symbols completed. EW took 37.1s. Estimated remaining: 3h 19m 29s. Rate: 7.9 symbols/min [2025-10-28T18:41:34.359357] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-04. [2025-10-28T18:41:35.108583] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-28T18:41:35.159297] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-07. [2025-10-28T18:41:35.304025] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-28T18:41:35.959345] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-05. [2025-10-28T18:41:36.637140] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-28T18:41:36.759338] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-08. [2025-10-28T18:41:36.845845] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-28T18:41:37.559400] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-06. [2025-10-28T18:41:38.225256] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-28T18:41:38.359309] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-09. [2025-10-28T18:41:38.471610] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-28T18:41:39.159366] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-07. [2025-10-28T18:41:39.689040] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-28T18:41:39.959333] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-10. [2025-10-28T18:41:40.301040] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-28T18:41:40.759334] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-08. [2025-10-28T18:41:41.509301] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-28T18:41:41.559323] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-09. [2025-10-28T18:41:41.861102] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-10 (1.90 seconds). [2025-10-28T18:41:41.871954] [INFO ] [REMOTE ] EXK: Full fetch complete (76883 records). [2025-10-28T18:41:41.872110] [DEBUG] [VALIDATOR ] EXK: Validating primary data. [2025-10-28T18:41:42.273133] [DEBUG] [VALIDATOR ] EXK: All expected trading days are present. [2025-10-28T18:41:42.273236] [DEBUG] [VALIDATOR ] EXK: Primary data validation passed. [2025-10-28T18:41:42.274457] [INFO ] [MAIN ] EXK: Fetched primary data is valid. [2025-10-28T18:41:42.274534] [DEBUG] [LOCAL ] EXK: Saving primary data. [2025-10-28T18:41:42.277594] [DEBUG] [LOCAL ] EXK: Trimmed 76883 records to 53188 (keeping 200 days of data) [2025-10-28T18:41:42.398489] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-28T18:41:42.408333] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-10. [2025-10-28T18:41:42.617278] [DEBUG] [LOCAL ] EXK: Primary data saved (53188 records). [2025-10-28T18:41:42.617406] [INFO ] [MAIN ] EXK: Full history saved. [2025-10-28T18:41:42.618327] [INFO ] [MAIN ] Update Progress: 799/2366 symbols completed. EXK took 23.9s. Estimated remaining: 3h 19m 23s. Rate: 7.9 symbols/min [2025-10-28T18:41:43.398661] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-28T18:41:43.404138] [INFO ] [REMOTE ] EXP: Full fetch complete (42818 records). [2025-10-28T18:41:43.404228] [DEBUG] [VALIDATOR ] EXP: Validating primary data. [2025-10-28T18:41:43.801215] [DEBUG] [VALIDATOR ] EXP: All expected trading days are present. [2025-10-28T18:41:43.801295] [DEBUG] [VALIDATOR ] EXP: Primary data validation passed. [2025-10-28T18:41:43.801986] [INFO ] [MAIN ] EXP: Fetched primary data is valid. [2025-10-28T18:41:43.802049] [DEBUG] [LOCAL ] EXP: Saving primary data. [2025-10-28T18:41:43.803124] [DEBUG] [LOCAL ] EXP: Trimmed 42818 records to 28717 (keeping 200 days of data) [2025-10-28T18:41:43.977273] [DEBUG] [LOCAL ] EXP: Primary data saved (28717 records). [2025-10-28T18:41:43.977396] [INFO ] [MAIN ] EXP: Full history saved. [2025-10-28T18:41:43.977464] [INFO ] [MAIN ] Update Progress: 800/2366 symbols completed. EXP took 16.0s. Estimated remaining: 3h 19m 3s. Rate: 7.9 symbols/min [2025-10-28T18:41:44.648867] [INFO ] [MAIN ] F: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:41:44.699315] [INFO ] [MAIN ] EXPD: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:41:44.695890] [INFO ] [MAIN ] FAF: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:41:44.717128] [INFO ] [MAIN ] EXR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:41:44.717323] [DEBUG] [LOCAL ] EXR: No existing data file found in primary storage. [2025-10-28T18:41:44.717564] [DEBUG] [LOCAL ] EXPD: No existing data file found in primary storage. [2025-10-28T18:41:44.717850] [WARN ] [MAIN ] EXPD: No existing data found, performing full refresh instead. [2025-10-28T18:41:44.718243] [WARN ] [MAIN ] EXR: No existing data found, performing full refresh instead. [2025-10-28T18:41:44.718701] [INFO ] [MAIN ] EXR: Wiping existing primary data before full refresh. [2025-10-28T18:41:44.718596] [INFO ] [MAIN ] EXPD: Wiping existing primary data before full refresh. [2025-10-28T18:41:44.718799] [INFO ] [LOCAL ] EXR: Starting deletion of primary data. [2025-10-28T18:41:44.718943] [DEBUG] [LOCAL ] EXR: No primary data file found to delete. [2025-10-28T18:41:44.719042] [INFO ] [LOCAL ] EXPD: Starting deletion of primary data. [2025-10-28T18:41:44.719107] [INFO ] [MAIN ] EXR: Starting full primary refresh. [2025-10-28T18:41:44.736498] [DEBUG] [LOCAL ] EXPD: No primary data file found to delete. [2025-10-28T18:41:44.757525] [INFO ] [MAIN ] EXPD: Starting full primary refresh. [2025-10-28T18:41:45.133915] [DEBUG] [LOCAL ] FAF: Loaded 41263 existing records from primary storage. [2025-10-28T18:41:45.167347] [INFO ] [MAIN ] FAF: Loaded 41263 existing records. [2025-10-28T18:41:45.334930] [DEBUG] [LOCAL ] F: Loaded 53820 existing records from primary storage. [2025-10-28T18:41:45.383184] [INFO ] [MAIN ] F: Loaded 53820 existing records. [2025-10-28T18:41:45.727846] [WARN ] [MAIN ] FAF: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:41:45.800253] [INFO ] [MAIN ] FAF: Wiping existing primary data before full refresh. [2025-10-28T18:41:45.800403] [INFO ] [LOCAL ] FAF: Starting deletion of primary data. [2025-10-28T18:41:45.776701] [INFO ] [REMOTE ] EXR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:41:45.868953] [INFO ] [REMOTE ] EXPD: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:41:45.878043] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-01. [2025-10-28T18:41:45.877836] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-01. [2025-10-28T18:41:45.888087] [DEBUG] [LOCAL ] FAF: Deleted primary data file. [2025-10-28T18:41:45.888214] [INFO ] [MAIN ] FAF: Starting full primary refresh. [2025-10-28T18:41:45.901243] [WARN ] [MAIN ] F: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:41:45.913608] [INFO ] [MAIN ] F: Wiping existing primary data before full refresh. [2025-10-28T18:41:45.947404] [INFO ] [LOCAL ] F: Starting deletion of primary data. [2025-10-28T18:41:45.971861] [DEBUG] [LOCAL ] F: Deleted primary data file. [2025-10-28T18:41:45.982681] [INFO ] [MAIN ] F: Starting full primary refresh. [2025-10-28T18:41:46.665354] [INFO ] [REMOTE ] FAF: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:41:46.694078] [INFO ] [REMOTE ] F: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:41:46.694508] [INFO ] [REMOTE ] F: Fetching primary data for 2025-01. [2025-10-28T18:41:46.694911] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-01. [2025-10-28T18:41:47.156041] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-28T18:41:47.165605] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-02. [2025-10-28T18:41:47.513264] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-28T18:41:47.523226] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-02. [2025-10-28T18:41:47.783325] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-28T18:41:47.959334] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-02. [2025-10-28T18:41:48.364890] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-28T18:41:48.621723] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-28T18:41:48.660105] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-28T18:41:48.759301] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-03. [2025-10-28T18:41:48.940823] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-28T18:41:49.559338] [INFO ] [REMOTE ] F: Fetching primary data for 2025-02. [2025-10-28T18:41:49.939702] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-28T18:41:50.359381] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-04. [2025-10-28T18:41:51.159407] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-03. [2025-10-28T18:41:51.307970] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-10-28T18:41:51.595540] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-28T18:41:51.959442] [INFO ] [REMOTE ] F: Fetching primary data for 2025-03. [2025-10-28T18:41:52.299802] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-28T18:41:52.759338] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-03. [2025-10-28T18:41:53.559336] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-05. [2025-10-28T18:41:53.793808] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-28T18:41:53.847344] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-28T18:41:54.359320] [INFO ] [REMOTE ] F: Fetching primary data for 2025-04. [2025-10-28T18:41:54.676275] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-28T18:41:55.159370] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-06. [2025-10-28T18:41:55.959408] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-04. [2025-10-28T18:41:56.285242] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-10-28T18:41:56.323945] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-28T18:41:56.759376] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-04. [2025-10-28T18:41:57.374308] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-28T18:41:57.559332] [INFO ] [REMOTE ] F: Fetching primary data for 2025-05. [2025-10-28T18:41:57.863884] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-28T18:41:58.359383] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-05. [2025-10-28T18:41:59.159318] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-07. [2025-10-28T18:41:59.588315] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-28T18:41:59.629210] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-10-28T18:41:59.959336] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-06. [2025-10-28T18:42:00.544554] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-28T18:42:00.759333] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-08. [2025-10-28T18:42:01.034245] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-28T18:42:01.559453] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-07. [2025-10-28T18:42:01.953616] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-28T18:42:02.359360] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-09. [2025-10-28T18:42:02.717829] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-28T18:42:03.159377] [INFO ] [REMOTE ] F: Fetching primary data for 2025-06. [2025-10-28T18:42:03.475221] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-28T18:42:03.959347] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-10. [2025-10-28T18:42:04.560493] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-28T18:42:04.569486] [INFO ] [REMOTE ] EXR: Full fetch complete (66042 records). [2025-10-28T18:42:04.569611] [DEBUG] [VALIDATOR ] EXR: Validating primary data. [2025-10-28T18:42:04.767840] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-08. [2025-10-28T18:42:04.963354] [DEBUG] [VALIDATOR ] EXR: All expected trading days are present. [2025-10-28T18:42:04.963469] [DEBUG] [VALIDATOR ] EXR: Primary data validation passed. [2025-10-28T18:42:04.964347] [INFO ] [MAIN ] EXR: Fetched primary data is valid. [2025-10-28T18:42:04.964436] [DEBUG] [LOCAL ] EXR: Saving primary data. [2025-10-28T18:42:04.965963] [DEBUG] [LOCAL ] EXR: Trimmed 66042 records to 45173 (keeping 200 days of data) [2025-10-28T18:42:05.101309] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-28T18:42:05.288432] [DEBUG] [LOCAL ] EXR: Primary data saved (45173 records). [2025-10-28T18:42:05.288558] [INFO ] [MAIN ] EXR: Full history saved. [2025-10-28T18:42:05.288627] [INFO ] [MAIN ] Update Progress: 801/2366 symbols completed. EXR took 21.3s. Estimated remaining: 3h 19m 22s. Rate: 7.8 symbols/min [2025-10-28T18:42:05.452155] [INFO ] [MAIN ] FBIN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:42:05.493026] [DEBUG] [LOCAL ] FBIN: Loaded 50259 existing records from primary storage. [2025-10-28T18:42:05.493332] [INFO ] [MAIN ] FBIN: Loaded 50259 existing records. [2025-10-28T18:42:05.566672] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-05. [2025-10-28T18:42:05.669733] [WARN ] [MAIN ] FBIN: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:42:05.669929] [INFO ] [MAIN ] FBIN: Wiping existing primary data before full refresh. [2025-10-28T18:42:05.669976] [INFO ] [LOCAL ] FBIN: Starting deletion of primary data. [2025-10-28T18:42:05.670836] [DEBUG] [LOCAL ] FBIN: Deleted primary data file. [2025-10-28T18:42:05.670909] [INFO ] [MAIN ] FBIN: Starting full primary refresh. [2025-10-28T18:42:06.025319] [INFO ] [REMOTE ] FBIN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:42:06.053279] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-28T18:42:06.359308] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-09. [2025-10-28T18:42:06.682355] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-28T18:42:07.159387] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-01. [2025-10-28T18:42:07.752893] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-28T18:42:07.959345] [INFO ] [REMOTE ] F: Fetching primary data for 2025-07. [2025-10-28T18:42:08.422703] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-28T18:42:08.759325] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-10. [2025-10-28T18:42:09.559341] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-02. [2025-10-28T18:42:09.961552] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-28T18:42:09.972266] [INFO ] [REMOTE ] EXPD: Full fetch complete (69282 records). [2025-10-28T18:42:09.972416] [DEBUG] [VALIDATOR ] EXPD: Validating primary data. [2025-10-28T18:42:10.187413] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-10-28T18:42:10.364564] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-06. [2025-10-28T18:42:10.485396] [DEBUG] [VALIDATOR ] EXPD: All expected trading days are present. [2025-10-28T18:42:10.485487] [DEBUG] [VALIDATOR ] EXPD: Primary data validation passed. [2025-10-28T18:42:10.486866] [INFO ] [MAIN ] EXPD: Fetched primary data is valid. [2025-10-28T18:42:10.486932] [DEBUG] [LOCAL ] EXPD: Saving primary data. [2025-10-28T18:42:10.488535] [DEBUG] [LOCAL ] EXPD: Trimmed 69282 records to 47457 (keeping 200 days of data) [2025-10-28T18:42:10.822288] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-28T18:42:10.843744] [DEBUG] [LOCAL ] EXPD: Primary data saved (47457 records). [2025-10-28T18:42:10.843852] [INFO ] [MAIN ] EXPD: Full history saved. [2025-10-28T18:42:10.843922] [INFO ] [MAIN ] Update Progress: 802/2366 symbols completed. EXPD took 26.9s. Estimated remaining: 3h 19m 10s. Rate: 7.9 symbols/min [2025-10-28T18:42:11.036300] [INFO ] [MAIN ] FBK: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:42:11.061030] [DEBUG] [LOCAL ] FBK: Loaded 27185 existing records from primary storage. [2025-10-28T18:42:11.061290] [INFO ] [MAIN ] FBK: Loaded 27185 existing records. [2025-10-28T18:42:11.160034] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-03. [2025-10-28T18:42:11.240536] [WARN ] [MAIN ] FBK: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:42:11.240775] [INFO ] [MAIN ] FBK: Wiping existing primary data before full refresh. [2025-10-28T18:42:11.240824] [INFO ] [LOCAL ] FBK: Starting deletion of primary data. [2025-10-28T18:42:11.241328] [DEBUG] [LOCAL ] FBK: Deleted primary data file. [2025-10-28T18:42:11.241385] [INFO ] [MAIN ] FBK: Starting full primary refresh. [2025-10-28T18:42:11.600701] [INFO ] [REMOTE ] FBK: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:42:11.635381] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-28T18:42:11.959387] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-07. [2025-10-28T18:42:12.447506] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-28T18:42:12.759349] [INFO ] [REMOTE ] F: Fetching primary data for 2025-08. [2025-10-28T18:42:13.207703] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-28T18:42:13.559371] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-04. [2025-10-28T18:42:14.359393] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-01. [2025-10-28T18:42:14.543555] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-28T18:42:14.733459] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-28T18:42:15.159325] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-05. [2025-10-28T18:42:15.192137] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-28T18:42:15.959419] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-08. [2025-10-28T18:42:16.395372] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-28T18:42:16.759365] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-02. [2025-10-28T18:42:16.985173] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-28T18:42:17.367584] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-28T18:42:17.559365] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-06. [2025-10-28T18:42:18.359367] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-03. [2025-10-28T18:42:18.957464] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-28T18:42:19.017344] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-28T18:42:19.159346] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-04. [2025-10-28T18:42:19.959335] [INFO ] [REMOTE ] F: Fetching primary data for 2025-09. [2025-10-28T18:42:20.008228] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-28T18:42:20.759358] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-09. [2025-10-28T18:42:21.559367] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-07. [2025-10-28T18:42:21.842824] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-10-28T18:42:21.882169] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-28T18:42:22.359379] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-05. [2025-10-28T18:42:22.779541] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-28T18:42:22.952425] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-28T18:42:23.159399] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-06. [2025-10-28T18:42:23.804420] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-28T18:42:23.959405] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-07. [2025-10-28T18:42:24.759368] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-10. [2025-10-28T18:42:25.286906] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-28T18:42:25.559378] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-08. [2025-10-28T18:42:25.856887] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-28T18:42:25.865682] [INFO ] [REMOTE ] FAF: Full fetch complete (58396 records). [2025-10-28T18:42:25.865912] [DEBUG] [VALIDATOR ] FAF: Validating primary data. [2025-10-28T18:42:26.292067] [DEBUG] [VALIDATOR ] FAF: All expected trading days are present. [2025-10-28T18:42:26.292184] [DEBUG] [VALIDATOR ] FAF: Primary data validation passed. [2025-10-28T18:42:26.293029] [INFO ] [MAIN ] FAF: Fetched primary data is valid. [2025-10-28T18:42:26.293091] [DEBUG] [LOCAL ] FAF: Saving primary data. [2025-10-28T18:42:26.294188] [DEBUG] [LOCAL ] FAF: Trimmed 58396 records to 41201 (keeping 200 days of data) [2025-10-28T18:42:26.379737] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-08. [2025-10-28T18:42:26.539682] [DEBUG] [LOCAL ] FAF: Primary data saved (41201 records). [2025-10-28T18:42:26.539809] [INFO ] [MAIN ] FAF: Full history saved. [2025-10-28T18:42:26.539885] [INFO ] [MAIN ] Update Progress: 803/2366 symbols completed. FAF took 42.5s. Estimated remaining: 3h 19m 18s. Rate: 7.8 symbols/min [2025-10-28T18:42:26.703910] [INFO ] [MAIN ] FBP: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:42:26.744089] [DEBUG] [LOCAL ] FBP: Loaded 45446 existing records from primary storage. [2025-10-28T18:42:26.744381] [INFO ] [MAIN ] FBP: Loaded 45446 existing records. [2025-10-28T18:42:26.925064] [WARN ] [MAIN ] FBP: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:42:26.925316] [INFO ] [MAIN ] FBP: Wiping existing primary data before full refresh. [2025-10-28T18:42:26.925489] [INFO ] [LOCAL ] FBP: Starting deletion of primary data. [2025-10-28T18:42:26.926358] [DEBUG] [LOCAL ] FBP: Deleted primary data file. [2025-10-28T18:42:26.926473] [INFO ] [MAIN ] FBP: Starting full primary refresh. [2025-10-28T18:42:27.121226] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-10-28T18:42:27.160045] [INFO ] [REMOTE ] F: Fetching primary data for 2025-10. [2025-10-28T18:42:27.343165] [INFO ] [REMOTE ] FBP: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:42:27.365540] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-28T18:42:27.932032] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-28T18:42:27.943319] [INFO ] [REMOTE ] F: Full fetch complete (78000 records). [2025-10-28T18:42:27.943527] [DEBUG] [VALIDATOR ] F: Validating primary data. [2025-10-28T18:42:27.965222] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-09. [2025-10-28T18:42:28.367626] [DEBUG] [VALIDATOR ] F: All expected trading days are present. [2025-10-28T18:42:28.367775] [DEBUG] [VALIDATOR ] F: Primary data validation passed. [2025-10-28T18:42:28.369215] [INFO ] [MAIN ] F: Fetched primary data is valid. [2025-10-28T18:42:28.369284] [DEBUG] [LOCAL ] F: Saving primary data. [2025-10-28T18:42:28.371506] [DEBUG] [LOCAL ] F: Trimmed 78000 records to 53820 (keeping 200 days of data) [2025-10-28T18:42:28.723226] [DEBUG] [LOCAL ] F: Primary data saved (53820 records). [2025-10-28T18:42:28.723431] [INFO ] [MAIN ] F: Full history saved. [2025-10-28T18:42:28.723535] [INFO ] [MAIN ] Update Progress: 804/2366 symbols completed. F took 44.7s. Estimated remaining: 3h 18m 60s. Rate: 7.8 symbols/min [2025-10-28T18:42:28.767447] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-01. [2025-10-28T18:42:28.899458] [INFO ] [MAIN ] FBRT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:42:28.937683] [DEBUG] [LOCAL ] FBRT: Loaded 34825 existing records from primary storage. [2025-10-28T18:42:28.938052] [INFO ] [MAIN ] FBRT: Loaded 34825 existing records. [2025-10-28T18:42:29.116072] [WARN ] [MAIN ] FBRT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:42:29.116385] [INFO ] [MAIN ] FBRT: Wiping existing primary data before full refresh. [2025-10-28T18:42:29.116437] [INFO ] [LOCAL ] FBRT: Starting deletion of primary data. [2025-10-28T18:42:29.117265] [DEBUG] [LOCAL ] FBRT: Deleted primary data file. [2025-10-28T18:42:29.117344] [INFO ] [MAIN ] FBRT: Starting full primary refresh. [2025-10-28T18:42:29.485668] [INFO ] [REMOTE ] FBRT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:42:29.570196] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-09. [2025-10-28T18:42:29.576829] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-28T18:42:30.029904] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-28T18:42:30.359317] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-02. [2025-10-28T18:42:30.462324] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-28T18:42:31.159406] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-01. [2025-10-28T18:42:31.378570] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-28T18:42:31.959336] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-10. [2025-10-28T18:42:32.168337] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-28T18:42:32.759369] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-03. [2025-10-28T18:42:33.356957] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-28T18:42:33.366898] [INFO ] [REMOTE ] FBIN: Full fetch complete (72840 records). [2025-10-28T18:42:33.367049] [DEBUG] [VALIDATOR ] FBIN: Validating primary data. [2025-10-28T18:42:33.566102] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-10. [2025-10-28T18:42:33.770890] [DEBUG] [VALIDATOR ] FBIN: All expected trading days are present. [2025-10-28T18:42:33.771023] [DEBUG] [VALIDATOR ] FBIN: Primary data validation passed. [2025-10-28T18:42:33.771984] [INFO ] [MAIN ] FBIN: Fetched primary data is valid. [2025-10-28T18:42:33.772095] [DEBUG] [LOCAL ] FBIN: Saving primary data. [2025-10-28T18:42:33.773871] [DEBUG] [LOCAL ] FBIN: Trimmed 72840 records to 50171 (keeping 200 days of data) [2025-10-28T18:42:33.917783] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-28T18:42:34.108926] [DEBUG] [LOCAL ] FBIN: Primary data saved (50171 records). [2025-10-28T18:42:34.109051] [INFO ] [MAIN ] FBIN: Full history saved. [2025-10-28T18:42:34.109128] [INFO ] [MAIN ] Update Progress: 805/2366 symbols completed. FBIN took 28.8s. Estimated remaining: 3h 18m 48s. Rate: 7.9 symbols/min [2025-10-28T18:42:34.274404] [INFO ] [MAIN ] FC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:42:34.287782] [DEBUG] [LOCAL ] FC: Loaded 13951 existing records from primary storage. [2025-10-28T18:42:34.288027] [INFO ] [MAIN ] FC: Loaded 13951 existing records. [2025-10-28T18:42:34.364419] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-04. [2025-10-28T18:42:34.468884] [WARN ] [MAIN ] FC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:42:34.469093] [INFO ] [MAIN ] FC: Wiping existing primary data before full refresh. [2025-10-28T18:42:34.469154] [INFO ] [LOCAL ] FC: Starting deletion of primary data. [2025-10-28T18:42:34.469560] [DEBUG] [LOCAL ] FC: Deleted primary data file. [2025-10-28T18:42:34.469619] [INFO ] [MAIN ] FC: Starting full primary refresh. [2025-10-28T18:42:34.833390] [INFO ] [REMOTE ] FC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:42:34.851380] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-28T18:42:34.857952] [INFO ] [REMOTE ] FBK: Full fetch complete (35656 records). [2025-10-28T18:42:34.858060] [DEBUG] [VALIDATOR ] FBK: Validating primary data. [2025-10-28T18:42:35.164571] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-02. [2025-10-28T18:42:35.232002] [DEBUG] [VALIDATOR ] FBK: All expected trading days are present. [2025-10-28T18:42:35.232082] [DEBUG] [VALIDATOR ] FBK: Primary data validation passed. [2025-10-28T18:42:35.232711] [INFO ] [MAIN ] FBK: Fetched primary data is valid. [2025-10-28T18:42:35.232772] [DEBUG] [LOCAL ] FBK: Saving primary data. [2025-10-28T18:42:35.233515] [DEBUG] [LOCAL ] FBK: Trimmed 35656 records to 27079 (keeping 200 days of data) [2025-10-28T18:42:35.393673] [DEBUG] [LOCAL ] FBK: Primary data saved (27079 records). [2025-10-28T18:42:35.393920] [INFO ] [MAIN ] FBK: Full history saved. [2025-10-28T18:42:35.394036] [INFO ] [MAIN ] Update Progress: 806/2366 symbols completed. FBK took 24.6s. Estimated remaining: 3h 18m 28s. Rate: 7.9 symbols/min [2025-10-28T18:42:35.565134] [INFO ] [MAIN ] FCF: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:42:35.594281] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-28T18:42:35.635053] [DEBUG] [LOCAL ] FCF: Loaded 38757 existing records from primary storage. [2025-10-28T18:42:35.635355] [INFO ] [MAIN ] FCF: Loaded 38757 existing records. [2025-10-28T18:42:35.826829] [WARN ] [MAIN ] FCF: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:42:35.827052] [INFO ] [MAIN ] FCF: Wiping existing primary data before full refresh. [2025-10-28T18:42:35.827099] [INFO ] [LOCAL ] FCF: Starting deletion of primary data. [2025-10-28T18:42:35.827858] [DEBUG] [LOCAL ] FCF: Deleted primary data file. [2025-10-28T18:42:35.827914] [INFO ] [MAIN ] FCF: Starting full primary refresh. [2025-10-28T18:42:35.964458] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-05. [2025-10-28T18:42:36.207597] [INFO ] [REMOTE ] FCF: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:42:36.247695] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-28T18:42:36.759343] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-01. [2025-10-28T18:42:37.273042] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-28T18:42:37.559347] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-06. [2025-10-28T18:42:37.958931] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-28T18:42:38.359355] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-01. [2025-10-28T18:42:38.553712] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-28T18:42:38.853778] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-28T18:42:39.159352] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-02. [2025-10-28T18:42:39.959320] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-02. [2025-10-28T18:42:40.128411] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-28T18:42:40.478232] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-28T18:42:40.759336] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-03. [2025-10-28T18:42:41.559318] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-03. [2025-10-28T18:42:41.655353] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-28T18:42:42.198493] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-28T18:42:42.359326] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-03. [2025-10-28T18:42:43.159339] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-07. [2025-10-28T18:42:43.493724] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-28T18:42:43.959331] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-04. [2025-10-28T18:42:44.567497] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-28T18:42:44.759385] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-04. [2025-10-28T18:42:45.164701] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-28T18:42:45.559335] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-08. [2025-10-28T18:42:46.116806] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-28T18:42:46.359362] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-04. [2025-10-28T18:42:46.676848] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-28T18:42:47.031080] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-28T18:42:47.159366] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-05. [2025-10-28T18:42:47.692513] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-28T18:42:47.959370] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-05. [2025-10-28T18:42:48.759379] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-09. [2025-10-28T18:42:48.802660] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-28T18:42:49.559330] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-05. [2025-10-28T18:42:49.773213] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-28T18:42:50.359317] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-06. [2025-10-28T18:42:50.488329] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-28T18:42:51.159311] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-10. [2025-10-28T18:42:51.308506] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-28T18:42:51.959400] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-06. [2025-10-28T18:42:52.518094] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-28T18:42:52.527613] [INFO ] [REMOTE ] FBP: Full fetch complete (66769 records). [2025-10-28T18:42:52.527791] [DEBUG] [VALIDATOR ] FBP: Validating primary data. [2025-10-28T18:42:52.763775] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-06. [2025-10-28T18:42:52.931877] [DEBUG] [VALIDATOR ] FBP: All expected trading days are present. [2025-10-28T18:42:52.931991] [DEBUG] [VALIDATOR ] FBP: Primary data validation passed. [2025-10-28T18:42:52.932906] [INFO ] [MAIN ] FBP: Fetched primary data is valid. [2025-10-28T18:42:52.933023] [DEBUG] [LOCAL ] FBP: Saving primary data. [2025-10-28T18:42:52.953264] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-28T18:42:52.960541] [DEBUG] [LOCAL ] FBP: Trimmed 66769 records to 45412 (keeping 200 days of data) [2025-10-28T18:42:53.225050] [DEBUG] [LOCAL ] FBP: Primary data saved (45412 records). [2025-10-28T18:42:53.225169] [INFO ] [MAIN ] FBP: Full history saved. [2025-10-28T18:42:53.225243] [INFO ] [MAIN ] Update Progress: 807/2366 symbols completed. FBP took 26.7s. Estimated remaining: 3h 18m 40s. Rate: 7.8 symbols/min [2025-10-28T18:42:53.392822] [INFO ] [MAIN ] FCN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:42:53.416876] [DEBUG] [LOCAL ] FCN: Loaded 25826 existing records from primary storage. [2025-10-28T18:42:53.417124] [INFO ] [MAIN ] FCN: Loaded 25826 existing records. [2025-10-28T18:42:53.550837] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-28T18:42:53.563021] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-07. [2025-10-28T18:42:53.607134] [WARN ] [MAIN ] FCN: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:42:53.607459] [INFO ] [MAIN ] FCN: Wiping existing primary data before full refresh. [2025-10-28T18:42:53.607520] [INFO ] [LOCAL ] FCN: Starting deletion of primary data. [2025-10-28T18:42:53.608093] [DEBUG] [LOCAL ] FCN: Deleted primary data file. [2025-10-28T18:42:53.608160] [INFO ] [MAIN ] FCN: Starting full primary refresh. [2025-10-28T18:42:53.962155] [INFO ] [REMOTE ] FCN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:42:54.359317] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-07. [2025-10-28T18:42:54.780216] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-28T18:42:55.050454] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-28T18:42:55.159326] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-08. [2025-10-28T18:42:55.959301] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-01. [2025-10-28T18:42:56.128190] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-28T18:42:56.640742] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-28T18:42:56.759373] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-08. [2025-10-28T18:42:57.344878] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-28T18:42:57.559335] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-09. [2025-10-28T18:42:58.187478] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-28T18:42:58.359366] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-09. [2025-10-28T18:42:59.159322] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-07. [2025-10-28T18:42:59.430827] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-28T18:42:59.959335] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-10. [2025-10-28T18:43:00.205577] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-28T18:43:00.759315] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-02. [2025-10-28T18:43:00.788493] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-28T18:43:00.791511] [INFO ] [REMOTE ] FC: Full fetch complete (21786 records). [2025-10-28T18:43:00.791599] [DEBUG] [VALIDATOR ] FC: Validating primary data. [2025-10-28T18:43:01.163190] [DEBUG] [VALIDATOR ] FC: All expected trading days are present. [2025-10-28T18:43:01.163268] [DEBUG] [VALIDATOR ] FC: Primary data validation passed. [2025-10-28T18:43:01.163789] [INFO ] [MAIN ] FC: Fetched primary data is valid. [2025-10-28T18:43:01.163852] [DEBUG] [LOCAL ] FC: Saving primary data. [2025-10-28T18:43:01.164445] [DEBUG] [LOCAL ] FC: Trimmed 21786 records to 13903 (keeping 200 days of data) [2025-10-28T18:43:01.244004] [DEBUG] [LOCAL ] FC: Primary data saved (13903 records). [2025-10-28T18:43:01.244139] [INFO ] [MAIN ] FC: Full history saved. [2025-10-28T18:43:01.244219] [INFO ] [MAIN ] Update Progress: 808/2366 symbols completed. FC took 27.1s. Estimated remaining: 3h 18m 33s. Rate: 7.8 symbols/min [2025-10-28T18:43:01.411152] [INFO ] [MAIN ] FCPT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:43:01.445566] [DEBUG] [LOCAL ] FCPT: Loaded 36614 existing records from primary storage. [2025-10-28T18:43:01.445928] [INFO ] [MAIN ] FCPT: Loaded 36614 existing records. [2025-10-28T18:43:01.560283] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-10. [2025-10-28T18:43:01.641191] [WARN ] [MAIN ] FCPT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:43:01.641417] [INFO ] [MAIN ] FCPT: Wiping existing primary data before full refresh. [2025-10-28T18:43:01.641466] [INFO ] [LOCAL ] FCPT: Starting deletion of primary data. [2025-10-28T18:43:01.642108] [DEBUG] [LOCAL ] FCPT: Deleted primary data file. [2025-10-28T18:43:01.642167] [INFO ] [MAIN ] FCPT: Starting full primary refresh. [2025-10-28T18:43:02.016258] [INFO ] [REMOTE ] FCPT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:43:02.030115] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-28T18:43:02.359397] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-03. [2025-10-28T18:43:02.865691] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-28T18:43:02.873820] [INFO ] [REMOTE ] FCF: Full fetch complete (57914 records). [2025-10-28T18:43:02.873944] [DEBUG] [VALIDATOR ] FCF: Validating primary data. [2025-10-28T18:43:03.161305] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-08. [2025-10-28T18:43:03.253567] [DEBUG] [VALIDATOR ] FCF: All expected trading days are present. [2025-10-28T18:43:03.253735] [DEBUG] [VALIDATOR ] FCF: Primary data validation passed. [2025-10-28T18:43:03.254542] [INFO ] [MAIN ] FCF: Fetched primary data is valid. [2025-10-28T18:43:03.254737] [DEBUG] [LOCAL ] FCF: Saving primary data. [2025-10-28T18:43:03.255849] [DEBUG] [LOCAL ] FCF: Trimmed 57914 records to 38576 (keeping 200 days of data) [2025-10-28T18:43:03.379824] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-28T18:43:03.508571] [DEBUG] [LOCAL ] FCF: Primary data saved (38576 records). [2025-10-28T18:43:03.508737] [INFO ] [MAIN ] FCF: Full history saved. [2025-10-28T18:43:03.508827] [INFO ] [MAIN ] Update Progress: 809/2366 symbols completed. FCF took 28.1s. Estimated remaining: 3h 18m 15s. Rate: 7.9 symbols/min [2025-10-28T18:43:03.676928] [INFO ] [MAIN ] FCRX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:43:03.677086] [DEBUG] [LOCAL ] FCRX: No existing data file found in primary storage. [2025-10-28T18:43:03.677123] [WARN ] [MAIN ] FCRX: No existing data found, performing full refresh instead. [2025-10-28T18:43:03.677226] [INFO ] [MAIN ] FCRX: Wiping existing primary data before full refresh. [2025-10-28T18:43:03.677265] [INFO ] [LOCAL ] FCRX: Starting deletion of primary data. [2025-10-28T18:43:03.677306] [DEBUG] [LOCAL ] FCRX: No primary data file found to delete. [2025-10-28T18:43:03.677337] [INFO ] [MAIN ] FCRX: Starting full primary refresh. [2025-10-28T18:43:03.963385] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-04. [2025-10-28T18:43:04.037625] [INFO ] [REMOTE ] FCRX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:43:04.056967] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-28T18:43:04.759362] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-01. [2025-10-28T18:43:05.144845] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-28T18:43:05.559382] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-09. [2025-10-28T18:43:05.771103] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-28T18:43:06.359376] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-02. [2025-10-28T18:43:06.414939] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-10-28T18:43:07.159386] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-01. [2025-10-28T18:43:07.511633] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-10-28T18:43:07.538764] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-28T18:43:07.959352] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-03. [2025-10-28T18:43:08.759330] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-02. [2025-10-28T18:43:08.997319] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-28T18:43:09.036023] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-02 (0.28 seconds). [2025-10-28T18:43:09.559333] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-03. [2025-10-28T18:43:09.841307] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-03 (0.28 seconds). [2025-10-28T18:43:10.359350] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-04. [2025-10-28T18:43:11.159367] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-04. [2025-10-28T18:43:11.445827] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-04 (0.29 seconds). [2025-10-28T18:43:11.474600] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-28T18:43:11.959332] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-05. [2025-10-28T18:43:12.759332] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-10. [2025-10-28T18:43:13.060156] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-28T18:43:13.559391] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-06. [2025-10-28T18:43:14.014848] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-28T18:43:14.022680] [INFO ] [REMOTE ] FBRT: Full fetch complete (49460 records). [2025-10-28T18:43:14.022814] [DEBUG] [VALIDATOR ] FBRT: Validating primary data. [2025-10-28T18:43:14.365061] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-05. [2025-10-28T18:43:14.416610] [DEBUG] [VALIDATOR ] FBRT: All expected trading days are present. [2025-10-28T18:43:14.416715] [DEBUG] [VALIDATOR ] FBRT: Primary data validation passed. [2025-10-28T18:43:14.417422] [INFO ] [MAIN ] FBRT: Fetched primary data is valid. [2025-10-28T18:43:14.417470] [DEBUG] [LOCAL ] FBRT: Saving primary data. [2025-10-28T18:43:14.418701] [DEBUG] [LOCAL ] FBRT: Trimmed 49460 records to 34679 (keeping 200 days of data) [2025-10-28T18:43:14.631417] [DEBUG] [LOCAL ] FBRT: Primary data saved (34679 records). [2025-10-28T18:43:14.631725] [INFO ] [MAIN ] FBRT: Full history saved. [2025-10-28T18:43:14.631839] [INFO ] [MAIN ] Update Progress: 810/2366 symbols completed. FBRT took 45.9s. Estimated remaining: 3h 18m 14s. Rate: 7.8 symbols/min [2025-10-28T18:43:14.768318] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-28T18:43:14.839778] [INFO ] [MAIN ] FCT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:43:14.839972] [DEBUG] [LOCAL ] FCT: No existing data file found in primary storage. [2025-10-28T18:43:14.840010] [WARN ] [MAIN ] FCT: No existing data found, performing full refresh instead. [2025-10-28T18:43:14.840118] [INFO ] [MAIN ] FCT: Wiping existing primary data before full refresh. [2025-10-28T18:43:14.840159] [INFO ] [LOCAL ] FCT: Starting deletion of primary data. [2025-10-28T18:43:14.840199] [DEBUG] [LOCAL ] FCT: No primary data file found to delete. [2025-10-28T18:43:14.840230] [INFO ] [MAIN ] FCT: Starting full primary refresh. [2025-10-28T18:43:15.164493] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-07. [2025-10-28T18:43:15.223673] [INFO ] [REMOTE ] FCT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:43:15.441794] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-28T18:43:15.959366] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-06. [2025-10-28T18:43:16.262448] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-28T18:43:16.764469] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-05. [2025-10-28T18:43:16.773393] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-28T18:43:17.004918] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-05 (0.24 seconds). [2025-10-28T18:43:17.559339] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-07. [2025-10-28T18:43:18.348957] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-10-28T18:43:18.359305] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-08. [2025-10-28T18:43:19.096941] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-28T18:43:19.159329] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-08. [2025-10-28T18:43:19.959305] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-09. [2025-10-28T18:43:20.141014] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-28T18:43:20.617866] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-28T18:43:20.759351] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-10. [2025-10-28T18:43:21.559315] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-09. [2025-10-28T18:43:21.712754] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-28T18:43:21.718821] [INFO ] [REMOTE ] FCN: Full fetch complete (36829 records). [2025-10-28T18:43:21.718937] [DEBUG] [VALIDATOR ] FCN: Validating primary data. [2025-10-28T18:43:22.153218] [DEBUG] [VALIDATOR ] FCN: All expected trading days are present. [2025-10-28T18:43:22.153300] [DEBUG] [VALIDATOR ] FCN: Primary data validation passed. [2025-10-28T18:43:22.153913] [INFO ] [MAIN ] FCN: Fetched primary data is valid. [2025-10-28T18:43:22.153975] [DEBUG] [LOCAL ] FCN: Saving primary data. [2025-10-28T18:43:22.154757] [DEBUG] [LOCAL ] FCN: Trimmed 36829 records to 25819 (keeping 200 days of data) [2025-10-28T18:43:22.318137] [DEBUG] [LOCAL ] FCN: Primary data saved (25819 records). [2025-10-28T18:43:22.318261] [INFO ] [MAIN ] FCN: Full history saved. [2025-10-28T18:43:22.318339] [INFO ] [MAIN ] Update Progress: 811/2366 symbols completed. FCN took 29.1s. Estimated remaining: 3h 18m 6s. Rate: 7.8 symbols/min [2025-10-28T18:43:22.365133] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-06. [2025-10-28T18:43:22.514055] [INFO ] [MAIN ] FCX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:43:22.514233] [DEBUG] [LOCAL ] FCX: No existing data file found in primary storage. [2025-10-28T18:43:22.514425] [WARN ] [MAIN ] FCX: No existing data found, performing full refresh instead. [2025-10-28T18:43:22.514694] [INFO ] [MAIN ] FCX: Wiping existing primary data before full refresh. [2025-10-28T18:43:22.514763] [INFO ] [LOCAL ] FCX: Starting deletion of primary data. [2025-10-28T18:43:22.514956] [DEBUG] [LOCAL ] FCX: No primary data file found to delete. [2025-10-28T18:43:22.515048] [INFO ] [MAIN ] FCX: Starting full primary refresh. [2025-10-28T18:43:22.754904] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-28T18:43:22.847224] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-28T18:43:22.939811] [INFO ] [REMOTE ] FCX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:43:23.159366] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-07. [2025-10-28T18:43:23.389813] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-07 (0.23 seconds). [2025-10-28T18:43:23.959366] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-01. [2025-10-28T18:43:24.759527] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-01. [2025-10-28T18:43:25.511994] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-28T18:43:25.559300] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-02. [2025-10-28T18:43:25.767976] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-28T18:43:26.359359] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-10. [2025-10-28T18:43:26.922121] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-28T18:43:27.159370] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-08. [2025-10-28T18:43:27.443445] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-08 (0.28 seconds). [2025-10-28T18:43:27.695959] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-28T18:43:27.703626] [INFO ] [REMOTE ] FCPT: Full fetch complete (53769 records). [2025-10-28T18:43:27.703787] [DEBUG] [VALIDATOR ] FCPT: Validating primary data. [2025-10-28T18:43:27.964605] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-02. [2025-10-28T18:43:28.079592] [DEBUG] [VALIDATOR ] FCPT: All expected trading days are present. [2025-10-28T18:43:28.079691] [DEBUG] [VALIDATOR ] FCPT: Primary data validation passed. [2025-10-28T18:43:28.080485] [INFO ] [MAIN ] FCPT: Fetched primary data is valid. [2025-10-28T18:43:28.080527] [DEBUG] [LOCAL ] FCPT: Saving primary data. [2025-10-28T18:43:28.081612] [DEBUG] [LOCAL ] FCPT: Trimmed 53769 records to 36533 (keeping 200 days of data) [2025-10-28T18:43:28.294298] [DEBUG] [LOCAL ] FCPT: Primary data saved (36533 records). [2025-10-28T18:43:28.294424] [INFO ] [MAIN ] FCPT: Full history saved. [2025-10-28T18:43:28.294511] [INFO ] [MAIN ] Update Progress: 812/2366 symbols completed. FCPT took 27.1s. Estimated remaining: 3h 17m 56s. Rate: 7.9 symbols/min [2025-10-28T18:43:28.458688] [INFO ] [MAIN ] FDP: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:43:28.485008] [DEBUG] [LOCAL ] FDP: Loaded 29418 existing records from primary storage. [2025-10-28T18:43:28.485260] [INFO ] [MAIN ] FDP: Loaded 29418 existing records. [2025-10-28T18:43:28.648351] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-28T18:43:28.671514] [WARN ] [MAIN ] FDP: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:43:28.671706] [INFO ] [MAIN ] FDP: Wiping existing primary data before full refresh. [2025-10-28T18:43:28.671762] [INFO ] [LOCAL ] FDP: Starting deletion of primary data. [2025-10-28T18:43:28.672319] [DEBUG] [LOCAL ] FDP: Deleted primary data file. [2025-10-28T18:43:28.672376] [INFO ] [MAIN ] FDP: Starting full primary refresh. [2025-10-28T18:43:28.767035] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-09. [2025-10-28T18:43:29.020768] [INFO ] [REMOTE ] FDP: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:43:29.046591] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-09 (0.28 seconds). [2025-10-28T18:43:29.559345] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-03. [2025-10-28T18:43:30.359339] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-03. [2025-10-28T18:43:30.843706] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-28T18:43:31.067173] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-28T18:43:31.159348] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-04. [2025-10-28T18:43:31.803741] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-28T18:43:31.959481] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-10. [2025-10-28T18:43:32.285436] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-10 (0.33 seconds). [2025-10-28T18:43:32.286323] [INFO ] [REMOTE ] FCRX: Full fetch complete (1619 records). [2025-10-28T18:43:32.286397] [DEBUG] [VALIDATOR ] FCRX: Validating primary data. [2025-10-28T18:43:32.469749] [WARN ] [VALIDATOR ] FCRX: Validation failed - insufficient historical data. Have 188 unique days, need 200 days [2025-10-28T18:43:32.469981] [FATAL] [MAIN ] FCRX: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:43:32.470060] [WARN ] [MAIN ] FCRX: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:43:32.470123] [INFO ] [LOCAL ] FCRX: Starting deletion of primary data. [2025-10-28T18:43:32.470188] [DEBUG] [LOCAL ] FCRX: No primary data file found to delete. [2025-10-28T18:43:32.470229] [INFO ] [LOCAL ] FCRX: Starting deletion of derivative data. [2025-10-28T18:43:32.470272] [DEBUG] [LOCAL ] FCRX: No derivative data file found to delete. [2025-10-28T18:43:32.470368] [INFO ] [MAIN ] Update Progress: 813/2366 symbols completed. FCRX took 29.0s. Estimated remaining: 3h 17m 41s. Rate: 7.9 symbols/min [2025-10-28T18:43:32.643488] [INFO ] [MAIN ] FDS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:43:32.672811] [DEBUG] [LOCAL ] FDS: Loaded 28149 existing records from primary storage. [2025-10-28T18:43:32.673149] [INFO ] [MAIN ] FDS: Loaded 28149 existing records. [2025-10-28T18:43:32.764506] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-01. [2025-10-28T18:43:32.868081] [WARN ] [MAIN ] FDS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:43:32.868471] [INFO ] [MAIN ] FDS: Wiping existing primary data before full refresh. [2025-10-28T18:43:32.868530] [INFO ] [LOCAL ] FDS: Starting deletion of primary data. [2025-10-28T18:43:32.869457] [DEBUG] [LOCAL ] FDS: Deleted primary data file. [2025-10-28T18:43:32.869517] [INFO ] [MAIN ] FDS: Starting full primary refresh. [2025-10-28T18:43:33.246272] [INFO ] [REMOTE ] FDS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:43:33.559296] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-04. [2025-10-28T18:43:33.736057] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-28T18:43:34.359355] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-02. [2025-10-28T18:43:35.159338] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-05. [2025-10-28T18:43:35.186246] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-28T18:43:35.327579] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-10-28T18:43:35.687078] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-28T18:43:35.959334] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-01. [2025-10-28T18:43:36.759326] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-06. [2025-10-28T18:43:36.868129] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-28T18:43:37.504908] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-28T18:43:37.559307] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-02. [2025-10-28T18:43:38.359306] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-05. [2025-10-28T18:43:38.440369] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-28T18:43:39.159321] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-03. [2025-10-28T18:43:39.973766] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-03. [2025-10-28T18:43:39.976782] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-10-28T18:43:40.012826] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-28T18:43:40.759347] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-06. [2025-10-28T18:43:40.999614] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-28T18:43:41.559334] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-04. [2025-10-28T18:43:42.266876] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-28T18:43:42.292639] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-28T18:43:42.359340] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-07. [2025-10-28T18:43:42.970598] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-28T18:43:43.159334] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-07. [2025-10-28T18:43:43.959358] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-04. [2025-10-28T18:43:44.759301] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-05. [2025-10-28T18:43:44.871979] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-28T18:43:45.031386] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-28T18:43:45.559337] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-08. [2025-10-28T18:43:45.801696] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-28T18:43:46.160260] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-28T18:43:46.359424] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-05. [2025-10-28T18:43:47.159362] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-08. [2025-10-28T18:43:47.244989] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-28T18:43:47.959357] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-09. [2025-10-28T18:43:48.745416] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-28T18:43:48.747473] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-28T18:43:48.761667] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-06. [2025-10-28T18:43:49.559302] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-10. [2025-10-28T18:43:49.582256] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-28T18:43:50.282144] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-28T18:43:50.286156] [INFO ] [REMOTE ] FCT: Full fetch complete (21443 records). [2025-10-28T18:43:50.286227] [DEBUG] [VALIDATOR ] FCT: Validating primary data. [2025-10-28T18:43:50.364468] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-09. [2025-10-28T18:43:50.649911] [DEBUG] [VALIDATOR ] FCT: All expected trading days are present. [2025-10-28T18:43:50.649980] [DEBUG] [VALIDATOR ] FCT: Primary data validation passed. [2025-10-28T18:43:50.650448] [INFO ] [MAIN ] FCT: Fetched primary data is valid. [2025-10-28T18:43:50.650506] [DEBUG] [LOCAL ] FCT: Saving primary data. [2025-10-28T18:43:50.651080] [DEBUG] [LOCAL ] FCT: Trimmed 21443 records to 14513 (keeping 200 days of data) [2025-10-28T18:43:50.747441] [DEBUG] [LOCAL ] FCT: Primary data saved (14513 records). [2025-10-28T18:43:50.747563] [INFO ] [MAIN ] FCT: Full history saved. [2025-10-28T18:43:50.747630] [INFO ] [MAIN ] Update Progress: 814/2366 symbols completed. FCT took 36.1s. Estimated remaining: 3h 17m 54s. Rate: 7.8 symbols/min [2025-10-28T18:43:50.920855] [INFO ] [MAIN ] FDX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:43:50.971738] [DEBUG] [LOCAL ] FDX: Loaded 51063 existing records from primary storage. [2025-10-28T18:43:50.972019] [INFO ] [MAIN ] FDX: Loaded 51063 existing records. [2025-10-28T18:43:51.145498] [WARN ] [MAIN ] FDX: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:43:51.145729] [INFO ] [MAIN ] FDX: Wiping existing primary data before full refresh. [2025-10-28T18:43:51.145782] [INFO ] [LOCAL ] FDX: Starting deletion of primary data. [2025-10-28T18:43:51.146753] [DEBUG] [LOCAL ] FDX: Deleted primary data file. [2025-10-28T18:43:51.146815] [INFO ] [MAIN ] FDX: Starting full primary refresh. [2025-10-28T18:43:51.167337] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-06. [2025-10-28T18:43:51.502505] [INFO ] [REMOTE ] FDX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:43:51.959317] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-07. [2025-10-28T18:43:52.082976] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-28T18:43:52.141091] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-28T18:43:52.759305] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-10. [2025-10-28T18:43:52.826285] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-28T18:43:53.559395] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-07. [2025-10-28T18:43:54.338973] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-28T18:43:54.359304] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-08. [2025-10-28T18:43:54.708541] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-10 (1.95 seconds). [2025-10-28T18:43:54.719245] [INFO ] [REMOTE ] FCX: Full fetch complete (77878 records). [2025-10-28T18:43:54.719368] [DEBUG] [VALIDATOR ] FCX: Validating primary data. [2025-10-28T18:43:55.108324] [DEBUG] [VALIDATOR ] FCX: All expected trading days are present. [2025-10-28T18:43:55.108419] [DEBUG] [VALIDATOR ] FCX: Primary data validation passed. [2025-10-28T18:43:55.109333] [INFO ] [MAIN ] FCX: Fetched primary data is valid. [2025-10-28T18:43:55.109534] [DEBUG] [LOCAL ] FCX: Saving primary data. [2025-10-28T18:43:55.111013] [DEBUG] [LOCAL ] FCX: Trimmed 77878 records to 53702 (keeping 200 days of data) [2025-10-28T18:43:55.163126] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-08. [2025-10-28T18:43:55.314545] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-28T18:43:55.462766] [DEBUG] [LOCAL ] FCX: Primary data saved (53702 records). [2025-10-28T18:43:55.462899] [INFO ] [MAIN ] FCX: Full history saved. [2025-10-28T18:43:55.462970] [INFO ] [MAIN ] Update Progress: 815/2366 symbols completed. FCX took 33.1s. Estimated remaining: 3h 17m 41s. Rate: 7.8 symbols/min [2025-10-28T18:43:55.626397] [INFO ] [MAIN ] FE: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:43:55.671935] [DEBUG] [LOCAL ] FE: Loaded 53430 existing records from primary storage. [2025-10-28T18:43:55.672232] [INFO ] [MAIN ] FE: Loaded 53430 existing records. [2025-10-28T18:43:55.843433] [WARN ] [MAIN ] FE: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:43:55.843633] [INFO ] [MAIN ] FE: Wiping existing primary data before full refresh. [2025-10-28T18:43:55.843727] [INFO ] [LOCAL ] FE: Starting deletion of primary data. [2025-10-28T18:43:55.844634] [DEBUG] [LOCAL ] FE: Deleted primary data file. [2025-10-28T18:43:55.844734] [INFO ] [MAIN ] FE: Starting full primary refresh. [2025-10-28T18:43:55.964460] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-09. [2025-10-28T18:43:56.232215] [INFO ] [REMOTE ] FE: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:43:56.249626] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-28T18:43:56.759335] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-01. [2025-10-28T18:43:57.207161] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-28T18:43:57.559402] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-01. [2025-10-28T18:43:58.178742] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-28T18:43:58.359349] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-10. [2025-10-28T18:43:58.869692] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-28T18:43:59.159326] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-02. [2025-10-28T18:43:59.959309] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-09. [2025-10-28T18:44:00.759319] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-02. [2025-10-28T18:44:01.276155] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-10 (2.92 seconds). [2025-10-28T18:44:01.284219] [INFO ] [REMOTE ] FDS: Full fetch complete (39791 records). [2025-10-28T18:44:01.284312] [DEBUG] [VALIDATOR ] FDS: Validating primary data. [2025-10-28T18:44:01.654357] [DEBUG] [VALIDATOR ] FDS: All expected trading days are present. [2025-10-28T18:44:01.654536] [DEBUG] [VALIDATOR ] FDS: Primary data validation passed. [2025-10-28T18:44:01.655245] [INFO ] [MAIN ] FDS: Fetched primary data is valid. [2025-10-28T18:44:01.655308] [DEBUG] [LOCAL ] FDS: Saving primary data. [2025-10-28T18:44:01.656213] [DEBUG] [LOCAL ] FDS: Trimmed 39791 records to 28214 (keeping 200 days of data) [2025-10-28T18:44:01.841170] [DEBUG] [LOCAL ] FDS: Primary data saved (28214 records). [2025-10-28T18:44:01.841321] [INFO ] [MAIN ] FDS: Full history saved. [2025-10-28T18:44:01.841416] [INFO ] [MAIN ] Update Progress: 816/2366 symbols completed. FDS took 29.4s. Estimated remaining: 3h 17m 31s. Rate: 7.8 symbols/min [2025-10-28T18:44:02.041194] [INFO ] [MAIN ] FENG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:44:02.041509] [DEBUG] [LOCAL ] FENG: No existing data file found in primary storage. [2025-10-28T18:44:02.041626] [WARN ] [MAIN ] FENG: No existing data found, performing full refresh instead. [2025-10-28T18:44:02.041763] [INFO ] [MAIN ] FENG: Wiping existing primary data before full refresh. [2025-10-28T18:44:02.041804] [INFO ] [LOCAL ] FENG: Starting deletion of primary data. [2025-10-28T18:44:02.041845] [DEBUG] [LOCAL ] FENG: No primary data file found to delete. [2025-10-28T18:44:02.041876] [INFO ] [MAIN ] FENG: Starting full primary refresh. [2025-10-28T18:44:02.410721] [INFO ] [REMOTE ] FENG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:44:02.411116] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-01. [2025-10-28T18:44:02.438924] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-28T18:44:02.449071] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-03. [2025-10-28T18:44:03.024302] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-09 (3.06 seconds). [2025-10-28T18:44:03.044337] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-28T18:44:03.159350] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-10. [2025-10-28T18:44:03.244281] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-02 (4.08 seconds). [2025-10-28T18:44:03.736536] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-28T18:44:03.959364] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-02. [2025-10-28T18:44:04.087965] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-28T18:44:04.093375] [INFO ] [REMOTE ] FDP: Full fetch complete (42785 records). [2025-10-28T18:44:04.093460] [DEBUG] [VALIDATOR ] FDP: Validating primary data. [2025-10-28T18:44:04.267896] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-10-28T18:44:04.476061] [DEBUG] [VALIDATOR ] FDP: All expected trading days are present. [2025-10-28T18:44:04.476148] [DEBUG] [VALIDATOR ] FDP: Primary data validation passed. [2025-10-28T18:44:04.476843] [INFO ] [MAIN ] FDP: Fetched primary data is valid. [2025-10-28T18:44:04.476905] [DEBUG] [LOCAL ] FDP: Saving primary data. [2025-10-28T18:44:04.477845] [DEBUG] [LOCAL ] FDP: Trimmed 42785 records to 29373 (keeping 200 days of data) [2025-10-28T18:44:04.648784] [DEBUG] [LOCAL ] FDP: Primary data saved (29373 records). [2025-10-28T18:44:04.648926] [INFO ] [MAIN ] FDP: Full history saved. [2025-10-28T18:44:04.649010] [INFO ] [MAIN ] Update Progress: 817/2366 symbols completed. FDP took 36.4s. Estimated remaining: 3h 17m 14s. Rate: 7.9 symbols/min [2025-10-28T18:44:04.764533] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-03. [2025-10-28T18:44:04.821369] [INFO ] [MAIN ] FERG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:44:04.864501] [DEBUG] [LOCAL ] FERG: Loaded 48610 existing records from primary storage. [2025-10-28T18:44:04.864861] [INFO ] [MAIN ] FERG: Loaded 48610 existing records. [2025-10-28T18:44:05.042808] [WARN ] [MAIN ] FERG: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:44:05.043002] [INFO ] [MAIN ] FERG: Wiping existing primary data before full refresh. [2025-10-28T18:44:05.043048] [INFO ] [LOCAL ] FERG: Starting deletion of primary data. [2025-10-28T18:44:05.043944] [DEBUG] [LOCAL ] FERG: Deleted primary data file. [2025-10-28T18:44:05.044000] [INFO ] [MAIN ] FERG: Starting full primary refresh. [2025-10-28T18:44:05.285841] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-28T18:44:05.397460] [INFO ] [REMOTE ] FERG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:44:05.559319] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-01. [2025-10-28T18:44:06.359369] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-04. [2025-10-28T18:44:06.778920] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-28T18:44:06.967162] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-28T18:44:07.159321] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-02. [2025-10-28T18:44:07.959431] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-03. [2025-10-28T18:44:08.252842] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-28T18:44:08.759355] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-05. [2025-10-28T18:44:09.033081] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-05 (0.27 seconds). [2025-10-28T18:44:09.559368] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-04. [2025-10-28T18:44:10.359464] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-03. [2025-10-28T18:44:10.939065] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-28T18:44:11.159309] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-05. [2025-10-28T18:44:11.637010] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-28T18:44:11.959410] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-04. [2025-10-28T18:44:12.344456] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-28T18:44:12.458809] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-03 (4.50 seconds). [2025-10-28T18:44:12.759325] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-04. [2025-10-28T18:44:13.559311] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-06. [2025-10-28T18:44:14.121498] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-28T18:44:14.359321] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-06. [2025-10-28T18:44:14.722893] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-10-28T18:44:15.159366] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-07. [2025-10-28T18:44:15.410220] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-07 (0.25 seconds). [2025-10-28T18:44:15.959345] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-05. [2025-10-28T18:44:16.759342] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-08. [2025-10-28T18:44:17.002334] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-08 (0.24 seconds). [2025-10-28T18:44:17.349104] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-28T18:44:17.559360] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-06. [2025-10-28T18:44:18.295863] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-04 (6.34 seconds). [2025-10-28T18:44:18.359320] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-09. [2025-10-28T18:44:18.728949] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-10-28T18:44:18.971041] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-28T18:44:19.159331] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-07. [2025-10-28T18:44:19.653760] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-06 (6.09 seconds). [2025-10-28T18:44:19.959412] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-05. [2025-10-28T18:44:20.759330] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-07. [2025-10-28T18:44:21.324965] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-28T18:44:21.559332] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-10. [2025-10-28T18:44:22.079914] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-28T18:44:22.191201] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-28T18:44:22.192148] [INFO ] [REMOTE ] FENG: Full fetch complete (2254 records). [2025-10-28T18:44:22.192217] [DEBUG] [VALIDATOR ] FENG: Validating primary data. [2025-10-28T18:44:22.366189] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-06. [2025-10-28T18:44:22.372791] [WARN ] [VALIDATOR ] FENG: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-28T18:44:22.372980] [FATAL] [MAIN ] FENG: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:44:22.374021] [WARN ] [MAIN ] FENG: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:44:22.374094] [INFO ] [LOCAL ] FENG: Starting deletion of primary data. [2025-10-28T18:44:22.374152] [DEBUG] [LOCAL ] FENG: No primary data file found to delete. [2025-10-28T18:44:22.374189] [INFO ] [LOCAL ] FENG: Starting deletion of derivative data. [2025-10-28T18:44:22.374230] [DEBUG] [LOCAL ] FENG: No derivative data file found to delete. [2025-10-28T18:44:22.374301] [INFO ] [MAIN ] Update Progress: 818/2366 symbols completed. FENG took 20.5s. Estimated remaining: 3h 17m 25s. Rate: 7.8 symbols/min [2025-10-28T18:44:22.545025] [INFO ] [MAIN ] FET: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:44:22.558157] [DEBUG] [LOCAL ] FET: Loaded 12924 existing records from primary storage. [2025-10-28T18:44:22.558397] [INFO ] [MAIN ] FET: Loaded 12924 existing records. [2025-10-28T18:44:22.736785] [WARN ] [MAIN ] FET: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:44:22.737018] [INFO ] [MAIN ] FET: Wiping existing primary data before full refresh. [2025-10-28T18:44:22.737066] [INFO ] [LOCAL ] FET: Starting deletion of primary data. [2025-10-28T18:44:22.737399] [DEBUG] [LOCAL ] FET: Deleted primary data file. [2025-10-28T18:44:22.737455] [INFO ] [MAIN ] FET: Starting full primary refresh. [2025-10-28T18:44:23.094033] [INFO ] [REMOTE ] FET: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:44:23.159315] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-01. [2025-10-28T18:44:23.682717] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-28T18:44:23.816388] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-28T18:44:23.959304] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-07. [2025-10-28T18:44:24.759324] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-08. [2025-10-28T18:44:25.060878] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-07 (5.90 seconds). [2025-10-28T18:44:25.264118] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-28T18:44:25.559344] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-02. [2025-10-28T18:44:26.002164] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-28T18:44:26.038060] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-28T18:44:26.359328] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-03. [2025-10-28T18:44:26.980430] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-28T18:44:27.159388] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-09. [2025-10-28T18:44:27.959377] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-08. [2025-10-28T18:44:28.552065] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-28T18:44:28.759334] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-10. [2025-10-28T18:44:29.559339] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-04. [2025-10-28T18:44:30.184529] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-28T18:44:30.334554] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-28T18:44:30.345700] [INFO ] [REMOTE ] FE: Full fetch complete (77495 records). [2025-10-28T18:44:30.345831] [DEBUG] [VALIDATOR ] FE: Validating primary data. [2025-10-28T18:44:30.367113] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-05. [2025-10-28T18:44:30.742918] [DEBUG] [VALIDATOR ] FE: All expected trading days are present. [2025-10-28T18:44:30.742995] [DEBUG] [VALIDATOR ] FE: Primary data validation passed. [2025-10-28T18:44:30.743895] [INFO ] [MAIN ] FE: Fetched primary data is valid. [2025-10-28T18:44:30.743958] [DEBUG] [LOCAL ] FE: Saving primary data. [2025-10-28T18:44:30.745379] [DEBUG] [LOCAL ] FE: Trimmed 77495 records to 53430 (keeping 200 days of data) [2025-10-28T18:44:31.061638] [DEBUG] [LOCAL ] FE: Primary data saved (53430 records). [2025-10-28T18:44:31.061796] [INFO ] [MAIN ] FE: Full history saved. [2025-10-28T18:44:31.061874] [INFO ] [MAIN ] Update Progress: 819/2366 symbols completed. FE took 35.6s. Estimated remaining: 3h 17m 20s. Rate: 7.8 symbols/min [2025-10-28T18:44:31.160462] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-08. [2025-10-28T18:44:31.230697] [INFO ] [MAIN ] FF: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:44:31.250981] [DEBUG] [LOCAL ] FF: Loaded 23163 existing records from primary storage. [2025-10-28T18:44:31.251222] [INFO ] [MAIN ] FF: Loaded 23163 existing records. [2025-10-28T18:44:31.424407] [WARN ] [MAIN ] FF: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:44:31.424600] [INFO ] [MAIN ] FF: Wiping existing primary data before full refresh. [2025-10-28T18:44:31.424714] [INFO ] [LOCAL ] FF: Starting deletion of primary data. [2025-10-28T18:44:31.425175] [DEBUG] [LOCAL ] FF: Deleted primary data file. [2025-10-28T18:44:31.425235] [INFO ] [MAIN ] FF: Starting full primary refresh. [2025-10-28T18:44:31.813496] [INFO ] [REMOTE ] FF: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:44:31.959377] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-01. [2025-10-28T18:44:32.778095] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-10-28T18:44:32.789584] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-09. [2025-10-28T18:44:32.837824] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-28T18:44:33.092516] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-08 (5.13 seconds). [2025-10-28T18:44:33.559334] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-02. [2025-10-28T18:44:34.306037] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-28T18:44:34.359585] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-03. [2025-10-28T18:44:34.462872] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-05 (4.10 seconds). [2025-10-28T18:44:35.159392] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-06. [2025-10-28T18:44:35.959332] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-09. [2025-10-28T18:44:37.508304] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-28T18:44:37.519253] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-10. [2025-10-28T18:44:38.813381] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-03 (4.45 seconds). [2025-10-28T18:44:38.820411] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-04. [2025-10-28T18:44:38.950423] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-28T18:44:38.961512] [INFO ] [REMOTE ] FERG: Full fetch complete (71184 records). [2025-10-28T18:44:38.961715] [DEBUG] [VALIDATOR ] FERG: Validating primary data. [2025-10-28T18:44:39.371204] [DEBUG] [VALIDATOR ] FERG: All expected trading days are present. [2025-10-28T18:44:39.371282] [DEBUG] [VALIDATOR ] FERG: Primary data validation passed. [2025-10-28T18:44:39.372273] [INFO ] [MAIN ] FERG: Fetched primary data is valid. [2025-10-28T18:44:39.372342] [DEBUG] [LOCAL ] FERG: Saving primary data. [2025-10-28T18:44:39.373778] [DEBUG] [LOCAL ] FERG: Trimmed 71184 records to 48558 (keeping 200 days of data) [2025-10-28T18:44:39.678977] [DEBUG] [LOCAL ] FERG: Primary data saved (48558 records). [2025-10-28T18:44:39.679209] [INFO ] [MAIN ] FERG: Full history saved. [2025-10-28T18:44:39.679940] [INFO ] [MAIN ] Update Progress: 820/2366 symbols completed. FERG took 35.0s. Estimated remaining: 3h 17m 14s. Rate: 7.8 symbols/min [2025-10-28T18:44:39.802490] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-10-28T18:44:39.850207] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-05. [2025-10-28T18:44:39.883077] [INFO ] [MAIN ] FFA: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:44:39.890032] [DEBUG] [LOCAL ] FFA: Loaded 5303 existing records from primary storage. [2025-10-28T18:44:39.890239] [INFO ] [MAIN ] FFA: Loaded 5303 existing records. [2025-10-28T18:44:40.081682] [WARN ] [MAIN ] FFA: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:44:40.081877] [INFO ] [MAIN ] FFA: Wiping existing primary data before full refresh. [2025-10-28T18:44:40.081927] [INFO ] [LOCAL ] FFA: Starting deletion of primary data. [2025-10-28T18:44:40.082185] [DEBUG] [LOCAL ] FFA: Deleted primary data file. [2025-10-28T18:44:40.082243] [INFO ] [MAIN ] FFA: Starting full primary refresh. [2025-10-28T18:44:40.408359] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-09 (7.62 seconds). [2025-10-28T18:44:40.471913] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-10. [2025-10-28T18:44:40.490605] [INFO ] [REMOTE ] FFA: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:44:40.491534] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-01. [2025-10-28T18:44:40.560608] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-06 (5.40 seconds). [2025-10-28T18:44:40.759366] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-07. [2025-10-28T18:44:40.847923] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-28T18:44:41.330917] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-28T18:44:41.394992] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-10-28T18:44:41.559347] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-02. [2025-10-28T18:44:41.896590] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-28T18:44:41.906257] [INFO ] [REMOTE ] FDX: Full fetch complete (73777 records). [2025-10-28T18:44:41.906377] [DEBUG] [VALIDATOR ] FDX: Validating primary data. [2025-10-28T18:44:41.907118] [FATAL] [VALIDATOR ] FDX: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T18:44:41.907220] [FATAL] [MAIN ] FDX: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:44:41.907265] [WARN ] [MAIN ] FDX: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:44:41.907329] [INFO ] [LOCAL ] FDX: Starting deletion of primary data. [2025-10-28T18:44:41.907392] [DEBUG] [LOCAL ] FDX: No primary data file found to delete. [2025-10-28T18:44:41.907434] [INFO ] [LOCAL ] FDX: Starting deletion of derivative data. [2025-10-28T18:44:41.907604] [DEBUG] [LOCAL ] FDX: Deleted derivative data file. [2025-10-28T18:44:41.908312] [INFO ] [MAIN ] Update Progress: 821/2366 symbols completed. FDX took 51.2s. Estimated remaining: 3h 16m 56s. Rate: 7.8 symbols/min [2025-10-28T18:44:42.029827] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-28T18:44:42.102880] [INFO ] [MAIN ] FFC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:44:42.119450] [DEBUG] [LOCAL ] FFC: Loaded 16365 existing records from primary storage. [2025-10-28T18:44:42.119691] [INFO ] [MAIN ] FFC: Loaded 16365 existing records. [2025-10-28T18:44:42.293676] [WARN ] [MAIN ] FFC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:44:42.293883] [INFO ] [MAIN ] FFC: Wiping existing primary data before full refresh. [2025-10-28T18:44:42.293929] [INFO ] [LOCAL ] FFC: Starting deletion of primary data. [2025-10-28T18:44:42.294273] [DEBUG] [LOCAL ] FFC: Deleted primary data file. [2025-10-28T18:44:42.294329] [INFO ] [MAIN ] FFC: Starting full primary refresh. [2025-10-28T18:44:42.364513] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-06. [2025-10-28T18:44:42.660948] [INFO ] [REMOTE ] FFC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:44:43.159307] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-01. [2025-10-28T18:44:43.310313] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-28T18:44:43.959334] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-08. [2025-10-28T18:44:44.272418] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-28T18:44:44.647795] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-28T18:44:44.759322] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-09. [2025-10-28T18:44:45.450085] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-28T18:44:45.559361] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-10. [2025-10-28T18:44:46.359334] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-02. [2025-10-28T18:44:46.663676] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-28T18:44:46.667096] [INFO ] [REMOTE ] FET: Full fetch complete (18667 records). [2025-10-28T18:44:46.667181] [DEBUG] [VALIDATOR ] FET: Validating primary data. [2025-10-28T18:44:47.026694] [DEBUG] [VALIDATOR ] FET: All expected trading days are present. [2025-10-28T18:44:47.026808] [DEBUG] [VALIDATOR ] FET: Primary data validation passed. [2025-10-28T18:44:47.035942] [INFO ] [MAIN ] FET: Fetched primary data is valid. [2025-10-28T18:44:47.036074] [DEBUG] [LOCAL ] FET: Saving primary data. [2025-10-28T18:44:47.036960] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-28T18:44:47.041335] [DEBUG] [LOCAL ] FET: Trimmed 18667 records to 12901 (keeping 200 days of data) [2025-10-28T18:44:47.112336] [DEBUG] [LOCAL ] FET: Primary data saved (12901 records). [2025-10-28T18:44:47.112455] [INFO ] [MAIN ] FET: Full history saved. [2025-10-28T18:44:47.112528] [INFO ] [MAIN ] Update Progress: 822/2366 symbols completed. FET took 24.7s. Estimated remaining: 3h 16m 44s. Rate: 7.8 symbols/min [2025-10-28T18:44:47.164489] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-07. [2025-10-28T18:44:47.281794] [INFO ] [MAIN ] FFWM: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:44:47.313765] [DEBUG] [LOCAL ] FFWM: Loaded 35352 existing records from primary storage. [2025-10-28T18:44:47.314004] [INFO ] [MAIN ] FFWM: Loaded 35352 existing records. [2025-10-28T18:44:47.488005] [WARN ] [MAIN ] FFWM: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:44:47.488213] [INFO ] [MAIN ] FFWM: Wiping existing primary data before full refresh. [2025-10-28T18:44:47.488258] [INFO ] [LOCAL ] FFWM: Starting deletion of primary data. [2025-10-28T18:44:47.488707] [DEBUG] [LOCAL ] FFWM: Deleted primary data file. [2025-10-28T18:44:47.488814] [INFO ] [MAIN ] FFWM: Starting full primary refresh. [2025-10-28T18:44:47.833752] [INFO ] [REMOTE ] FFWM: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:44:47.927086] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-28T18:44:47.959289] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-08. [2025-10-28T18:44:48.760268] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-01. [2025-10-28T18:44:48.767326] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-28T18:44:49.559341] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-09. [2025-10-28T18:44:49.949605] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-28T18:44:50.288017] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-28T18:44:50.359311] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-10. [2025-10-28T18:44:51.159341] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-02. [2025-10-28T18:44:51.959390] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-03. [2025-10-28T18:44:52.506808] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-28T18:44:52.559841] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-28T18:44:52.759332] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-04. [2025-10-28T18:44:52.963775] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-10 (2.60 seconds). [2025-10-28T18:44:52.968702] [INFO ] [REMOTE ] FF: Full fetch complete (36189 records). [2025-10-28T18:44:52.968806] [DEBUG] [VALIDATOR ] FF: Validating primary data. [2025-10-28T18:44:53.357511] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-28T18:44:53.357300] [DEBUG] [VALIDATOR ] FF: All expected trading days are present. [2025-10-28T18:44:53.357682] [DEBUG] [VALIDATOR ] FF: Primary data validation passed. [2025-10-28T18:44:53.361138] [INFO ] [MAIN ] FF: Fetched primary data is valid. [2025-10-28T18:44:53.361199] [DEBUG] [LOCAL ] FF: Saving primary data. [2025-10-28T18:44:53.361948] [DEBUG] [LOCAL ] FF: Trimmed 36189 records to 23037 (keeping 200 days of data) [2025-10-28T18:44:53.489133] [DEBUG] [LOCAL ] FF: Primary data saved (23037 records). [2025-10-28T18:44:53.489255] [INFO ] [MAIN ] FF: Full history saved. [2025-10-28T18:44:53.489329] [INFO ] [MAIN ] Update Progress: 823/2366 symbols completed. FF took 22.4s. Estimated remaining: 3h 16m 34s. Rate: 7.8 symbols/min [2025-10-28T18:44:53.564497] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-05. [2025-10-28T18:44:53.657874] [INFO ] [MAIN ] FG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:44:53.678187] [DEBUG] [LOCAL ] FG: Loaded 20750 existing records from primary storage. [2025-10-28T18:44:53.678426] [INFO ] [MAIN ] FG: Loaded 20750 existing records. [2025-10-28T18:44:53.852756] [WARN ] [MAIN ] FG: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:44:53.852983] [INFO ] [MAIN ] FG: Wiping existing primary data before full refresh. [2025-10-28T18:44:53.853029] [INFO ] [LOCAL ] FG: Starting deletion of primary data. [2025-10-28T18:44:53.853362] [DEBUG] [LOCAL ] FG: Deleted primary data file. [2025-10-28T18:44:53.853419] [INFO ] [MAIN ] FG: Starting full primary refresh. [2025-10-28T18:44:54.204145] [INFO ] [REMOTE ] FG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:44:54.208723] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-28T18:44:54.359315] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-01. [2025-10-28T18:44:55.159374] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-03. [2025-10-28T18:44:55.959374] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-06. [2025-10-28T18:44:56.163667] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-10-28T18:44:56.433723] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-10-28T18:44:56.759374] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-02. [2025-10-28T18:44:57.290160] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-28T18:44:57.559322] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-03. [2025-10-28T18:44:58.359312] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-03. [2025-10-28T18:44:58.430486] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-28T18:44:59.159299] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-04. [2025-10-28T18:44:59.804614] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-28T18:44:59.959347] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-05. [2025-10-28T18:45:00.351694] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-03 (5.19 seconds). [2025-10-28T18:45:00.759313] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-07. [2025-10-28T18:45:01.308371] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-03 (2.95 seconds). [2025-10-28T18:45:01.356454] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-28T18:45:01.559335] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-08. [2025-10-28T18:45:01.968574] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-10-28T18:45:02.363565] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-06. [2025-10-28T18:45:02.366044] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-28T18:45:03.143687] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-28T18:45:03.159340] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-07. [2025-10-28T18:45:03.959343] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-04. [2025-10-28T18:45:04.017284] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-28T18:45:04.759327] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-09. [2025-10-28T18:45:05.131543] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-28T18:45:05.559418] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-04. [2025-10-28T18:45:05.727474] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-28T18:45:06.359400] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-10. [2025-10-28T18:45:06.847477] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-28T18:45:06.986852] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-28T18:45:06.988819] [INFO ] [REMOTE ] FFA: Full fetch complete (8603 records). [2025-10-28T18:45:06.988889] [DEBUG] [VALIDATOR ] FFA: Validating primary data. [2025-10-28T18:45:07.167734] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-05. [2025-10-28T18:45:07.367605] [DEBUG] [VALIDATOR ] FFA: All expected trading days are present. [2025-10-28T18:45:07.367717] [DEBUG] [VALIDATOR ] FFA: Primary data validation passed. [2025-10-28T18:45:07.367989] [INFO ] [MAIN ] FFA: Fetched primary data is valid. [2025-10-28T18:45:07.368032] [DEBUG] [LOCAL ] FFA: Saving primary data. [2025-10-28T18:45:07.368466] [DEBUG] [LOCAL ] FFA: Trimmed 8603 records to 5236 (keeping 200 days of data) [2025-10-28T18:45:07.398543] [DEBUG] [LOCAL ] FFA: Primary data saved (5236 records). [2025-10-28T18:45:07.398614] [INFO ] [MAIN ] FFA: Full history saved. [2025-10-28T18:45:07.398709] [INFO ] [MAIN ] Update Progress: 824/2366 symbols completed. FFA took 27.7s. Estimated remaining: 3h 16m 38s. Rate: 7.8 symbols/min [2025-10-28T18:45:07.571334] [INFO ] [MAIN ] FGN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:45:07.571502] [DEBUG] [LOCAL ] FGN: No existing data file found in primary storage. [2025-10-28T18:45:07.571540] [WARN ] [MAIN ] FGN: No existing data found, performing full refresh instead. [2025-10-28T18:45:07.571666] [INFO ] [MAIN ] FGN: Wiping existing primary data before full refresh. [2025-10-28T18:45:07.571724] [INFO ] [LOCAL ] FGN: Starting deletion of primary data. [2025-10-28T18:45:07.571772] [DEBUG] [LOCAL ] FGN: No primary data file found to delete. [2025-10-28T18:45:07.571806] [INFO ] [MAIN ] FGN: Starting full primary refresh. [2025-10-28T18:45:07.940457] [INFO ] [REMOTE ] FGN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:45:07.959292] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-01. [2025-10-28T18:45:08.127627] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-28T18:45:08.450758] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-28T18:45:08.759349] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-08. [2025-10-28T18:45:09.487489] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-28T18:45:09.559331] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-05. [2025-10-28T18:45:10.359319] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-09. [2025-10-28T18:45:10.488567] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-28T18:45:11.159304] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-02. [2025-10-28T18:45:11.619937] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-28T18:45:11.744272] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-28T18:45:11.959347] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-10. [2025-10-28T18:45:12.738241] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-28T18:45:12.743334] [INFO ] [REMOTE ] FFC: Full fetch complete (24469 records). [2025-10-28T18:45:12.743501] [DEBUG] [VALIDATOR ] FFC: Validating primary data. [2025-10-28T18:45:12.768154] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-06. [2025-10-28T18:45:13.129229] [DEBUG] [VALIDATOR ] FFC: All expected trading days are present. [2025-10-28T18:45:13.129310] [DEBUG] [VALIDATOR ] FFC: Primary data validation passed. [2025-10-28T18:45:13.129972] [INFO ] [MAIN ] FFC: Fetched primary data is valid. [2025-10-28T18:45:13.130034] [DEBUG] [LOCAL ] FFC: Saving primary data. [2025-10-28T18:45:13.130793] [DEBUG] [LOCAL ] FFC: Trimmed 24469 records to 16268 (keeping 200 days of data) [2025-10-28T18:45:13.230360] [DEBUG] [LOCAL ] FFC: Primary data saved (16268 records). [2025-10-28T18:45:13.230501] [INFO ] [MAIN ] FFC: Full history saved. [2025-10-28T18:45:13.230581] [INFO ] [MAIN ] Update Progress: 825/2366 symbols completed. FFC took 31.3s. Estimated remaining: 3h 16m 27s. Rate: 7.8 symbols/min [2025-10-28T18:45:13.411603] [INFO ] [MAIN ] FGSN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:45:13.411778] [DEBUG] [LOCAL ] FGSN: No existing data file found in primary storage. [2025-10-28T18:45:13.411821] [WARN ] [MAIN ] FGSN: No existing data found, performing full refresh instead. [2025-10-28T18:45:13.411928] [INFO ] [MAIN ] FGSN: Wiping existing primary data before full refresh. [2025-10-28T18:45:13.411969] [INFO ] [LOCAL ] FGSN: Starting deletion of primary data. [2025-10-28T18:45:13.412009] [DEBUG] [LOCAL ] FGSN: No primary data file found to delete. [2025-10-28T18:45:13.412073] [INFO ] [MAIN ] FGSN: Starting full primary refresh. [2025-10-28T18:45:13.564445] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-06. [2025-10-28T18:45:13.802351] [INFO ] [REMOTE ] FGSN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:45:13.830138] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-28T18:45:14.283609] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-28T18:45:14.359393] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-07. [2025-10-28T18:45:15.159382] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-03. [2025-10-28T18:45:15.523260] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-10-28T18:45:15.959394] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-04. [2025-10-28T18:45:16.365218] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-10-28T18:45:16.759374] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-07. [2025-10-28T18:45:17.539990] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-28T18:45:17.559293] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-08. [2025-10-28T18:45:17.618897] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-07 (3.26 seconds). [2025-10-28T18:45:18.359324] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-01. [2025-10-28T18:45:18.481061] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-28T18:45:19.017063] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-28T18:45:19.159336] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-05. [2025-10-28T18:45:19.720020] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-28T18:45:19.959354] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-06. [2025-10-28T18:45:20.369806] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-10-28T18:45:20.759360] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-07. [2025-10-28T18:45:21.106858] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-10-28T18:45:21.559320] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-08. [2025-10-28T18:45:22.359353] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-08. [2025-10-28T18:45:22.760017] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-10-28T18:45:23.159315] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-09. [2025-10-28T18:45:23.287115] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-28T18:45:23.903227] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-28T18:45:23.959350] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-09. [2025-10-28T18:45:24.759314] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-09. [2025-10-28T18:45:25.098241] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-10-28T18:45:25.559354] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-10. [2025-10-28T18:45:26.359443] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-02. [2025-10-28T18:45:26.759786] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-28T18:45:27.044984] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-09 (3.09 seconds). [2025-10-28T18:45:27.083038] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-28T18:45:27.084322] [INFO ] [REMOTE ] FGN: Full fetch complete (5372 records). [2025-10-28T18:45:27.084396] [DEBUG] [VALIDATOR ] FGN: Validating primary data. [2025-10-28T18:45:27.085482] [FATAL] [VALIDATOR ] FGN: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T18:45:27.085729] [FATAL] [MAIN ] FGN: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:45:27.085815] [WARN ] [MAIN ] FGN: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:45:27.085896] [INFO ] [LOCAL ] FGN: Starting deletion of primary data. [2025-10-28T18:45:27.085970] [DEBUG] [LOCAL ] FGN: No primary data file found to delete. [2025-10-28T18:45:27.086008] [INFO ] [LOCAL ] FGN: Starting deletion of derivative data. [2025-10-28T18:45:27.086048] [DEBUG] [LOCAL ] FGN: No derivative data file found to delete. [2025-10-28T18:45:27.086134] [INFO ] [MAIN ] Update Progress: 826/2366 symbols completed. FGN took 19.7s. Estimated remaining: 3h 16m 31s. Rate: 7.8 symbols/min [2025-10-28T18:45:27.164626] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-03. [2025-10-28T18:45:27.267157] [INFO ] [MAIN ] FHI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:45:27.304080] [DEBUG] [LOCAL ] FHI: Loaded 39290 existing records from primary storage. [2025-10-28T18:45:27.304367] [INFO ] [MAIN ] FHI: Loaded 39290 existing records. [2025-10-28T18:45:27.516806] [WARN ] [MAIN ] FHI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:45:27.517027] [INFO ] [MAIN ] FHI: Wiping existing primary data before full refresh. [2025-10-28T18:45:27.517077] [INFO ] [LOCAL ] FHI: Starting deletion of primary data. [2025-10-28T18:45:27.517839] [DEBUG] [LOCAL ] FHI: Deleted primary data file. [2025-10-28T18:45:27.517899] [INFO ] [MAIN ] FHI: Starting full primary refresh. [2025-10-28T18:45:27.638735] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-28T18:45:27.926007] [INFO ] [REMOTE ] FHI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:45:27.959332] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-01. [2025-10-28T18:45:28.759381] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-10. [2025-10-28T18:45:29.559371] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-04. [2025-10-28T18:45:29.916698] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-28T18:45:29.924988] [INFO ] [REMOTE ] FFWM: Full fetch complete (52058 records). [2025-10-28T18:45:29.925260] [DEBUG] [VALIDATOR ] FFWM: Validating primary data. [2025-10-28T18:45:30.337430] [DEBUG] [VALIDATOR ] FFWM: All expected trading days are present. [2025-10-28T18:45:30.337589] [DEBUG] [VALIDATOR ] FFWM: Primary data validation passed. [2025-10-28T18:45:30.338781] [INFO ] [MAIN ] FFWM: Fetched primary data is valid. [2025-10-28T18:45:30.338856] [DEBUG] [LOCAL ] FFWM: Saving primary data. [2025-10-28T18:45:30.340386] [DEBUG] [LOCAL ] FFWM: Trimmed 52058 records to 35414 (keeping 200 days of data) [2025-10-28T18:45:30.385256] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-10. [2025-10-28T18:45:30.438137] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-28T18:45:30.550840] [DEBUG] [LOCAL ] FFWM: Primary data saved (35414 records). [2025-10-28T18:45:30.550985] [INFO ] [MAIN ] FFWM: Full history saved. [2025-10-28T18:45:30.551084] [INFO ] [MAIN ] Update Progress: 827/2366 symbols completed. FFWM took 43.4s. Estimated remaining: 3h 16m 15s. Rate: 7.8 symbols/min [2025-10-28T18:45:30.715363] [INFO ] [MAIN ] FHN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:45:30.761457] [DEBUG] [LOCAL ] FHN: Loaded 53398 existing records from primary storage. [2025-10-28T18:45:30.761793] [INFO ] [MAIN ] FHN: Loaded 53398 existing records. [2025-10-28T18:45:30.938268] [WARN ] [MAIN ] FHN: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:45:30.938667] [INFO ] [MAIN ] FHN: Wiping existing primary data before full refresh. [2025-10-28T18:45:30.938728] [INFO ] [LOCAL ] FHN: Starting deletion of primary data. [2025-10-28T18:45:30.939853] [DEBUG] [LOCAL ] FHN: Deleted primary data file. [2025-10-28T18:45:30.939911] [INFO ] [MAIN ] FHN: Starting full primary refresh. [2025-10-28T18:45:31.164812] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-05. [2025-10-28T18:45:31.242399] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-01 (3.28 seconds). [2025-10-28T18:45:31.333716] [INFO ] [REMOTE ] FHN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:45:31.345483] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-10 (0.96 seconds). [2025-10-28T18:45:31.349700] [INFO ] [REMOTE ] FG: Full fetch complete (29014 records). [2025-10-28T18:45:31.349774] [DEBUG] [VALIDATOR ] FG: Validating primary data. [2025-10-28T18:45:31.619553] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-28T18:45:31.733920] [DEBUG] [VALIDATOR ] FG: All expected trading days are present. [2025-10-28T18:45:31.734006] [DEBUG] [VALIDATOR ] FG: Primary data validation passed. [2025-10-28T18:45:31.734691] [INFO ] [MAIN ] FG: Fetched primary data is valid. [2025-10-28T18:45:31.734764] [DEBUG] [LOCAL ] FG: Saving primary data. [2025-10-28T18:45:31.735575] [DEBUG] [LOCAL ] FG: Trimmed 29014 records to 20582 (keeping 200 days of data) [2025-10-28T18:45:31.878928] [DEBUG] [LOCAL ] FG: Primary data saved (20582 records). [2025-10-28T18:45:31.879056] [INFO ] [MAIN ] FG: Full history saved. [2025-10-28T18:45:31.879135] [INFO ] [MAIN ] Update Progress: 828/2366 symbols completed. FG took 38.4s. Estimated remaining: 3h 15m 56s. Rate: 7.8 symbols/min [2025-10-28T18:45:31.964609] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-02. [2025-10-28T18:45:32.061698] [INFO ] [MAIN ] FI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:45:32.110980] [DEBUG] [LOCAL ] FI: Loaded 53574 existing records from primary storage. [2025-10-28T18:45:32.111328] [INFO ] [MAIN ] FI: Loaded 53574 existing records. [2025-10-28T18:45:32.286149] [WARN ] [MAIN ] FI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:45:32.286398] [INFO ] [MAIN ] FI: Wiping existing primary data before full refresh. [2025-10-28T18:45:32.286445] [INFO ] [LOCAL ] FI: Starting deletion of primary data. [2025-10-28T18:45:32.287461] [DEBUG] [LOCAL ] FI: Deleted primary data file. [2025-10-28T18:45:32.287521] [INFO ] [MAIN ] FI: Starting full primary refresh. [2025-10-28T18:45:32.628967] [INFO ] [REMOTE ] FI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:45:32.759372] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-06. [2025-10-28T18:45:33.157391] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-10-28T18:45:33.559318] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-07. [2025-10-28T18:45:33.979024] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-10-28T18:45:34.359338] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-01. [2025-10-28T18:45:35.159337] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-08. [2025-10-28T18:45:35.532618] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-10-28T18:45:35.601748] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-28T18:45:35.770152] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-02 (3.81 seconds). [2025-10-28T18:45:35.959310] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-03. [2025-10-28T18:45:36.759321] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-01. [2025-10-28T18:45:37.174982] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-28T18:45:37.559327] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-09. [2025-10-28T18:45:37.925951] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-10-28T18:45:38.125967] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-28T18:45:38.359356] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-10. [2025-10-28T18:45:38.898062] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-10 (0.54 seconds). [2025-10-28T18:45:38.899292] [INFO ] [REMOTE ] FGSN: Full fetch complete (8156 records). [2025-10-28T18:45:38.899359] [DEBUG] [VALIDATOR ] FGSN: Validating primary data. [2025-10-28T18:45:39.077481] [WARN ] [VALIDATOR ] FGSN: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-10-28T18:45:39.077779] [FATAL] [MAIN ] FGSN: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:45:39.077856] [WARN ] [MAIN ] FGSN: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:45:39.077932] [INFO ] [LOCAL ] FGSN: Starting deletion of primary data. [2025-10-28T18:45:39.077997] [DEBUG] [LOCAL ] FGSN: No primary data file found to delete. [2025-10-28T18:45:39.078036] [INFO ] [LOCAL ] FGSN: Starting deletion of derivative data. [2025-10-28T18:45:39.078078] [DEBUG] [LOCAL ] FGSN: No derivative data file found to delete. [2025-10-28T18:45:39.078137] [INFO ] [MAIN ] Update Progress: 829/2366 symbols completed. FGSN took 25.8s. Estimated remaining: 3h 15m 47s. Rate: 7.9 symbols/min [2025-10-28T18:45:39.164411] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-04. [2025-10-28T18:45:39.286446] [INFO ] [MAIN ] FICO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:45:39.307595] [DEBUG] [LOCAL ] FICO: Loaded 21863 existing records from primary storage. [2025-10-28T18:45:39.307869] [INFO ] [MAIN ] FICO: Loaded 21863 existing records. [2025-10-28T18:45:39.479047] [WARN ] [MAIN ] FICO: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:45:39.479233] [INFO ] [MAIN ] FICO: Wiping existing primary data before full refresh. [2025-10-28T18:45:39.479279] [INFO ] [LOCAL ] FICO: Starting deletion of primary data. [2025-10-28T18:45:39.479751] [DEBUG] [LOCAL ] FICO: Deleted primary data file. [2025-10-28T18:45:39.479808] [INFO ] [MAIN ] FICO: Starting full primary refresh. [2025-10-28T18:45:39.851419] [INFO ] [REMOTE ] FICO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:45:39.959327] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-01. [2025-10-28T18:45:40.759321] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-02. [2025-10-28T18:45:41.559334] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-02. [2025-10-28T18:45:41.920929] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-28T18:45:42.265197] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-01 (2.31 seconds). [2025-10-28T18:45:42.359322] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-02. [2025-10-28T18:45:43.035060] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-10-28T18:45:43.073256] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-28T18:45:43.159313] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-03. [2025-10-28T18:45:43.959306] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-03. [2025-10-28T18:45:44.427722] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-28T18:45:44.759316] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-04. [2025-10-28T18:45:45.139343] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-04 (5.97 seconds). [2025-10-28T18:45:45.374985] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-28T18:45:45.559350] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-05. [2025-10-28T18:45:46.359365] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-04. [2025-10-28T18:45:46.872052] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-10-28T18:45:47.159327] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-05. [2025-10-28T18:45:47.618529] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-28T18:45:47.959304] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-05. [2025-10-28T18:45:48.100935] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-28T18:45:48.759328] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-03. [2025-10-28T18:45:49.559358] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-06. [2025-10-28T18:45:50.089210] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-28T18:45:50.318050] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-10-28T18:45:50.359337] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-07. [2025-10-28T18:45:50.594085] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-05 (5.03 seconds). [2025-10-28T18:45:51.159380] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-06. [2025-10-28T18:45:51.444955] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-28T18:45:51.959399] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-08. [2025-10-28T18:45:52.759312] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-04. [2025-10-28T18:45:52.839004] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-28T18:45:53.559397] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-09. [2025-10-28T18:45:54.350669] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-05 (6.39 seconds). [2025-10-28T18:45:54.362417] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-06. [2025-10-28T18:45:54.471869] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-10-28T18:45:54.494709] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-28T18:45:54.568637] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-06 (3.41 seconds). [2025-10-28T18:45:55.159352] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-10. [2025-10-28T18:45:55.797696] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-28T18:45:55.959393] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-05. [2025-10-28T18:45:56.367566] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-28T18:45:56.373471] [INFO ] [REMOTE ] FICO: Full fetch complete (30106 records). [2025-10-28T18:45:56.373625] [DEBUG] [VALIDATOR ] FICO: Validating primary data. [2025-10-28T18:45:56.374175] [FATAL] [VALIDATOR ] FICO: Data is stale - most recent date (2025-10-27) is before last completed trading day (2025-10-28). Symbol may be delisted or halted. [2025-10-28T18:45:56.374273] [FATAL] [MAIN ] FICO: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:45:56.374369] [WARN ] [MAIN ] FICO: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:45:56.374460] [INFO ] [LOCAL ] FICO: Starting deletion of primary data. [2025-10-28T18:45:56.374540] [DEBUG] [LOCAL ] FICO: No primary data file found to delete. [2025-10-28T18:45:56.374578] [INFO ] [LOCAL ] FICO: Starting deletion of derivative data. [2025-10-28T18:45:56.374886] [DEBUG] [LOCAL ] FICO: Deleted derivative data file. [2025-10-28T18:45:56.374980] [INFO ] [MAIN ] Update Progress: 830/2366 symbols completed. FICO took 17.3s. Estimated remaining: 3h 15m 58s. Rate: 7.8 symbols/min [2025-10-28T18:45:56.548009] [INFO ] [MAIN ] FIG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:45:56.548198] [DEBUG] [LOCAL ] FIG: No existing data file found in primary storage. [2025-10-28T18:45:56.548236] [WARN ] [MAIN ] FIG: No existing data found, performing full refresh instead. [2025-10-28T18:45:56.548349] [INFO ] [MAIN ] FIG: Wiping existing primary data before full refresh. [2025-10-28T18:45:56.548414] [INFO ] [LOCAL ] FIG: Starting deletion of primary data. [2025-10-28T18:45:56.548478] [DEBUG] [LOCAL ] FIG: No primary data file found to delete. [2025-10-28T18:45:56.548522] [INFO ] [MAIN ] FIG: Starting full primary refresh. [2025-10-28T18:45:56.766408] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-07. [2025-10-28T18:45:56.925337] [INFO ] [REMOTE ] FIG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:45:57.559325] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-07. [2025-10-28T18:45:57.986027] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-28T18:45:58.359342] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-01. [2025-10-28T18:45:58.873907] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-10-28T18:45:58.876403] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-28T18:45:59.159309] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-08. [2025-10-28T18:45:59.959320] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-02. [2025-10-28T18:46:00.183716] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-02 (0.22 seconds). [2025-10-28T18:46:00.364142] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-28T18:46:00.759355] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-03. [2025-10-28T18:46:01.559354] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-08. [2025-10-28T18:46:02.359437] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-09. [2025-10-28T18:46:02.587186] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-28T18:46:02.590203] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-05 (6.63 seconds). [2025-10-28T18:46:03.154743] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-28T18:46:03.165338] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-04. [2025-10-28T18:46:03.412107] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-04 (0.25 seconds). [2025-10-28T18:46:03.959351] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-05. [2025-10-28T18:46:04.171454] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-05 (0.21 seconds). [2025-10-28T18:46:04.759309] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-06. [2025-10-28T18:46:04.906305] [DEBUG] [REMOTE ] FIG: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-28T18:46:04.906692] [WARN ] [REMOTE ] FIG: No data returned for month 2025-06 [2025-10-28T18:46:04.906762] [FATAL] [REMOTE ] FIG: API call failed - aborting fetch to avoid wasting further API calls [2025-10-28T18:46:04.906831] [FATAL] [MAIN ] FIG: Failed to fetch primary data. [2025-10-28T18:46:04.906909] [WARN ] [MAIN ] FIG: Deleting existing primary and derivative data due to fetch failure. [2025-10-28T18:46:04.906980] [INFO ] [LOCAL ] FIG: Starting deletion of primary data. [2025-10-28T18:46:04.907043] [DEBUG] [LOCAL ] FIG: No primary data file found to delete. [2025-10-28T18:46:04.907078] [INFO ] [LOCAL ] FIG: Starting deletion of derivative data. [2025-10-28T18:46:04.907117] [DEBUG] [LOCAL ] FIG: No derivative data file found to delete. [2025-10-28T18:46:04.907160] [INFO ] [MAIN ] Update Progress: 831/2366 symbols completed. FIG took 8.5s. Estimated remaining: 3h 15m 52s. Rate: 7.8 symbols/min [2025-10-28T18:46:05.076982] [INFO ] [MAIN ] FIGS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:46:05.118461] [DEBUG] [LOCAL ] FIGS: Loaded 48361 existing records from primary storage. [2025-10-28T18:46:05.118803] [INFO ] [MAIN ] FIGS: Loaded 48361 existing records. [2025-10-28T18:46:05.292299] [WARN ] [MAIN ] FIGS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:46:05.292523] [INFO ] [MAIN ] FIGS: Wiping existing primary data before full refresh. [2025-10-28T18:46:05.292575] [INFO ] [LOCAL ] FIGS: Starting deletion of primary data. [2025-10-28T18:46:05.293282] [DEBUG] [LOCAL ] FIGS: Deleted primary data file. [2025-10-28T18:46:05.293338] [INFO ] [MAIN ] FIGS: Starting full primary refresh. [2025-10-28T18:46:05.565258] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-09. [2025-10-28T18:46:05.646044] [INFO ] [REMOTE ] FIGS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:46:06.359312] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-01. [2025-10-28T18:46:06.640957] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-09 (4.28 seconds). [2025-10-28T18:46:06.956366] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-28T18:46:07.159368] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-06. [2025-10-28T18:46:07.959347] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-10. [2025-10-28T18:46:08.572982] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-28T18:46:08.759345] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-10. [2025-10-28T18:46:09.016703] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-28T18:46:09.024004] [INFO ] [REMOTE ] FHI: Full fetch complete (57322 records). [2025-10-28T18:46:09.024137] [DEBUG] [VALIDATOR ] FHI: Validating primary data. [2025-10-28T18:46:09.399896] [DEBUG] [VALIDATOR ] FHI: All expected trading days are present. [2025-10-28T18:46:09.399965] [DEBUG] [VALIDATOR ] FHI: Primary data validation passed. [2025-10-28T18:46:09.400704] [INFO ] [MAIN ] FHI: Fetched primary data is valid. [2025-10-28T18:46:09.400766] [DEBUG] [LOCAL ] FHI: Saving primary data. [2025-10-28T18:46:09.401834] [DEBUG] [LOCAL ] FHI: Trimmed 57322 records to 39205 (keeping 200 days of data) [2025-10-28T18:46:09.565365] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-07. [2025-10-28T18:46:09.635715] [DEBUG] [LOCAL ] FHI: Primary data saved (39205 records). [2025-10-28T18:46:09.635842] [INFO ] [MAIN ] FHI: Full history saved. [2025-10-28T18:46:09.635920] [INFO ] [MAIN ] Update Progress: 832/2366 symbols completed. FHI took 42.5s. Estimated remaining: 3h 15m 38s. Rate: 7.8 symbols/min [2025-10-28T18:46:09.802686] [INFO ] [MAIN ] FIHL: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:46:09.840093] [DEBUG] [LOCAL ] FIHL: Loaded 38701 existing records from primary storage. [2025-10-28T18:46:09.840372] [INFO ] [MAIN ] FIHL: Loaded 38701 existing records. [2025-10-28T18:46:10.015082] [WARN ] [MAIN ] FIHL: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:46:10.015325] [INFO ] [MAIN ] FIHL: Wiping existing primary data before full refresh. [2025-10-28T18:46:10.015385] [INFO ] [LOCAL ] FIHL: Starting deletion of primary data. [2025-10-28T18:46:10.015899] [DEBUG] [LOCAL ] FIHL: Deleted primary data file. [2025-10-28T18:46:10.015956] [INFO ] [MAIN ] FIHL: Starting full primary refresh. [2025-10-28T18:46:10.374533] [INFO ] [REMOTE ] FIHL: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:46:10.374928] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-01. [2025-10-28T18:46:10.404712] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-28T18:46:10.415590] [INFO ] [REMOTE ] FHN: Full fetch complete (77483 records). [2025-10-28T18:46:10.415740] [DEBUG] [VALIDATOR ] FHN: Validating primary data. [2025-10-28T18:46:10.800169] [DEBUG] [VALIDATOR ] FHN: All expected trading days are present. [2025-10-28T18:46:10.800234] [DEBUG] [VALIDATOR ] FHN: Primary data validation passed. [2025-10-28T18:46:10.801112] [INFO ] [MAIN ] FHN: Fetched primary data is valid. [2025-10-28T18:46:10.801172] [DEBUG] [LOCAL ] FHN: Saving primary data. [2025-10-28T18:46:10.802459] [DEBUG] [LOCAL ] FHN: Trimmed 77483 records to 53398 (keeping 200 days of data) [2025-10-28T18:46:11.112890] [DEBUG] [LOCAL ] FHN: Primary data saved (53398 records). [2025-10-28T18:46:11.113002] [INFO ] [MAIN ] FHN: Full history saved. [2025-10-28T18:46:11.113076] [INFO ] [MAIN ] Update Progress: 833/2366 symbols completed. FHN took 40.6s. Estimated remaining: 3h 15m 19s. Rate: 7.8 symbols/min [2025-10-28T18:46:11.288113] [INFO ] [MAIN ] FINS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:46:11.328621] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-28T18:46:11.326589] [DEBUG] [LOCAL ] FINS: Loaded 8194 existing records from primary storage. [2025-10-28T18:46:11.341083] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-08. [2025-10-28T18:46:11.341311] [INFO ] [MAIN ] FINS: Loaded 8194 existing records. [2025-10-28T18:46:11.419041] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-28T18:46:11.551023] [WARN ] [MAIN ] FINS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:46:11.551264] [INFO ] [MAIN ] FINS: Wiping existing primary data before full refresh. [2025-10-28T18:46:11.551312] [INFO ] [LOCAL ] FINS: Starting deletion of primary data. [2025-10-28T18:46:11.551592] [DEBUG] [LOCAL ] FINS: Deleted primary data file. [2025-10-28T18:46:11.551688] [INFO ] [MAIN ] FINS: Starting full primary refresh. [2025-10-28T18:46:11.905304] [INFO ] [REMOTE ] FINS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:46:11.959312] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-01. [2025-10-28T18:46:12.172343] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-01 (5.81 seconds). [2025-10-28T18:46:12.439496] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-28T18:46:12.759326] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-02. [2025-10-28T18:46:13.559378] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-02. [2025-10-28T18:46:13.858909] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-28T18:46:14.359351] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-02. [2025-10-28T18:46:14.450777] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-28T18:46:14.674519] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-10-28T18:46:15.159324] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-03. [2025-10-28T18:46:15.552265] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-10-28T18:46:15.959347] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-04. [2025-10-28T18:46:16.519488] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-28T18:46:16.716787] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-08 (5.38 seconds). [2025-10-28T18:46:16.759301] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-09. [2025-10-28T18:46:17.559342] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-05. [2025-10-28T18:46:18.125097] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-28T18:46:18.145764] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-28T18:46:18.359347] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-10. [2025-10-28T18:46:19.159324] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-03. [2025-10-28T18:46:19.959369] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-06. [2025-10-28T18:46:20.713015] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-28T18:46:20.759384] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-03. [2025-10-28T18:46:21.559361] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-07. [2025-10-28T18:46:22.072633] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-28T18:46:22.359406] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-08. [2025-10-28T18:46:22.592289] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-10 (4.23 seconds). [2025-10-28T18:46:22.603117] [INFO ] [REMOTE ] FI: Full fetch complete (77497 records). [2025-10-28T18:46:22.603268] [DEBUG] [VALIDATOR ] FI: Validating primary data. [2025-10-28T18:46:22.874756] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-28T18:46:23.027232] [DEBUG] [VALIDATOR ] FI: All expected trading days are present. [2025-10-28T18:46:23.027310] [DEBUG] [VALIDATOR ] FI: Primary data validation passed. [2025-10-28T18:46:23.028272] [INFO ] [MAIN ] FI: Fetched primary data is valid. [2025-10-28T18:46:23.028336] [DEBUG] [LOCAL ] FI: Saving primary data. [2025-10-28T18:46:23.029750] [DEBUG] [LOCAL ] FI: Trimmed 77497 records to 53573 (keeping 200 days of data) [2025-10-28T18:46:23.201450] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-09. [2025-10-28T18:46:23.355620] [DEBUG] [LOCAL ] FI: Primary data saved (53573 records). [2025-10-28T18:46:23.355787] [INFO ] [MAIN ] FI: Full history saved. [2025-10-28T18:46:23.355871] [INFO ] [MAIN ] Update Progress: 834/2366 symbols completed. FI took 51.5s. Estimated remaining: 3h 15m 20s. Rate: 7.8 symbols/min [2025-10-28T18:46:23.569112] [INFO ] [MAIN ] FINV: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:46:23.572479] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-03 (2.81 seconds). [2025-10-28T18:46:23.624050] [DEBUG] [LOCAL ] FINV: Loaded 45169 existing records from primary storage. [2025-10-28T18:46:23.624329] [INFO ] [MAIN ] FINV: Loaded 45169 existing records. [2025-10-28T18:46:23.723059] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-28T18:46:23.815004] [WARN ] [MAIN ] FINV: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:46:23.815248] [INFO ] [MAIN ] FINV: Wiping existing primary data before full refresh. [2025-10-28T18:46:23.815296] [INFO ] [LOCAL ] FINV: Starting deletion of primary data. [2025-10-28T18:46:23.816309] [DEBUG] [LOCAL ] FINV: Deleted primary data file. [2025-10-28T18:46:23.816367] [INFO ] [MAIN ] FINV: Starting full primary refresh. [2025-10-28T18:46:23.968027] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-10. [2025-10-28T18:46:24.189975] [INFO ] [REMOTE ] FINV: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:46:24.612131] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-28T18:46:24.613729] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-03 (5.45 seconds). [2025-10-28T18:46:24.626218] [INFO ] [REMOTE ] FINS: Full fetch complete (11500 records). [2025-10-28T18:46:24.626677] [DEBUG] [VALIDATOR ] FINS: Validating primary data. [2025-10-28T18:46:24.764434] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-04. [2025-10-28T18:46:25.035394] [DEBUG] [VALIDATOR ] FINS: All expected trading days are present. [2025-10-28T18:46:25.035469] [DEBUG] [VALIDATOR ] FINS: Primary data validation passed. [2025-10-28T18:46:25.035757] [INFO ] [MAIN ] FINS: Fetched primary data is valid. [2025-10-28T18:46:25.035815] [DEBUG] [LOCAL ] FINS: Saving primary data. [2025-10-28T18:46:25.036227] [DEBUG] [LOCAL ] FINS: Trimmed 11500 records to 8142 (keeping 200 days of data) [2025-10-28T18:46:25.083936] [DEBUG] [LOCAL ] FINS: Primary data saved (8142 records). [2025-10-28T18:46:25.084064] [INFO ] [MAIN ] FINS: Full history saved. [2025-10-28T18:46:25.084143] [INFO ] [MAIN ] Update Progress: 835/2366 symbols completed. FINS took 14.0s. Estimated remaining: 3h 15m 2s. Rate: 7.9 symbols/min [2025-10-28T18:46:25.251572] [INFO ] [MAIN ] FIS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:46:25.298999] [DEBUG] [LOCAL ] FIS: Loaded 53324 existing records from primary storage. [2025-10-28T18:46:25.299289] [INFO ] [MAIN ] FIS: Loaded 53324 existing records. [2025-10-28T18:46:25.473749] [WARN ] [MAIN ] FIS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:46:25.473933] [INFO ] [MAIN ] FIS: Wiping existing primary data before full refresh. [2025-10-28T18:46:25.473978] [INFO ] [LOCAL ] FIS: Starting deletion of primary data. [2025-10-28T18:46:25.474543] [DEBUG] [LOCAL ] FIS: Deleted primary data file. [2025-10-28T18:46:25.474600] [INFO ] [MAIN ] FIS: Starting full primary refresh. [2025-10-28T18:46:25.567043] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-04. [2025-10-28T18:46:25.828351] [INFO ] [REMOTE ] FIS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:46:26.033306] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-28T18:46:26.359356] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-05. [2025-10-28T18:46:27.159362] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-01. [2025-10-28T18:46:27.959336] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-01. [2025-10-28T18:46:30.133419] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-04 (4.57 seconds). [2025-10-28T18:46:30.142866] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-05. [2025-10-28T18:46:31.730822] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-28T18:46:31.739381] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-06. [2025-10-28T18:46:32.257376] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-05 (5.90 seconds). [2025-10-28T18:46:32.267840] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-06. [2025-10-28T18:46:32.773890] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-28T18:46:32.782259] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-07. [2025-10-28T18:46:33.383034] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-28T18:46:33.393203] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-07. [2025-10-28T18:46:33.745858] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-28T18:46:33.754062] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-08. [2025-10-28T18:46:34.680050] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-28T18:46:34.690610] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-08. [2025-10-28T18:46:34.829017] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-28T18:46:34.837888] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-09. [2025-10-28T18:46:35.918957] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-28T18:46:35.930152] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-09. [2025-10-28T18:46:37.150382] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-28T18:46:37.160970] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-10. [2025-10-28T18:46:38.362146] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-01 (11.20 seconds). [2025-10-28T18:46:38.372425] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-02. [2025-10-28T18:46:38.496000] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-28T18:46:38.505287] [INFO ] [REMOTE ] FIGS: Full fetch complete (70716 records). [2025-10-28T18:46:38.505400] [DEBUG] [VALIDATOR ] FIGS: Validating primary data. [2025-10-28T18:46:38.723315] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-01 (10.76 seconds). [2025-10-28T18:46:38.810805] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-02. [2025-10-28T18:46:38.930174] [DEBUG] [VALIDATOR ] FIGS: All expected trading days are present. [2025-10-28T18:46:38.930258] [DEBUG] [VALIDATOR ] FIGS: Primary data validation passed. [2025-10-28T18:46:38.931107] [INFO ] [MAIN ] FIGS: Fetched primary data is valid. [2025-10-28T18:46:38.931168] [DEBUG] [LOCAL ] FIGS: Saving primary data. [2025-10-28T18:46:38.932503] [DEBUG] [LOCAL ] FIGS: Trimmed 70716 records to 48318 (keeping 200 days of data) [2025-10-28T18:46:39.196957] [DEBUG] [LOCAL ] FIGS: Primary data saved (48318 records). [2025-10-28T18:46:39.197075] [INFO ] [MAIN ] FIGS: Full history saved. [2025-10-28T18:46:39.197856] [INFO ] [MAIN ] Update Progress: 836/2366 symbols completed. FIGS took 34.3s. Estimated remaining: 3h 15m 6s. Rate: 7.8 symbols/min [2025-10-28T18:46:39.368221] [INFO ] [MAIN ] FIX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:46:39.396543] [DEBUG] [LOCAL ] FIX: Loaded 28309 existing records from primary storage. [2025-10-28T18:46:39.396850] [INFO ] [MAIN ] FIX: Loaded 28309 existing records. [2025-10-28T18:46:39.575035] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-09 (4.74 seconds). [2025-10-28T18:46:39.603535] [WARN ] [MAIN ] FIX: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:46:39.611616] [INFO ] [MAIN ] FIX: Wiping existing primary data before full refresh. [2025-10-28T18:46:39.611881] [INFO ] [LOCAL ] FIX: Starting deletion of primary data. [2025-10-28T18:46:39.612499] [DEBUG] [LOCAL ] FIX: Deleted primary data file. [2025-10-28T18:46:39.612579] [INFO ] [MAIN ] FIX: Starting full primary refresh. [2025-10-28T18:46:39.612460] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-10. [2025-10-28T18:46:39.983965] [INFO ] [REMOTE ] FIX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:46:39.984344] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-01. [2025-10-28T18:46:40.008806] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-28T18:46:40.017368] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-03. [2025-10-28T18:46:40.832283] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-28T18:46:40.841303] [INFO ] [REMOTE ] FIHL: Full fetch complete (56294 records). [2025-10-28T18:46:40.841485] [DEBUG] [VALIDATOR ] FIHL: Validating primary data. [2025-10-28T18:46:41.248098] [DEBUG] [VALIDATOR ] FIHL: All expected trading days are present. [2025-10-28T18:46:41.248352] [DEBUG] [VALIDATOR ] FIHL: Primary data validation passed. [2025-10-28T18:46:41.249764] [INFO ] [MAIN ] FIHL: Fetched primary data is valid. [2025-10-28T18:46:41.249874] [DEBUG] [LOCAL ] FIHL: Saving primary data. [2025-10-28T18:46:41.275074] [DEBUG] [LOCAL ] FIHL: Trimmed 56294 records to 38617 (keeping 200 days of data) [2025-10-28T18:46:41.276387] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-28T18:46:41.286477] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-04. [2025-10-28T18:46:41.530170] [DEBUG] [LOCAL ] FIHL: Primary data saved (38617 records). [2025-10-28T18:46:41.530448] [INFO ] [MAIN ] FIHL: Full history saved. [2025-10-28T18:46:41.530546] [INFO ] [MAIN ] Update Progress: 837/2366 symbols completed. FIHL took 31.9s. Estimated remaining: 3h 14m 49s. Rate: 7.8 symbols/min [2025-10-28T18:46:42.446712] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-28T18:46:42.456413] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-05. [2025-10-28T18:46:43.301904] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-02 (4.93 seconds). [2025-10-28T18:46:43.312317] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-03. [2025-10-28T18:46:43.505973] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-28T18:46:43.514448] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-06. [2025-10-28T18:46:44.544700] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-28T18:46:44.554335] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-07. [2025-10-28T18:46:44.643297] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-28T18:46:44.759366] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-04. [2025-10-28T18:46:45.719510] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-28T18:46:45.730434] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-08. [2025-10-28T18:46:45.946813] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-28T18:46:46.359314] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-05. [2025-10-28T18:46:46.987123] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-28T18:46:47.159366] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-09. [2025-10-28T18:46:47.318017] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-01 (7.33 seconds). [2025-10-28T18:46:47.561543] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-28T18:46:47.959348] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-02. [2025-10-28T18:46:48.759368] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-06. [2025-10-28T18:46:49.980103] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-28T18:46:49.994032] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-07. [2025-10-28T18:46:50.796098] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-02 (2.84 seconds). [2025-10-28T18:46:50.803427] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-03. [2025-10-28T18:46:51.288130] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-28T18:46:51.301202] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-08. [2025-10-28T18:46:52.058537] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-28T18:46:52.088121] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-04. [2025-10-28T18:46:52.092823] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-09 (4.93 seconds). [2025-10-28T18:46:52.759327] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-10. [2025-10-28T18:46:53.194878] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-28T18:46:53.559333] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-05. [2025-10-28T18:46:54.000865] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-28T18:46:54.010231] [INFO ] [REMOTE ] FINV: Full fetch complete (65030 records). [2025-10-28T18:46:54.010353] [DEBUG] [VALIDATOR ] FINV: Validating primary data. [2025-10-28T18:46:54.400326] [DEBUG] [VALIDATOR ] FINV: All expected trading days are present. [2025-10-28T18:46:54.400500] [DEBUG] [VALIDATOR ] FINV: Primary data validation passed. [2025-10-28T18:46:54.401382] [INFO ] [MAIN ] FINV: Fetched primary data is valid. [2025-10-28T18:46:54.401443] [DEBUG] [LOCAL ] FINV: Saving primary data. [2025-10-28T18:46:54.402663] [DEBUG] [LOCAL ] FINV: Trimmed 65030 records to 45195 (keeping 200 days of data) [2025-10-28T18:46:54.590395] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-28T18:46:54.656229] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-06. [2025-10-28T18:46:54.665935] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-08 (3.36 seconds). [2025-10-28T18:46:54.739343] [DEBUG] [LOCAL ] FINV: Primary data saved (45195 records). [2025-10-28T18:46:54.739490] [INFO ] [MAIN ] FINV: Full history saved. [2025-10-28T18:46:54.739586] [INFO ] [MAIN ] Update Progress: 838/2366 symbols completed. FINV took 31.4s. Estimated remaining: 3h 14m 51s. Rate: 7.8 symbols/min [2025-10-28T18:46:55.159352] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-09. [2025-10-28T18:46:55.522464] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-28T18:46:55.959413] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-07. [2025-10-28T18:46:58.860118] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-07 (2.90 seconds). [2025-10-28T18:46:58.866690] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-08. [2025-10-28T18:46:59.857082] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-28T18:46:59.863186] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-09. [2025-10-28T18:47:00.185020] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-09 (5.03 seconds). [2025-10-28T18:47:00.196763] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-10. [2025-10-28T18:47:01.002735] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-28T18:47:01.009070] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-10. [2025-10-28T18:47:01.346317] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-28T18:47:01.357033] [INFO ] [REMOTE ] FIS: Full fetch complete (77398 records). [2025-10-28T18:47:01.357182] [DEBUG] [VALIDATOR ] FIS: Validating primary data. [2025-10-28T18:47:01.755882] [DEBUG] [VALIDATOR ] FIS: All expected trading days are present. [2025-10-28T18:47:01.755962] [DEBUG] [VALIDATOR ] FIS: Primary data validation passed. [2025-10-28T18:47:01.757105] [INFO ] [MAIN ] FIS: Fetched primary data is valid. [2025-10-28T18:47:01.757171] [DEBUG] [LOCAL ] FIS: Saving primary data. [2025-10-28T18:47:01.758810] [DEBUG] [LOCAL ] FIS: Trimmed 77398 records to 53324 (keeping 200 days of data) [2025-10-28T18:47:02.080392] [DEBUG] [LOCAL ] FIS: Primary data saved (53324 records). [2025-10-28T18:47:02.080503] [INFO ] [MAIN ] FIS: Full history saved. [2025-10-28T18:47:02.080580] [INFO ] [MAIN ] Update Progress: 839/2366 symbols completed. FIS took 37.0s. Estimated remaining: 3h 14m 43s. Rate: 7.8 symbols/min [2025-10-28T18:47:02.807810] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-28T18:47:02.813768] [INFO ] [REMOTE ] FIX: Full fetch complete (45704 records). [2025-10-28T18:47:02.813913] [DEBUG] [VALIDATOR ] FIX: Validating primary data. [2025-10-28T18:47:03.217792] [DEBUG] [VALIDATOR ] FIX: All expected trading days are present. [2025-10-28T18:47:03.217910] [DEBUG] [VALIDATOR ] FIX: Primary data validation passed. [2025-10-28T18:47:03.218592] [INFO ] [MAIN ] FIX: Fetched primary data is valid. [2025-10-28T18:47:03.218633] [DEBUG] [LOCAL ] FIX: Saving primary data. [2025-10-28T18:47:03.219689] [DEBUG] [LOCAL ] FIX: Trimmed 45704 records to 28232 (keeping 200 days of data) [2025-10-28T18:47:03.392531] [DEBUG] [LOCAL ] FIX: Primary data saved (28232 records). [2025-10-28T18:47:03.392700] [INFO ] [MAIN ] FIX: Full history saved. [2025-10-28T18:47:03.392796] [INFO ] [MAIN ] Update Progress: 840/2366 symbols completed. FIX took 24.2s. Estimated remaining: 3h 14m 24s. Rate: 7.8 symbols/min [2025-10-28T18:47:04.025841] [INFO ] [MAIN ] FLG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:47:04.037475] [INFO ] [MAIN ] FLC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:47:04.082545] [INFO ] [MAIN ] FLNG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:47:04.111214] [INFO ] [MAIN ] FIXT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:47:04.113338] [DEBUG] [LOCAL ] FIXT: No existing data file found in primary storage. [2025-10-28T18:47:04.113428] [WARN ] [MAIN ] FIXT: No existing data found, performing full refresh instead. [2025-10-28T18:47:04.113585] [INFO ] [MAIN ] FIXT: Wiping existing primary data before full refresh. [2025-10-28T18:47:04.113666] [INFO ] [LOCAL ] FIXT: Starting deletion of primary data. [2025-10-28T18:47:04.113799] [DEBUG] [LOCAL ] FIXT: No primary data file found to delete. [2025-10-28T18:47:04.113853] [INFO ] [MAIN ] FIXT: Starting full primary refresh. [2025-10-28T18:47:04.193012] [DEBUG] [LOCAL ] FLC: Loaded 5167 existing records from primary storage. [2025-10-28T18:47:04.216384] [INFO ] [MAIN ] FLC: Loaded 5167 existing records. [2025-10-28T18:47:04.553795] [DEBUG] [LOCAL ] FLNG: Loaded 32921 existing records from primary storage. [2025-10-28T18:47:04.554532] [DEBUG] [LOCAL ] FLG: Loaded 53317 existing records from primary storage. [2025-10-28T18:47:04.594357] [INFO ] [MAIN ] FLNG: Loaded 32921 existing records. [2025-10-28T18:47:04.593808] [INFO ] [MAIN ] FLG: Loaded 53317 existing records. [2025-10-28T18:47:04.663296] [WARN ] [MAIN ] FLC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:47:04.823732] [INFO ] [MAIN ] FLC: Wiping existing primary data before full refresh. [2025-10-28T18:47:04.839356] [INFO ] [LOCAL ] FLC: Starting deletion of primary data. [2025-10-28T18:47:04.861618] [DEBUG] [LOCAL ] FLC: Deleted primary data file. [2025-10-28T18:47:04.879076] [INFO ] [MAIN ] FLC: Starting full primary refresh. [2025-10-28T18:47:05.170902] [WARN ] [MAIN ] FLG: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:47:05.195956] [WARN ] [MAIN ] FLNG: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:47:05.167578] [INFO ] [REMOTE ] FIXT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:47:05.228977] [INFO ] [MAIN ] FLNG: Wiping existing primary data before full refresh. [2025-10-28T18:47:05.229728] [INFO ] [MAIN ] FLG: Wiping existing primary data before full refresh. [2025-10-28T18:47:05.229826] [INFO ] [LOCAL ] FLG: Starting deletion of primary data. [2025-10-28T18:47:05.229938] [INFO ] [LOCAL ] FLNG: Starting deletion of primary data. [2025-10-28T18:47:05.230406] [DEBUG] [LOCAL ] FLNG: Deleted primary data file. [2025-10-28T18:47:05.230471] [INFO ] [MAIN ] FLNG: Starting full primary refresh. [2025-10-28T18:47:05.257516] [DEBUG] [LOCAL ] FLG: Deleted primary data file. [2025-10-28T18:47:05.229597] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-01. [2025-10-28T18:47:05.330752] [INFO ] [MAIN ] FLG: Starting full primary refresh. [2025-10-28T18:47:05.570872] [DEBUG] [REMOTE ] FIXT: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-28T18:47:05.630125] [WARN ] [REMOTE ] FIXT: No data returned for month 2025-01 [2025-10-28T18:47:05.645253] [FATAL] [REMOTE ] FIXT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-28T18:47:05.660848] [FATAL] [MAIN ] FIXT: Failed to fetch primary data. [2025-10-28T18:47:05.692192] [WARN ] [MAIN ] FIXT: Deleting existing primary and derivative data due to fetch failure. [2025-10-28T18:47:05.896055] [INFO ] [LOCAL ] FIXT: Starting deletion of primary data. [2025-10-28T18:47:05.998167] [DEBUG] [LOCAL ] FIXT: No primary data file found to delete. [2025-10-28T18:47:06.064308] [INFO ] [REMOTE ] FLC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:47:06.080123] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-01. [2025-10-28T18:47:06.080464] [INFO ] [LOCAL ] FIXT: Starting deletion of derivative data. [2025-10-28T18:47:06.106137] [DEBUG] [LOCAL ] FIXT: No derivative data file found to delete. [2025-10-28T18:47:06.164801] [INFO ] [MAIN ] Update Progress: 841/2366 symbols completed. FIXT took 2.7s. Estimated remaining: 3h 14m 7s. Rate: 7.9 symbols/min [2025-10-28T18:47:06.214511] [INFO ] [REMOTE ] FLNG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:47:06.224870] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-01. [2025-10-28T18:47:06.289238] [INFO ] [REMOTE ] FLG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:47:06.305723] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-01. [2025-10-28T18:47:06.437931] [INFO ] [MAIN ] FLO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:47:06.484098] [DEBUG] [LOCAL ] FLO: Loaded 52066 existing records from primary storage. [2025-10-28T18:47:06.484387] [INFO ] [MAIN ] FLO: Loaded 52066 existing records. [2025-10-28T18:47:06.656308] [WARN ] [MAIN ] FLO: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:47:06.656537] [INFO ] [MAIN ] FLO: Wiping existing primary data before full refresh. [2025-10-28T18:47:06.656606] [INFO ] [LOCAL ] FLO: Starting deletion of primary data. [2025-10-28T18:47:06.657502] [DEBUG] [LOCAL ] FLO: Deleted primary data file. [2025-10-28T18:47:06.657559] [INFO ] [MAIN ] FLO: Starting full primary refresh. [2025-10-28T18:47:06.933161] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-28T18:47:06.945506] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-02. [2025-10-28T18:47:07.011496] [INFO ] [REMOTE ] FLO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:47:07.011790] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-01. [2025-10-28T18:47:07.377374] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-28T18:47:07.378901] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-03. [2025-10-28T18:47:07.400040] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-28T18:47:07.407294] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-02. [2025-10-28T18:47:07.647986] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-28T18:47:07.658498] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-02. [2025-10-28T18:47:08.114021] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-28T18:47:08.116307] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-04. [2025-10-28T18:47:08.260294] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-28T18:47:08.270186] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-02. [2025-10-28T18:47:08.410853] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-28T18:47:08.556696] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-28T18:47:08.759375] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-05. [2025-10-28T18:47:08.861055] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-28T18:47:09.559327] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-03. [2025-10-28T18:47:09.570874] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-28T18:47:10.359366] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-06. [2025-10-28T18:47:10.733946] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-10-28T18:47:11.120288] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-28T18:47:11.159304] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-04. [2025-10-28T18:47:11.959351] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-07. [2025-10-28T18:47:12.357387] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-10-28T18:47:12.480782] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-28T18:47:12.544925] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-02 (4.27 seconds). [2025-10-28T18:47:12.759362] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-03. [2025-10-28T18:47:13.559372] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-03. [2025-10-28T18:47:13.981963] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-28T18:47:14.359390] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-04. [2025-10-28T18:47:15.159332] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-05. [2025-10-28T18:47:15.736027] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-28T18:47:15.959355] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-05. [2025-10-28T18:47:16.664357] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-28T18:47:16.759335] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-08. [2025-10-28T18:47:17.124969] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-10-28T18:47:17.216231] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-28T18:47:17.559339] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-06. [2025-10-28T18:47:18.359305] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-06. [2025-10-28T18:47:18.778803] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-28T18:47:19.159330] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-07. [2025-10-28T18:47:19.959321] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-09. [2025-10-28T18:47:21.252008] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-03 (7.69 seconds). [2025-10-28T18:47:21.260856] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-04. [2025-10-28T18:47:22.270943] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-28T18:47:22.278283] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-05. [2025-10-28T18:47:23.185621] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-28T18:47:23.191919] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-06. [2025-10-28T18:47:24.279862] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-28T18:47:24.286882] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-07. [2025-10-28T18:47:25.454494] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-28T18:47:25.462820] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-08. [2025-10-28T18:47:28.457436] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-06 (10.10 seconds). [2025-10-28T18:47:28.468556] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-07. [2025-10-28T18:47:29.845967] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-28T18:47:29.857635] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-08. [2025-10-28T18:47:31.156346] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-28T18:47:31.168206] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-09. [2025-10-28T18:47:32.531420] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-28T18:47:32.543722] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-10. [2025-10-28T18:47:33.944799] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-28T18:47:33.956002] [INFO ] [REMOTE ] FLG: Full fetch complete (77425 records). [2025-10-28T18:47:33.956147] [DEBUG] [VALIDATOR ] FLG: Validating primary data. [2025-10-28T18:47:34.372889] [DEBUG] [VALIDATOR ] FLG: All expected trading days are present. [2025-10-28T18:47:34.372970] [DEBUG] [VALIDATOR ] FLG: Primary data validation passed. [2025-10-28T18:47:34.373912] [INFO ] [MAIN ] FLG: Fetched primary data is valid. [2025-10-28T18:47:34.373975] [DEBUG] [LOCAL ] FLG: Saving primary data. [2025-10-28T18:47:34.375443] [DEBUG] [LOCAL ] FLG: Trimmed 77425 records to 53316 (keeping 200 days of data) [2025-10-28T18:47:34.717885] [DEBUG] [LOCAL ] FLG: Primary data saved (53316 records). [2025-10-28T18:47:34.718075] [INFO ] [MAIN ] FLG: Full history saved. [2025-10-28T18:47:34.719116] [INFO ] [MAIN ] Update Progress: 842/2366 symbols completed. FLG took 31.3s. Estimated remaining: 3h 14m 37s. Rate: 7.8 symbols/min [2025-10-28T18:47:34.889347] [INFO ] [MAIN ] FLOC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:47:34.889556] [DEBUG] [LOCAL ] FLOC: No existing data file found in primary storage. [2025-10-28T18:47:34.889610] [WARN ] [MAIN ] FLOC: No existing data found, performing full refresh instead. [2025-10-28T18:47:34.889741] [INFO ] [MAIN ] FLOC: Wiping existing primary data before full refresh. [2025-10-28T18:47:34.889782] [INFO ] [LOCAL ] FLOC: Starting deletion of primary data. [2025-10-28T18:47:34.889823] [DEBUG] [LOCAL ] FLOC: No primary data file found to delete. [2025-10-28T18:47:34.889855] [INFO ] [MAIN ] FLOC: Starting full primary refresh. [2025-10-28T18:47:35.236293] [INFO ] [REMOTE ] FLOC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:47:35.236661] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-01. [2025-10-28T18:47:46.593605] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-07 (27.43 seconds). [2025-10-28T18:47:46.605189] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-08. [2025-10-28T18:47:47.943039] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-28T18:47:47.954865] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-09. [2025-10-28T18:47:48.158629] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-09 (28.20 seconds). [2025-10-28T18:47:48.160293] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-10. [2025-10-28T18:47:48.651290] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-28T18:47:48.652873] [INFO ] [REMOTE ] FLC: Full fetch complete (7802 records). [2025-10-28T18:47:48.652949] [DEBUG] [VALIDATOR ] FLC: Validating primary data. [2025-10-28T18:47:49.029806] [DEBUG] [VALIDATOR ] FLC: All expected trading days are present. [2025-10-28T18:47:49.029923] [DEBUG] [VALIDATOR ] FLC: Primary data validation passed. [2025-10-28T18:47:49.030151] [INFO ] [MAIN ] FLC: Fetched primary data is valid. [2025-10-28T18:47:49.030212] [DEBUG] [LOCAL ] FLC: Saving primary data. [2025-10-28T18:47:49.030597] [DEBUG] [LOCAL ] FLC: Trimmed 7802 records to 5080 (keeping 200 days of data) [2025-10-28T18:47:49.060692] [DEBUG] [LOCAL ] FLC: Primary data saved (5080 records). [2025-10-28T18:47:49.060788] [INFO ] [MAIN ] FLC: Full history saved. [2025-10-28T18:47:49.060861] [INFO ] [MAIN ] Update Progress: 843/2366 symbols completed. FLC took 45.7s. Estimated remaining: 3h 14m 42s. Rate: 7.8 symbols/min [2025-10-28T18:47:49.240258] [INFO ] [MAIN ] FLR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:47:49.288013] [DEBUG] [LOCAL ] FLR: Loaded 53242 existing records from primary storage. [2025-10-28T18:47:49.288445] [INFO ] [MAIN ] FLR: Loaded 53242 existing records. [2025-10-28T18:47:49.480762] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-10-28T18:47:49.512183] [WARN ] [MAIN ] FLR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:47:49.513583] [INFO ] [MAIN ] FLR: Wiping existing primary data before full refresh. [2025-10-28T18:47:49.513809] [INFO ] [LOCAL ] FLR: Starting deletion of primary data. [2025-10-28T18:47:49.514263] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-10. [2025-10-28T18:47:49.515114] [DEBUG] [LOCAL ] FLR: Deleted primary data file. [2025-10-28T18:47:49.515189] [INFO ] [MAIN ] FLR: Starting full primary refresh. [2025-10-28T18:47:49.869967] [INFO ] [REMOTE ] FLR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:47:49.870634] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-01. [2025-10-28T18:47:51.100187] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-28T18:47:51.110855] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-02. [2025-10-28T18:47:51.178241] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-28T18:47:51.189310] [INFO ] [REMOTE ] FLO: Full fetch complete (75400 records). [2025-10-28T18:47:51.189456] [DEBUG] [VALIDATOR ] FLO: Validating primary data. [2025-10-28T18:47:51.628290] [DEBUG] [VALIDATOR ] FLO: All expected trading days are present. [2025-10-28T18:47:51.628372] [DEBUG] [VALIDATOR ] FLO: Primary data validation passed. [2025-10-28T18:47:51.629418] [INFO ] [MAIN ] FLO: Fetched primary data is valid. [2025-10-28T18:47:51.629483] [DEBUG] [LOCAL ] FLO: Saving primary data. [2025-10-28T18:47:51.631057] [DEBUG] [LOCAL ] FLO: Trimmed 75400 records to 52068 (keeping 200 days of data) [2025-10-28T18:47:51.957533] [DEBUG] [LOCAL ] FLO: Primary data saved (52068 records). [2025-10-28T18:47:51.957682] [INFO ] [MAIN ] FLO: Full history saved. [2025-10-28T18:47:51.957787] [INFO ] [MAIN ] Update Progress: 844/2366 symbols completed. FLO took 45.8s. Estimated remaining: 3h 14m 26s. Rate: 7.8 symbols/min [2025-10-28T18:47:52.126197] [INFO ] [MAIN ] FLS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:47:52.170517] [DEBUG] [LOCAL ] FLS: Loaded 50378 existing records from primary storage. [2025-10-28T18:47:52.170831] [INFO ] [MAIN ] FLS: Loaded 50378 existing records. [2025-10-28T18:47:52.342839] [WARN ] [MAIN ] FLS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:47:52.343056] [INFO ] [MAIN ] FLS: Wiping existing primary data before full refresh. [2025-10-28T18:47:52.343102] [INFO ] [LOCAL ] FLS: Starting deletion of primary data. [2025-10-28T18:47:52.343680] [DEBUG] [LOCAL ] FLS: Deleted primary data file. [2025-10-28T18:47:52.343750] [INFO ] [MAIN ] FLS: Starting full primary refresh. [2025-10-28T18:47:52.687577] [INFO ] [REMOTE ] FLS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:47:52.687908] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-01. [2025-10-28T18:47:53.949870] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-28T18:47:53.959260] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-02. [2025-10-28T18:47:54.939870] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-28T18:47:54.948862] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-03. [2025-10-28T18:47:55.122829] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-08 (29.66 seconds). [2025-10-28T18:47:55.130556] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-09. [2025-10-28T18:47:56.116909] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-28T18:47:56.125628] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-10. [2025-10-28T18:47:56.162149] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-28T18:47:56.173006] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-04. [2025-10-28T18:47:57.203844] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-28T18:47:57.209954] [INFO ] [REMOTE ] FLNG: Full fetch complete (49602 records). [2025-10-28T18:47:57.210050] [DEBUG] [VALIDATOR ] FLNG: Validating primary data. [2025-10-28T18:47:57.593496] [DEBUG] [VALIDATOR ] FLNG: All expected trading days are present. [2025-10-28T18:47:57.593666] [DEBUG] [VALIDATOR ] FLNG: Primary data validation passed. [2025-10-28T18:47:57.594402] [INFO ] [MAIN ] FLNG: Fetched primary data is valid. [2025-10-28T18:47:57.594457] [DEBUG] [LOCAL ] FLNG: Saving primary data. [2025-10-28T18:47:57.595661] [DEBUG] [LOCAL ] FLNG: Trimmed 49602 records to 32849 (keeping 200 days of data) [2025-10-28T18:47:57.626215] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-28T18:47:57.726179] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-05. [2025-10-28T18:47:57.835503] [DEBUG] [LOCAL ] FLNG: Primary data saved (32849 records). [2025-10-28T18:47:57.835637] [INFO ] [MAIN ] FLNG: Full history saved. [2025-10-28T18:47:57.835752] [INFO ] [MAIN ] Update Progress: 845/2366 symbols completed. FLNG took 54.4s. Estimated remaining: 3h 14m 15s. Rate: 7.8 symbols/min [2025-10-28T18:47:58.011670] [INFO ] [MAIN ] FLUT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:47:58.058861] [DEBUG] [LOCAL ] FLUT: Loaded 50601 existing records from primary storage. [2025-10-28T18:47:58.059171] [INFO ] [MAIN ] FLUT: Loaded 50601 existing records. [2025-10-28T18:47:58.235137] [WARN ] [MAIN ] FLUT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:47:58.235356] [INFO ] [MAIN ] FLUT: Wiping existing primary data before full refresh. [2025-10-28T18:47:58.235402] [INFO ] [LOCAL ] FLUT: Starting deletion of primary data. [2025-10-28T18:47:58.235744] [DEBUG] [LOCAL ] FLUT: Deleted primary data file. [2025-10-28T18:47:58.235800] [INFO ] [MAIN ] FLUT: Starting full primary refresh. [2025-10-28T18:47:58.580919] [INFO ] [REMOTE ] FLUT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:47:58.581240] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-01. [2025-10-28T18:47:58.873074] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-28T18:47:58.882911] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-06. [2025-10-28T18:47:59.840236] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-28T18:47:59.849807] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-02. [2025-10-28T18:48:01.161310] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-28T18:48:01.171272] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-03. [2025-10-28T18:48:01.226118] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-01 (25.99 seconds). [2025-10-28T18:48:01.230925] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-02. [2025-10-28T18:48:02.087233] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-28T18:48:02.093295] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-03. [2025-10-28T18:48:02.542938] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-28T18:48:02.553761] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-04. [2025-10-28T18:48:03.098715] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-28T18:48:03.106232] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-04. [2025-10-28T18:48:04.029442] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-28T18:48:04.035601] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-05. [2025-10-28T18:48:04.977455] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-28T18:48:04.984796] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-06. [2025-10-28T18:48:13.640668] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-02 (22.53 seconds). [2025-10-28T18:48:13.650922] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-03. [2025-10-28T18:48:14.902792] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-28T18:48:14.913639] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-04. [2025-10-28T18:48:15.271587] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-04 (12.72 seconds). [2025-10-28T18:48:15.284027] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-05. [2025-10-28T18:48:16.180962] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-28T18:48:16.191785] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-05. [2025-10-28T18:48:17.474462] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-28T18:48:17.485588] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-06. [2025-10-28T18:48:18.853971] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-28T18:48:18.864544] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-07. [2025-10-28T18:48:20.321029] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-28T18:48:20.332451] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-08. [2025-10-28T18:48:21.800769] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-28T18:48:21.812282] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-09. [2025-10-28T18:48:23.172308] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-28T18:48:23.183546] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-10. [2025-10-28T18:48:25.823913] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-06 (26.94 seconds). [2025-10-28T18:48:25.834466] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-07. [2025-10-28T18:48:27.039533] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-28T18:48:27.050634] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-08. [2025-10-28T18:48:28.322522] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-28T18:48:28.332737] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-09. [2025-10-28T18:48:29.771847] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-28T18:48:29.782904] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-10. [2025-10-28T18:48:30.921676] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-05 (15.64 seconds). [2025-10-28T18:48:30.932446] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-06. [2025-10-28T18:48:31.259318] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-28T18:48:31.270137] [INFO ] [REMOTE ] FLS: Full fetch complete (72638 records). [2025-10-28T18:48:31.270287] [DEBUG] [VALIDATOR ] FLS: Validating primary data. [2025-10-28T18:48:31.661625] [DEBUG] [VALIDATOR ] FLS: All expected trading days are present. [2025-10-28T18:48:31.661730] [DEBUG] [VALIDATOR ] FLS: Primary data validation passed. [2025-10-28T18:48:31.662577] [INFO ] [MAIN ] FLS: Fetched primary data is valid. [2025-10-28T18:48:31.662638] [DEBUG] [LOCAL ] FLS: Saving primary data. [2025-10-28T18:48:31.664120] [DEBUG] [LOCAL ] FLS: Trimmed 72638 records to 50389 (keeping 200 days of data) [2025-10-28T18:48:31.962166] [DEBUG] [LOCAL ] FLS: Primary data saved (50389 records). [2025-10-28T18:48:31.962287] [INFO ] [MAIN ] FLS: Full history saved. [2025-10-28T18:48:31.962363] [INFO ] [MAIN ] Update Progress: 846/2366 symbols completed. FLS took 40.0s. Estimated remaining: 3h 14m 55s. Rate: 7.8 symbols/min [2025-10-28T18:48:32.136068] [INFO ] [MAIN ] FLXR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:48:32.170995] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-28T18:48:32.181467] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-07. [2025-10-28T18:48:32.189593] [DEBUG] [LOCAL ] FLXR: Loaded 21635 existing records from primary storage. [2025-10-28T18:48:32.189998] [INFO ] [MAIN ] FLXR: Loaded 21635 existing records. [2025-10-28T18:48:32.365233] [WARN ] [MAIN ] FLXR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:48:32.365428] [INFO ] [MAIN ] FLXR: Wiping existing primary data before full refresh. [2025-10-28T18:48:32.365473] [INFO ] [LOCAL ] FLXR: Starting deletion of primary data. [2025-10-28T18:48:32.365987] [DEBUG] [LOCAL ] FLXR: Deleted primary data file. [2025-10-28T18:48:32.366047] [INFO ] [MAIN ] FLXR: Starting full primary refresh. [2025-10-28T18:48:32.717188] [INFO ] [REMOTE ] FLXR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:48:32.717474] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-01. [2025-10-28T18:48:33.182458] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-28T18:48:33.185069] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-02. [2025-10-28T18:48:33.268527] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-06 (28.28 seconds). [2025-10-28T18:48:33.274661] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-07. [2025-10-28T18:48:33.465725] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-28T18:48:33.476909] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-08. [2025-10-28T18:48:34.077594] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-28T18:48:34.083614] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-08. [2025-10-28T18:48:34.726019] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-28T18:48:34.736496] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-09. [2025-10-28T18:48:36.057928] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-28T18:48:36.068841] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-10. [2025-10-28T18:48:38.721122] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-10 (2.65 seconds). [2025-10-28T18:48:38.732452] [INFO ] [REMOTE ] FLUT: Full fetch complete (73388 records). [2025-10-28T18:48:38.732714] [DEBUG] [VALIDATOR ] FLUT: Validating primary data. [2025-10-28T18:48:39.125624] [DEBUG] [VALIDATOR ] FLUT: All expected trading days are present. [2025-10-28T18:48:39.125756] [DEBUG] [VALIDATOR ] FLUT: Primary data validation passed. [2025-10-28T18:48:39.126777] [INFO ] [MAIN ] FLUT: Fetched primary data is valid. [2025-10-28T18:48:39.126839] [DEBUG] [LOCAL ] FLUT: Saving primary data. [2025-10-28T18:48:39.128319] [DEBUG] [LOCAL ] FLUT: Trimmed 73388 records to 50602 (keeping 200 days of data) [2025-10-28T18:48:39.429865] [DEBUG] [LOCAL ] FLUT: Primary data saved (50602 records). [2025-10-28T18:48:39.429998] [INFO ] [MAIN ] FLUT: Full history saved. [2025-10-28T18:48:39.430899] [INFO ] [MAIN ] Update Progress: 847/2366 symbols completed. FLUT took 41.6s. Estimated remaining: 3h 14m 47s. Rate: 7.8 symbols/min [2025-10-28T18:48:39.597362] [INFO ] [MAIN ] FMC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:48:39.645548] [DEBUG] [LOCAL ] FMC: Loaded 51842 existing records from primary storage. [2025-10-28T18:48:39.645901] [INFO ] [MAIN ] FMC: Loaded 51842 existing records. [2025-10-28T18:48:39.820173] [WARN ] [MAIN ] FMC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:48:39.820371] [INFO ] [MAIN ] FMC: Wiping existing primary data before full refresh. [2025-10-28T18:48:39.820417] [INFO ] [LOCAL ] FMC: Starting deletion of primary data. [2025-10-28T18:48:39.821278] [DEBUG] [LOCAL ] FMC: Deleted primary data file. [2025-10-28T18:48:39.821334] [INFO ] [MAIN ] FMC: Starting full primary refresh. [2025-10-28T18:48:40.171079] [INFO ] [REMOTE ] FMC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:48:40.171404] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-01. [2025-10-28T18:48:43.541909] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-08 (9.46 seconds). [2025-10-28T18:48:43.550143] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-09. [2025-10-28T18:48:45.029097] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-28T18:48:45.034622] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-10. [2025-10-28T18:48:45.626629] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-10 (22.44 seconds). [2025-10-28T18:48:45.637363] [INFO ] [REMOTE ] FLR: Full fetch complete (76932 records). [2025-10-28T18:48:45.637482] [DEBUG] [VALIDATOR ] FLR: Validating primary data. [2025-10-28T18:48:46.028762] [DEBUG] [VALIDATOR ] FLR: All expected trading days are present. [2025-10-28T18:48:46.028891] [DEBUG] [VALIDATOR ] FLR: Primary data validation passed. [2025-10-28T18:48:46.029818] [INFO ] [MAIN ] FLR: Fetched primary data is valid. [2025-10-28T18:48:46.029880] [DEBUG] [LOCAL ] FLR: Saving primary data. [2025-10-28T18:48:46.031319] [DEBUG] [LOCAL ] FLR: Trimmed 76932 records to 53241 (keeping 200 days of data) [2025-10-28T18:48:46.241885] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-28T18:48:46.259394] [INFO ] [REMOTE ] FLOC: Full fetch complete (41754 records). [2025-10-28T18:48:46.272123] [DEBUG] [VALIDATOR ] FLOC: Validating primary data. [2025-10-28T18:48:46.543056] [WARN ] [VALIDATOR ] FLOC: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-10-28T18:48:46.551605] [DEBUG] [LOCAL ] FLR: Primary data saved (53241 records). [2025-10-28T18:48:46.549623] [FATAL] [MAIN ] FLOC: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:48:46.551751] [INFO ] [MAIN ] FLR: Full history saved. [2025-10-28T18:48:46.551908] [INFO ] [MAIN ] Update Progress: 848/2366 symbols completed. FLR took 57.5s. Estimated remaining: 3h 14m 38s. Rate: 7.8 symbols/min [2025-10-28T18:48:46.551825] [WARN ] [MAIN ] FLOC: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:48:46.583200] [INFO ] [LOCAL ] FLOC: Starting deletion of primary data. [2025-10-28T18:48:46.631229] [DEBUG] [LOCAL ] FLOC: No primary data file found to delete. [2025-10-28T18:48:46.651830] [INFO ] [LOCAL ] FLOC: Starting deletion of derivative data. [2025-10-28T18:48:46.651958] [DEBUG] [LOCAL ] FLOC: No derivative data file found to delete. [2025-10-28T18:48:46.657631] [INFO ] [MAIN ] Update Progress: 849/2366 symbols completed. FLOC took 1m 12s. Estimated remaining: 3h 14m 17s. Rate: 7.8 symbols/min [2025-10-28T18:48:46.818674] [INFO ] [MAIN ] FMN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:48:46.907334] [DEBUG] [LOCAL ] FMN: Loaded 5419 existing records from primary storage. [2025-10-28T18:48:46.904593] [INFO ] [MAIN ] FMS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:48:46.907556] [INFO ] [MAIN ] FMN: Loaded 5419 existing records. [2025-10-28T18:48:47.098549] [WARN ] [MAIN ] FMN: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:48:47.108590] [INFO ] [MAIN ] FMN: Wiping existing primary data before full refresh. [2025-10-28T18:48:47.108709] [INFO ] [LOCAL ] FMN: Starting deletion of primary data. [2025-10-28T18:48:47.108967] [DEBUG] [LOCAL ] FMN: Deleted primary data file. [2025-10-28T18:48:47.109032] [INFO ] [MAIN ] FMN: Starting full primary refresh. [2025-10-28T18:48:47.141725] [DEBUG] [LOCAL ] FMS: Loaded 30079 existing records from primary storage. [2025-10-28T18:48:47.173684] [INFO ] [MAIN ] FMS: Loaded 30079 existing records. [2025-10-28T18:48:47.588232] [WARN ] [MAIN ] FMS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:48:47.592428] [INFO ] [MAIN ] FMS: Wiping existing primary data before full refresh. [2025-10-28T18:48:47.598036] [INFO ] [LOCAL ] FMS: Starting deletion of primary data. [2025-10-28T18:48:47.614343] [DEBUG] [LOCAL ] FMS: Deleted primary data file. [2025-10-28T18:48:47.631753] [INFO ] [MAIN ] FMS: Starting full primary refresh. [2025-10-28T18:48:47.713967] [INFO ] [REMOTE ] FMN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:48:47.762992] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-01. [2025-10-28T18:48:47.786191] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-02 (14.60 seconds). [2025-10-28T18:48:47.837006] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-03. [2025-10-28T18:48:48.048553] [INFO ] [REMOTE ] FMS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:48:48.049018] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-01. [2025-10-28T18:48:48.411893] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-28T18:48:48.414578] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-02. [2025-10-28T18:48:48.560571] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-28T18:48:48.564464] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-04. [2025-10-28T18:48:48.895103] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-28T18:48:48.901091] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-02. [2025-10-28T18:48:48.964005] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-28T18:48:48.966366] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-03. [2025-10-28T18:48:49.486945] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-28T18:48:49.489811] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-04. [2025-10-28T18:48:49.698284] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-28T18:48:49.703431] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-03. [2025-10-28T18:48:51.427573] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-28T18:48:51.434222] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-04. [2025-10-28T18:48:52.536915] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-28T18:48:52.544319] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-05. [2025-10-28T18:48:52.674291] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-04 (3.18 seconds). [2025-10-28T18:48:52.676574] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-05. [2025-10-28T18:48:53.050863] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-10-28T18:48:53.052371] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-06. [2025-10-28T18:48:54.690071] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-28T18:48:54.691985] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-07. [2025-10-28T18:48:55.269212] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-01 (15.10 seconds). [2025-10-28T18:48:55.281138] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-02. [2025-10-28T18:48:55.918031] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-28T18:48:55.920272] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-08. [2025-10-28T18:48:56.767226] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-28T18:48:56.769054] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-09. [2025-10-28T18:48:56.963004] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-10-28T18:48:56.973539] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-03. [2025-10-28T18:48:57.187910] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-10-28T18:48:57.189907] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-10. [2025-10-28T18:48:57.842460] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-28T18:48:57.844556] [INFO ] [REMOTE ] FMN: Full fetch complete (9796 records). [2025-10-28T18:48:57.844626] [DEBUG] [VALIDATOR ] FMN: Validating primary data. [2025-10-28T18:48:58.258752] [DEBUG] [VALIDATOR ] FMN: All expected trading days are present. [2025-10-28T18:48:58.258856] [DEBUG] [VALIDATOR ] FMN: Primary data validation passed. [2025-10-28T18:48:58.259219] [INFO ] [MAIN ] FMN: Fetched primary data is valid. [2025-10-28T18:48:58.259268] [DEBUG] [LOCAL ] FMN: Saving primary data. [2025-10-28T18:48:58.259856] [DEBUG] [LOCAL ] FMN: Trimmed 9796 records to 5507 (keeping 200 days of data) [2025-10-28T18:48:58.295149] [DEBUG] [LOCAL ] FMN: Primary data saved (5507 records). [2025-10-28T18:48:58.295326] [INFO ] [MAIN ] FMN: Full history saved. [2025-10-28T18:48:58.295432] [INFO ] [MAIN ] Update Progress: 850/2366 symbols completed. FMN took 11.7s. Estimated remaining: 3h 14m 16s. Rate: 7.8 symbols/min [2025-10-28T18:48:58.474930] [INFO ] [MAIN ] FMX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:48:58.516047] [DEBUG] [LOCAL ] FMX: Loaded 39996 existing records from primary storage. [2025-10-28T18:48:58.516626] [INFO ] [MAIN ] FMX: Loaded 39996 existing records. [2025-10-28T18:48:58.710603] [WARN ] [MAIN ] FMX: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:48:58.710993] [INFO ] [MAIN ] FMX: Wiping existing primary data before full refresh. [2025-10-28T18:48:58.711138] [INFO ] [LOCAL ] FMX: Starting deletion of primary data. [2025-10-28T18:48:58.723903] [DEBUG] [LOCAL ] FMX: Deleted primary data file. [2025-10-28T18:48:58.742307] [INFO ] [MAIN ] FMX: Starting full primary refresh. [2025-10-28T18:48:58.750554] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-10-28T18:48:58.856030] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-04. [2025-10-28T18:48:59.139249] [INFO ] [REMOTE ] FMX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:48:59.139625] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-01. [2025-10-28T18:49:00.215212] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-04 (11.65 seconds). [2025-10-28T18:49:00.219321] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-05. [2025-10-28T18:49:00.645479] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-10-28T18:49:00.666309] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-05. [2025-10-28T18:49:00.845428] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-28T18:49:00.852580] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-06. [2025-10-28T18:49:01.487319] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-28T18:49:01.491557] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-07. [2025-10-28T18:49:02.551186] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-28T18:49:02.555997] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-08. [2025-10-28T18:49:03.511126] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-28T18:49:03.516299] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-09. [2025-10-28T18:49:04.426586] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-28T18:49:04.432432] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-10. [2025-10-28T18:49:05.493924] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-28T18:49:05.501400] [INFO ] [REMOTE ] FLXR: Full fetch complete (28072 records). [2025-10-28T18:49:05.501544] [DEBUG] [VALIDATOR ] FLXR: Validating primary data. [2025-10-28T18:49:05.878477] [DEBUG] [VALIDATOR ] FLXR: All expected trading days are present. [2025-10-28T18:49:05.878541] [DEBUG] [VALIDATOR ] FLXR: Primary data validation passed. [2025-10-28T18:49:05.879141] [INFO ] [MAIN ] FLXR: Fetched primary data is valid. [2025-10-28T18:49:05.879201] [DEBUG] [LOCAL ] FLXR: Saving primary data. [2025-10-28T18:49:05.880030] [DEBUG] [LOCAL ] FLXR: Trimmed 28072 records to 21694 (keeping 200 days of data) [2025-10-28T18:49:06.022391] [DEBUG] [LOCAL ] FLXR: Primary data saved (21694 records). [2025-10-28T18:49:06.022515] [INFO ] [MAIN ] FLXR: Full history saved. [2025-10-28T18:49:06.022595] [INFO ] [MAIN ] Update Progress: 851/2366 symbols completed. FLXR took 34.1s. Estimated remaining: 3h 14m 8s. Rate: 7.8 symbols/min [2025-10-28T18:49:06.210576] [INFO ] [MAIN ] FMY: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:49:06.213436] [DEBUG] [LOCAL ] FMY: Loaded 1320 existing records from primary storage. [2025-10-28T18:49:06.213580] [INFO ] [MAIN ] FMY: Loaded 1320 existing records. [2025-10-28T18:49:06.386666] [WARN ] [MAIN ] FMY: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:49:06.386903] [INFO ] [MAIN ] FMY: Wiping existing primary data before full refresh. [2025-10-28T18:49:06.386952] [INFO ] [LOCAL ] FMY: Starting deletion of primary data. [2025-10-28T18:49:06.387096] [DEBUG] [LOCAL ] FMY: Deleted primary data file. [2025-10-28T18:49:06.387134] [INFO ] [MAIN ] FMY: Starting full primary refresh. [2025-10-28T18:49:06.731054] [INFO ] [REMOTE ] FMY: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:49:06.731341] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-01. [2025-10-28T18:49:06.973137] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-01 (0.24 seconds). [2025-10-28T18:49:06.974032] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-02. [2025-10-28T18:49:09.646759] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-05 (17.10 seconds). [2025-10-28T18:49:09.654291] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-06. [2025-10-28T18:49:10.566445] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-28T18:49:10.572882] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-07. [2025-10-28T18:49:15.656953] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-05 (14.99 seconds). [2025-10-28T18:49:15.670884] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-06. [2025-10-28T18:49:16.114693] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-02 (9.14 seconds). [2025-10-28T18:49:16.115767] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-03. [2025-10-28T18:49:16.383600] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-03 (0.27 seconds). [2025-10-28T18:49:16.384573] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-04. [2025-10-28T18:49:16.768268] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-10-28T18:49:16.769802] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-05. [2025-10-28T18:49:17.019470] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-05 (0.25 seconds). [2025-10-28T18:49:17.020473] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-06. [2025-10-28T18:49:17.124609] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-28T18:49:17.135418] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-07. [2025-10-28T18:49:18.461320] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-28T18:49:18.472310] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-08. [2025-10-28T18:49:19.546870] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-01 (20.41 seconds). [2025-10-28T18:49:19.553983] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-02. [2025-10-28T18:49:19.826843] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-28T18:49:19.838008] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-09. [2025-10-28T18:49:20.627915] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-28T18:49:20.635489] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-03. [2025-10-28T18:49:21.574330] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-07 (11.00 seconds). [2025-10-28T18:49:21.580319] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-08. [2025-10-28T18:49:21.684549] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-06 (4.66 seconds). [2025-10-28T18:49:21.685499] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-07. [2025-10-28T18:49:21.974340] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-07 (0.29 seconds). [2025-10-28T18:49:21.975395] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-08. [2025-10-28T18:49:30.862688] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-08 (9.28 seconds). [2025-10-28T18:49:30.868839] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-09. [2025-10-28T18:49:31.866763] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-28T18:49:31.873600] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-10. [2025-10-28T18:49:32.914502] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-28T18:49:32.921148] [INFO ] [REMOTE ] FMS: Full fetch complete (43184 records). [2025-10-28T18:49:32.921286] [DEBUG] [VALIDATOR ] FMS: Validating primary data. [2025-10-28T18:49:33.334353] [DEBUG] [VALIDATOR ] FMS: All expected trading days are present. [2025-10-28T18:49:33.334444] [DEBUG] [VALIDATOR ] FMS: Primary data validation passed. [2025-10-28T18:49:33.335183] [INFO ] [MAIN ] FMS: Fetched primary data is valid. [2025-10-28T18:49:33.335247] [DEBUG] [LOCAL ] FMS: Saving primary data. [2025-10-28T18:49:33.336408] [DEBUG] [LOCAL ] FMS: Trimmed 43184 records to 30062 (keeping 200 days of data) [2025-10-28T18:49:33.511364] [DEBUG] [LOCAL ] FMS: Primary data saved (30062 records). [2025-10-28T18:49:33.511487] [INFO ] [MAIN ] FMS: Full history saved. [2025-10-28T18:49:33.511563] [INFO ] [MAIN ] Update Progress: 852/2366 symbols completed. FMS took 46.8s. Estimated remaining: 3h 14m 36s. Rate: 7.8 symbols/min [2025-10-28T18:49:33.691880] [INFO ] [MAIN ] FN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:49:33.726132] [DEBUG] [LOCAL ] FN: Loaded 37005 existing records from primary storage. [2025-10-28T18:49:33.726435] [INFO ] [MAIN ] FN: Loaded 37005 existing records. [2025-10-28T18:49:33.922542] [WARN ] [MAIN ] FN: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:49:33.922801] [INFO ] [MAIN ] FN: Wiping existing primary data before full refresh. [2025-10-28T18:49:33.922849] [INFO ] [LOCAL ] FN: Starting deletion of primary data. [2025-10-28T18:49:33.923058] [DEBUG] [LOCAL ] FN: Deleted primary data file. [2025-10-28T18:49:33.923113] [INFO ] [MAIN ] FN: Starting full primary refresh. [2025-10-28T18:49:34.307217] [INFO ] [REMOTE ] FN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:49:34.307756] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-01. [2025-10-28T18:49:38.795044] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-09 (18.96 seconds). [2025-10-28T18:49:38.806202] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-10. [2025-10-28T18:49:40.473282] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-28T18:49:40.483844] [INFO ] [REMOTE ] FMC: Full fetch complete (75435 records). [2025-10-28T18:49:40.483980] [DEBUG] [VALIDATOR ] FMC: Validating primary data. [2025-10-28T18:49:40.885124] [DEBUG] [VALIDATOR ] FMC: All expected trading days are present. [2025-10-28T18:49:40.885216] [DEBUG] [VALIDATOR ] FMC: Primary data validation passed. [2025-10-28T18:49:40.886318] [INFO ] [MAIN ] FMC: Fetched primary data is valid. [2025-10-28T18:49:40.886389] [DEBUG] [LOCAL ] FMC: Saving primary data. [2025-10-28T18:49:40.887951] [DEBUG] [LOCAL ] FMC: Trimmed 75435 records to 51833 (keeping 200 days of data) [2025-10-28T18:49:41.196911] [DEBUG] [LOCAL ] FMC: Primary data saved (51833 records). [2025-10-28T18:49:41.197045] [INFO ] [MAIN ] FMC: Full history saved. [2025-10-28T18:49:41.197753] [INFO ] [MAIN ] Update Progress: 853/2366 symbols completed. FMC took 1m 2s. Estimated remaining: 3h 14m 28s. Rate: 7.8 symbols/min [2025-10-28T18:49:41.362839] [INFO ] [MAIN ] FNB: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:49:41.416098] [DEBUG] [LOCAL ] FNB: Loaded 52602 existing records from primary storage. [2025-10-28T18:49:41.416405] [INFO ] [MAIN ] FNB: Loaded 52602 existing records. [2025-10-28T18:49:41.588947] [WARN ] [MAIN ] FNB: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:49:41.589132] [INFO ] [MAIN ] FNB: Wiping existing primary data before full refresh. [2025-10-28T18:49:41.589177] [INFO ] [LOCAL ] FNB: Starting deletion of primary data. [2025-10-28T18:49:41.589637] [DEBUG] [LOCAL ] FNB: Deleted primary data file. [2025-10-28T18:49:41.589727] [INFO ] [MAIN ] FNB: Starting full primary refresh. [2025-10-28T18:49:41.977729] [INFO ] [REMOTE ] FNB: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:49:41.978107] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-01. [2025-10-28T18:49:43.338245] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-28T18:49:43.348408] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-02. [2025-10-28T18:49:44.375847] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-08 (22.40 seconds). [2025-10-28T18:49:44.377252] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-09. [2025-10-28T18:49:44.619096] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-28T18:49:44.629136] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-03. [2025-10-28T18:49:44.685618] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-09 (0.31 seconds). [2025-10-28T18:49:44.686779] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-10. [2025-10-28T18:49:45.168037] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-28T18:49:45.169063] [INFO ] [REMOTE ] FMY: Full fetch complete (1936 records). [2025-10-28T18:49:45.169136] [DEBUG] [VALIDATOR ] FMY: Validating primary data. [2025-10-28T18:49:45.544808] [DEBUG] [VALIDATOR ] FMY: All expected trading days are present. [2025-10-28T18:49:45.544903] [DEBUG] [VALIDATOR ] FMY: Primary data validation passed. [2025-10-28T18:49:45.545016] [INFO ] [MAIN ] FMY: Fetched primary data is valid. [2025-10-28T18:49:45.545056] [DEBUG] [LOCAL ] FMY: Saving primary data. [2025-10-28T18:49:45.545380] [DEBUG] [LOCAL ] FMY: Trimmed 1936 records to 1325 (keeping 200 days of data) [2025-10-28T18:49:45.553760] [DEBUG] [LOCAL ] FMY: Primary data saved (1325 records). [2025-10-28T18:49:45.553819] [INFO ] [MAIN ] FMY: Full history saved. [2025-10-28T18:49:45.553884] [INFO ] [MAIN ] Update Progress: 854/2366 symbols completed. FMY took 39.5s. Estimated remaining: 3h 14m 14s. Rate: 7.8 symbols/min [2025-10-28T18:49:45.725806] [INFO ] [MAIN ] FND: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:49:45.772800] [DEBUG] [LOCAL ] FND: Loaded 52045 existing records from primary storage. [2025-10-28T18:49:45.773164] [INFO ] [MAIN ] FND: Loaded 52045 existing records. [2025-10-28T18:49:45.961367] [WARN ] [MAIN ] FND: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:49:45.961623] [INFO ] [MAIN ] FND: Wiping existing primary data before full refresh. [2025-10-28T18:49:45.961861] [INFO ] [LOCAL ] FND: Starting deletion of primary data. [2025-10-28T18:49:45.962277] [DEBUG] [LOCAL ] FND: Deleted primary data file. [2025-10-28T18:49:45.962334] [INFO ] [MAIN ] FND: Starting full primary refresh. [2025-10-28T18:49:46.275835] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-28T18:49:46.340593] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-04. [2025-10-28T18:49:46.360233] [INFO ] [REMOTE ] FND: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:49:46.361393] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-01. [2025-10-28T18:49:47.713686] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-28T18:49:47.723973] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-02. [2025-10-28T18:49:47.786849] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-28T18:49:47.799627] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-05. [2025-10-28T18:49:48.271378] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-03 (27.64 seconds). [2025-10-28T18:49:48.283627] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-04. [2025-10-28T18:49:49.025975] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-28T18:49:49.035535] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-03. [2025-10-28T18:49:49.222678] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-28T18:49:49.233487] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-06. [2025-10-28T18:49:49.598291] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-28T18:49:49.607489] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-05. [2025-10-28T18:49:50.447919] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-28T18:49:50.459318] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-04. [2025-10-28T18:49:50.720782] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-28T18:49:50.728548] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-06. [2025-10-28T18:49:51.768072] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-28T18:49:51.775863] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-07. [2025-10-28T18:50:01.178941] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-01 (26.87 seconds). [2025-10-28T18:50:01.186392] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-02. [2025-10-28T18:50:01.574981] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-06 (12.34 seconds). [2025-10-28T18:50:01.589393] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-07. [2025-10-28T18:50:02.956871] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-28T18:50:02.968478] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-08. [2025-10-28T18:50:04.306768] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-28T18:50:04.318357] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-09. [2025-10-28T18:50:10.981567] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-07 (19.21 seconds). [2025-10-28T18:50:10.990414] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-08. [2025-10-28T18:50:14.821518] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-04 (24.36 seconds). [2025-10-28T18:50:14.832382] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-05. [2025-10-28T18:50:16.335764] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-28T18:50:16.346751] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-06. [2025-10-28T18:50:23.572602] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-02 (22.39 seconds). [2025-10-28T18:50:23.581149] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-03. [2025-10-28T18:50:24.757741] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-09 (20.44 seconds). [2025-10-28T18:50:24.769391] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-10. [2025-10-28T18:50:24.796470] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-28T18:50:24.807412] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-04. [2025-10-28T18:50:25.988181] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-28T18:50:26.001549] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-05. [2025-10-28T18:50:26.350571] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-28T18:50:26.361556] [INFO ] [REMOTE ] FNB: Full fetch complete (76249 records). [2025-10-28T18:50:26.361754] [DEBUG] [VALIDATOR ] FNB: Validating primary data. [2025-10-28T18:50:26.751047] [DEBUG] [VALIDATOR ] FNB: All expected trading days are present. [2025-10-28T18:50:26.751127] [DEBUG] [VALIDATOR ] FNB: Primary data validation passed. [2025-10-28T18:50:26.752037] [INFO ] [MAIN ] FNB: Fetched primary data is valid. [2025-10-28T18:50:26.752106] [DEBUG] [LOCAL ] FNB: Saving primary data. [2025-10-28T18:50:26.753686] [DEBUG] [LOCAL ] FNB: Trimmed 76249 records to 52602 (keeping 200 days of data) [2025-10-28T18:50:27.070937] [DEBUG] [LOCAL ] FNB: Primary data saved (52602 records). [2025-10-28T18:50:27.071085] [INFO ] [MAIN ] FNB: Full history saved. [2025-10-28T18:50:27.071733] [INFO ] [MAIN ] Update Progress: 855/2366 symbols completed. FNB took 45.9s. Estimated remaining: 3h 15m 6s. Rate: 7.7 symbols/min [2025-10-28T18:50:27.244671] [INFO ] [MAIN ] FNF: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:50:27.290244] [DEBUG] [LOCAL ] FNF: Loaded 48527 existing records from primary storage. [2025-10-28T18:50:27.290521] [INFO ] [MAIN ] FNF: Loaded 48527 existing records. [2025-10-28T18:50:27.466864] [WARN ] [MAIN ] FNF: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:50:27.467010] [INFO ] [MAIN ] FNF: Wiping existing primary data before full refresh. [2025-10-28T18:50:27.467057] [INFO ] [LOCAL ] FNF: Starting deletion of primary data. [2025-10-28T18:50:27.467365] [DEBUG] [LOCAL ] FNF: Deleted primary data file. [2025-10-28T18:50:27.467406] [INFO ] [MAIN ] FNF: Starting full primary refresh. [2025-10-28T18:50:27.829248] [INFO ] [REMOTE ] FNF: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:50:27.829670] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-01. [2025-10-28T18:50:28.874100] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-28T18:50:28.882936] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-02. [2025-10-28T18:50:30.028502] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-10-28T18:50:30.037492] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-03. [2025-10-28T18:50:31.222860] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-28T18:50:31.233186] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-04. [2025-10-28T18:50:35.918230] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-08 (24.93 seconds). [2025-10-28T18:50:35.927531] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-09. [2025-10-28T18:50:46.116557] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-04 (14.88 seconds). [2025-10-28T18:50:46.127137] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-05. [2025-10-28T18:50:47.338791] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-28T18:50:47.349571] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-06. [2025-10-28T18:50:48.519187] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-28T18:50:48.530480] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-07. [2025-10-28T18:50:48.635979] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-06 (32.29 seconds). [2025-10-28T18:50:48.646184] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-07. [2025-10-28T18:50:49.758550] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-28T18:50:49.770195] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-08. [2025-10-28T18:50:49.821607] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-28T18:50:49.832751] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-08. [2025-10-28T18:50:50.997596] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-28T18:50:51.008092] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-09. [2025-10-28T18:50:51.114632] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-28T18:50:51.125594] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-09. [2025-10-28T18:50:52.117211] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-28T18:50:52.127475] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-10. [2025-10-28T18:50:52.379337] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-28T18:50:52.390551] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-10. [2025-10-28T18:50:53.351971] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-28T18:50:53.361996] [INFO ] [REMOTE ] FNF: Full fetch complete (69832 records). [2025-10-28T18:50:53.362233] [DEBUG] [VALIDATOR ] FNF: Validating primary data. [2025-10-28T18:50:53.786933] [DEBUG] [VALIDATOR ] FNF: All expected trading days are present. [2025-10-28T18:50:53.787152] [DEBUG] [VALIDATOR ] FNF: Primary data validation passed. [2025-10-28T18:50:53.788204] [INFO ] [MAIN ] FNF: Fetched primary data is valid. [2025-10-28T18:50:53.788286] [DEBUG] [LOCAL ] FNF: Saving primary data. [2025-10-28T18:50:53.789831] [DEBUG] [LOCAL ] FNF: Trimmed 69832 records to 48424 (keeping 200 days of data) [2025-10-28T18:50:53.911158] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-28T18:50:53.937808] [INFO ] [REMOTE ] FND: Full fetch complete (75095 records). [2025-10-28T18:50:53.944519] [DEBUG] [VALIDATOR ] FND: Validating primary data. [2025-10-28T18:50:54.542282] [DEBUG] [LOCAL ] FNF: Primary data saved (48424 records). [2025-10-28T18:50:54.560421] [INFO ] [MAIN ] FNF: Full history saved. [2025-10-28T18:50:54.561322] [INFO ] [MAIN ] Update Progress: 856/2366 symbols completed. FNF took 27.5s. Estimated remaining: 3h 15m 33s. Rate: 7.7 symbols/min [2025-10-28T18:50:54.561806] [DEBUG] [VALIDATOR ] FND: All expected trading days are present. [2025-10-28T18:50:54.567044] [DEBUG] [VALIDATOR ] FND: Primary data validation passed. [2025-10-28T18:50:54.578070] [INFO ] [MAIN ] FND: Fetched primary data is valid. [2025-10-28T18:50:54.600598] [DEBUG] [LOCAL ] FND: Saving primary data. [2025-10-28T18:50:54.680443] [DEBUG] [LOCAL ] FND: Trimmed 75095 records to 52022 (keeping 200 days of data) [2025-10-28T18:50:54.828075] [INFO ] [MAIN ] FNV: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:50:55.074727] [DEBUG] [LOCAL ] FND: Primary data saved (52022 records). [2025-10-28T18:50:55.086294] [INFO ] [MAIN ] FND: Full history saved. [2025-10-28T18:50:55.087409] [INFO ] [MAIN ] Update Progress: 857/2366 symbols completed. FND took 1m 10s. Estimated remaining: 3h 15m 13s. Rate: 7.7 symbols/min [2025-10-28T18:50:55.110060] [DEBUG] [LOCAL ] FNV: Loaded 45932 existing records from primary storage. [2025-10-28T18:50:55.133054] [INFO ] [MAIN ] FNV: Loaded 45932 existing records. [2025-10-28T18:50:55.399048] [INFO ] [MAIN ] FOA: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:50:55.466303] [WARN ] [MAIN ] FNV: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:50:55.473345] [INFO ] [MAIN ] FNV: Wiping existing primary data before full refresh. [2025-10-28T18:50:55.473511] [INFO ] [LOCAL ] FNV: Starting deletion of primary data. [2025-10-28T18:50:55.474598] [DEBUG] [LOCAL ] FNV: Deleted primary data file. [2025-10-28T18:50:55.474694] [INFO ] [MAIN ] FNV: Starting full primary refresh. [2025-10-28T18:50:55.563274] [DEBUG] [LOCAL ] FOA: Loaded 12847 existing records from primary storage. [2025-10-28T18:50:55.586074] [INFO ] [MAIN ] FOA: Loaded 12847 existing records. [2025-10-28T18:50:55.975025] [WARN ] [MAIN ] FOA: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:50:56.004988] [INFO ] [MAIN ] FOA: Wiping existing primary data before full refresh. [2025-10-28T18:50:56.010828] [INFO ] [LOCAL ] FOA: Starting deletion of primary data. [2025-10-28T18:50:56.021447] [DEBUG] [LOCAL ] FOA: Deleted primary data file. [2025-10-28T18:50:56.026876] [INFO ] [MAIN ] FOA: Starting full primary refresh. [2025-10-28T18:50:56.186730] [INFO ] [REMOTE ] FNV: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:50:56.216997] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-01. [2025-10-28T18:50:56.657023] [INFO ] [REMOTE ] FOA: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:50:56.657434] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-01. [2025-10-28T18:50:57.466034] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-28T18:50:57.474713] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-02. [2025-10-28T18:50:57.523523] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-09 (21.60 seconds). [2025-10-28T18:50:57.533813] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-10. [2025-10-28T18:50:58.575625] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-05 (32.57 seconds). [2025-10-28T18:50:58.585322] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-06. [2025-10-28T18:50:58.628724] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-28T18:50:58.636581] [INFO ] [REMOTE ] FMX: Full fetch complete (57856 records). [2025-10-28T18:50:58.636828] [DEBUG] [VALIDATOR ] FMX: Validating primary data. [2025-10-28T18:50:59.055099] [DEBUG] [VALIDATOR ] FMX: All expected trading days are present. [2025-10-28T18:50:59.055301] [DEBUG] [VALIDATOR ] FMX: Primary data validation passed. [2025-10-28T18:50:59.056309] [INFO ] [MAIN ] FMX: Fetched primary data is valid. [2025-10-28T18:50:59.056374] [DEBUG] [LOCAL ] FMX: Saving primary data. [2025-10-28T18:50:59.057709] [DEBUG] [LOCAL ] FMX: Trimmed 57856 records to 39942 (keeping 200 days of data) [2025-10-28T18:50:59.320422] [DEBUG] [LOCAL ] FMX: Primary data saved (39942 records). [2025-10-28T18:50:59.320558] [INFO ] [MAIN ] FMX: Full history saved. [2025-10-28T18:50:59.320636] [INFO ] [MAIN ] Update Progress: 858/2366 symbols completed. FMX took 2m 1s. Estimated remaining: 3h 14m 59s. Rate: 7.7 symbols/min [2025-10-28T18:50:59.504427] [INFO ] [MAIN ] FOF: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:50:59.514700] [DEBUG] [LOCAL ] FOF: Loaded 8138 existing records from primary storage. [2025-10-28T18:50:59.514936] [INFO ] [MAIN ] FOF: Loaded 8138 existing records. [2025-10-28T18:50:59.714325] [WARN ] [MAIN ] FOF: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:50:59.714701] [INFO ] [MAIN ] FOF: Wiping existing primary data before full refresh. [2025-10-28T18:50:59.714892] [INFO ] [LOCAL ] FOF: Starting deletion of primary data. [2025-10-28T18:50:59.715151] [DEBUG] [LOCAL ] FOF: Deleted primary data file. [2025-10-28T18:50:59.715233] [INFO ] [MAIN ] FOF: Starting full primary refresh. [2025-10-28T18:50:59.864813] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-28T18:50:59.948378] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-07. [2025-10-28T18:51:00.129629] [INFO ] [REMOTE ] FOF: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:51:00.129961] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-01. [2025-10-28T18:51:01.237702] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-28T18:51:01.245408] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-08. [2025-10-28T18:51:02.449809] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-28T18:51:02.459151] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-09. [2025-10-28T18:51:08.214792] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-01 (11.56 seconds). [2025-10-28T18:51:08.219752] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-02. [2025-10-28T18:51:09.122695] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-02 (11.65 seconds). [2025-10-28T18:51:09.132801] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-03. [2025-10-28T18:51:10.256836] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-01 (10.13 seconds). [2025-10-28T18:51:10.258928] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-02. [2025-10-28T18:51:10.713058] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-28T18:51:10.715162] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-03. [2025-10-28T18:51:11.192263] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-28T18:51:11.194346] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-04. [2025-10-28T18:51:13.795073] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-04 (2.60 seconds). [2025-10-28T18:51:13.798056] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-05. [2025-10-28T18:51:14.284550] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-28T18:51:14.286935] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-06. [2025-10-28T18:51:14.735503] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-28T18:51:14.737716] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-07. [2025-10-28T18:51:17.436335] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-07 (2.70 seconds). [2025-10-28T18:51:17.438771] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-08. [2025-10-28T18:51:17.989694] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-28T18:51:17.992219] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-09. [2025-10-28T18:51:18.485742] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-28T18:51:18.488579] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-10. [2025-10-28T18:51:18.993845] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-09 (16.53 seconds). [2025-10-28T18:51:19.001696] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-10. [2025-10-28T18:51:19.043806] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-28T18:51:19.045911] [INFO ] [REMOTE ] FOF: Full fetch complete (11909 records). [2025-10-28T18:51:19.045980] [DEBUG] [VALIDATOR ] FOF: Validating primary data. [2025-10-28T18:51:19.419909] [DEBUG] [VALIDATOR ] FOF: All expected trading days are present. [2025-10-28T18:51:19.419983] [DEBUG] [VALIDATOR ] FOF: Primary data validation passed. [2025-10-28T18:51:19.420285] [INFO ] [MAIN ] FOF: Fetched primary data is valid. [2025-10-28T18:51:19.420349] [DEBUG] [LOCAL ] FOF: Saving primary data. [2025-10-28T18:51:19.420848] [DEBUG] [LOCAL ] FOF: Trimmed 11909 records to 8130 (keeping 200 days of data) [2025-10-28T18:51:19.469883] [DEBUG] [LOCAL ] FOF: Primary data saved (8130 records). [2025-10-28T18:51:19.470008] [INFO ] [MAIN ] FOF: Full history saved. [2025-10-28T18:51:19.470086] [INFO ] [MAIN ] Update Progress: 859/2366 symbols completed. FOF took 20.1s. Estimated remaining: 3h 15m 13s. Rate: 7.7 symbols/min [2025-10-28T18:51:19.645680] [INFO ] [MAIN ] FOR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:51:19.664167] [DEBUG] [LOCAL ] FOR: Loaded 19027 existing records from primary storage. [2025-10-28T18:51:19.664394] [INFO ] [MAIN ] FOR: Loaded 19027 existing records. [2025-10-28T18:51:19.844616] [WARN ] [MAIN ] FOR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:51:19.844834] [INFO ] [MAIN ] FOR: Wiping existing primary data before full refresh. [2025-10-28T18:51:19.844882] [INFO ] [LOCAL ] FOR: Starting deletion of primary data. [2025-10-28T18:51:19.845056] [DEBUG] [LOCAL ] FOR: Deleted primary data file. [2025-10-28T18:51:19.845111] [INFO ] [MAIN ] FOR: Starting full primary refresh. [2025-10-28T18:51:20.205759] [INFO ] [REMOTE ] FOR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:51:20.206106] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-01. [2025-10-28T18:51:20.225392] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-28T18:51:20.232791] [INFO ] [REMOTE ] FN: Full fetch complete (56441 records). [2025-10-28T18:51:20.233002] [DEBUG] [VALIDATOR ] FN: Validating primary data. [2025-10-28T18:51:20.607439] [DEBUG] [VALIDATOR ] FN: All expected trading days are present. [2025-10-28T18:51:20.607516] [DEBUG] [VALIDATOR ] FN: Primary data validation passed. [2025-10-28T18:51:20.608395] [INFO ] [MAIN ] FN: Fetched primary data is valid. [2025-10-28T18:51:20.608456] [DEBUG] [LOCAL ] FN: Saving primary data. [2025-10-28T18:51:20.609564] [DEBUG] [LOCAL ] FN: Trimmed 56441 records to 36887 (keeping 200 days of data) [2025-10-28T18:51:20.829373] [DEBUG] [LOCAL ] FN: Primary data saved (36887 records). [2025-10-28T18:51:20.829514] [INFO ] [MAIN ] FN: Full history saved. [2025-10-28T18:51:20.829597] [INFO ] [MAIN ] Update Progress: 860/2366 symbols completed. FN took 1m 47s. Estimated remaining: 3h 14m 54s. Rate: 7.7 symbols/min [2025-10-28T18:51:20.998934] [INFO ] [MAIN ] FOUR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:51:21.016574] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-28T18:51:21.022082] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-02. [2025-10-28T18:51:21.061753] [DEBUG] [LOCAL ] FOUR: Loaded 49574 existing records from primary storage. [2025-10-28T18:51:21.062042] [INFO ] [MAIN ] FOUR: Loaded 49574 existing records. [2025-10-28T18:51:21.242483] [WARN ] [MAIN ] FOUR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:51:21.242733] [INFO ] [MAIN ] FOUR: Wiping existing primary data before full refresh. [2025-10-28T18:51:21.242786] [INFO ] [LOCAL ] FOUR: Starting deletion of primary data. [2025-10-28T18:51:21.242970] [DEBUG] [LOCAL ] FOUR: Deleted primary data file. [2025-10-28T18:51:21.243009] [INFO ] [MAIN ] FOUR: Starting full primary refresh. [2025-10-28T18:51:21.597818] [INFO ] [REMOTE ] FOUR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:51:21.598156] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-01. [2025-10-28T18:51:22.888903] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-28T18:51:22.898638] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-02. [2025-10-28T18:51:25.924486] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-02 (17.70 seconds). [2025-10-28T18:51:25.928331] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-03. [2025-10-28T18:51:26.560508] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-28T18:51:26.564387] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-04. [2025-10-28T18:51:27.204237] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-28T18:51:27.207792] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-05. [2025-10-28T18:51:27.768899] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-28T18:51:27.772105] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-06. [2025-10-28T18:51:28.296210] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-28T18:51:28.299082] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-07. [2025-10-28T18:51:35.206898] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-03 (26.07 seconds). [2025-10-28T18:51:35.216952] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-04. [2025-10-28T18:51:36.441196] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-28T18:51:36.452314] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-05. [2025-10-28T18:51:38.189027] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-02 (15.29 seconds). [2025-10-28T18:51:38.198693] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-03. [2025-10-28T18:51:40.242709] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-02 (19.22 seconds). [2025-10-28T18:51:40.247347] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-03. [2025-10-28T18:51:40.841335] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-07 (12.54 seconds). [2025-10-28T18:51:40.844726] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-08. [2025-10-28T18:51:40.987429] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-10-28T18:51:40.992587] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-04. [2025-10-28T18:51:52.041734] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-03 (13.84 seconds). [2025-10-28T18:51:52.052319] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-04. [2025-10-28T18:51:53.336752] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-28T18:51:53.350605] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-05 (16.90 seconds). [2025-10-28T18:51:53.361005] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-05. [2025-10-28T18:51:53.362988] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-06. [2025-10-28T18:51:54.633093] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-28T18:51:54.644279] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-06. [2025-10-28T18:51:54.787474] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-28T18:51:54.797892] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-07. [2025-10-28T18:51:55.846049] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-28T18:51:55.855848] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-07. [2025-10-28T18:51:55.906941] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-10-28T18:51:55.916751] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-08. [2025-10-28T18:51:57.028458] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-28T18:51:57.039289] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-09. [2025-10-28T18:51:57.198169] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-08 (16.35 seconds). [2025-10-28T18:51:57.201736] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-09. [2025-10-28T18:51:57.897071] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-28T18:51:57.901319] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-10. [2025-10-28T18:51:57.983316] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-04 (16.99 seconds). [2025-10-28T18:51:57.989688] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-05. [2025-10-28T18:51:58.298108] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-28T18:51:58.307939] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-10. [2025-10-28T18:51:58.496114] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-28T18:51:58.499141] [INFO ] [REMOTE ] FOA: Full fetch complete (20542 records). [2025-10-28T18:51:58.499211] [DEBUG] [VALIDATOR ] FOA: Validating primary data. [2025-10-28T18:51:58.794530] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-10-28T18:51:58.815231] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-06. [2025-10-28T18:51:58.880918] [DEBUG] [VALIDATOR ] FOA: All expected trading days are present. [2025-10-28T18:51:58.880982] [DEBUG] [VALIDATOR ] FOA: Primary data validation passed. [2025-10-28T18:51:58.881396] [INFO ] [MAIN ] FOA: Fetched primary data is valid. [2025-10-28T18:51:58.881435] [DEBUG] [LOCAL ] FOA: Saving primary data. [2025-10-28T18:51:58.881981] [DEBUG] [LOCAL ] FOA: Trimmed 20542 records to 12715 (keeping 200 days of data) [2025-10-28T18:51:58.952026] [DEBUG] [LOCAL ] FOA: Primary data saved (12715 records). [2025-10-28T18:51:58.952144] [INFO ] [MAIN ] FOA: Full history saved. [2025-10-28T18:51:58.952219] [INFO ] [MAIN ] Update Progress: 861/2366 symbols completed. FOA took 1m 4s. Estimated remaining: 3h 15m 39s. Rate: 7.7 symbols/min [2025-10-28T18:51:59.119692] [INFO ] [MAIN ] FPF: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:51:59.138367] [DEBUG] [LOCAL ] FPF: Loaded 18490 existing records from primary storage. [2025-10-28T18:51:59.138581] [INFO ] [MAIN ] FPF: Loaded 18490 existing records. [2025-10-28T18:51:59.317760] [WARN ] [MAIN ] FPF: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:51:59.317933] [INFO ] [MAIN ] FPF: Wiping existing primary data before full refresh. [2025-10-28T18:51:59.317995] [INFO ] [LOCAL ] FPF: Starting deletion of primary data. [2025-10-28T18:51:59.318242] [DEBUG] [LOCAL ] FPF: Deleted primary data file. [2025-10-28T18:51:59.318301] [INFO ] [MAIN ] FPF: Starting full primary refresh. [2025-10-28T18:51:59.679705] [INFO ] [REMOTE ] FPF: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:51:59.685295] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-01. [2025-10-28T18:51:59.694893] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-28T18:51:59.700419] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-07. [2025-10-28T18:51:59.730247] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-28T18:51:59.739746] [INFO ] [REMOTE ] FNV: Full fetch complete (66968 records). [2025-10-28T18:51:59.739900] [DEBUG] [VALIDATOR ] FNV: Validating primary data. [2025-10-28T18:52:00.115910] [DEBUG] [VALIDATOR ] FNV: All expected trading days are present. [2025-10-28T18:52:00.115981] [DEBUG] [VALIDATOR ] FNV: Primary data validation passed. [2025-10-28T18:52:00.116827] [INFO ] [MAIN ] FNV: Fetched primary data is valid. [2025-10-28T18:52:00.116889] [DEBUG] [LOCAL ] FNV: Saving primary data. [2025-10-28T18:52:00.118126] [DEBUG] [LOCAL ] FNV: Trimmed 66968 records to 45877 (keeping 200 days of data) [2025-10-28T18:52:00.412430] [DEBUG] [LOCAL ] FNV: Primary data saved (45877 records). [2025-10-28T18:52:00.412662] [INFO ] [MAIN ] FNV: Full history saved. [2025-10-28T18:52:00.413749] [INFO ] [MAIN ] Update Progress: 862/2366 symbols completed. FNV took 1m 6s. Estimated remaining: 3h 15m 20s. Rate: 7.7 symbols/min [2025-10-28T18:52:00.424575] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-28T18:52:00.454483] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-28T18:52:00.473715] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-02. [2025-10-28T18:52:00.517571] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-08. [2025-10-28T18:52:00.611881] [INFO ] [MAIN ] FPH: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:52:00.631507] [DEBUG] [LOCAL ] FPH: Loaded 19064 existing records from primary storage. [2025-10-28T18:52:00.631768] [INFO ] [MAIN ] FPH: Loaded 19064 existing records. [2025-10-28T18:52:00.806959] [WARN ] [MAIN ] FPH: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:52:00.807118] [INFO ] [MAIN ] FPH: Wiping existing primary data before full refresh. [2025-10-28T18:52:00.807165] [INFO ] [LOCAL ] FPH: Starting deletion of primary data. [2025-10-28T18:52:00.807370] [DEBUG] [LOCAL ] FPH: Deleted primary data file. [2025-10-28T18:52:00.807426] [INFO ] [MAIN ] FPH: Starting full primary refresh. [2025-10-28T18:52:01.154723] [INFO ] [REMOTE ] FPH: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:52:01.155057] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-01. [2025-10-28T18:52:01.215687] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-28T18:52:01.219505] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-03. [2025-10-28T18:52:01.343580] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-28T18:52:01.347969] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-09. [2025-10-28T18:52:01.849758] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-28T18:52:01.853932] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-04. [2025-10-28T18:52:01.932383] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-28T18:52:01.938472] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-02. [2025-10-28T18:52:02.696073] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-28T18:52:02.702296] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-05. [2025-10-28T18:52:02.822424] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-28T18:52:02.828915] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-03. [2025-10-28T18:52:03.396917] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-28T18:52:03.401469] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-06. [2025-10-28T18:52:03.702204] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-28T18:52:03.708276] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-04. [2025-10-28T18:52:04.138297] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-28T18:52:04.143210] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-07. [2025-10-28T18:52:04.653836] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-10-28T18:52:04.658901] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-05. [2025-10-28T18:52:04.797266] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-10-28T18:52:04.801840] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-08. [2025-10-28T18:52:05.331137] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-28T18:52:05.335292] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-06. [2025-10-28T18:52:05.475329] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-28T18:52:05.479707] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-09. [2025-10-28T18:52:06.016577] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-28T18:52:06.020561] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-07. [2025-10-28T18:52:06.143440] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-28T18:52:06.148084] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-10. [2025-10-28T18:52:06.706676] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-28T18:52:06.712112] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-08. [2025-10-28T18:52:07.156312] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-28T18:52:07.161113] [INFO ] [REMOTE ] FPF: Full fetch complete (26578 records). [2025-10-28T18:52:07.161185] [DEBUG] [VALIDATOR ] FPF: Validating primary data. [2025-10-28T18:52:07.523026] [DEBUG] [VALIDATOR ] FPF: All expected trading days are present. [2025-10-28T18:52:07.523103] [DEBUG] [VALIDATOR ] FPF: Primary data validation passed. [2025-10-28T18:52:07.523774] [INFO ] [MAIN ] FPF: Fetched primary data is valid. [2025-10-28T18:52:07.523835] [DEBUG] [LOCAL ] FPF: Saving primary data. [2025-10-28T18:52:07.524499] [DEBUG] [LOCAL ] FPF: Trimmed 26578 records to 18437 (keeping 200 days of data) [2025-10-28T18:52:07.631407] [DEBUG] [LOCAL ] FPF: Primary data saved (18437 records). [2025-10-28T18:52:07.631542] [INFO ] [MAIN ] FPF: Full history saved. [2025-10-28T18:52:07.631620] [INFO ] [MAIN ] Update Progress: 863/2366 symbols completed. FPF took 8.7s. Estimated remaining: 3h 15m 12s. Rate: 7.7 symbols/min [2025-10-28T18:52:07.797780] [INFO ] [MAIN ] FPI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:52:07.829393] [DEBUG] [LOCAL ] FPI: Loaded 31057 existing records from primary storage. [2025-10-28T18:52:07.829703] [INFO ] [MAIN ] FPI: Loaded 31057 existing records. [2025-10-28T18:52:08.007317] [WARN ] [MAIN ] FPI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:52:08.007551] [INFO ] [MAIN ] FPI: Wiping existing primary data before full refresh. [2025-10-28T18:52:08.007598] [INFO ] [LOCAL ] FPI: Starting deletion of primary data. [2025-10-28T18:52:08.007835] [DEBUG] [LOCAL ] FPI: Deleted primary data file. [2025-10-28T18:52:08.007893] [INFO ] [MAIN ] FPI: Starting full primary refresh. [2025-10-28T18:52:08.360954] [INFO ] [REMOTE ] FPI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:52:08.361274] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-01. [2025-10-28T18:52:09.177123] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-28T18:52:09.184238] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-02. [2025-10-28T18:52:09.924856] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-28T18:52:09.930587] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-03. [2025-10-28T18:52:09.997733] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-07 (14.14 seconds). [2025-10-28T18:52:10.007983] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-08. [2025-10-28T18:52:10.996750] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-28T18:52:11.003276] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-04. [2025-10-28T18:52:11.926170] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-28T18:52:11.933243] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-05. [2025-10-28T18:52:12.893971] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-28T18:52:12.901246] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-06. [2025-10-28T18:52:13.563732] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-09 (12.22 seconds). [2025-10-28T18:52:13.568356] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-10. [2025-10-28T18:52:13.862832] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-28T18:52:13.869604] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-07. [2025-10-28T18:52:14.292301] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-28T18:52:14.295734] [INFO ] [REMOTE ] FOR: Full fetch complete (29424 records). [2025-10-28T18:52:14.295807] [DEBUG] [VALIDATOR ] FOR: Validating primary data. [2025-10-28T18:52:14.681706] [DEBUG] [VALIDATOR ] FOR: All expected trading days are present. [2025-10-28T18:52:14.681787] [DEBUG] [VALIDATOR ] FOR: Primary data validation passed. [2025-10-28T18:52:14.682358] [INFO ] [MAIN ] FOR: Fetched primary data is valid. [2025-10-28T18:52:14.682417] [DEBUG] [LOCAL ] FOR: Saving primary data. [2025-10-28T18:52:14.683160] [DEBUG] [LOCAL ] FOR: Trimmed 29424 records to 18946 (keeping 200 days of data) [2025-10-28T18:52:14.789009] [DEBUG] [LOCAL ] FOR: Primary data saved (18946 records). [2025-10-28T18:52:14.789133] [INFO ] [MAIN ] FOR: Full history saved. [2025-10-28T18:52:14.789211] [INFO ] [MAIN ] Update Progress: 864/2366 symbols completed. FOR took 55.3s. Estimated remaining: 3h 15m 3s. Rate: 7.7 symbols/min [2025-10-28T18:52:14.905820] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-08 (8.19 seconds). [2025-10-28T18:52:14.932137] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-09. [2025-10-28T18:52:14.987222] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-28T18:52:15.007150] [INFO ] [MAIN ] FR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:52:15.014899] [DEBUG] [LOCAL ] FR: No existing data file found in primary storage. [2025-10-28T18:52:15.014982] [WARN ] [MAIN ] FR: No existing data found, performing full refresh instead. [2025-10-28T18:52:15.015631] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-08. [2025-10-28T18:52:15.015326] [INFO ] [MAIN ] FR: Wiping existing primary data before full refresh. [2025-10-28T18:52:15.015846] [INFO ] [LOCAL ] FR: Starting deletion of primary data. [2025-10-28T18:52:15.016723] [DEBUG] [LOCAL ] FR: No primary data file found to delete. [2025-10-28T18:52:15.016770] [INFO ] [MAIN ] FR: Starting full primary refresh. [2025-10-28T18:52:15.399016] [INFO ] [REMOTE ] FR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:52:15.399330] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-01. [2025-10-28T18:52:15.707441] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-28T18:52:15.712123] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-10. [2025-10-28T18:52:16.011601] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-28T18:52:16.018082] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-09. [2025-10-28T18:52:16.424564] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-28T18:52:16.433407] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-02. [2025-10-28T18:52:16.516921] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-28T18:52:16.520942] [INFO ] [REMOTE ] FPH: Full fetch complete (30816 records). [2025-10-28T18:52:16.521023] [DEBUG] [VALIDATOR ] FPH: Validating primary data. [2025-10-28T18:52:16.884182] [DEBUG] [VALIDATOR ] FPH: All expected trading days are present. [2025-10-28T18:52:16.884258] [DEBUG] [VALIDATOR ] FPH: Primary data validation passed. [2025-10-28T18:52:16.884841] [INFO ] [MAIN ] FPH: Fetched primary data is valid. [2025-10-28T18:52:16.884900] [DEBUG] [LOCAL ] FPH: Saving primary data. [2025-10-28T18:52:16.885585] [DEBUG] [LOCAL ] FPH: Trimmed 30816 records to 19084 (keeping 200 days of data) [2025-10-28T18:52:16.989979] [DEBUG] [LOCAL ] FPH: Primary data saved (19084 records). [2025-10-28T18:52:16.990111] [INFO ] [MAIN ] FPH: Full history saved. [2025-10-28T18:52:16.990192] [INFO ] [MAIN ] Update Progress: 865/2366 symbols completed. FPH took 16.6s. Estimated remaining: 3h 14m 45s. Rate: 7.7 symbols/min [2025-10-28T18:52:17.158029] [INFO ] [MAIN ] FRA: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:52:17.173214] [DEBUG] [LOCAL ] FRA: Loaded 13514 existing records from primary storage. [2025-10-28T18:52:17.173481] [INFO ] [MAIN ] FRA: Loaded 13514 existing records. [2025-10-28T18:52:17.345435] [WARN ] [MAIN ] FRA: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:52:17.345662] [INFO ] [MAIN ] FRA: Wiping existing primary data before full refresh. [2025-10-28T18:52:17.345738] [INFO ] [LOCAL ] FRA: Starting deletion of primary data. [2025-10-28T18:52:17.346016] [DEBUG] [LOCAL ] FRA: Deleted primary data file. [2025-10-28T18:52:17.346084] [INFO ] [MAIN ] FRA: Starting full primary refresh. [2025-10-28T18:52:17.731508] [INFO ] [REMOTE ] FRA: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:52:17.732095] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-01. [2025-10-28T18:52:17.755557] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-28T18:52:17.764713] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-03. [2025-10-28T18:52:18.613960] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-28T18:52:18.619857] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-02. [2025-10-28T18:52:18.958533] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-28T18:52:18.968433] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-04. [2025-10-28T18:52:19.144308] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-08 (9.14 seconds). [2025-10-28T18:52:19.155574] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-09. [2025-10-28T18:52:19.773826] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-09 (3.76 seconds). [2025-10-28T18:52:19.780565] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-10. [2025-10-28T18:52:20.271423] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-28T18:52:20.281815] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-05. [2025-10-28T18:52:20.543371] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-28T18:52:20.554246] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-10. [2025-10-28T18:52:20.705854] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-10-28T18:52:20.712412] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-03. [2025-10-28T18:52:20.955556] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-28T18:52:20.961744] [INFO ] [REMOTE ] FPI: Full fetch complete (43618 records). [2025-10-28T18:52:20.961838] [DEBUG] [VALIDATOR ] FPI: Validating primary data. [2025-10-28T18:52:21.332520] [DEBUG] [VALIDATOR ] FPI: All expected trading days are present. [2025-10-28T18:52:21.332677] [DEBUG] [VALIDATOR ] FPI: Primary data validation passed. [2025-10-28T18:52:21.333347] [INFO ] [MAIN ] FPI: Fetched primary data is valid. [2025-10-28T18:52:21.333388] [DEBUG] [LOCAL ] FPI: Saving primary data. [2025-10-28T18:52:21.334324] [DEBUG] [LOCAL ] FPI: Trimmed 43618 records to 30983 (keeping 200 days of data) [2025-10-28T18:52:21.433821] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-28T18:52:21.450191] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-04. [2025-10-28T18:52:21.539902] [DEBUG] [LOCAL ] FPI: Primary data saved (30983 records). [2025-10-28T18:52:21.540038] [INFO ] [MAIN ] FPI: Full history saved. [2025-10-28T18:52:21.540136] [INFO ] [MAIN ] Update Progress: 866/2366 symbols completed. FPI took 13.9s. Estimated remaining: 3h 14m 32s. Rate: 7.7 symbols/min [2025-10-28T18:52:21.707059] [INFO ] [MAIN ] FRGE: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:52:21.723341] [DEBUG] [LOCAL ] FRGE: Loaded 15237 existing records from primary storage. [2025-10-28T18:52:21.723774] [INFO ] [MAIN ] FRGE: Loaded 15237 existing records. [2025-10-28T18:52:21.898309] [WARN ] [MAIN ] FRGE: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:52:21.898614] [INFO ] [MAIN ] FRGE: Wiping existing primary data before full refresh. [2025-10-28T18:52:21.898696] [INFO ] [LOCAL ] FRGE: Starting deletion of primary data. [2025-10-28T18:52:21.898879] [DEBUG] [LOCAL ] FRGE: Deleted primary data file. [2025-10-28T18:52:21.898918] [INFO ] [MAIN ] FRGE: Starting full primary refresh. [2025-10-28T18:52:22.249270] [INFO ] [REMOTE ] FRGE: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:52:22.249584] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-01. [2025-10-28T18:52:22.260887] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-28T18:52:22.265211] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-05. [2025-10-28T18:52:22.812424] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-28T18:52:22.815904] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-06. [2025-10-28T18:52:23.259746] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-28T18:52:23.266989] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-02. [2025-10-28T18:52:23.438816] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-05 (3.16 seconds). [2025-10-28T18:52:23.449091] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-06. [2025-10-28T18:52:23.546674] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-28T18:52:23.550623] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-07. [2025-10-28T18:52:24.201415] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-28T18:52:24.208297] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-03. [2025-10-28T18:52:24.512348] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-28T18:52:24.522455] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-07. [2025-10-28T18:52:24.789721] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-28T18:52:24.793415] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-08. [2025-10-28T18:52:25.162029] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-28T18:52:25.168537] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-04. [2025-10-28T18:52:25.317234] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-28T18:52:25.320374] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-09. [2025-10-28T18:52:25.843396] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-10 (5.29 seconds). [2025-10-28T18:52:25.854359] [INFO ] [REMOTE ] FOUR: Full fetch complete (72269 records). [2025-10-28T18:52:25.854514] [DEBUG] [VALIDATOR ] FOUR: Validating primary data. [2025-10-28T18:52:26.013379] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-28T18:52:26.033518] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-10. [2025-10-28T18:52:26.246990] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-28T18:52:26.293740] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-05. [2025-10-28T18:52:26.311697] [DEBUG] [VALIDATOR ] FOUR: All expected trading days are present. [2025-10-28T18:52:26.311757] [DEBUG] [VALIDATOR ] FOUR: Primary data validation passed. [2025-10-28T18:52:26.312611] [INFO ] [MAIN ] FOUR: Fetched primary data is valid. [2025-10-28T18:52:26.313114] [DEBUG] [LOCAL ] FOUR: Saving primary data. [2025-10-28T18:52:26.314552] [DEBUG] [LOCAL ] FOUR: Trimmed 72269 records to 49590 (keeping 200 days of data) [2025-10-28T18:52:26.601233] [DEBUG] [LOCAL ] FOUR: Primary data saved (49590 records). [2025-10-28T18:52:26.601357] [INFO ] [MAIN ] FOUR: Full history saved. [2025-10-28T18:52:26.601433] [INFO ] [MAIN ] Update Progress: 867/2366 symbols completed. FOUR took 1m 6s. Estimated remaining: 3h 14m 19s. Rate: 7.7 symbols/min [2025-10-28T18:52:26.769354] [INFO ] [MAIN ] FRO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:52:26.815856] [DEBUG] [LOCAL ] FRO: Loaded 51628 existing records from primary storage. [2025-10-28T18:52:26.816146] [INFO ] [MAIN ] FRO: Loaded 51628 existing records. [2025-10-28T18:52:26.997887] [WARN ] [MAIN ] FRO: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:52:26.998616] [INFO ] [MAIN ] FRO: Wiping existing primary data before full refresh. [2025-10-28T18:52:27.006507] [INFO ] [LOCAL ] FRO: Starting deletion of primary data. [2025-10-28T18:52:27.007711] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-28T18:52:27.007387] [DEBUG] [LOCAL ] FRO: Deleted primary data file. [2025-10-28T18:52:27.011146] [INFO ] [MAIN ] FRO: Starting full primary refresh. [2025-10-28T18:52:27.011286] [INFO ] [REMOTE ] FRA: Full fetch complete (23022 records). [2025-10-28T18:52:27.022591] [DEBUG] [VALIDATOR ] FRA: Validating primary data. [2025-10-28T18:52:27.312472] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-07 (2.79 seconds). [2025-10-28T18:52:27.499734] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-08. [2025-10-28T18:52:27.587121] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-28T18:52:27.684531] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-06. [2025-10-28T18:52:27.727295] [INFO ] [REMOTE ] FRO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:52:27.748341] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-01. [2025-10-28T18:52:27.805771] [DEBUG] [VALIDATOR ] FRA: All expected trading days are present. [2025-10-28T18:52:27.805851] [DEBUG] [VALIDATOR ] FRA: Primary data validation passed. [2025-10-28T18:52:27.806347] [INFO ] [MAIN ] FRA: Fetched primary data is valid. [2025-10-28T18:52:27.806384] [DEBUG] [LOCAL ] FRA: Saving primary data. [2025-10-28T18:52:27.807053] [DEBUG] [LOCAL ] FRA: Trimmed 23022 records to 13295 (keeping 200 days of data) [2025-10-28T18:52:27.884918] [DEBUG] [LOCAL ] FRA: Primary data saved (13295 records). [2025-10-28T18:52:27.885036] [INFO ] [MAIN ] FRA: Full history saved. [2025-10-28T18:52:27.885110] [INFO ] [MAIN ] Update Progress: 868/2366 symbols completed. FRA took 10.9s. Estimated remaining: 3h 14m 0s. Rate: 7.7 symbols/min [2025-10-28T18:52:28.047279] [INFO ] [MAIN ] FRT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:52:28.085114] [DEBUG] [LOCAL ] FRT: Loaded 41110 existing records from primary storage. [2025-10-28T18:52:28.085385] [INFO ] [MAIN ] FRT: Loaded 41110 existing records. [2025-10-28T18:52:28.257112] [WARN ] [MAIN ] FRT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:52:28.257354] [INFO ] [MAIN ] FRT: Wiping existing primary data before full refresh. [2025-10-28T18:52:28.257400] [INFO ] [LOCAL ] FRT: Starting deletion of primary data. [2025-10-28T18:52:28.257834] [DEBUG] [LOCAL ] FRT: Deleted primary data file. [2025-10-28T18:52:28.257890] [INFO ] [MAIN ] FRT: Starting full primary refresh. [2025-10-28T18:52:28.419959] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-28T18:52:28.485307] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-07. [2025-10-28T18:52:28.620433] [INFO ] [REMOTE ] FRT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:52:28.620710] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-01. [2025-10-28T18:52:28.748799] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-28T18:52:28.757804] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-09. [2025-10-28T18:52:29.204467] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-10-28T18:52:29.208442] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-08. [2025-10-28T18:52:29.285361] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-28T18:52:29.295339] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-02. [2025-10-28T18:52:29.870201] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-28T18:52:29.874379] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-09. [2025-10-28T18:52:30.018745] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-28T18:52:30.029716] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-10. [2025-10-28T18:52:30.375816] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-10-28T18:52:30.384849] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-02. [2025-10-28T18:52:30.393960] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-28T18:52:30.397280] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-10. [2025-10-28T18:52:30.781713] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-28T18:52:30.791846] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-03. [2025-10-28T18:52:31.304828] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-10 (0.91 seconds). [2025-10-28T18:52:31.307939] [INFO ] [REMOTE ] FRGE: Full fetch complete (29641 records). [2025-10-28T18:52:31.308041] [DEBUG] [VALIDATOR ] FRGE: Validating primary data. [2025-10-28T18:52:31.706940] [DEBUG] [VALIDATOR ] FRGE: All expected trading days are present. [2025-10-28T18:52:31.707115] [DEBUG] [VALIDATOR ] FRGE: Primary data validation passed. [2025-10-28T18:52:31.707825] [INFO ] [MAIN ] FRGE: Fetched primary data is valid. [2025-10-28T18:52:31.708037] [DEBUG] [LOCAL ] FRGE: Saving primary data. [2025-10-28T18:52:31.718093] [DEBUG] [LOCAL ] FRGE: Trimmed 29641 records to 15273 (keeping 200 days of data) [2025-10-28T18:52:31.735474] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-28T18:52:31.810145] [INFO ] [REMOTE ] FR: Full fetch complete (67453 records). [2025-10-28T18:52:31.810885] [DEBUG] [VALIDATOR ] FR: Validating primary data. [2025-10-28T18:52:31.921102] [DEBUG] [LOCAL ] FRGE: Primary data saved (15273 records). [2025-10-28T18:52:31.932269] [INFO ] [MAIN ] FRGE: Full history saved. [2025-10-28T18:52:31.940549] [INFO ] [MAIN ] Update Progress: 869/2366 symbols completed. FRGE took 10.4s. Estimated remaining: 3h 13m 46s. Rate: 7.7 symbols/min [2025-10-28T18:52:32.177757] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-10-28T18:52:32.283575] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-03. [2025-10-28T18:52:32.342215] [INFO ] [MAIN ] FSCO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:52:32.448914] [DEBUG] [VALIDATOR ] FR: All expected trading days are present. [2025-10-28T18:52:32.448993] [DEBUG] [VALIDATOR ] FR: Primary data validation passed. [2025-10-28T18:52:32.449794] [INFO ] [MAIN ] FR: Fetched primary data is valid. [2025-10-28T18:52:32.449873] [DEBUG] [LOCAL ] FR: Saving primary data. [2025-10-28T18:52:32.460053] [DEBUG] [LOCAL ] FR: Trimmed 67453 records to 46483 (keeping 200 days of data) [2025-10-28T18:52:32.560959] [DEBUG] [LOCAL ] FSCO: Loaded 38336 existing records from primary storage. [2025-10-28T18:52:32.563113] [INFO ] [MAIN ] FSCO: Loaded 38336 existing records. [2025-10-28T18:52:32.779699] [WARN ] [MAIN ] FSCO: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:52:32.832341] [INFO ] [MAIN ] FSCO: Wiping existing primary data before full refresh. [2025-10-28T18:52:32.832601] [INFO ] [LOCAL ] FSCO: Starting deletion of primary data. [2025-10-28T18:52:32.870338] [DEBUG] [LOCAL ] FSCO: Deleted primary data file. [2025-10-28T18:52:32.870449] [INFO ] [MAIN ] FSCO: Starting full primary refresh. [2025-10-28T18:52:33.243504] [DEBUG] [LOCAL ] FR: Primary data saved (46483 records). [2025-10-28T18:52:33.259501] [INFO ] [MAIN ] FR: Full history saved. [2025-10-28T18:52:33.259681] [INFO ] [MAIN ] Update Progress: 870/2366 symbols completed. FR took 18.5s. Estimated remaining: 3h 13m 27s. Rate: 7.7 symbols/min [2025-10-28T18:52:33.376818] [INFO ] [REMOTE ] FSCO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:52:33.377168] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-01. [2025-10-28T18:52:33.507128] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-03 (2.72 seconds). [2025-10-28T18:52:33.542189] [INFO ] [MAIN ] FSK: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:52:33.543527] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-04. [2025-10-28T18:52:33.571423] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-28T18:52:33.581757] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-04. [2025-10-28T18:52:33.618841] [DEBUG] [LOCAL ] FSK: Loaded 49397 existing records from primary storage. [2025-10-28T18:52:33.619153] [INFO ] [MAIN ] FSK: Loaded 49397 existing records. [2025-10-28T18:52:33.790999] [WARN ] [MAIN ] FSK: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:52:33.791142] [INFO ] [MAIN ] FSK: Wiping existing primary data before full refresh. [2025-10-28T18:52:33.791186] [INFO ] [LOCAL ] FSK: Starting deletion of primary data. [2025-10-28T18:52:33.791981] [DEBUG] [LOCAL ] FSK: Deleted primary data file. [2025-10-28T18:52:33.792038] [INFO ] [MAIN ] FSK: Starting full primary refresh. [2025-10-28T18:52:34.134149] [INFO ] [REMOTE ] FSK: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:52:34.134432] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-01. [2025-10-28T18:52:34.520595] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-28T18:52:34.529059] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-02. [2025-10-28T18:52:34.747984] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-28T18:52:34.757790] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-05. [2025-10-28T18:52:34.902541] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-28T18:52:34.919078] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-05. [2025-10-28T18:52:35.198769] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-28T18:52:35.214376] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-02. [2025-10-28T18:52:35.430753] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-10-28T18:52:35.443056] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-03. [2025-10-28T18:52:35.730222] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-28T18:52:35.740782] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-06. [2025-10-28T18:52:36.148964] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-28T18:52:36.160112] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-06. [2025-10-28T18:52:36.578575] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-28T18:52:36.588083] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-03. [2025-10-28T18:52:36.858225] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-28T18:52:36.866433] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-07. [2025-10-28T18:52:37.511531] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-10-28T18:52:37.518984] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-04. [2025-10-28T18:52:37.704670] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-10-28T18:52:37.717434] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-07. [2025-10-28T18:52:37.779866] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-28T18:52:37.790479] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-04. [2025-10-28T18:52:38.057617] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-28T18:52:38.067332] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-08. [2025-10-28T18:52:38.527755] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-28T18:52:38.536583] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-05. [2025-10-28T18:52:39.064290] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-28T18:52:39.075446] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-05. [2025-10-28T18:52:39.238265] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-28T18:52:39.249569] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-08. [2025-10-28T18:52:39.394086] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-28T18:52:39.403238] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-06. [2025-10-28T18:52:40.202298] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-28T18:52:40.212458] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-06. [2025-10-28T18:52:40.332747] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-28T18:52:40.340756] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-07. [2025-10-28T18:52:40.498583] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-08 (2.43 seconds). [2025-10-28T18:52:40.510737] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-09. [2025-10-28T18:52:40.772150] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-28T18:52:40.783995] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-09. [2025-10-28T18:52:41.279460] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-28T18:52:41.290133] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-07. [2025-10-28T18:52:41.701889] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-28T18:52:41.710712] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-10. [2025-10-28T18:52:42.017110] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-28T18:52:42.025709] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-08. [2025-10-28T18:52:42.115181] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-28T18:52:42.125978] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-10. [2025-10-28T18:52:42.948114] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-28T18:52:42.956261] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-09. [2025-10-28T18:52:43.241264] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-10-28T18:52:43.252559] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-08. [2025-10-28T18:52:43.781017] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-28T18:52:43.791507] [INFO ] [REMOTE ] FRO: Full fetch complete (75318 records). [2025-10-28T18:52:43.791674] [DEBUG] [VALIDATOR ] FRO: Validating primary data. [2025-10-28T18:52:43.914736] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-10 (2.20 seconds). [2025-10-28T18:52:43.949586] [INFO ] [REMOTE ] FRT: Full fetch complete (60377 records). [2025-10-28T18:52:43.972247] [DEBUG] [VALIDATOR ] FRT: Validating primary data. [2025-10-28T18:52:44.403204] [DEBUG] [VALIDATOR ] FRO: All expected trading days are present. [2025-10-28T18:52:44.423759] [DEBUG] [VALIDATOR ] FRO: Primary data validation passed. [2025-10-28T18:52:44.424857] [INFO ] [MAIN ] FRO: Fetched primary data is valid. [2025-10-28T18:52:44.433164] [DEBUG] [LOCAL ] FRO: Saving primary data. [2025-10-28T18:52:44.516738] [DEBUG] [LOCAL ] FRO: Trimmed 75318 records to 51591 (keeping 200 days of data) [2025-10-28T18:52:44.723785] [DEBUG] [VALIDATOR ] FRT: All expected trading days are present. [2025-10-28T18:52:44.741620] [DEBUG] [VALIDATOR ] FRT: Primary data validation passed. [2025-10-28T18:52:44.755088] [INFO ] [MAIN ] FRT: Fetched primary data is valid. [2025-10-28T18:52:44.755377] [DEBUG] [LOCAL ] FRT: Saving primary data. [2025-10-28T18:52:44.767512] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-10-28T18:52:44.775936] [DEBUG] [LOCAL ] FRT: Trimmed 60377 records to 41037 (keeping 200 days of data) [2025-10-28T18:52:44.795956] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-10. [2025-10-28T18:52:45.198903] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-10-28T18:52:45.297740] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-09. [2025-10-28T18:52:45.306618] [DEBUG] [LOCAL ] FRO: Primary data saved (51591 records). [2025-10-28T18:52:45.312722] [INFO ] [MAIN ] FRO: Full history saved. [2025-10-28T18:52:45.314784] [INFO ] [MAIN ] Update Progress: 871/2366 symbols completed. FRO took 18.7s. Estimated remaining: 3h 13m 27s. Rate: 7.7 symbols/min [2025-10-28T18:52:45.408344] [DEBUG] [LOCAL ] FRT: Primary data saved (41037 records). [2025-10-28T18:52:45.424230] [INFO ] [MAIN ] FRT: Full history saved. [2025-10-28T18:52:45.433038] [INFO ] [MAIN ] Update Progress: 872/2366 symbols completed. FRT took 17.5s. Estimated remaining: 3h 13m 6s. Rate: 7.7 symbols/min [2025-10-28T18:52:45.632513] [INFO ] [MAIN ] FSLY: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:52:45.704627] [INFO ] [MAIN ] FSM: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:52:45.749476] [DEBUG] [LOCAL ] FSLY: Loaded 51237 existing records from primary storage. [2025-10-28T18:52:45.749872] [INFO ] [MAIN ] FSLY: Loaded 51237 existing records. [2025-10-28T18:52:45.938166] [DEBUG] [LOCAL ] FSM: Loaded 53298 existing records from primary storage. [2025-10-28T18:52:45.960032] [WARN ] [MAIN ] FSLY: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:52:45.957038] [INFO ] [MAIN ] FSM: Loaded 53298 existing records. [2025-10-28T18:52:45.991157] [INFO ] [MAIN ] FSLY: Wiping existing primary data before full refresh. [2025-10-28T18:52:45.996539] [INFO ] [LOCAL ] FSLY: Starting deletion of primary data. [2025-10-28T18:52:46.029498] [DEBUG] [LOCAL ] FSLY: Deleted primary data file. [2025-10-28T18:52:46.035712] [INFO ] [MAIN ] FSLY: Starting full primary refresh. [2025-10-28T18:52:46.271163] [WARN ] [MAIN ] FSM: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:52:46.290035] [INFO ] [MAIN ] FSM: Wiping existing primary data before full refresh. [2025-10-28T18:52:46.300317] [INFO ] [LOCAL ] FSM: Starting deletion of primary data. [2025-10-28T18:52:46.309228] [DEBUG] [LOCAL ] FSM: Deleted primary data file. [2025-10-28T18:52:46.313921] [INFO ] [MAIN ] FSM: Starting full primary refresh. [2025-10-28T18:52:46.597568] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-28T18:52:46.638488] [INFO ] [REMOTE ] FSCO: Full fetch complete (55335 records). [2025-10-28T18:52:46.703611] [DEBUG] [VALIDATOR ] FSCO: Validating primary data. [2025-10-28T18:52:46.768085] [INFO ] [REMOTE ] FSLY: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:52:46.809607] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-01. [2025-10-28T18:52:47.216670] [INFO ] [REMOTE ] FSM: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:52:47.224589] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-01. [2025-10-28T18:52:47.380177] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-10-28T18:52:47.419852] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-10. [2025-10-28T18:52:47.434565] [DEBUG] [VALIDATOR ] FSCO: All expected trading days are present. [2025-10-28T18:52:47.435616] [DEBUG] [VALIDATOR ] FSCO: Primary data validation passed. [2025-10-28T18:52:47.436440] [INFO ] [MAIN ] FSCO: Fetched primary data is valid. [2025-10-28T18:52:47.436629] [DEBUG] [LOCAL ] FSCO: Saving primary data. [2025-10-28T18:52:47.438039] [DEBUG] [LOCAL ] FSCO: Trimmed 55335 records to 38332 (keeping 200 days of data) [2025-10-28T18:52:47.660035] [DEBUG] [LOCAL ] FSCO: Primary data saved (38332 records). [2025-10-28T18:52:47.660199] [INFO ] [MAIN ] FSCO: Full history saved. [2025-10-28T18:52:47.660285] [INFO ] [MAIN ] Update Progress: 873/2366 symbols completed. FSCO took 15.7s. Estimated remaining: 3h 12m 49s. Rate: 7.7 symbols/min [2025-10-28T18:52:47.843920] [INFO ] [MAIN ] FSS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:52:47.875295] [DEBUG] [LOCAL ] FSS: Loaded 32611 existing records from primary storage. [2025-10-28T18:52:47.875583] [INFO ] [MAIN ] FSS: Loaded 32611 existing records. [2025-10-28T18:52:48.061150] [WARN ] [MAIN ] FSS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:52:48.061503] [INFO ] [MAIN ] FSS: Wiping existing primary data before full refresh. [2025-10-28T18:52:48.061568] [INFO ] [LOCAL ] FSS: Starting deletion of primary data. [2025-10-28T18:52:48.062206] [DEBUG] [LOCAL ] FSS: Deleted primary data file. [2025-10-28T18:52:48.062266] [INFO ] [MAIN ] FSS: Starting full primary refresh. [2025-10-28T18:52:48.438477] [INFO ] [REMOTE ] FSS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:52:48.439017] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-01. [2025-10-28T18:52:48.469673] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-10-28T18:52:48.480527] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-02. [2025-10-28T18:52:48.510510] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-28T18:52:48.520618] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-02. [2025-10-28T18:52:48.814758] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-28T18:52:48.825246] [INFO ] [REMOTE ] FSK: Full fetch complete (72136 records). [2025-10-28T18:52:48.825356] [DEBUG] [VALIDATOR ] FSK: Validating primary data. [2025-10-28T18:52:49.211084] [DEBUG] [VALIDATOR ] FSK: All expected trading days are present. [2025-10-28T18:52:49.211155] [DEBUG] [VALIDATOR ] FSK: Primary data validation passed. [2025-10-28T18:52:49.212063] [INFO ] [MAIN ] FSK: Fetched primary data is valid. [2025-10-28T18:52:49.212124] [DEBUG] [LOCAL ] FSK: Saving primary data. [2025-10-28T18:52:49.213744] [DEBUG] [LOCAL ] FSK: Trimmed 72136 records to 49374 (keeping 200 days of data) [2025-10-28T18:52:49.364256] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-28T18:52:49.421443] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-02. [2025-10-28T18:52:49.547722] [DEBUG] [LOCAL ] FSK: Primary data saved (49374 records). [2025-10-28T18:52:49.547872] [INFO ] [MAIN ] FSK: Full history saved. [2025-10-28T18:52:49.548004] [INFO ] [MAIN ] Update Progress: 874/2366 symbols completed. FSK took 16.3s. Estimated remaining: 3h 12m 31s. Rate: 7.7 symbols/min [2025-10-28T18:52:49.722854] [INFO ] [MAIN ] FT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:52:49.755462] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-28T18:52:49.755733] [DEBUG] [LOCAL ] FT: Loaded 6749 existing records from primary storage. [2025-10-28T18:52:49.765362] [INFO ] [MAIN ] FT: Loaded 6749 existing records. [2025-10-28T18:52:49.819944] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-03. [2025-10-28T18:52:49.948050] [WARN ] [MAIN ] FT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:52:49.948364] [INFO ] [MAIN ] FT: Wiping existing primary data before full refresh. [2025-10-28T18:52:49.948420] [INFO ] [LOCAL ] FT: Starting deletion of primary data. [2025-10-28T18:52:49.948736] [DEBUG] [LOCAL ] FT: Deleted primary data file. [2025-10-28T18:52:49.948794] [INFO ] [MAIN ] FT: Starting full primary refresh. [2025-10-28T18:52:50.322682] [INFO ] [REMOTE ] FT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:52:50.323154] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-01. [2025-10-28T18:52:50.350222] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-28T18:52:50.356919] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-03. [2025-10-28T18:52:50.418143] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-28T18:52:50.428361] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-03. [2025-10-28T18:52:50.747124] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-10-28T18:52:50.748960] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-02. [2025-10-28T18:52:51.170243] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-28T18:52:51.171954] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-03. [2025-10-28T18:52:51.421672] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-28T18:52:51.429969] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-04. [2025-10-28T18:52:51.721222] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-28T18:52:51.732178] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-04. [2025-10-28T18:52:51.948828] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-28T18:52:51.950508] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-04. [2025-10-28T18:52:52.327908] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-03 (2.51 seconds). [2025-10-28T18:52:52.338788] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-04. [2025-10-28T18:52:52.624629] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-28T18:52:52.634016] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-05. [2025-10-28T18:52:52.924681] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-28T18:52:52.926861] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-05. [2025-10-28T18:52:52.981363] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-28T18:52:52.992162] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-05. [2025-10-28T18:52:53.384750] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-28T18:52:53.387037] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-06. [2025-10-28T18:52:53.640800] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-28T18:52:53.651981] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-05. [2025-10-28T18:52:54.213137] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-28T18:52:54.224165] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-06. [2025-10-28T18:52:54.799115] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-10-28T18:52:54.807263] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-06. [2025-10-28T18:52:54.895796] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-28T18:52:54.897480] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-07. [2025-10-28T18:52:54.942162] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-28T18:52:54.953577] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-06. [2025-10-28T18:52:55.456943] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-28T18:52:55.459006] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-08. [2025-10-28T18:52:55.575188] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-28T18:52:55.585564] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-07. [2025-10-28T18:52:55.738750] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-28T18:52:55.745816] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-07. [2025-10-28T18:52:55.961139] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-28T18:52:55.963556] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-09. [2025-10-28T18:52:56.232867] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-28T18:52:56.243897] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-07. [2025-10-28T18:52:56.712135] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-28T18:52:56.714415] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-10. [2025-10-28T18:52:56.859309] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-28T18:52:56.870960] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-08. [2025-10-28T18:52:57.306940] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-28T18:52:57.309346] [INFO ] [REMOTE ] FT: Full fetch complete (9383 records). [2025-10-28T18:52:57.309505] [DEBUG] [VALIDATOR ] FT: Validating primary data. [2025-10-28T18:52:57.698166] [DEBUG] [VALIDATOR ] FT: All expected trading days are present. [2025-10-28T18:52:57.698262] [DEBUG] [VALIDATOR ] FT: Primary data validation passed. [2025-10-28T18:52:57.698594] [INFO ] [MAIN ] FT: Fetched primary data is valid. [2025-10-28T18:52:57.698719] [DEBUG] [LOCAL ] FT: Saving primary data. [2025-10-28T18:52:57.699399] [DEBUG] [LOCAL ] FT: Trimmed 9383 records to 6758 (keeping 200 days of data) [2025-10-28T18:52:57.759485] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-28T18:52:57.779910] [DEBUG] [LOCAL ] FT: Primary data saved (6758 records). [2025-10-28T18:52:57.780109] [INFO ] [MAIN ] FT: Full history saved. [2025-10-28T18:52:57.780192] [INFO ] [MAIN ] Update Progress: 875/2366 symbols completed. FT took 8.2s. Estimated remaining: 3h 12m 24s. Rate: 7.7 symbols/min [2025-10-28T18:52:57.791898] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-08. [2025-10-28T18:52:57.954049] [INFO ] [MAIN ] FTHY: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:52:57.965818] [DEBUG] [LOCAL ] FTHY: Loaded 12001 existing records from primary storage. [2025-10-28T18:52:57.966140] [INFO ] [MAIN ] FTHY: Loaded 12001 existing records. [2025-10-28T18:52:58.142515] [WARN ] [MAIN ] FTHY: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:52:58.142832] [INFO ] [MAIN ] FTHY: Wiping existing primary data before full refresh. [2025-10-28T18:52:58.143034] [INFO ] [LOCAL ] FTHY: Starting deletion of primary data. [2025-10-28T18:52:58.143407] [DEBUG] [LOCAL ] FTHY: Deleted primary data file. [2025-10-28T18:52:58.143519] [INFO ] [MAIN ] FTHY: Starting full primary refresh. [2025-10-28T18:52:58.316670] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-28T18:52:58.414942] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-09. [2025-10-28T18:52:58.574924] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-07 (2.83 seconds). [2025-10-28T18:52:58.579412] [INFO ] [REMOTE ] FTHY: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:52:58.579899] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-01. [2025-10-28T18:52:58.589779] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-08. [2025-10-28T18:52:59.230512] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-28T18:52:59.243204] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-09. [2025-10-28T18:52:59.438728] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-28T18:52:59.445482] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-09. [2025-10-28T18:52:59.787371] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-28T18:52:59.798482] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-10. [2025-10-28T18:53:00.283299] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-28T18:53:00.282925] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-28T18:53:00.561142] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-02. [2025-10-28T18:53:00.638824] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-28T18:53:01.167307] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-28T18:53:01.361173] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-10. [2025-10-28T18:53:01.716118] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-10 (1.92 seconds). [2025-10-28T18:53:01.727332] [INFO ] [REMOTE ] FSLY: Full fetch complete (74840 records). [2025-10-28T18:53:01.727499] [DEBUG] [VALIDATOR ] FSLY: Validating primary data. [2025-10-28T18:53:02.118227] [DEBUG] [VALIDATOR ] FSLY: All expected trading days are present. [2025-10-28T18:53:02.118317] [DEBUG] [VALIDATOR ] FSLY: Primary data validation passed. [2025-10-28T18:53:02.119375] [INFO ] [MAIN ] FSLY: Fetched primary data is valid. [2025-10-28T18:53:02.119440] [DEBUG] [LOCAL ] FSLY: Saving primary data. [2025-10-28T18:53:02.120955] [DEBUG] [LOCAL ] FSLY: Trimmed 74840 records to 51200 (keeping 200 days of data) [2025-10-28T18:53:02.167409] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-03. [2025-10-28T18:53:02.413729] [DEBUG] [LOCAL ] FSLY: Primary data saved (51200 records). [2025-10-28T18:53:02.413879] [INFO ] [MAIN ] FSLY: Full history saved. [2025-10-28T18:53:02.413992] [INFO ] [MAIN ] Update Progress: 876/2366 symbols completed. FSLY took 17.1s. Estimated remaining: 3h 12m 11s. Rate: 7.8 symbols/min [2025-10-28T18:53:02.583934] [INFO ] [MAIN ] FTI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:53:02.632873] [DEBUG] [LOCAL ] FTI: Loaded 53292 existing records from primary storage. [2025-10-28T18:53:02.633281] [INFO ] [MAIN ] FTI: Loaded 53292 existing records. [2025-10-28T18:53:02.746760] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-28T18:53:02.777501] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-10-28T18:53:02.776404] [INFO ] [REMOTE ] FSS: Full fetch complete (48340 records). [2025-10-28T18:53:02.783494] [DEBUG] [VALIDATOR ] FSS: Validating primary data. [2025-10-28T18:53:02.964741] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-04. [2025-10-28T18:53:02.964606] [WARN ] [MAIN ] FTI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:53:02.976120] [INFO ] [MAIN ] FTI: Wiping existing primary data before full refresh. [2025-10-28T18:53:02.988435] [INFO ] [LOCAL ] FTI: Starting deletion of primary data. [2025-10-28T18:53:02.999841] [DEBUG] [LOCAL ] FTI: Deleted primary data file. [2025-10-28T18:53:03.018832] [INFO ] [MAIN ] FTI: Starting full primary refresh. [2025-10-28T18:53:03.549145] [DEBUG] [VALIDATOR ] FSS: All expected trading days are present. [2025-10-28T18:53:03.554519] [DEBUG] [VALIDATOR ] FSS: Primary data validation passed. [2025-10-28T18:53:03.555480] [INFO ] [MAIN ] FSS: Fetched primary data is valid. [2025-10-28T18:53:03.555615] [DEBUG] [LOCAL ] FSS: Saving primary data. [2025-10-28T18:53:03.661847] [DEBUG] [LOCAL ] FSS: Trimmed 48340 records to 32538 (keeping 200 days of data) [2025-10-28T18:53:03.666109] [INFO ] [REMOTE ] FTI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:53:03.739029] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-28T18:53:03.768522] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-10. [2025-10-28T18:53:03.885959] [DEBUG] [LOCAL ] FSS: Primary data saved (32538 records). [2025-10-28T18:53:03.886105] [INFO ] [MAIN ] FSS: Full history saved. [2025-10-28T18:53:03.886190] [INFO ] [MAIN ] Update Progress: 877/2366 symbols completed. FSS took 16.2s. Estimated remaining: 3h 11m 53s. Rate: 7.8 symbols/min [2025-10-28T18:53:04.561141] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-01. [2025-10-28T18:53:05.361190] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-05. [2025-10-28T18:53:05.863106] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-28T18:53:06.161216] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-06. [2025-10-28T18:53:06.685222] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-28T18:53:06.961118] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-07. [2025-10-28T18:53:07.519134] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-28T18:53:07.538955] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-10 (3.77 seconds). [2025-10-28T18:53:07.550491] [INFO ] [REMOTE ] FSM: Full fetch complete (77222 records). [2025-10-28T18:53:07.550632] [DEBUG] [VALIDATOR ] FSM: Validating primary data. [2025-10-28T18:53:07.772773] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-08. [2025-10-28T18:53:07.950805] [DEBUG] [VALIDATOR ] FSM: All expected trading days are present. [2025-10-28T18:53:07.950887] [DEBUG] [VALIDATOR ] FSM: Primary data validation passed. [2025-10-28T18:53:07.951848] [INFO ] [MAIN ] FSM: Fetched primary data is valid. [2025-10-28T18:53:07.951909] [DEBUG] [LOCAL ] FSM: Saving primary data. [2025-10-28T18:53:07.953371] [DEBUG] [LOCAL ] FSM: Trimmed 77222 records to 53298 (keeping 200 days of data) [2025-10-28T18:53:08.260369] [DEBUG] [LOCAL ] FSM: Primary data saved (53298 records). [2025-10-28T18:53:08.260512] [INFO ] [MAIN ] FSM: Full history saved. [2025-10-28T18:53:08.260592] [INFO ] [MAIN ] Update Progress: 878/2366 symbols completed. FSM took 22.8s. Estimated remaining: 3h 11m 39s. Rate: 7.8 symbols/min [2025-10-28T18:53:08.433582] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-10-28T18:53:08.561138] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-09. [2025-10-28T18:53:09.021430] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-01 (4.46 seconds). [2025-10-28T18:53:09.194170] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-28T18:53:09.361116] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-10. [2025-10-28T18:53:10.132546] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-28T18:53:10.135711] [INFO ] [REMOTE ] FTHY: Full fetch complete (17244 records). [2025-10-28T18:53:10.135785] [DEBUG] [VALIDATOR ] FTHY: Validating primary data. [2025-10-28T18:53:10.169610] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-02. [2025-10-28T18:53:10.522637] [DEBUG] [VALIDATOR ] FTHY: All expected trading days are present. [2025-10-28T18:53:10.522757] [DEBUG] [VALIDATOR ] FTHY: Primary data validation passed. [2025-10-28T18:53:10.523130] [INFO ] [MAIN ] FTHY: Fetched primary data is valid. [2025-10-28T18:53:10.523169] [DEBUG] [LOCAL ] FTHY: Saving primary data. [2025-10-28T18:53:10.523957] [DEBUG] [LOCAL ] FTHY: Trimmed 17244 records to 11966 (keeping 200 days of data) [2025-10-28T18:53:10.594982] [DEBUG] [LOCAL ] FTHY: Primary data saved (11966 records). [2025-10-28T18:53:10.595118] [INFO ] [MAIN ] FTHY: Full history saved. [2025-10-28T18:53:10.595195] [INFO ] [MAIN ] Update Progress: 879/2366 symbols completed. FTHY took 12.8s. Estimated remaining: 3h 11m 23s. Rate: 7.8 symbols/min [2025-10-28T18:53:13.030892] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-02 (2.86 seconds). [2025-10-28T18:53:13.040999] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-03. [2025-10-28T18:53:14.449909] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-28T18:53:14.464302] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-04. [2025-10-28T18:53:17.523078] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-04 (3.06 seconds). [2025-10-28T18:53:17.534700] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-05. [2025-10-28T18:53:19.032197] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-28T18:53:19.044426] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-06. [2025-10-28T18:53:20.425377] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-10-28T18:53:20.437045] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-07. [2025-10-28T18:53:21.758538] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-28T18:53:21.770413] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-08. [2025-10-28T18:53:23.251678] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-10-28T18:53:23.263059] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-09. [2025-10-28T18:53:24.462883] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-28T18:53:24.474098] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-10. [2025-10-28T18:53:26.070077] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-28T18:53:26.080823] [INFO ] [REMOTE ] FTI: Full fetch complete (77335 records). [2025-10-28T18:53:26.080974] [DEBUG] [VALIDATOR ] FTI: Validating primary data. [2025-10-28T18:53:26.468102] [DEBUG] [VALIDATOR ] FTI: All expected trading days are present. [2025-10-28T18:53:26.468183] [DEBUG] [VALIDATOR ] FTI: Primary data validation passed. [2025-10-28T18:53:26.469143] [INFO ] [MAIN ] FTI: Fetched primary data is valid. [2025-10-28T18:53:26.469207] [DEBUG] [LOCAL ] FTI: Saving primary data. [2025-10-28T18:53:26.470605] [DEBUG] [LOCAL ] FTI: Trimmed 77335 records to 53291 (keeping 200 days of data) [2025-10-28T18:53:26.782500] [DEBUG] [LOCAL ] FTI: Primary data saved (53291 records). [2025-10-28T18:53:26.782625] [INFO ] [MAIN ] FTI: Full history saved. [2025-10-28T18:53:26.782738] [INFO ] [MAIN ] Update Progress: 880/2366 symbols completed. FTI took 24.4s. Estimated remaining: 3h 11m 29s. Rate: 7.8 symbols/min [2025-10-28T18:53:27.384138] [INFO ] [MAIN ] FTV: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:53:27.501301] [INFO ] [MAIN ] FTS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:53:27.494589] [INFO ] [MAIN ] FTWO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:53:27.527693] [INFO ] [MAIN ] FTK: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:53:27.533387] [DEBUG] [LOCAL ] FTWO: Loaded 1917 existing records from primary storage. [2025-10-28T18:53:27.533724] [INFO ] [MAIN ] FTWO: Loaded 1917 existing records. [2025-10-28T18:53:27.782345] [DEBUG] [LOCAL ] FTK: Loaded 33051 existing records from primary storage. [2025-10-28T18:53:27.783634] [DEBUG] [LOCAL ] FTS: Loaded 42295 existing records from primary storage. [2025-10-28T18:53:27.781406] [WARN ] [MAIN ] FTWO: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:53:27.798034] [INFO ] [MAIN ] FTWO: Wiping existing primary data before full refresh. [2025-10-28T18:53:27.798166] [INFO ] [LOCAL ] FTWO: Starting deletion of primary data. [2025-10-28T18:53:27.797976] [INFO ] [MAIN ] FTK: Loaded 33051 existing records. [2025-10-28T18:53:27.798458] [DEBUG] [LOCAL ] FTWO: Deleted primary data file. [2025-10-28T18:53:27.798573] [INFO ] [MAIN ] FTS: Loaded 42295 existing records. [2025-10-28T18:53:27.799221] [DEBUG] [LOCAL ] FTV: Loaded 52997 existing records from primary storage. [2025-10-28T18:53:27.799407] [INFO ] [MAIN ] FTWO: Starting full primary refresh. [2025-10-28T18:53:27.841357] [INFO ] [MAIN ] FTV: Loaded 52997 existing records. [2025-10-28T18:53:28.408875] [WARN ] [MAIN ] FTS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:53:28.483174] [WARN ] [MAIN ] FTK: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:53:28.490168] [INFO ] [MAIN ] FTS: Wiping existing primary data before full refresh. [2025-10-28T18:53:28.490337] [INFO ] [MAIN ] FTK: Wiping existing primary data before full refresh. [2025-10-28T18:53:28.514044] [INFO ] [LOCAL ] FTK: Starting deletion of primary data. [2025-10-28T18:53:28.505028] [INFO ] [LOCAL ] FTS: Starting deletion of primary data. [2025-10-28T18:53:28.553639] [DEBUG] [LOCAL ] FTS: Deleted primary data file. [2025-10-28T18:53:28.596907] [INFO ] [MAIN ] FTS: Starting full primary refresh. [2025-10-28T18:53:28.565509] [DEBUG] [LOCAL ] FTK: Deleted primary data file. [2025-10-28T18:53:28.618078] [INFO ] [MAIN ] FTK: Starting full primary refresh. [2025-10-28T18:53:28.612805] [WARN ] [MAIN ] FTV: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:53:28.654837] [INFO ] [MAIN ] FTV: Wiping existing primary data before full refresh. [2025-10-28T18:53:28.655111] [INFO ] [LOCAL ] FTV: Starting deletion of primary data. [2025-10-28T18:53:28.724230] [DEBUG] [LOCAL ] FTV: Deleted primary data file. [2025-10-28T18:53:28.770576] [INFO ] [MAIN ] FTV: Starting full primary refresh. [2025-10-28T18:53:28.977929] [INFO ] [REMOTE ] FTWO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:53:29.020910] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-01. [2025-10-28T18:53:29.760477] [INFO ] [REMOTE ] FTV: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:53:29.773898] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-01. [2025-10-28T18:53:29.823671] [INFO ] [REMOTE ] FTS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:53:29.831585] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-01. [2025-10-28T18:53:29.830406] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-10-28T18:53:29.865961] [INFO ] [REMOTE ] FTK: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:53:29.866271] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-01. [2025-10-28T18:53:29.838062] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-02. [2025-10-28T18:53:30.173125] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-10-28T18:53:30.174453] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-03. [2025-10-28T18:53:30.538528] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-10-28T18:53:30.539917] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-04. [2025-10-28T18:53:30.815567] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-04 (0.28 seconds). [2025-10-28T18:53:30.816905] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-05. [2025-10-28T18:53:30.947963] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-28T18:53:30.956443] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-02. [2025-10-28T18:53:31.002731] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-28T18:53:31.014453] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-02. [2025-10-28T18:53:31.018149] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-05 (0.20 seconds). [2025-10-28T18:53:31.019301] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-06. [2025-10-28T18:53:31.368548] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-28T18:53:31.369755] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-07. [2025-10-28T18:53:31.676553] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-07 (0.31 seconds). [2025-10-28T18:53:31.677700] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-08. [2025-10-28T18:53:31.929427] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-10-28T18:53:31.934711] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-02. [2025-10-28T18:53:32.016075] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-28T18:53:32.024140] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-03. [2025-10-28T18:53:32.127424] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-28T18:53:32.128561] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-09. [2025-10-28T18:53:32.243683] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-28T18:53:32.253836] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-03. [2025-10-28T18:53:32.424465] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-09 (0.30 seconds). [2025-10-28T18:53:32.425607] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-10. [2025-10-28T18:53:32.600736] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-10-28T18:53:32.605041] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-03. [2025-10-28T18:53:32.919382] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-28T18:53:32.920460] [INFO ] [REMOTE ] FTWO: Full fetch complete (3300 records). [2025-10-28T18:53:32.920526] [DEBUG] [VALIDATOR ] FTWO: Validating primary data. [2025-10-28T18:53:33.299372] [DEBUG] [VALIDATOR ] FTWO: All expected trading days are present. [2025-10-28T18:53:33.306968] [DEBUG] [VALIDATOR ] FTWO: Primary data validation passed. [2025-10-28T18:53:33.307104] [INFO ] [MAIN ] FTWO: Fetched primary data is valid. [2025-10-28T18:53:33.307174] [DEBUG] [LOCAL ] FTWO: Saving primary data. [2025-10-28T18:53:33.308751] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-28T18:53:33.308972] [DEBUG] [LOCAL ] FTWO: Trimmed 3300 records to 1923 (keeping 200 days of data) [2025-10-28T18:53:33.317882] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-04. [2025-10-28T18:53:33.330199] [DEBUG] [LOCAL ] FTWO: Primary data saved (1923 records). [2025-10-28T18:53:33.330275] [INFO ] [MAIN ] FTWO: Full history saved. [2025-10-28T18:53:33.330370] [INFO ] [MAIN ] Update Progress: 881/2366 symbols completed. FTWO took 6.5s. Estimated remaining: 3h 11m 19s. Rate: 7.8 symbols/min [2025-10-28T18:53:33.508571] [INFO ] [MAIN ] FUBO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:53:33.557130] [DEBUG] [LOCAL ] FUBO: Loaded 53714 existing records from primary storage. [2025-10-28T18:53:33.557450] [INFO ] [MAIN ] FUBO: Loaded 53714 existing records. [2025-10-28T18:53:33.739104] [WARN ] [MAIN ] FUBO: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:53:33.739333] [INFO ] [MAIN ] FUBO: Wiping existing primary data before full refresh. [2025-10-28T18:53:33.739533] [INFO ] [LOCAL ] FUBO: Starting deletion of primary data. [2025-10-28T18:53:33.739823] [DEBUG] [LOCAL ] FUBO: Deleted primary data file. [2025-10-28T18:53:33.739946] [INFO ] [MAIN ] FUBO: Starting full primary refresh. [2025-10-28T18:53:34.001007] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-10-28T18:53:34.072006] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-04. [2025-10-28T18:53:34.150127] [INFO ] [REMOTE ] FUBO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:53:34.161120] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-01. [2025-10-28T18:53:34.811588] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-03 (2.21 seconds). [2025-10-28T18:53:34.961113] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-04. [2025-10-28T18:53:35.470445] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-28T18:53:35.761154] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-05. [2025-10-28T18:53:35.868468] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-28T18:53:36.561130] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-02. [2025-10-28T18:53:37.074396] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-28T18:53:37.114920] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-04 (3.80 seconds). [2025-10-28T18:53:37.361167] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-05. [2025-10-28T18:53:38.161201] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-06. [2025-10-28T18:53:38.422205] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-04 (3.46 seconds). [2025-10-28T18:53:38.541855] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-10-28T18:53:38.961096] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-03. [2025-10-28T18:53:39.372605] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-28T18:53:39.761184] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-05. [2025-10-28T18:53:39.836060] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-05 (2.47 seconds). [2025-10-28T18:53:40.561157] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-06. [2025-10-28T18:53:40.747192] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-10-28T18:53:41.361118] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-07. [2025-10-28T18:53:41.601004] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-28T18:53:42.161110] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-04. [2025-10-28T18:53:42.376309] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-05 (2.62 seconds). [2025-10-28T18:53:42.961129] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-06. [2025-10-28T18:53:43.706366] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-07 (2.35 seconds). [2025-10-28T18:53:43.760499] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-28T18:53:43.770724] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-08. [2025-10-28T18:53:43.884437] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-28T18:53:44.561129] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-05. [2025-10-28T18:53:45.361105] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-07. [2025-10-28T18:53:45.912450] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-10-28T18:53:46.161172] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-07. [2025-10-28T18:53:46.732044] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-10-28T18:53:46.961102] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-06. [2025-10-28T18:53:47.184322] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-28T18:53:47.282592] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-10-28T18:53:47.761172] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-08. [2025-10-28T18:53:48.396410] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-28T18:53:48.561155] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-07. [2025-10-28T18:53:48.728362] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-28T18:53:49.361183] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-09. [2025-10-28T18:53:50.161142] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-08. [2025-10-28T18:53:50.493554] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-28T18:53:50.535239] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-10-28T18:53:50.961177] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-08. [2025-10-28T18:53:51.761141] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-10. [2025-10-28T18:53:52.367120] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-08 (2.21 seconds). [2025-10-28T18:53:52.561123] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-09. [2025-10-28T18:53:52.919799] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-10-28T18:53:53.090363] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-28T18:53:53.097321] [INFO ] [REMOTE ] FTK: Full fetch complete (44122 records). [2025-10-28T18:53:53.097479] [DEBUG] [VALIDATOR ] FTK: Validating primary data. [2025-10-28T18:53:53.367704] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-09. [2025-10-28T18:53:53.491608] [DEBUG] [VALIDATOR ] FTK: All expected trading days are present. [2025-10-28T18:53:53.491760] [DEBUG] [VALIDATOR ] FTK: Primary data validation passed. [2025-10-28T18:53:53.492895] [INFO ] [MAIN ] FTK: Fetched primary data is valid. [2025-10-28T18:53:53.492973] [DEBUG] [LOCAL ] FTK: Saving primary data. [2025-10-28T18:53:53.494239] [DEBUG] [LOCAL ] FTK: Trimmed 44122 records to 33060 (keeping 200 days of data) [2025-10-28T18:53:53.693931] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-28T18:53:53.725117] [DEBUG] [LOCAL ] FTK: Primary data saved (33060 records). [2025-10-28T18:53:53.725498] [INFO ] [MAIN ] FTK: Full history saved. [2025-10-28T18:53:53.725601] [INFO ] [MAIN ] Update Progress: 882/2366 symbols completed. FTK took 26.9s. Estimated remaining: 3h 11m 33s. Rate: 7.7 symbols/min [2025-10-28T18:53:53.893684] [INFO ] [MAIN ] FUL: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:53:53.923525] [DEBUG] [LOCAL ] FUL: Loaded 31762 existing records from primary storage. [2025-10-28T18:53:53.923842] [INFO ] [MAIN ] FUL: Loaded 31762 existing records. [2025-10-28T18:53:54.097874] [WARN ] [MAIN ] FUL: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:53:54.098081] [INFO ] [MAIN ] FUL: Wiping existing primary data before full refresh. [2025-10-28T18:53:54.098129] [INFO ] [LOCAL ] FUL: Starting deletion of primary data. [2025-10-28T18:53:54.098499] [DEBUG] [LOCAL ] FUL: Deleted primary data file. [2025-10-28T18:53:54.098543] [INFO ] [MAIN ] FUL: Starting full primary refresh. [2025-10-28T18:53:54.166290] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-09. [2025-10-28T18:53:54.451060] [INFO ] [REMOTE ] FUL: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:53:54.961189] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-01. [2025-10-28T18:53:55.100614] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-28T18:53:55.761105] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-10. [2025-10-28T18:53:55.918585] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-28T18:53:56.561110] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-10. [2025-10-28T18:53:56.646938] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-09 (2.48 seconds). [2025-10-28T18:53:57.097416] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-28T18:53:57.106178] [INFO ] [REMOTE ] FTS: Full fetch complete (60953 records). [2025-10-28T18:53:57.106302] [DEBUG] [VALIDATOR ] FTS: Validating primary data. [2025-10-28T18:53:57.366391] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-02. [2025-10-28T18:53:57.502996] [DEBUG] [VALIDATOR ] FTS: All expected trading days are present. [2025-10-28T18:53:57.503101] [DEBUG] [VALIDATOR ] FTS: Primary data validation passed. [2025-10-28T18:53:57.504013] [INFO ] [MAIN ] FTS: Fetched primary data is valid. [2025-10-28T18:53:57.504083] [DEBUG] [LOCAL ] FTS: Saving primary data. [2025-10-28T18:53:57.505412] [DEBUG] [LOCAL ] FTS: Trimmed 60953 records to 42265 (keeping 200 days of data) [2025-10-28T18:53:57.756833] [DEBUG] [LOCAL ] FTS: Primary data saved (42265 records). [2025-10-28T18:53:57.756971] [INFO ] [MAIN ] FTS: Full history saved. [2025-10-28T18:53:57.757046] [INFO ] [MAIN ] Update Progress: 883/2366 symbols completed. FTS took 31.0s. Estimated remaining: 3h 11m 19s. Rate: 7.8 symbols/min [2025-10-28T18:53:57.927937] [INFO ] [MAIN ] FUN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:53:57.959306] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-28T18:53:57.970290] [INFO ] [REMOTE ] FTV: Full fetch complete (76624 records). [2025-10-28T18:53:57.970498] [DEBUG] [VALIDATOR ] FTV: Validating primary data. [2025-10-28T18:53:58.178052] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-10. [2025-10-28T18:53:58.229563] [DEBUG] [LOCAL ] FUN: Loaded 52033 existing records from primary storage. [2025-10-28T18:53:58.263507] [INFO ] [MAIN ] FUN: Loaded 52033 existing records. [2025-10-28T18:53:58.598674] [DEBUG] [VALIDATOR ] FTV: All expected trading days are present. [2025-10-28T18:53:58.598829] [DEBUG] [VALIDATOR ] FTV: Primary data validation passed. [2025-10-28T18:53:58.598363] [WARN ] [MAIN ] FUN: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:53:58.599267] [INFO ] [MAIN ] FUN: Wiping existing primary data before full refresh. [2025-10-28T18:53:58.600366] [INFO ] [MAIN ] FTV: Fetched primary data is valid. [2025-10-28T18:53:58.600452] [INFO ] [LOCAL ] FUN: Starting deletion of primary data. [2025-10-28T18:53:58.600532] [DEBUG] [LOCAL ] FTV: Saving primary data. [2025-10-28T18:53:58.601010] [DEBUG] [LOCAL ] FUN: Deleted primary data file. [2025-10-28T18:53:58.601069] [INFO ] [MAIN ] FUN: Starting full primary refresh. [2025-10-28T18:53:58.700448] [DEBUG] [LOCAL ] FTV: Trimmed 76624 records to 52998 (keeping 200 days of data) [2025-10-28T18:53:58.960815] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-10-28T18:53:59.027318] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-03. [2025-10-28T18:53:59.181031] [INFO ] [REMOTE ] FUN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:53:59.318550] [DEBUG] [LOCAL ] FTV: Primary data saved (52998 records). [2025-10-28T18:53:59.318714] [INFO ] [MAIN ] FTV: Full history saved. [2025-10-28T18:53:59.319161] [INFO ] [MAIN ] Update Progress: 884/2366 symbols completed. FTV took 32.5s. Estimated remaining: 3h 11m 1s. Rate: 7.8 symbols/min [2025-10-28T18:53:59.496637] [INFO ] [MAIN ] FVR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:53:59.518138] [DEBUG] [LOCAL ] FVR: Loaded 20577 existing records from primary storage. [2025-10-28T18:53:59.518392] [INFO ] [MAIN ] FVR: Loaded 20577 existing records. [2025-10-28T18:53:59.694968] [WARN ] [MAIN ] FVR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:53:59.695192] [INFO ] [MAIN ] FVR: Wiping existing primary data before full refresh. [2025-10-28T18:53:59.695237] [INFO ] [LOCAL ] FVR: Starting deletion of primary data. [2025-10-28T18:53:59.695433] [DEBUG] [LOCAL ] FVR: Deleted primary data file. [2025-10-28T18:53:59.695488] [INFO ] [MAIN ] FVR: Starting full primary refresh. [2025-10-28T18:53:59.766375] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-01. [2025-10-28T18:54:00.091048] [INFO ] [REMOTE ] FVR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:54:00.234877] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-28T18:54:00.561096] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-01. [2025-10-28T18:54:01.016905] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-28T18:54:01.248379] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-28T18:54:01.361144] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-02. [2025-10-28T18:54:01.674067] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-10 (3.50 seconds). [2025-10-28T18:54:01.684867] [INFO ] [REMOTE ] FUBO: Full fetch complete (77865 records). [2025-10-28T18:54:01.685005] [DEBUG] [VALIDATOR ] FUBO: Validating primary data. [2025-10-28T18:54:02.077851] [DEBUG] [VALIDATOR ] FUBO: All expected trading days are present. [2025-10-28T18:54:02.077930] [DEBUG] [VALIDATOR ] FUBO: Primary data validation passed. [2025-10-28T18:54:02.078862] [INFO ] [MAIN ] FUBO: Fetched primary data is valid. [2025-10-28T18:54:02.078924] [DEBUG] [LOCAL ] FUBO: Saving primary data. [2025-10-28T18:54:02.080352] [DEBUG] [LOCAL ] FUBO: Trimmed 77865 records to 53714 (keeping 200 days of data) [2025-10-28T18:54:02.161889] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-04. [2025-10-28T18:54:02.379192] [DEBUG] [LOCAL ] FUBO: Primary data saved (53714 records). [2025-10-28T18:54:02.379318] [INFO ] [MAIN ] FUBO: Full history saved. [2025-10-28T18:54:02.379393] [INFO ] [MAIN ] Update Progress: 885/2366 symbols completed. FUBO took 29.0s. Estimated remaining: 3h 10m 45s. Rate: 7.8 symbols/min [2025-10-28T18:54:02.552230] [INFO ] [MAIN ] FVRR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:54:02.588219] [DEBUG] [LOCAL ] FVRR: Loaded 40434 existing records from primary storage. [2025-10-28T18:54:02.588552] [INFO ] [MAIN ] FVRR: Loaded 40434 existing records. [2025-10-28T18:54:02.767832] [WARN ] [MAIN ] FVRR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:54:02.768161] [INFO ] [MAIN ] FVRR: Wiping existing primary data before full refresh. [2025-10-28T18:54:02.768275] [INFO ] [LOCAL ] FVRR: Starting deletion of primary data. [2025-10-28T18:54:02.768563] [DEBUG] [LOCAL ] FVRR: Deleted primary data file. [2025-10-28T18:54:02.768687] [INFO ] [MAIN ] FVRR: Starting full primary refresh. [2025-10-28T18:54:02.961706] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-02. [2025-10-28T18:54:02.980060] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-28T18:54:03.177864] [INFO ] [REMOTE ] FVRR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:54:03.271270] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-28T18:54:03.637915] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-28T18:54:03.761161] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-03. [2025-10-28T18:54:04.561140] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-05. [2025-10-28T18:54:04.688229] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-28T18:54:05.361150] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-01. [2025-10-28T18:54:05.447031] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-28T18:54:06.161141] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-03. [2025-10-28T18:54:06.708329] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-28T18:54:06.961128] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-06. [2025-10-28T18:54:07.761137] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-02. [2025-10-28T18:54:07.865777] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-28T18:54:07.877247] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-28T18:54:08.561163] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-07. [2025-10-28T18:54:08.849196] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-28T18:54:09.361120] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-03. [2025-10-28T18:54:09.650845] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-28T18:54:10.161190] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-04. [2025-10-28T18:54:10.435405] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-28T18:54:10.961148] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-04. [2025-10-28T18:54:11.364885] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-28T18:54:11.761163] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-04. [2025-10-28T18:54:11.901753] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-28T18:54:12.561127] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-05. [2025-10-28T18:54:12.761129] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-28T18:54:13.361158] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-05. [2025-10-28T18:54:13.932346] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-28T18:54:14.161143] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-08. [2025-10-28T18:54:14.594451] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-28T18:54:14.961106] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-05. [2025-10-28T18:54:15.655163] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-10-28T18:54:15.761133] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-06. [2025-10-28T18:54:16.402801] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-28T18:54:16.561127] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-06. [2025-10-28T18:54:16.945145] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-28T18:54:17.361130] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-09. [2025-10-28T18:54:17.828729] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-28T18:54:18.161139] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-07. [2025-10-28T18:54:18.413008] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-28T18:54:18.961122] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-10. [2025-10-28T18:54:19.761113] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-07. [2025-10-28T18:54:20.037069] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-10 (1.08 seconds). [2025-10-28T18:54:20.043701] [INFO ] [REMOTE ] FUL: Full fetch complete (47803 records). [2025-10-28T18:54:20.043913] [DEBUG] [VALIDATOR ] FUL: Validating primary data. [2025-10-28T18:54:20.451395] [DEBUG] [VALIDATOR ] FUL: All expected trading days are present. [2025-10-28T18:54:20.451730] [DEBUG] [VALIDATOR ] FUL: Primary data validation passed. [2025-10-28T18:54:20.452629] [INFO ] [MAIN ] FUL: Fetched primary data is valid. [2025-10-28T18:54:20.452825] [DEBUG] [LOCAL ] FUL: Saving primary data. [2025-10-28T18:54:20.454086] [DEBUG] [LOCAL ] FUL: Trimmed 47803 records to 31642 (keeping 200 days of data) [2025-10-28T18:54:20.577173] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-06. [2025-10-28T18:54:20.629601] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-28T18:54:20.682477] [DEBUG] [LOCAL ] FUL: Primary data saved (31642 records). [2025-10-28T18:54:20.682684] [INFO ] [MAIN ] FUL: Full history saved. [2025-10-28T18:54:20.682806] [INFO ] [MAIN ] Update Progress: 886/2366 symbols completed. FUL took 27.0s. Estimated remaining: 3h 10m 55s. Rate: 7.8 symbols/min [2025-10-28T18:54:20.859934] [INFO ] [MAIN ] FXED: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:54:20.863589] [DEBUG] [LOCAL ] FXED: Loaded 1221 existing records from primary storage. [2025-10-28T18:54:20.863759] [INFO ] [MAIN ] FXED: Loaded 1221 existing records. [2025-10-28T18:54:21.057447] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-07 (2.90 seconds). [2025-10-28T18:54:21.091054] [WARN ] [MAIN ] FXED: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:54:21.091587] [INFO ] [MAIN ] FXED: Wiping existing primary data before full refresh. [2025-10-28T18:54:21.091673] [INFO ] [LOCAL ] FXED: Starting deletion of primary data. [2025-10-28T18:54:21.092136] [DEBUG] [LOCAL ] FXED: Deleted primary data file. [2025-10-28T18:54:21.092195] [INFO ] [MAIN ] FXED: Starting full primary refresh. [2025-10-28T18:54:21.368147] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-08. [2025-10-28T18:54:21.458903] [INFO ] [REMOTE ] FXED: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:54:21.668546] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-28T18:54:22.161132] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-07. [2025-10-28T18:54:22.961162] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-01. [2025-10-28T18:54:23.314283] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-28T18:54:23.761122] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-08. [2025-10-28T18:54:24.300470] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-08 (2.93 seconds). [2025-10-28T18:54:24.352863] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-28T18:54:24.561112] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-02. [2025-10-28T18:54:24.787144] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-02 (0.23 seconds). [2025-10-28T18:54:24.834207] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-28T18:54:25.361139] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-08. [2025-10-28T18:54:26.150270] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-28T18:54:26.161080] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-09. [2025-10-28T18:54:26.842946] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-28T18:54:26.961120] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-09. [2025-10-28T18:54:27.761159] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-10. [2025-10-28T18:54:28.110008] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-28T18:54:28.355474] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-28T18:54:28.359522] [INFO ] [REMOTE ] FVR: Full fetch complete (29094 records). [2025-10-28T18:54:28.359624] [DEBUG] [VALIDATOR ] FVR: Validating primary data. [2025-10-28T18:54:28.566368] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-09. [2025-10-28T18:54:28.783752] [DEBUG] [VALIDATOR ] FVR: All expected trading days are present. [2025-10-28T18:54:28.783837] [DEBUG] [VALIDATOR ] FVR: Primary data validation passed. [2025-10-28T18:54:28.784501] [INFO ] [MAIN ] FVR: Fetched primary data is valid. [2025-10-28T18:54:28.784575] [DEBUG] [LOCAL ] FVR: Saving primary data. [2025-10-28T18:54:28.785407] [DEBUG] [LOCAL ] FVR: Trimmed 29094 records to 20491 (keeping 200 days of data) [2025-10-28T18:54:28.921501] [DEBUG] [LOCAL ] FVR: Primary data saved (20491 records). [2025-10-28T18:54:28.921620] [INFO ] [MAIN ] FVR: Full history saved. [2025-10-28T18:54:28.921728] [INFO ] [MAIN ] Update Progress: 887/2366 symbols completed. FVR took 29.6s. Estimated remaining: 3h 10m 48s. Rate: 7.8 symbols/min [2025-10-28T18:54:29.118788] [INFO ] [MAIN ] G: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:54:29.165236] [DEBUG] [LOCAL ] G: Loaded 50010 existing records from primary storage. [2025-10-28T18:54:29.165567] [INFO ] [MAIN ] G: Loaded 50010 existing records. [2025-10-28T18:54:29.366411] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-10. [2025-10-28T18:54:29.372278] [WARN ] [MAIN ] G: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:54:29.372595] [INFO ] [MAIN ] G: Wiping existing primary data before full refresh. [2025-10-28T18:54:29.372670] [INFO ] [LOCAL ] G: Starting deletion of primary data. [2025-10-28T18:54:29.373461] [DEBUG] [LOCAL ] G: Deleted primary data file. [2025-10-28T18:54:29.373519] [INFO ] [MAIN ] G: Starting full primary refresh. [2025-10-28T18:54:29.779959] [INFO ] [REMOTE ] G: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:54:30.161152] [INFO ] [REMOTE ] G: Fetching primary data for 2025-01. [2025-10-28T18:54:30.680720] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-28T18:54:30.689097] [INFO ] [REMOTE ] FVRR: Full fetch complete (59272 records). [2025-10-28T18:54:30.689229] [DEBUG] [VALIDATOR ] FVRR: Validating primary data. [2025-10-28T18:54:30.968229] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-03. [2025-10-28T18:54:31.100625] [DEBUG] [VALIDATOR ] FVRR: All expected trading days are present. [2025-10-28T18:54:31.100766] [DEBUG] [VALIDATOR ] FVRR: Primary data validation passed. [2025-10-28T18:54:31.101637] [INFO ] [MAIN ] FVRR: Fetched primary data is valid. [2025-10-28T18:54:31.101901] [DEBUG] [LOCAL ] FVRR: Saving primary data. [2025-10-28T18:54:31.103979] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-09 (2.54 seconds). [2025-10-28T18:54:31.115959] [DEBUG] [LOCAL ] FVRR: Trimmed 59272 records to 40391 (keeping 200 days of data) [2025-10-28T18:54:31.324916] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-10-28T18:54:31.358916] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-28T18:54:31.392309] [DEBUG] [LOCAL ] FVRR: Primary data saved (40391 records). [2025-10-28T18:54:31.392416] [INFO ] [MAIN ] FVRR: Full history saved. [2025-10-28T18:54:31.392485] [INFO ] [MAIN ] Update Progress: 888/2366 symbols completed. FVRR took 29.0s. Estimated remaining: 3h 10m 32s. Rate: 7.8 symbols/min [2025-10-28T18:54:31.563345] [INFO ] [MAIN ] GAB: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:54:31.588416] [DEBUG] [LOCAL ] GAB: Loaded 26973 existing records from primary storage. [2025-10-28T18:54:31.588713] [INFO ] [MAIN ] GAB: Loaded 26973 existing records. [2025-10-28T18:54:31.770315] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-10. [2025-10-28T18:54:31.776995] [WARN ] [MAIN ] GAB: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:54:31.777268] [INFO ] [MAIN ] GAB: Wiping existing primary data before full refresh. [2025-10-28T18:54:31.778167] [INFO ] [LOCAL ] GAB: Starting deletion of primary data. [2025-10-28T18:54:31.778384] [DEBUG] [LOCAL ] GAB: Deleted primary data file. [2025-10-28T18:54:31.778442] [INFO ] [MAIN ] GAB: Starting full primary refresh. [2025-10-28T18:54:32.323582] [INFO ] [REMOTE ] GAB: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:54:32.561194] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-04. [2025-10-28T18:54:32.800406] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-04 (0.24 seconds). [2025-10-28T18:54:33.361145] [INFO ] [REMOTE ] G: Fetching primary data for 2025-02. [2025-10-28T18:54:34.161312] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-05. [2025-10-28T18:54:34.272407] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-10 (2.50 seconds). [2025-10-28T18:54:34.283669] [INFO ] [REMOTE ] FUN: Full fetch complete (73714 records). [2025-10-28T18:54:34.283883] [DEBUG] [VALIDATOR ] FUN: Validating primary data. [2025-10-28T18:54:34.466979] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-05 (0.31 seconds). [2025-10-28T18:54:34.696754] [DEBUG] [VALIDATOR ] FUN: All expected trading days are present. [2025-10-28T18:54:34.696842] [DEBUG] [VALIDATOR ] FUN: Primary data validation passed. [2025-10-28T18:54:34.697856] [INFO ] [MAIN ] FUN: Fetched primary data is valid. [2025-10-28T18:54:34.697918] [DEBUG] [LOCAL ] FUN: Saving primary data. [2025-10-28T18:54:34.699340] [DEBUG] [LOCAL ] FUN: Trimmed 73714 records to 52036 (keeping 200 days of data) [2025-10-28T18:54:34.963925] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-01. [2025-10-28T18:54:35.002175] [DEBUG] [LOCAL ] FUN: Primary data saved (52036 records). [2025-10-28T18:54:35.002286] [INFO ] [MAIN ] FUN: Full history saved. [2025-10-28T18:54:35.003047] [INFO ] [MAIN ] Update Progress: 889/2366 symbols completed. FUN took 37.2s. Estimated remaining: 3h 10m 17s. Rate: 7.8 symbols/min [2025-10-28T18:54:35.171774] [INFO ] [MAIN ] GAM: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:54:35.178448] [DEBUG] [LOCAL ] GAM: Loaded 3682 existing records from primary storage. [2025-10-28T18:54:35.178660] [INFO ] [MAIN ] GAM: Loaded 3682 existing records. [2025-10-28T18:54:35.352241] [WARN ] [MAIN ] GAM: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:54:35.352490] [INFO ] [MAIN ] GAM: Wiping existing primary data before full refresh. [2025-10-28T18:54:35.352537] [INFO ] [LOCAL ] GAM: Starting deletion of primary data. [2025-10-28T18:54:35.352725] [DEBUG] [LOCAL ] GAM: Deleted primary data file. [2025-10-28T18:54:35.352781] [INFO ] [MAIN ] GAM: Starting full primary refresh. [2025-10-28T18:54:35.702666] [INFO ] [REMOTE ] GAM: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:54:35.733948] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-02 (2.37 seconds). [2025-10-28T18:54:35.761089] [INFO ] [REMOTE ] G: Fetching primary data for 2025-03. [2025-10-28T18:54:36.374438] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-28T18:54:36.561123] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-06. [2025-10-28T18:54:36.870102] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-06 (0.31 seconds). [2025-10-28T18:54:37.057773] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-28T18:54:37.361114] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-02. [2025-10-28T18:54:38.093539] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-28T18:54:38.161096] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-03. [2025-10-28T18:54:38.961162] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-07. [2025-10-28T18:54:39.067879] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-28T18:54:39.249351] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-07 (0.29 seconds). [2025-10-28T18:54:39.761153] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-08. [2025-10-28T18:54:40.098407] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-10-28T18:54:40.561152] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-09. [2025-10-28T18:54:40.829502] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-09 (0.27 seconds). [2025-10-28T18:54:41.361182] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-04. [2025-10-28T18:54:42.161141] [INFO ] [REMOTE ] G: Fetching primary data for 2025-04. [2025-10-28T18:54:42.380156] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-28T18:54:42.961256] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-01. [2025-10-28T18:54:43.340962] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-10-28T18:54:43.345017] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-28T18:54:43.761145] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-02. [2025-10-28T18:54:44.197658] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-28T18:54:44.561158] [INFO ] [REMOTE ] G: Fetching primary data for 2025-05. [2025-10-28T18:54:45.361209] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-05. [2025-10-28T18:54:46.104743] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-10-28T18:54:46.130708] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-28T18:54:46.161092] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-06. [2025-10-28T18:54:46.961099] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-03. [2025-10-28T18:54:47.055961] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-28T18:54:47.428828] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-28T18:54:47.761131] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-07. [2025-10-28T18:54:48.561112] [INFO ] [REMOTE ] G: Fetching primary data for 2025-06. [2025-10-28T18:54:48.673947] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-28T18:54:49.361186] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-08. [2025-10-28T18:54:49.693924] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-28T18:54:50.144470] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-28T18:54:50.161088] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-09. [2025-10-28T18:54:50.961226] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-10. [2025-10-28T18:54:51.139499] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-28T18:54:51.304835] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-10 (0.34 seconds). [2025-10-28T18:54:51.305610] [INFO ] [REMOTE ] FXED: Full fetch complete (1769 records). [2025-10-28T18:54:51.305707] [DEBUG] [VALIDATOR ] FXED: Validating primary data. [2025-10-28T18:54:51.664832] [DEBUG] [VALIDATOR ] FXED: All expected trading days are present. [2025-10-28T18:54:51.664921] [DEBUG] [VALIDATOR ] FXED: Primary data validation passed. [2025-10-28T18:54:51.665025] [INFO ] [MAIN ] FXED: Fetched primary data is valid. [2025-10-28T18:54:51.665085] [DEBUG] [LOCAL ] FXED: Saving primary data. [2025-10-28T18:54:51.665404] [DEBUG] [LOCAL ] FXED: Trimmed 1769 records to 1212 (keeping 200 days of data) [2025-10-28T18:54:51.673239] [DEBUG] [LOCAL ] FXED: Primary data saved (1212 records). [2025-10-28T18:54:51.673299] [INFO ] [MAIN ] FXED: Full history saved. [2025-10-28T18:54:51.673366] [INFO ] [MAIN ] Update Progress: 890/2366 symbols completed. FXED took 31.0s. Estimated remaining: 3h 10m 24s. Rate: 7.8 symbols/min [2025-10-28T18:54:51.770284] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-04. [2025-10-28T18:54:51.844089] [INFO ] [MAIN ] GAP: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:54:51.894631] [DEBUG] [LOCAL ] GAP: Loaded 53653 existing records from primary storage. [2025-10-28T18:54:51.894953] [INFO ] [MAIN ] GAP: Loaded 53653 existing records. [2025-10-28T18:54:52.072601] [WARN ] [MAIN ] GAP: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:54:52.072851] [INFO ] [MAIN ] GAP: Wiping existing primary data before full refresh. [2025-10-28T18:54:52.072905] [INFO ] [LOCAL ] GAP: Starting deletion of primary data. [2025-10-28T18:54:52.073511] [DEBUG] [LOCAL ] GAP: Deleted primary data file. [2025-10-28T18:54:52.073570] [INFO ] [MAIN ] GAP: Starting full primary refresh. [2025-10-28T18:54:52.356734] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-28T18:54:52.435477] [INFO ] [REMOTE ] GAP: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:54:52.561136] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-01. [2025-10-28T18:54:53.361251] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-05. [2025-10-28T18:54:53.727502] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-10-28T18:54:53.925667] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-28T18:54:54.161111] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-06. [2025-10-28T18:54:54.726211] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-28T18:54:54.961164] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-07. [2025-10-28T18:54:55.387313] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-28T18:54:55.761166] [INFO ] [REMOTE ] G: Fetching primary data for 2025-07. [2025-10-28T18:54:56.561164] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-10. [2025-10-28T18:54:56.876992] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-28T18:54:57.319564] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-28T18:54:57.325746] [INFO ] [REMOTE ] GAB: Full fetch complete (39272 records). [2025-10-28T18:54:57.325857] [DEBUG] [VALIDATOR ] GAB: Validating primary data. [2025-10-28T18:54:57.366472] [INFO ] [REMOTE ] G: Fetching primary data for 2025-08. [2025-10-28T18:54:57.722367] [DEBUG] [VALIDATOR ] GAB: All expected trading days are present. [2025-10-28T18:54:57.722521] [DEBUG] [VALIDATOR ] GAB: Primary data validation passed. [2025-10-28T18:54:57.724690] [INFO ] [MAIN ] GAB: Fetched primary data is valid. [2025-10-28T18:54:57.724761] [DEBUG] [LOCAL ] GAB: Saving primary data. [2025-10-28T18:54:57.726389] [DEBUG] [LOCAL ] GAB: Trimmed 39272 records to 26834 (keeping 200 days of data) [2025-10-28T18:54:57.887884] [DEBUG] [LOCAL ] GAB: Primary data saved (26834 records). [2025-10-28T18:54:57.888068] [INFO ] [MAIN ] GAB: Full history saved. [2025-10-28T18:54:57.888174] [INFO ] [MAIN ] Update Progress: 891/2366 symbols completed. GAB took 26.5s. Estimated remaining: 3h 10m 14s. Rate: 7.8 symbols/min [2025-10-28T18:54:58.115759] [INFO ] [MAIN ] GATX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:54:58.136954] [DEBUG] [LOCAL ] GATX: Loaded 17782 existing records from primary storage. [2025-10-28T18:54:58.137268] [INFO ] [MAIN ] GATX: Loaded 17782 existing records. [2025-10-28T18:54:58.168723] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-08. [2025-10-28T18:54:58.324713] [WARN ] [MAIN ] GATX: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:54:58.324983] [INFO ] [MAIN ] GATX: Wiping existing primary data before full refresh. [2025-10-28T18:54:58.325036] [INFO ] [LOCAL ] GATX: Starting deletion of primary data. [2025-10-28T18:54:58.325345] [DEBUG] [LOCAL ] GATX: Deleted primary data file. [2025-10-28T18:54:58.325407] [INFO ] [MAIN ] GATX: Starting full primary refresh. [2025-10-28T18:54:58.706939] [INFO ] [REMOTE ] GATX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:54:58.708568] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-28T18:54:58.747269] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-28T18:54:58.961157] [INFO ] [REMOTE ] G: Fetching primary data for 2025-09. [2025-10-28T18:54:59.761200] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-02. [2025-10-28T18:55:00.192857] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-28T18:55:00.561202] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-01. [2025-10-28T18:55:01.361128] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-09. [2025-10-28T18:55:01.504410] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-28T18:55:01.752348] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-10-28T18:55:02.161126] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-10. [2025-10-28T18:55:02.290613] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-02 (2.53 seconds). [2025-10-28T18:55:02.710285] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-28T18:55:02.711664] [INFO ] [REMOTE ] GAM: Full fetch complete (6399 records). [2025-10-28T18:55:02.711737] [DEBUG] [VALIDATOR ] GAM: Validating primary data. [2025-10-28T18:55:02.966212] [INFO ] [REMOTE ] G: Fetching primary data for 2025-10. [2025-10-28T18:55:03.076285] [DEBUG] [VALIDATOR ] GAM: All expected trading days are present. [2025-10-28T18:55:03.076362] [DEBUG] [VALIDATOR ] GAM: Primary data validation passed. [2025-10-28T18:55:03.076587] [INFO ] [MAIN ] GAM: Fetched primary data is valid. [2025-10-28T18:55:03.076667] [DEBUG] [LOCAL ] GAM: Saving primary data. [2025-10-28T18:55:03.077076] [DEBUG] [LOCAL ] GAM: Trimmed 6399 records to 3674 (keeping 200 days of data) [2025-10-28T18:55:03.099154] [DEBUG] [LOCAL ] GAM: Primary data saved (3674 records). [2025-10-28T18:55:03.099252] [INFO ] [MAIN ] GAM: Full history saved. [2025-10-28T18:55:03.099324] [INFO ] [MAIN ] Update Progress: 892/2366 symbols completed. GAM took 28.1s. Estimated remaining: 3h 10m 2s. Rate: 7.8 symbols/min [2025-10-28T18:55:03.270598] [INFO ] [MAIN ] GBAB: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:55:03.284944] [DEBUG] [LOCAL ] GBAB: Loaded 12396 existing records from primary storage. [2025-10-28T18:55:03.285156] [INFO ] [MAIN ] GBAB: Loaded 12396 existing records. [2025-10-28T18:55:03.460139] [WARN ] [MAIN ] GBAB: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:55:03.460335] [INFO ] [MAIN ] GBAB: Wiping existing primary data before full refresh. [2025-10-28T18:55:03.460381] [INFO ] [LOCAL ] GBAB: Starting deletion of primary data. [2025-10-28T18:55:03.460622] [DEBUG] [LOCAL ] GBAB: Deleted primary data file. [2025-10-28T18:55:03.460705] [INFO ] [MAIN ] GBAB: Starting full primary refresh. [2025-10-28T18:55:03.766204] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-03. [2025-10-28T18:55:03.816271] [INFO ] [REMOTE ] GBAB: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:55:04.418919] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-28T18:55:04.429340] [INFO ] [REMOTE ] G: Full fetch complete (72315 records). [2025-10-28T18:55:04.429462] [DEBUG] [VALIDATOR ] G: Validating primary data. [2025-10-28T18:55:04.569094] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-01. [2025-10-28T18:55:04.830768] [DEBUG] [VALIDATOR ] G: All expected trading days are present. [2025-10-28T18:55:04.830870] [DEBUG] [VALIDATOR ] G: Primary data validation passed. [2025-10-28T18:55:04.831838] [INFO ] [MAIN ] G: Fetched primary data is valid. [2025-10-28T18:55:04.831914] [DEBUG] [LOCAL ] G: Saving primary data. [2025-10-28T18:55:04.833400] [DEBUG] [LOCAL ] G: Trimmed 72315 records to 50000 (keeping 200 days of data) [2025-10-28T18:55:05.132807] [DEBUG] [LOCAL ] G: Primary data saved (50000 records). [2025-10-28T18:55:05.132950] [INFO ] [MAIN ] G: Full history saved. [2025-10-28T18:55:05.133034] [INFO ] [MAIN ] Update Progress: 893/2366 symbols completed. G took 36.2s. Estimated remaining: 3h 9m 45s. Rate: 7.8 symbols/min [2025-10-28T18:55:05.314191] [INFO ] [MAIN ] GBCI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:55:05.325921] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-28T18:55:05.367529] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-02. [2025-10-28T18:55:05.370877] [DEBUG] [LOCAL ] GBCI: Loaded 41110 existing records from primary storage. [2025-10-28T18:55:05.371299] [INFO ] [MAIN ] GBCI: Loaded 41110 existing records. [2025-10-28T18:55:05.566323] [WARN ] [MAIN ] GBCI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:55:05.566639] [INFO ] [MAIN ] GBCI: Wiping existing primary data before full refresh. [2025-10-28T18:55:05.566730] [INFO ] [LOCAL ] GBCI: Starting deletion of primary data. [2025-10-28T18:55:05.567059] [DEBUG] [LOCAL ] GBCI: Deleted primary data file. [2025-10-28T18:55:05.567104] [INFO ] [MAIN ] GBCI: Starting full primary refresh. [2025-10-28T18:55:05.970543] [INFO ] [REMOTE ] GBCI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:55:06.068471] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-10-28T18:55:06.161129] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-02. [2025-10-28T18:55:06.558669] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-03 (2.79 seconds). [2025-10-28T18:55:06.746478] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-10-28T18:55:06.961127] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-03. [2025-10-28T18:55:07.766851] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-04. [2025-10-28T18:55:07.770288] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-28T18:55:08.561161] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-03. [2025-10-28T18:55:08.722321] [DEBUG] [REMOTE ] GBAB: Error fetching primary data for 2025-03: 'API call returned an empty response.' [2025-10-28T18:55:08.722604] [WARN ] [REMOTE ] GBAB: No data returned for month 2025-03 [2025-10-28T18:55:08.722709] [FATAL] [REMOTE ] GBAB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-28T18:55:08.722808] [FATAL] [MAIN ] GBAB: Failed to fetch primary data. [2025-10-28T18:55:08.722873] [WARN ] [MAIN ] GBAB: Deleting existing primary and derivative data due to fetch failure. [2025-10-28T18:55:08.722941] [INFO ] [LOCAL ] GBAB: Starting deletion of primary data. [2025-10-28T18:55:08.723022] [DEBUG] [LOCAL ] GBAB: No primary data file found to delete. [2025-10-28T18:55:08.723059] [INFO ] [LOCAL ] GBAB: Starting deletion of derivative data. [2025-10-28T18:55:08.723260] [DEBUG] [LOCAL ] GBAB: Deleted derivative data file. [2025-10-28T18:55:08.723343] [INFO ] [MAIN ] Update Progress: 894/2366 symbols completed. GBAB took 5.6s. Estimated remaining: 3h 9m 31s. Rate: 7.8 symbols/min [2025-10-28T18:55:08.891119] [INFO ] [MAIN ] GBLI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:55:08.891301] [DEBUG] [LOCAL ] GBLI: No existing data file found in primary storage. [2025-10-28T18:55:08.891339] [WARN ] [MAIN ] GBLI: No existing data found, performing full refresh instead. [2025-10-28T18:55:08.891442] [INFO ] [MAIN ] GBLI: Wiping existing primary data before full refresh. [2025-10-28T18:55:08.891482] [INFO ] [LOCAL ] GBLI: Starting deletion of primary data. [2025-10-28T18:55:08.891522] [DEBUG] [LOCAL ] GBLI: No primary data file found to delete. [2025-10-28T18:55:08.891553] [INFO ] [MAIN ] GBLI: Starting full primary refresh. [2025-10-28T18:55:09.251476] [INFO ] [REMOTE ] GBLI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:55:09.297485] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-28T18:55:09.361144] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-04. [2025-10-28T18:55:10.132386] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-28T18:55:10.161151] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-01. [2025-10-28T18:55:10.961168] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-05. [2025-10-28T18:55:11.204151] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-28T18:55:11.761144] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-02. [2025-10-28T18:55:12.277937] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-28T18:55:12.561114] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-06. [2025-10-28T18:55:12.711289] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-28T18:55:13.361132] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-01. [2025-10-28T18:55:13.661049] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-01 (0.30 seconds). [2025-10-28T18:55:13.855059] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-28T18:55:14.161102] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-07. [2025-10-28T18:55:14.961159] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-03. [2025-10-28T18:55:15.761176] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-05. [2025-10-28T18:55:15.837739] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-28T18:55:16.125481] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-28T18:55:16.561174] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-02. [2025-10-28T18:55:16.760018] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-28T18:55:16.991579] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-28T18:55:17.361096] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-03. [2025-10-28T18:55:17.620707] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-03 (0.26 seconds). [2025-10-28T18:55:18.161135] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-06. [2025-10-28T18:55:18.872041] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-28T18:55:18.961157] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-04. [2025-10-28T18:55:19.254346] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-04 (0.29 seconds). [2025-10-28T18:55:19.761192] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-05. [2025-10-28T18:55:20.110205] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-10-28T18:55:20.561181] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-08. [2025-10-28T18:55:21.361142] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-07. [2025-10-28T18:55:22.161127] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-06. [2025-10-28T18:55:22.492727] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-28T18:55:22.961165] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-04. [2025-10-28T18:55:23.761170] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-08. [2025-10-28T18:55:24.010007] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-28T18:55:24.445494] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-28T18:55:24.561206] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-05. [2025-10-28T18:55:25.361151] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-09. [2025-10-28T18:55:25.552688] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-08 (4.99 seconds). [2025-10-28T18:55:25.566456] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-06 (3.41 seconds). [2025-10-28T18:55:26.132586] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-28T18:55:26.161121] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-07. [2025-10-28T18:55:26.366925] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-07 (0.21 seconds). [2025-10-28T18:55:26.961153] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-09. [2025-10-28T18:55:27.096401] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-05 (2.54 seconds). [2025-10-28T18:55:27.761114] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-10. [2025-10-28T18:55:28.371936] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-28T18:55:28.561131] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-10. [2025-10-28T18:55:28.962420] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-28T18:55:28.965993] [INFO ] [REMOTE ] GATX: Full fetch complete (25157 records). [2025-10-28T18:55:28.966066] [DEBUG] [VALIDATOR ] GATX: Validating primary data. [2025-10-28T18:55:29.331976] [DEBUG] [VALIDATOR ] GATX: All expected trading days are present. [2025-10-28T18:55:29.332049] [DEBUG] [VALIDATOR ] GATX: Primary data validation passed. [2025-10-28T18:55:29.332549] [INFO ] [MAIN ] GATX: Fetched primary data is valid. [2025-10-28T18:55:29.332589] [DEBUG] [LOCAL ] GATX: Saving primary data. [2025-10-28T18:55:29.333194] [DEBUG] [LOCAL ] GATX: Trimmed 25157 records to 17729 (keeping 200 days of data) [2025-10-28T18:55:29.380008] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-08. [2025-10-28T18:55:29.445587] [DEBUG] [LOCAL ] GATX: Primary data saved (17729 records). [2025-10-28T18:55:29.445761] [INFO ] [MAIN ] GATX: Full history saved. [2025-10-28T18:55:29.445849] [INFO ] [MAIN ] Update Progress: 895/2366 symbols completed. GATX took 31.6s. Estimated remaining: 3h 9m 44s. Rate: 7.8 symbols/min [2025-10-28T18:55:29.621133] [INFO ] [MAIN ] GBTG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:55:29.656057] [DEBUG] [LOCAL ] GBTG: Loaded 39966 existing records from primary storage. [2025-10-28T18:55:29.656340] [INFO ] [MAIN ] GBTG: Loaded 39966 existing records. [2025-10-28T18:55:29.815702] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-10-28T18:55:29.845015] [WARN ] [MAIN ] GBTG: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:55:29.845199] [INFO ] [MAIN ] GBTG: Wiping existing primary data before full refresh. [2025-10-28T18:55:29.845266] [INFO ] [LOCAL ] GBTG: Starting deletion of primary data. [2025-10-28T18:55:29.845613] [DEBUG] [LOCAL ] GBTG: Deleted primary data file. [2025-10-28T18:55:29.845698] [INFO ] [MAIN ] GBTG: Starting full primary refresh. [2025-10-28T18:55:30.166014] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-09. [2025-10-28T18:55:30.206677] [INFO ] [REMOTE ] GBTG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:55:30.239440] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-28T18:55:30.250321] [INFO ] [REMOTE ] GAP: Full fetch complete (77815 records). [2025-10-28T18:55:30.250446] [DEBUG] [VALIDATOR ] GAP: Validating primary data. [2025-10-28T18:55:30.504254] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-10-28T18:55:30.664050] [DEBUG] [VALIDATOR ] GAP: All expected trading days are present. [2025-10-28T18:55:30.664152] [DEBUG] [VALIDATOR ] GAP: Primary data validation passed. [2025-10-28T18:55:30.665165] [INFO ] [MAIN ] GAP: Fetched primary data is valid. [2025-10-28T18:55:30.665226] [DEBUG] [LOCAL ] GAP: Saving primary data. [2025-10-28T18:55:30.666636] [DEBUG] [LOCAL ] GAP: Trimmed 77815 records to 53653 (keeping 200 days of data) [2025-10-28T18:55:30.967302] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-06. [2025-10-28T18:55:30.991359] [DEBUG] [LOCAL ] GAP: Primary data saved (53653 records). [2025-10-28T18:55:30.991624] [INFO ] [MAIN ] GAP: Full history saved. [2025-10-28T18:55:30.991765] [INFO ] [MAIN ] Update Progress: 896/2366 symbols completed. GAP took 39.3s. Estimated remaining: 3h 9m 26s. Rate: 7.8 symbols/min [2025-10-28T18:55:31.168707] [INFO ] [MAIN ] GBX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:55:31.195022] [DEBUG] [LOCAL ] GBX: Loaded 27618 existing records from primary storage. [2025-10-28T18:55:31.195279] [INFO ] [MAIN ] GBX: Loaded 27618 existing records. [2025-10-28T18:55:31.376817] [WARN ] [MAIN ] GBX: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:55:31.377047] [INFO ] [MAIN ] GBX: Wiping existing primary data before full refresh. [2025-10-28T18:55:31.377094] [INFO ] [LOCAL ] GBX: Starting deletion of primary data. [2025-10-28T18:55:31.377329] [DEBUG] [LOCAL ] GBX: Deleted primary data file. [2025-10-28T18:55:31.377370] [INFO ] [MAIN ] GBX: Starting full primary refresh. [2025-10-28T18:55:31.749260] [INFO ] [REMOTE ] GBX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:55:31.761099] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-01. [2025-10-28T18:55:32.561139] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-10. [2025-10-28T18:55:32.777150] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-28T18:55:32.895945] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-10 (0.33 seconds). [2025-10-28T18:55:32.896985] [INFO ] [REMOTE ] GBLI: Full fetch complete (1276 records). [2025-10-28T18:55:32.897161] [DEBUG] [VALIDATOR ] GBLI: Validating primary data. [2025-10-28T18:55:33.099130] [WARN ] [VALIDATOR ] GBLI: Validation failed - insufficient historical data. Have 172 unique days, need 200 days [2025-10-28T18:55:33.099363] [FATAL] [MAIN ] GBLI: Fetched primary data is invalid. Refusing to save it. [2025-10-28T18:55:33.099459] [WARN ] [MAIN ] GBLI: Deleting existing primary and derivative data due to validation failure. [2025-10-28T18:55:33.099561] [INFO ] [LOCAL ] GBLI: Starting deletion of primary data. [2025-10-28T18:55:33.099680] [DEBUG] [LOCAL ] GBLI: No primary data file found to delete. [2025-10-28T18:55:33.099757] [INFO ] [LOCAL ] GBLI: Starting deletion of derivative data. [2025-10-28T18:55:33.099826] [DEBUG] [LOCAL ] GBLI: No derivative data file found to delete. [2025-10-28T18:55:33.099909] [INFO ] [MAIN ] Update Progress: 897/2366 symbols completed. GBLI took 24.4s. Estimated remaining: 3h 9m 9s. Rate: 7.8 symbols/min [2025-10-28T18:55:33.296751] [INFO ] [MAIN ] GCI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:55:33.341065] [DEBUG] [LOCAL ] GCI: Loaded 43427 existing records from primary storage. [2025-10-28T18:55:33.341491] [INFO ] [MAIN ] GCI: Loaded 43427 existing records. [2025-10-28T18:55:33.366329] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-02. [2025-10-28T18:55:33.539937] [WARN ] [MAIN ] GCI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:55:33.540211] [INFO ] [MAIN ] GCI: Wiping existing primary data before full refresh. [2025-10-28T18:55:33.540267] [INFO ] [LOCAL ] GCI: Starting deletion of primary data. [2025-10-28T18:55:33.540478] [DEBUG] [LOCAL ] GCI: Deleted primary data file. [2025-10-28T18:55:33.540535] [INFO ] [MAIN ] GCI: Starting full primary refresh. [2025-10-28T18:55:33.876894] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-06 (2.91 seconds). [2025-10-28T18:55:33.924388] [INFO ] [REMOTE ] GCI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:55:34.161123] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-07. [2025-10-28T18:55:34.322939] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-28T18:55:34.961147] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-01. [2025-10-28T18:55:35.421434] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-28T18:55:35.761143] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-01. [2025-10-28T18:55:35.933026] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-28T18:55:36.561147] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-02. [2025-10-28T18:55:36.900536] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-28T18:55:37.361133] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-02. [2025-10-28T18:55:37.503108] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-28T18:55:38.161105] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-08. [2025-10-28T18:55:38.961185] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-03. [2025-10-28T18:55:39.722761] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-02 (2.36 seconds). [2025-10-28T18:55:39.761105] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-03. [2025-10-28T18:55:39.993449] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-28T18:55:40.368723] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-08 (2.21 seconds). [2025-10-28T18:55:40.561153] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-09. [2025-10-28T18:55:40.807090] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-28T18:55:41.361214] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-04. [2025-10-28T18:55:41.621941] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-28T18:55:42.161168] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-10. [2025-10-28T18:55:42.961184] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-03. [2025-10-28T18:55:43.409394] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-28T18:55:43.418854] [INFO ] [REMOTE ] GBCI: Full fetch complete (59501 records). [2025-10-28T18:55:43.419014] [DEBUG] [VALIDATOR ] GBCI: Validating primary data. [2025-10-28T18:55:43.774685] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-04. [2025-10-28T18:55:43.833365] [DEBUG] [VALIDATOR ] GBCI: All expected trading days are present. [2025-10-28T18:55:43.833515] [DEBUG] [VALIDATOR ] GBCI: Primary data validation passed. [2025-10-28T18:55:43.834475] [INFO ] [MAIN ] GBCI: Fetched primary data is valid. [2025-10-28T18:55:43.834728] [DEBUG] [LOCAL ] GBCI: Saving primary data. [2025-10-28T18:55:43.842318] [DEBUG] [LOCAL ] GBCI: Trimmed 59501 records to 41010 (keeping 200 days of data) [2025-10-28T18:55:43.855554] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-28T18:55:43.993848] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-04 (2.63 seconds). [2025-10-28T18:55:44.147418] [DEBUG] [LOCAL ] GBCI: Primary data saved (41010 records). [2025-10-28T18:55:44.147539] [INFO ] [MAIN ] GBCI: Full history saved. [2025-10-28T18:55:44.147615] [INFO ] [MAIN ] Update Progress: 898/2366 symbols completed. GBCI took 39.0s. Estimated remaining: 3h 9m 7s. Rate: 7.8 symbols/min [2025-10-28T18:55:44.324155] [INFO ] [MAIN ] GCO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:55:44.345679] [DEBUG] [LOCAL ] GCO: Loaded 22201 existing records from primary storage. [2025-10-28T18:55:44.345940] [INFO ] [MAIN ] GCO: Loaded 22201 existing records. [2025-10-28T18:55:44.535323] [WARN ] [MAIN ] GCO: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:55:44.535523] [INFO ] [MAIN ] GCO: Wiping existing primary data before full refresh. [2025-10-28T18:55:44.535571] [INFO ] [LOCAL ] GCO: Starting deletion of primary data. [2025-10-28T18:55:44.535818] [DEBUG] [LOCAL ] GCO: Deleted primary data file. [2025-10-28T18:55:44.535879] [INFO ] [MAIN ] GCO: Starting full primary refresh. [2025-10-28T18:55:44.568761] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-04. [2025-10-28T18:55:44.898177] [INFO ] [REMOTE ] GCO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:55:45.361160] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-01. [2025-10-28T18:55:45.796371] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-28T18:55:46.161122] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-05. [2025-10-28T18:55:46.294865] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-04 (2.52 seconds). [2025-10-28T18:55:46.794118] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-28T18:55:46.961227] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-05. [2025-10-28T18:55:47.252242] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-28T18:55:47.761101] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-06. [2025-10-28T18:55:47.844013] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-28T18:55:48.561166] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-02. [2025-10-28T18:55:48.711961] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-28T18:55:49.286091] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-28T18:55:49.361134] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-03. [2025-10-28T18:55:50.161162] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-05. [2025-10-28T18:55:50.417758] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-28T18:55:50.945634] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-28T18:55:50.961114] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-06. [2025-10-28T18:55:51.761103] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-06. [2025-10-28T18:55:51.776461] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-28T18:55:52.561145] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-07. [2025-10-28T18:55:52.746358] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-28T18:55:53.361189] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-07. [2025-10-28T18:55:53.718412] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-28T18:55:54.161093] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-08. [2025-10-28T18:55:54.357440] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-28T18:55:54.961104] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-08. [2025-10-28T18:55:55.679488] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-28T18:55:55.761100] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-09. [2025-10-28T18:55:56.567475] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-07. [2025-10-28T18:55:56.569637] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-28T18:55:57.361143] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-10. [2025-10-28T18:55:57.457731] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-08 (3.30 seconds). [2025-10-28T18:55:58.161118] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-09. [2025-10-28T18:55:58.212826] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-28T18:55:58.218485] [INFO ] [REMOTE ] GBX: Full fetch complete (42470 records). [2025-10-28T18:55:58.218600] [DEBUG] [VALIDATOR ] GBX: Validating primary data. [2025-10-28T18:55:58.603663] [DEBUG] [VALIDATOR ] GBX: All expected trading days are present. [2025-10-28T18:55:58.603754] [DEBUG] [VALIDATOR ] GBX: Primary data validation passed. [2025-10-28T18:55:58.604433] [INFO ] [MAIN ] GBX: Fetched primary data is valid. [2025-10-28T18:55:58.604473] [DEBUG] [LOCAL ] GBX: Saving primary data. [2025-10-28T18:55:58.605422] [DEBUG] [LOCAL ] GBX: Trimmed 42470 records to 27555 (keeping 200 days of data) [2025-10-28T18:55:58.766864] [DEBUG] [LOCAL ] GBX: Primary data saved (27555 records). [2025-10-28T18:55:58.767004] [INFO ] [MAIN ] GBX: Full history saved. [2025-10-28T18:55:58.767084] [INFO ] [MAIN ] Update Progress: 899/2366 symbols completed. GBX took 27.8s. Estimated remaining: 3h 9m 11s. Rate: 7.8 symbols/min [2025-10-28T18:55:58.950163] [INFO ] [MAIN ] GCTS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:55:58.961123] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-04. [2025-10-28T18:55:58.970879] [DEBUG] [LOCAL ] GCTS: Loaded 20201 existing records from primary storage. [2025-10-28T18:55:58.971557] [INFO ] [MAIN ] GCTS: Loaded 20201 existing records. [2025-10-28T18:55:59.163539] [WARN ] [MAIN ] GCTS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:55:59.164072] [INFO ] [MAIN ] GCTS: Wiping existing primary data before full refresh. [2025-10-28T18:55:59.164302] [INFO ] [LOCAL ] GCTS: Starting deletion of primary data. [2025-10-28T18:55:59.164876] [DEBUG] [LOCAL ] GCTS: Deleted primary data file. [2025-10-28T18:55:59.165034] [INFO ] [MAIN ] GCTS: Starting full primary refresh. [2025-10-28T18:55:59.369376] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-28T18:55:59.561076] [INFO ] [REMOTE ] GCTS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:55:59.761097] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-01. [2025-10-28T18:55:59.949371] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-28T18:56:00.336843] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-07 (3.77 seconds). [2025-10-28T18:56:00.561094] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-05. [2025-10-28T18:56:00.705938] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-28T18:56:01.361252] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-08. [2025-10-28T18:56:02.039500] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-28T18:56:02.161201] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-06. [2025-10-28T18:56:02.545455] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-28T18:56:02.961097] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-09. [2025-10-28T18:56:03.711019] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-28T18:56:03.761098] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-10. [2025-10-28T18:56:04.018543] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-28T18:56:04.561144] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-07. [2025-10-28T18:56:04.865839] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-28T18:56:04.874469] [INFO ] [REMOTE ] GCI: Full fetch complete (63268 records). [2025-10-28T18:56:04.874583] [DEBUG] [VALIDATOR ] GCI: Validating primary data. [2025-10-28T18:56:05.254936] [DEBUG] [VALIDATOR ] GCI: All expected trading days are present. [2025-10-28T18:56:05.255013] [DEBUG] [VALIDATOR ] GCI: Primary data validation passed. [2025-10-28T18:56:05.255880] [INFO ] [MAIN ] GCI: Fetched primary data is valid. [2025-10-28T18:56:05.255942] [DEBUG] [LOCAL ] GCI: Saving primary data. [2025-10-28T18:56:05.257318] [DEBUG] [LOCAL ] GCI: Trimmed 63268 records to 43464 (keeping 200 days of data) [2025-10-28T18:56:05.362955] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-10. [2025-10-28T18:56:05.497786] [DEBUG] [LOCAL ] GCI: Primary data saved (43464 records). [2025-10-28T18:56:05.497900] [INFO ] [MAIN ] GCI: Full history saved. [2025-10-28T18:56:05.498603] [INFO ] [MAIN ] Update Progress: 900/2366 symbols completed. GCI took 32.4s. Estimated remaining: 3h 9m 1s. Rate: 7.8 symbols/min [2025-10-28T18:56:05.671179] [INFO ] [MAIN ] GCV: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:56:05.681597] [DEBUG] [LOCAL ] GCV: Loaded 7919 existing records from primary storage. [2025-10-28T18:56:05.681881] [INFO ] [MAIN ] GCV: Loaded 7919 existing records. [2025-10-28T18:56:05.855774] [WARN ] [MAIN ] GCV: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:56:05.856052] [INFO ] [MAIN ] GCV: Wiping existing primary data before full refresh. [2025-10-28T18:56:05.856105] [INFO ] [LOCAL ] GCV: Starting deletion of primary data. [2025-10-28T18:56:05.856262] [DEBUG] [LOCAL ] GCV: Deleted primary data file. [2025-10-28T18:56:05.856329] [INFO ] [MAIN ] GCV: Starting full primary refresh. [2025-10-28T18:56:06.139388] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-28T18:56:06.166219] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-08. [2025-10-28T18:56:06.233527] [INFO ] [REMOTE ] GCV: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:56:06.537368] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-10 (1.17 seconds). [2025-10-28T18:56:06.545254] [INFO ] [REMOTE ] GBTG: Full fetch complete (56838 records). [2025-10-28T18:56:06.545356] [DEBUG] [VALIDATOR ] GBTG: Validating primary data. [2025-10-28T18:56:06.921273] [DEBUG] [VALIDATOR ] GBTG: All expected trading days are present. [2025-10-28T18:56:06.921349] [DEBUG] [VALIDATOR ] GBTG: Primary data validation passed. [2025-10-28T18:56:06.922127] [INFO ] [MAIN ] GBTG: Fetched primary data is valid. [2025-10-28T18:56:06.922188] [DEBUG] [LOCAL ] GBTG: Saving primary data. [2025-10-28T18:56:06.923261] [DEBUG] [LOCAL ] GBTG: Trimmed 56838 records to 39877 (keeping 200 days of data) [2025-10-28T18:56:06.965697] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-02. [2025-10-28T18:56:07.142727] [DEBUG] [LOCAL ] GBTG: Primary data saved (39877 records). [2025-10-28T18:56:07.142857] [INFO ] [MAIN ] GBTG: Full history saved. [2025-10-28T18:56:07.142931] [INFO ] [MAIN ] Update Progress: 901/2366 symbols completed. GBTG took 37.7s. Estimated remaining: 3h 8m 44s. Rate: 7.8 symbols/min [2025-10-28T18:56:07.311176] [INFO ] [MAIN ] GD: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:56:07.351614] [DEBUG] [LOCAL ] GD: Loaded 46417 existing records from primary storage. [2025-10-28T18:56:07.351940] [INFO ] [MAIN ] GD: Loaded 46417 existing records. [2025-10-28T18:56:07.528117] [WARN ] [MAIN ] GD: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:56:07.528304] [INFO ] [MAIN ] GD: Wiping existing primary data before full refresh. [2025-10-28T18:56:07.528349] [INFO ] [LOCAL ] GD: Starting deletion of primary data. [2025-10-28T18:56:07.528697] [DEBUG] [LOCAL ] GD: Deleted primary data file. [2025-10-28T18:56:07.528755] [INFO ] [MAIN ] GD: Starting full primary refresh. [2025-10-28T18:56:07.684547] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-28T18:56:07.767284] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-01. [2025-10-28T18:56:07.902509] [INFO ] [REMOTE ] GD: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:56:08.072305] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-28T18:56:08.233178] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-10-28T18:56:08.561157] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-09. [2025-10-28T18:56:09.299266] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-28T18:56:09.361156] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-01. [2025-10-28T18:56:10.161132] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-02. [2025-10-28T18:56:10.728394] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-28T18:56:10.961135] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-10. [2025-10-28T18:56:11.684368] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-28T18:56:11.690254] [INFO ] [REMOTE ] GCO: Full fetch complete (34407 records). [2025-10-28T18:56:11.690419] [DEBUG] [VALIDATOR ] GCO: Validating primary data. [2025-10-28T18:56:11.767440] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-03. [2025-10-28T18:56:12.165120] [DEBUG] [VALIDATOR ] GCO: All expected trading days are present. [2025-10-28T18:56:12.165219] [DEBUG] [VALIDATOR ] GCO: Primary data validation passed. [2025-10-28T18:56:12.166031] [INFO ] [MAIN ] GCO: Fetched primary data is valid. [2025-10-28T18:56:12.166098] [DEBUG] [LOCAL ] GCO: Saving primary data. [2025-10-28T18:56:12.167155] [DEBUG] [LOCAL ] GCO: Trimmed 34407 records to 21977 (keeping 200 days of data) [2025-10-28T18:56:12.298819] [DEBUG] [LOCAL ] GCO: Primary data saved (21977 records). [2025-10-28T18:56:12.298956] [INFO ] [MAIN ] GCO: Full history saved. [2025-10-28T18:56:12.299041] [INFO ] [MAIN ] Update Progress: 902/2366 symbols completed. GCO took 28.2s. Estimated remaining: 3h 8m 32s. Rate: 7.8 symbols/min [2025-10-28T18:56:12.432065] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-28T18:56:12.491731] [INFO ] [MAIN ] GDDY: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:56:12.537294] [DEBUG] [LOCAL ] GDDY: Loaded 49453 existing records from primary storage. [2025-10-28T18:56:12.537611] [INFO ] [MAIN ] GDDY: Loaded 49453 existing records. [2025-10-28T18:56:12.569453] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-03. [2025-10-28T18:56:12.725378] [WARN ] [MAIN ] GDDY: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:56:12.725618] [INFO ] [MAIN ] GDDY: Wiping existing primary data before full refresh. [2025-10-28T18:56:12.725707] [INFO ] [LOCAL ] GDDY: Starting deletion of primary data. [2025-10-28T18:56:12.726035] [DEBUG] [LOCAL ] GDDY: Deleted primary data file. [2025-10-28T18:56:12.726094] [INFO ] [MAIN ] GDDY: Starting full primary refresh. [2025-10-28T18:56:13.082859] [INFO ] [REMOTE ] GDDY: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:56:13.361153] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-01. [2025-10-28T18:56:14.146082] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-01 (4.78 seconds). [2025-10-28T18:56:14.161097] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-02. [2025-10-28T18:56:14.332903] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-10-28T18:56:14.558840] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-28T18:56:14.961140] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-04. [2025-10-28T18:56:15.299557] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-28T18:56:15.761161] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-02. [2025-10-28T18:56:16.219371] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-28T18:56:16.561137] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-05. [2025-10-28T18:56:17.361159] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-04. [2025-10-28T18:56:17.858088] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-28T18:56:17.887179] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-28T18:56:18.161150] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-06. [2025-10-28T18:56:18.496301] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-02 (2.74 seconds). [2025-10-28T18:56:18.961219] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-03. [2025-10-28T18:56:19.219209] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-28T18:56:19.761213] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-03. [2025-10-28T18:56:20.561156] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-07. [2025-10-28T18:56:21.105627] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-28T18:56:21.331404] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-28T18:56:21.361134] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-04. [2025-10-28T18:56:22.161154] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-05. [2025-10-28T18:56:22.307805] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-03 (3.35 seconds). [2025-10-28T18:56:22.597838] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-10-28T18:56:22.961176] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-06. [2025-10-28T18:56:23.379207] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-28T18:56:23.761126] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-04. [2025-10-28T18:56:24.561172] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-08. [2025-10-28T18:56:24.804701] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-04 (3.44 seconds). [2025-10-28T18:56:25.147967] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-28T18:56:25.361183] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-05. [2025-10-28T18:56:26.000010] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-28T18:56:26.161176] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-07. [2025-10-28T18:56:26.559797] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-28T18:56:26.703117] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-28T18:56:26.961115] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-05. [2025-10-28T18:56:27.761192] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-08. [2025-10-28T18:56:28.242586] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-28T18:56:28.241125] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-28T18:56:28.561147] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-09. [2025-10-28T18:56:29.361177] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-06. [2025-10-28T18:56:29.863816] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-28T18:56:30.161176] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-09. [2025-10-28T18:56:30.441496] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-28T18:56:30.714718] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-28T18:56:30.961128] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-07. [2025-10-28T18:56:31.761178] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-10. [2025-10-28T18:56:32.218757] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-28T18:56:32.561175] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-08. [2025-10-28T18:56:32.968018] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-28T18:56:32.971909] [INFO ] [REMOTE ] GCTS: Full fetch complete (26632 records). [2025-10-28T18:56:32.972011] [DEBUG] [VALIDATOR ] GCTS: Validating primary data. [2025-10-28T18:56:33.350444] [DEBUG] [VALIDATOR ] GCTS: All expected trading days are present. [2025-10-28T18:56:33.350516] [DEBUG] [VALIDATOR ] GCTS: Primary data validation passed. [2025-10-28T18:56:33.351048] [INFO ] [MAIN ] GCTS: Fetched primary data is valid. [2025-10-28T18:56:33.351107] [DEBUG] [LOCAL ] GCTS: Saving primary data. [2025-10-28T18:56:33.351759] [DEBUG] [LOCAL ] GCTS: Trimmed 26632 records to 20155 (keeping 200 days of data) [2025-10-28T18:56:33.394507] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-06. [2025-10-28T18:56:33.464698] [DEBUG] [LOCAL ] GCTS: Primary data saved (20155 records). [2025-10-28T18:56:33.464831] [INFO ] [MAIN ] GCTS: Full history saved. [2025-10-28T18:56:33.464910] [INFO ] [MAIN ] Update Progress: 903/2366 symbols completed. GCTS took 34.7s. Estimated remaining: 3h 8m 46s. Rate: 7.8 symbols/min [2025-10-28T18:56:33.642406] [INFO ] [MAIN ] GDIV: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:56:33.648165] [DEBUG] [LOCAL ] GDIV: Loaded 3405 existing records from primary storage. [2025-10-28T18:56:33.648315] [INFO ] [MAIN ] GDIV: Loaded 3405 existing records. [2025-10-28T18:56:33.830684] [WARN ] [MAIN ] GDIV: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:56:33.830907] [INFO ] [MAIN ] GDIV: Wiping existing primary data before full refresh. [2025-10-28T18:56:33.830955] [INFO ] [LOCAL ] GDIV: Starting deletion of primary data. [2025-10-28T18:56:33.831087] [DEBUG] [LOCAL ] GDIV: Deleted primary data file. [2025-10-28T18:56:33.831126] [INFO ] [MAIN ] GDIV: Starting full primary refresh. [2025-10-28T18:56:34.166285] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-10. [2025-10-28T18:56:34.207073] [INFO ] [REMOTE ] GDIV: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:56:34.810716] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-10-28T18:56:34.871617] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-28T18:56:34.874418] [INFO ] [REMOTE ] GCV: Full fetch complete (10243 records). [2025-10-28T18:56:34.874489] [DEBUG] [VALIDATOR ] GCV: Validating primary data. [2025-10-28T18:56:34.964015] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-07. [2025-10-28T18:56:35.238335] [DEBUG] [VALIDATOR ] GCV: All expected trading days are present. [2025-10-28T18:56:35.238434] [DEBUG] [VALIDATOR ] GCV: Primary data validation passed. [2025-10-28T18:56:35.238708] [INFO ] [MAIN ] GCV: Fetched primary data is valid. [2025-10-28T18:56:35.238767] [DEBUG] [LOCAL ] GCV: Saving primary data. [2025-10-28T18:56:35.239192] [DEBUG] [LOCAL ] GCV: Trimmed 10243 records to 7933 (keeping 200 days of data) [2025-10-28T18:56:35.285217] [DEBUG] [LOCAL ] GCV: Primary data saved (7933 records). [2025-10-28T18:56:35.285392] [INFO ] [MAIN ] GCV: Full history saved. [2025-10-28T18:56:35.285477] [INFO ] [MAIN ] Update Progress: 904/2366 symbols completed. GCV took 29.8s. Estimated remaining: 3h 8m 28s. Rate: 7.8 symbols/min [2025-10-28T18:56:35.450087] [INFO ] [MAIN ] GDL: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:56:35.455004] [DEBUG] [LOCAL ] GDL: Loaded 2495 existing records from primary storage. [2025-10-28T18:56:35.455163] [INFO ] [MAIN ] GDL: Loaded 2495 existing records. [2025-10-28T18:56:35.629542] [WARN ] [MAIN ] GDL: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:56:35.629771] [INFO ] [MAIN ] GDL: Wiping existing primary data before full refresh. [2025-10-28T18:56:35.629820] [INFO ] [LOCAL ] GDL: Starting deletion of primary data. [2025-10-28T18:56:35.629992] [DEBUG] [LOCAL ] GDL: Deleted primary data file. [2025-10-28T18:56:35.630048] [INFO ] [MAIN ] GDL: Starting full primary refresh. [2025-10-28T18:56:35.767898] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-01. [2025-10-28T18:56:35.944732] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-08 (3.38 seconds). [2025-10-28T18:56:36.032051] [INFO ] [REMOTE ] GDL: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:56:36.230170] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-28T18:56:36.403293] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-28T18:56:36.561142] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-09. [2025-10-28T18:56:37.361144] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-02. [2025-10-28T18:56:37.844988] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-28T18:56:38.161103] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-03. [2025-10-28T18:56:38.516772] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-10-28T18:56:38.919731] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-09 (2.36 seconds). [2025-10-28T18:56:38.961105] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-01. [2025-10-28T18:56:39.417360] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-28T18:56:39.761172] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-04. [2025-10-28T18:56:40.156898] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-10-28T18:56:40.561130] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-05. [2025-10-28T18:56:41.114471] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-10-28T18:56:41.361137] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-08. [2025-10-28T18:56:42.161130] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-02. [2025-10-28T18:56:42.431983] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-02 (0.27 seconds). [2025-10-28T18:56:42.546342] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-28T18:56:42.961140] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-10. [2025-10-28T18:56:43.761185] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-06. [2025-10-28T18:56:44.108430] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-28T18:56:44.362478] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-28T18:56:44.373249] [INFO ] [REMOTE ] GDDY: Full fetch complete (72039 records). [2025-10-28T18:56:44.373440] [DEBUG] [VALIDATOR ] GDDY: Validating primary data. [2025-10-28T18:56:44.566443] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-07. [2025-10-28T18:56:44.759716] [DEBUG] [VALIDATOR ] GDDY: All expected trading days are present. [2025-10-28T18:56:44.759813] [DEBUG] [VALIDATOR ] GDDY: Primary data validation passed. [2025-10-28T18:56:44.760782] [INFO ] [MAIN ] GDDY: Fetched primary data is valid. [2025-10-28T18:56:44.760845] [DEBUG] [LOCAL ] GDDY: Saving primary data. [2025-10-28T18:56:44.762241] [DEBUG] [LOCAL ] GDDY: Trimmed 72039 records to 49387 (keeping 200 days of data) [2025-10-28T18:56:45.043969] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-28T18:56:45.063934] [DEBUG] [LOCAL ] GDDY: Primary data saved (49387 records). [2025-10-28T18:56:45.064110] [INFO ] [MAIN ] GDDY: Full history saved. [2025-10-28T18:56:45.064204] [INFO ] [MAIN ] Update Progress: 905/2366 symbols completed. GDDY took 32.8s. Estimated remaining: 3h 8m 24s. Rate: 7.8 symbols/min [2025-10-28T18:56:45.234747] [INFO ] [MAIN ] GDO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:56:45.242455] [DEBUG] [LOCAL ] GDO: Loaded 5681 existing records from primary storage. [2025-10-28T18:56:45.242681] [INFO ] [MAIN ] GDO: Loaded 5681 existing records. [2025-10-28T18:56:45.366410] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-08. [2025-10-28T18:56:45.419190] [WARN ] [MAIN ] GDO: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:56:45.419743] [INFO ] [MAIN ] GDO: Wiping existing primary data before full refresh. [2025-10-28T18:56:45.419803] [INFO ] [LOCAL ] GDO: Starting deletion of primary data. [2025-10-28T18:56:45.420441] [DEBUG] [LOCAL ] GDO: Deleted primary data file. [2025-10-28T18:56:45.420500] [INFO ] [MAIN ] GDO: Starting full primary refresh. [2025-10-28T18:56:45.776989] [INFO ] [REMOTE ] GDO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:56:45.778303] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-10-28T18:56:46.161188] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-09. [2025-10-28T18:56:46.961140] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-03. [2025-10-28T18:56:47.248212] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-03 (0.29 seconds). [2025-10-28T18:56:47.391554] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-28T18:56:47.761133] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-10. [2025-10-28T18:56:48.561186] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-04. [2025-10-28T18:56:49.001781] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-28T18:56:49.269456] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-28T18:56:49.278670] [INFO ] [REMOTE ] GD: Full fetch complete (69585 records). [2025-10-28T18:56:49.278819] [DEBUG] [VALIDATOR ] GD: Validating primary data. [2025-10-28T18:56:49.366191] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-09. [2025-10-28T18:56:49.680401] [DEBUG] [VALIDATOR ] GD: All expected trading days are present. [2025-10-28T18:56:49.680479] [DEBUG] [VALIDATOR ] GD: Primary data validation passed. [2025-10-28T18:56:49.681423] [INFO ] [MAIN ] GD: Fetched primary data is valid. [2025-10-28T18:56:49.681503] [DEBUG] [LOCAL ] GD: Saving primary data. [2025-10-28T18:56:49.682892] [DEBUG] [LOCAL ] GD: Trimmed 69585 records to 46355 (keeping 200 days of data) [2025-10-28T18:56:49.776041] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-10-28T18:56:49.993949] [DEBUG] [LOCAL ] GD: Primary data saved (46355 records). [2025-10-28T18:56:49.994076] [INFO ] [MAIN ] GD: Full history saved. [2025-10-28T18:56:49.995008] [INFO ] [MAIN ] Update Progress: 906/2366 symbols completed. GD took 42.9s. Estimated remaining: 3h 8m 12s. Rate: 7.8 symbols/min [2025-10-28T18:56:50.183205] [INFO ] [MAIN ] GDOT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:56:50.179687] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-10. [2025-10-28T18:56:50.222096] [DEBUG] [LOCAL ] GDOT: Loaded 37431 existing records from primary storage. [2025-10-28T18:56:50.222378] [INFO ] [MAIN ] GDOT: Loaded 37431 existing records. [2025-10-28T18:56:50.406218] [WARN ] [MAIN ] GDOT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:56:50.406451] [INFO ] [MAIN ] GDOT: Wiping existing primary data before full refresh. [2025-10-28T18:56:50.406518] [INFO ] [LOCAL ] GDOT: Starting deletion of primary data. [2025-10-28T18:56:50.406884] [DEBUG] [LOCAL ] GDOT: Deleted primary data file. [2025-10-28T18:56:50.406941] [INFO ] [MAIN ] GDOT: Starting full primary refresh. [2025-10-28T18:56:50.767209] [INFO ] [REMOTE ] GDOT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:56:50.770527] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-10 (0.59 seconds). [2025-10-28T18:56:50.771614] [INFO ] [REMOTE ] GDIV: Full fetch complete (5397 records). [2025-10-28T18:56:50.771721] [DEBUG] [VALIDATOR ] GDIV: Validating primary data. [2025-10-28T18:56:50.966265] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-01. [2025-10-28T18:56:51.132784] [DEBUG] [VALIDATOR ] GDIV: All expected trading days are present. [2025-10-28T18:56:51.132860] [DEBUG] [VALIDATOR ] GDIV: Primary data validation passed. [2025-10-28T18:56:51.133026] [INFO ] [MAIN ] GDIV: Fetched primary data is valid. [2025-10-28T18:56:51.133064] [DEBUG] [LOCAL ] GDIV: Saving primary data. [2025-10-28T18:56:51.133421] [DEBUG] [LOCAL ] GDIV: Trimmed 5397 records to 3395 (keeping 200 days of data) [2025-10-28T18:56:51.153584] [DEBUG] [LOCAL ] GDIV: Primary data saved (3395 records). [2025-10-28T18:56:51.153685] [INFO ] [MAIN ] GDIV: Full history saved. [2025-10-28T18:56:51.153773] [INFO ] [MAIN ] Update Progress: 907/2366 symbols completed. GDIV took 17.7s. Estimated remaining: 3h 7m 53s. Rate: 7.8 symbols/min [2025-10-28T18:56:51.324457] [INFO ] [MAIN ] GDV: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:56:51.341905] [DEBUG] [LOCAL ] GDV: Loaded 18804 existing records from primary storage. [2025-10-28T18:56:51.342157] [INFO ] [MAIN ] GDV: Loaded 18804 existing records. [2025-10-28T18:56:51.522143] [WARN ] [MAIN ] GDV: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:56:51.522342] [INFO ] [MAIN ] GDV: Wiping existing primary data before full refresh. [2025-10-28T18:56:51.522389] [INFO ] [LOCAL ] GDV: Starting deletion of primary data. [2025-10-28T18:56:51.522964] [DEBUG] [LOCAL ] GDV: Deleted primary data file. [2025-10-28T18:56:51.523023] [INFO ] [MAIN ] GDV: Starting full primary refresh. [2025-10-28T18:56:51.766225] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-01. [2025-10-28T18:56:51.886443] [INFO ] [REMOTE ] GDV: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:56:52.211352] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-28T18:56:52.463512] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-28T18:56:52.561116] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-05. [2025-10-28T18:56:52.881768] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-10-28T18:56:53.361223] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-01. [2025-10-28T18:56:54.022222] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-28T18:56:54.161109] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-06. [2025-10-28T18:56:54.462246] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-06 (0.30 seconds). [2025-10-28T18:56:54.961187] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-07. [2025-10-28T18:56:55.260101] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-07 (0.30 seconds). [2025-10-28T18:56:55.761155] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-02. [2025-10-28T18:56:56.137084] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-10-28T18:56:56.561150] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-03. [2025-10-28T18:56:56.947913] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-10-28T18:56:57.361161] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-04. [2025-10-28T18:56:58.018813] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-28T18:56:58.161151] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-05. [2025-10-28T18:56:58.554487] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-10-28T18:56:58.961199] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-06. [2025-10-28T18:56:59.406158] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-28T18:56:59.761170] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-02. [2025-10-28T18:57:00.561111] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-07. [2025-10-28T18:57:01.042279] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-28T18:57:01.288003] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-28T18:57:01.361131] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-03. [2025-10-28T18:57:02.150626] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-28T18:57:02.161115] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-04. [2025-10-28T18:57:02.961109] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-08. [2025-10-28T18:57:03.277085] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-08 (0.32 seconds). [2025-10-28T18:57:03.603434] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-28T18:57:03.761131] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-09. [2025-10-28T18:57:04.105678] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-10-28T18:57:04.561198] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-05. [2025-10-28T18:57:05.283336] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-28T18:57:05.361157] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-06. [2025-10-28T18:57:06.062145] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-28T18:57:06.161127] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-08. [2025-10-28T18:57:06.495303] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-10-28T18:57:06.961156] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-07. [2025-10-28T18:57:07.761106] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-09. [2025-10-28T18:57:07.778378] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-10-28T18:57:08.367260] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-28T18:57:08.561151] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-10. [2025-10-28T18:57:08.955599] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-10 (0.39 seconds). [2025-10-28T18:57:08.956637] [INFO ] [REMOTE ] GDL: Full fetch complete (3445 records). [2025-10-28T18:57:08.956738] [DEBUG] [VALIDATOR ] GDL: Validating primary data. [2025-10-28T18:57:09.342897] [DEBUG] [VALIDATOR ] GDL: All expected trading days are present. [2025-10-28T18:57:09.342973] [DEBUG] [VALIDATOR ] GDL: Primary data validation passed. [2025-10-28T18:57:09.343092] [INFO ] [MAIN ] GDL: Fetched primary data is valid. [2025-10-28T18:57:09.343128] [DEBUG] [LOCAL ] GDL: Saving primary data. [2025-10-28T18:57:09.343458] [DEBUG] [LOCAL ] GDL: Trimmed 3445 records to 2505 (keeping 200 days of data) [2025-10-28T18:57:09.358472] [DEBUG] [LOCAL ] GDL: Primary data saved (2505 records). [2025-10-28T18:57:09.358543] [INFO ] [MAIN ] GDL: Full history saved. [2025-10-28T18:57:09.358611] [INFO ] [MAIN ] Update Progress: 908/2366 symbols completed. GDL took 34.1s. Estimated remaining: 3h 8m 2s. Rate: 7.8 symbols/min [2025-10-28T18:57:09.369522] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-02. [2025-10-28T18:57:09.535276] [INFO ] [MAIN ] GE: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:57:09.583792] [DEBUG] [LOCAL ] GE: Loaded 53689 existing records from primary storage. [2025-10-28T18:57:09.584119] [INFO ] [MAIN ] GE: Loaded 53689 existing records. [2025-10-28T18:57:09.764543] [WARN ] [MAIN ] GE: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:57:09.764797] [INFO ] [MAIN ] GE: Wiping existing primary data before full refresh. [2025-10-28T18:57:09.764855] [INFO ] [LOCAL ] GE: Starting deletion of primary data. [2025-10-28T18:57:09.765825] [DEBUG] [LOCAL ] GE: Deleted primary data file. [2025-10-28T18:57:09.765883] [INFO ] [MAIN ] GE: Starting full primary refresh. [2025-10-28T18:57:10.124555] [INFO ] [REMOTE ] GE: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:57:10.161085] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-01. [2025-10-28T18:57:10.240787] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-28T18:57:10.961138] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-08. [2025-10-28T18:57:11.632173] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-28T18:57:11.761137] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-09. [2025-10-28T18:57:12.561155] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-03. [2025-10-28T18:57:13.361144] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-10. [2025-10-28T18:57:13.706620] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-28T18:57:13.887154] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-01 (3.73 seconds). [2025-10-28T18:57:14.029887] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-28T18:57:14.031580] [INFO ] [REMOTE ] GDO: Full fetch complete (8380 records). [2025-10-28T18:57:14.031691] [DEBUG] [VALIDATOR ] GDO: Validating primary data. [2025-10-28T18:57:14.176146] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-02. [2025-10-28T18:57:14.404488] [DEBUG] [VALIDATOR ] GDO: All expected trading days are present. [2025-10-28T18:57:14.404558] [DEBUG] [VALIDATOR ] GDO: Primary data validation passed. [2025-10-28T18:57:14.404781] [INFO ] [MAIN ] GDO: Fetched primary data is valid. [2025-10-28T18:57:14.404840] [DEBUG] [LOCAL ] GDO: Saving primary data. [2025-10-28T18:57:14.405228] [DEBUG] [LOCAL ] GDO: Trimmed 8380 records to 5703 (keeping 200 days of data) [2025-10-28T18:57:14.443001] [DEBUG] [LOCAL ] GDO: Primary data saved (5703 records). [2025-10-28T18:57:14.443139] [INFO ] [MAIN ] GDO: Full history saved. [2025-10-28T18:57:14.443236] [INFO ] [MAIN ] Update Progress: 909/2366 symbols completed. GDO took 29.4s. Estimated remaining: 3h 7m 50s. Rate: 7.8 symbols/min [2025-10-28T18:57:14.613176] [INFO ] [MAIN ] GEF: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:57:14.631354] [DEBUG] [LOCAL ] GEF: Loaded 20495 existing records from primary storage. [2025-10-28T18:57:14.631577] [INFO ] [MAIN ] GEF: Loaded 20495 existing records. [2025-10-28T18:57:14.815009] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-09 (3.05 seconds). [2025-10-28T18:57:14.819670] [WARN ] [MAIN ] GEF: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:57:14.819880] [INFO ] [MAIN ] GEF: Wiping existing primary data before full refresh. [2025-10-28T18:57:14.819958] [INFO ] [LOCAL ] GEF: Starting deletion of primary data. [2025-10-28T18:57:14.824227] [DEBUG] [LOCAL ] GEF: Deleted primary data file. [2025-10-28T18:57:14.824289] [INFO ] [MAIN ] GEF: Starting full primary refresh. [2025-10-28T18:57:14.966213] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-04. [2025-10-28T18:57:15.198716] [INFO ] [REMOTE ] GEF: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:57:15.761168] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-10. [2025-10-28T18:57:16.130443] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-28T18:57:16.561128] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-01. [2025-10-28T18:57:16.808832] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-02 (2.63 seconds). [2025-10-28T18:57:16.860061] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-28T18:57:16.863825] [INFO ] [REMOTE ] GDV: Full fetch complete (28134 records). [2025-10-28T18:57:16.863900] [DEBUG] [VALIDATOR ] GDV: Validating primary data. [2025-10-28T18:57:17.227412] [DEBUG] [VALIDATOR ] GDV: All expected trading days are present. [2025-10-28T18:57:17.227500] [DEBUG] [VALIDATOR ] GDV: Primary data validation passed. [2025-10-28T18:57:17.228093] [INFO ] [MAIN ] GDV: Fetched primary data is valid. [2025-10-28T18:57:17.228156] [DEBUG] [LOCAL ] GDV: Saving primary data. [2025-10-28T18:57:17.229038] [DEBUG] [LOCAL ] GDV: Trimmed 28134 records to 18696 (keeping 200 days of data) [2025-10-28T18:57:17.339984] [DEBUG] [LOCAL ] GDV: Primary data saved (18696 records). [2025-10-28T18:57:17.340098] [INFO ] [MAIN ] GDV: Full history saved. [2025-10-28T18:57:17.340175] [INFO ] [MAIN ] Update Progress: 910/2366 symbols completed. GDV took 26.2s. Estimated remaining: 3h 7m 35s. Rate: 7.8 symbols/min [2025-10-28T18:57:17.370712] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-05. [2025-10-28T18:57:17.537616] [INFO ] [MAIN ] GEL: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:57:17.549550] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-28T18:57:17.580962] [DEBUG] [LOCAL ] GEL: Loaded 30690 existing records from primary storage. [2025-10-28T18:57:17.581211] [INFO ] [MAIN ] GEL: Loaded 30690 existing records. [2025-10-28T18:57:17.755452] [WARN ] [MAIN ] GEL: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:57:17.755686] [INFO ] [MAIN ] GEL: Wiping existing primary data before full refresh. [2025-10-28T18:57:17.755751] [INFO ] [LOCAL ] GEL: Starting deletion of primary data. [2025-10-28T18:57:17.756058] [DEBUG] [LOCAL ] GEL: Deleted primary data file. [2025-10-28T18:57:17.756114] [INFO ] [MAIN ] GEL: Starting full primary refresh. [2025-10-28T18:57:18.103596] [INFO ] [REMOTE ] GEL: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:57:18.161107] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-03. [2025-10-28T18:57:18.961192] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-02. [2025-10-28T18:57:19.743069] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-05 (2.37 seconds). [2025-10-28T18:57:19.761094] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-06. [2025-10-28T18:57:20.256631] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-28T18:57:20.561169] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-03. [2025-10-28T18:57:20.711720] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-28T18:57:21.271902] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-28T18:57:21.361135] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-04. [2025-10-28T18:57:22.082705] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-28T18:57:22.161097] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-05. [2025-10-28T18:57:22.564189] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-03 (4.40 seconds). [2025-10-28T18:57:22.759834] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-28T18:57:22.961173] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-07. [2025-10-28T18:57:23.761172] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-06. [2025-10-28T18:57:24.138617] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-28T18:57:24.561146] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-01. [2025-10-28T18:57:24.690547] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-28T18:57:25.361546] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-07. [2025-10-28T18:57:26.161164] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-04. [2025-10-28T18:57:26.489680] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-10-28T18:57:26.961183] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-08. [2025-10-28T18:57:26.996594] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-28T18:57:27.761170] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-08. [2025-10-28T18:57:28.194742] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-28T18:57:28.544524] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-28T18:57:28.561134] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-02. [2025-10-28T18:57:29.361118] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-09. [2025-10-28T18:57:30.161125] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-09. [2025-10-28T18:57:30.667328] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-28T18:57:30.926067] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-28T18:57:30.961088] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-10. [2025-10-28T18:57:31.381529] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-04 (5.22 seconds). [2025-10-28T18:57:31.756177] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-28T18:57:31.760776] [INFO ] [REMOTE ] GEF: Full fetch complete (29294 records). [2025-10-28T18:57:31.760855] [DEBUG] [VALIDATOR ] GEF: Validating primary data. [2025-10-28T18:57:31.772496] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-05. [2025-10-28T18:57:32.130115] [DEBUG] [VALIDATOR ] GEF: All expected trading days are present. [2025-10-28T18:57:32.130200] [DEBUG] [VALIDATOR ] GEF: Primary data validation passed. [2025-10-28T18:57:32.130802] [INFO ] [MAIN ] GEF: Fetched primary data is valid. [2025-10-28T18:57:32.130883] [DEBUG] [LOCAL ] GEF: Saving primary data. [2025-10-28T18:57:32.131558] [DEBUG] [LOCAL ] GEF: Trimmed 29294 records to 20496 (keeping 200 days of data) [2025-10-28T18:57:32.254108] [DEBUG] [LOCAL ] GEF: Primary data saved (20496 records). [2025-10-28T18:57:32.254223] [INFO ] [MAIN ] GEF: Full history saved. [2025-10-28T18:57:32.254295] [INFO ] [MAIN ] Update Progress: 911/2366 symbols completed. GEF took 17.8s. Estimated remaining: 3h 7m 39s. Rate: 7.8 symbols/min [2025-10-28T18:57:32.424826] [INFO ] [MAIN ] GENI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:57:32.473635] [DEBUG] [LOCAL ] GENI: Loaded 52863 existing records from primary storage. [2025-10-28T18:57:32.473961] [INFO ] [MAIN ] GENI: Loaded 52863 existing records. [2025-10-28T18:57:32.566285] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-10. [2025-10-28T18:57:32.652124] [WARN ] [MAIN ] GENI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:57:32.652301] [INFO ] [MAIN ] GENI: Wiping existing primary data before full refresh. [2025-10-28T18:57:32.652346] [INFO ] [LOCAL ] GENI: Starting deletion of primary data. [2025-10-28T18:57:32.652662] [DEBUG] [LOCAL ] GENI: Deleted primary data file. [2025-10-28T18:57:32.652721] [INFO ] [MAIN ] GENI: Starting full primary refresh. [2025-10-28T18:57:33.006560] [INFO ] [REMOTE ] GENI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:57:33.303069] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-02 (4.74 seconds). [2025-10-28T18:57:33.361085] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-03. [2025-10-28T18:57:33.699593] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-10-28T18:57:34.161120] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-01. [2025-10-28T18:57:34.542501] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-28T18:57:34.961108] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-04. [2025-10-28T18:57:35.220722] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-10 (2.65 seconds). [2025-10-28T18:57:35.228223] [INFO ] [REMOTE ] GDOT: Full fetch complete (53699 records). [2025-10-28T18:57:35.228385] [DEBUG] [VALIDATOR ] GDOT: Validating primary data. [2025-10-28T18:57:35.612350] [DEBUG] [VALIDATOR ] GDOT: All expected trading days are present. [2025-10-28T18:57:35.612432] [DEBUG] [VALIDATOR ] GDOT: Primary data validation passed. [2025-10-28T18:57:35.613174] [INFO ] [MAIN ] GDOT: Fetched primary data is valid. [2025-10-28T18:57:35.613234] [DEBUG] [LOCAL ] GDOT: Saving primary data. [2025-10-28T18:57:35.614330] [DEBUG] [LOCAL ] GDOT: Trimmed 53699 records to 37323 (keeping 200 days of data) [2025-10-28T18:57:35.767725] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-06. [2025-10-28T18:57:35.827062] [DEBUG] [LOCAL ] GDOT: Primary data saved (37323 records). [2025-10-28T18:57:35.827166] [INFO ] [MAIN ] GDOT: Full history saved. [2025-10-28T18:57:35.827238] [INFO ] [MAIN ] Update Progress: 912/2366 symbols completed. GDOT took 45.8s. Estimated remaining: 3h 7m 24s. Rate: 7.8 symbols/min [2025-10-28T18:57:36.001694] [INFO ] [MAIN ] GEO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:57:36.019345] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-28T18:57:36.071768] [DEBUG] [LOCAL ] GEO: Loaded 51578 existing records from primary storage. [2025-10-28T18:57:36.072098] [INFO ] [MAIN ] GEO: Loaded 51578 existing records. [2025-10-28T18:57:36.253940] [WARN ] [MAIN ] GEO: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:57:36.254102] [INFO ] [MAIN ] GEO: Wiping existing primary data before full refresh. [2025-10-28T18:57:36.254214] [INFO ] [LOCAL ] GEO: Starting deletion of primary data. [2025-10-28T18:57:36.254445] [DEBUG] [LOCAL ] GEO: Deleted primary data file. [2025-10-28T18:57:36.254514] [INFO ] [MAIN ] GEO: Starting full primary refresh. [2025-10-28T18:57:36.569366] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-05. [2025-10-28T18:57:36.607760] [INFO ] [REMOTE ] GEO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:57:37.347411] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-28T18:57:37.361082] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-07. [2025-10-28T18:57:38.161143] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-01. [2025-10-28T18:57:38.392118] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-01 (4.23 seconds). [2025-10-28T18:57:38.961143] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-02. [2025-10-28T18:57:39.369466] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-10-28T18:57:39.630572] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-10-28T18:57:39.761196] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-08. [2025-10-28T18:57:39.815999] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-05 (3.25 seconds). [2025-10-28T18:57:39.929336] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-28T18:57:40.561189] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-02. [2025-10-28T18:57:41.361152] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-06. [2025-10-28T18:57:41.414125] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-28T18:57:41.950344] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-28T18:57:42.161155] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-03. [2025-10-28T18:57:42.419311] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-28T18:57:42.961194] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-07. [2025-10-28T18:57:43.761103] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-09. [2025-10-28T18:57:44.561161] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-03. [2025-10-28T18:57:45.880016] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-28T18:57:45.891763] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-04. [2025-10-28T18:57:46.917424] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-03 (4.76 seconds). [2025-10-28T18:57:46.928279] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-04. [2025-10-28T18:57:47.277815] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-28T18:57:47.289050] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-05. [2025-10-28T18:57:48.059736] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-28T18:57:48.070860] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-05. [2025-10-28T18:57:48.808875] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-28T18:57:48.820317] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-06. [2025-10-28T18:57:49.444317] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-28T18:57:49.456141] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-06. [2025-10-28T18:57:50.224861] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-28T18:57:50.236977] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-07. [2025-10-28T18:57:50.707313] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-28T18:57:50.961139] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-07. [2025-10-28T18:57:51.280713] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-07 (8.32 seconds). [2025-10-28T18:57:51.463338] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-28T18:57:51.761133] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-08. [2025-10-28T18:57:52.561108] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-08. [2025-10-28T18:57:52.654119] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-28T18:57:53.361169] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-09. [2025-10-28T18:57:53.893870] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-28T18:57:54.134476] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-10-28T18:57:54.161094] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-10. [2025-10-28T18:57:54.965119] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-09. [2025-10-28T18:57:54.966062] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-10 (0.80 seconds). [2025-10-28T18:57:54.971615] [INFO ] [REMOTE ] GEL: Full fetch complete (47825 records). [2025-10-28T18:57:54.971746] [DEBUG] [VALIDATOR ] GEL: Validating primary data. [2025-10-28T18:57:55.355768] [DEBUG] [VALIDATOR ] GEL: All expected trading days are present. [2025-10-28T18:57:55.355860] [DEBUG] [VALIDATOR ] GEL: Primary data validation passed. [2025-10-28T18:57:55.356598] [INFO ] [MAIN ] GEL: Fetched primary data is valid. [2025-10-28T18:57:55.356691] [DEBUG] [LOCAL ] GEL: Saving primary data. [2025-10-28T18:57:55.357768] [DEBUG] [LOCAL ] GEL: Trimmed 47825 records to 30623 (keeping 200 days of data) [2025-10-28T18:57:55.536785] [DEBUG] [LOCAL ] GEL: Primary data saved (30623 records). [2025-10-28T18:57:55.536910] [INFO ] [MAIN ] GEL: Full history saved. [2025-10-28T18:57:55.536991] [INFO ] [MAIN ] Update Progress: 913/2366 symbols completed. GEL took 38.2s. Estimated remaining: 3h 7m 36s. Rate: 7.7 symbols/min [2025-10-28T18:57:55.711755] [INFO ] [MAIN ] GES: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:57:55.748870] [DEBUG] [LOCAL ] GES: Loaded 37496 existing records from primary storage. [2025-10-28T18:57:55.749190] [INFO ] [MAIN ] GES: Loaded 37496 existing records. [2025-10-28T18:57:55.954155] [WARN ] [MAIN ] GES: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:57:55.954438] [INFO ] [MAIN ] GES: Wiping existing primary data before full refresh. [2025-10-28T18:57:55.954491] [INFO ] [LOCAL ] GES: Starting deletion of primary data. [2025-10-28T18:57:55.954799] [DEBUG] [LOCAL ] GES: Deleted primary data file. [2025-10-28T18:57:55.954859] [INFO ] [MAIN ] GES: Starting full primary refresh. [2025-10-28T18:57:56.312713] [INFO ] [REMOTE ] GES: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:57:56.313129] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-01. [2025-10-28T18:57:56.346112] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-28T18:57:56.561133] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-10. [2025-10-28T18:57:57.991690] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-28T18:57:58.002398] [INFO ] [REMOTE ] GENI: Full fetch complete (76065 records). [2025-10-28T18:57:58.002598] [DEBUG] [VALIDATOR ] GENI: Validating primary data. [2025-10-28T18:57:58.390489] [DEBUG] [VALIDATOR ] GENI: All expected trading days are present. [2025-10-28T18:57:58.390625] [DEBUG] [VALIDATOR ] GENI: Primary data validation passed. [2025-10-28T18:57:58.391797] [INFO ] [MAIN ] GENI: Fetched primary data is valid. [2025-10-28T18:57:58.391864] [DEBUG] [LOCAL ] GENI: Saving primary data. [2025-10-28T18:57:58.393232] [DEBUG] [LOCAL ] GENI: Trimmed 76065 records to 52850 (keeping 200 days of data) [2025-10-28T18:57:58.699126] [DEBUG] [LOCAL ] GENI: Primary data saved (52850 records). [2025-10-28T18:57:58.699261] [INFO ] [MAIN ] GENI: Full history saved. [2025-10-28T18:57:58.699357] [INFO ] [MAIN ] Update Progress: 914/2366 symbols completed. GENI took 26.4s. Estimated remaining: 3h 7m 21s. Rate: 7.8 symbols/min [2025-10-28T18:57:58.876874] [INFO ] [MAIN ] GETY: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:57:58.909201] [DEBUG] [LOCAL ] GETY: Loaded 35015 existing records from primary storage. [2025-10-28T18:57:58.909452] [INFO ] [MAIN ] GETY: Loaded 35015 existing records. [2025-10-28T18:57:59.082820] [WARN ] [MAIN ] GETY: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:57:59.083093] [INFO ] [MAIN ] GETY: Wiping existing primary data before full refresh. [2025-10-28T18:57:59.083145] [INFO ] [LOCAL ] GETY: Starting deletion of primary data. [2025-10-28T18:57:59.083494] [DEBUG] [LOCAL ] GETY: Deleted primary data file. [2025-10-28T18:57:59.083553] [INFO ] [MAIN ] GETY: Starting full primary refresh. [2025-10-28T18:57:59.443903] [INFO ] [REMOTE ] GETY: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:57:59.444189] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-01. [2025-10-28T18:58:03.460005] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-09 (19.70 seconds). [2025-10-28T18:58:03.471602] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-10. [2025-10-28T18:58:05.566755] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-10 (2.10 seconds). [2025-10-28T18:58:05.578496] [INFO ] [REMOTE ] GE: Full fetch complete (77857 records). [2025-10-28T18:58:05.578699] [DEBUG] [VALIDATOR ] GE: Validating primary data. [2025-10-28T18:58:05.990078] [DEBUG] [VALIDATOR ] GE: All expected trading days are present. [2025-10-28T18:58:05.990162] [DEBUG] [VALIDATOR ] GE: Primary data validation passed. [2025-10-28T18:58:05.991237] [INFO ] [MAIN ] GE: Fetched primary data is valid. [2025-10-28T18:58:05.991302] [DEBUG] [LOCAL ] GE: Saving primary data. [2025-10-28T18:58:05.992853] [DEBUG] [LOCAL ] GE: Trimmed 77857 records to 53688 (keeping 200 days of data) [2025-10-28T18:58:06.351420] [DEBUG] [LOCAL ] GE: Primary data saved (53688 records). [2025-10-28T18:58:06.351564] [INFO ] [MAIN ] GE: Full history saved. [2025-10-28T18:58:06.352570] [INFO ] [MAIN ] Update Progress: 915/2366 symbols completed. GE took 57.0s. Estimated remaining: 3h 7m 13s. Rate: 7.8 symbols/min [2025-10-28T18:58:06.581554] [INFO ] [MAIN ] GEV: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:58:06.653032] [DEBUG] [LOCAL ] GEV: Loaded 52985 existing records from primary storage. [2025-10-28T18:58:06.653507] [INFO ] [MAIN ] GEV: Loaded 52985 existing records. [2025-10-28T18:58:06.926670] [WARN ] [MAIN ] GEV: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:58:06.926938] [INFO ] [MAIN ] GEV: Wiping existing primary data before full refresh. [2025-10-28T18:58:06.926997] [INFO ] [LOCAL ] GEV: Starting deletion of primary data. [2025-10-28T18:58:06.927310] [DEBUG] [LOCAL ] GEV: Deleted primary data file. [2025-10-28T18:58:06.927368] [INFO ] [MAIN ] GEV: Starting full primary refresh. [2025-10-28T18:58:07.166069] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-01 (10.85 seconds). [2025-10-28T18:58:07.208516] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-02. [2025-10-28T18:58:07.449962] [INFO ] [REMOTE ] GEV: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:58:07.450283] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-01. [2025-10-28T18:58:08.340719] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-28T18:58:08.349441] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-03. [2025-10-28T18:58:09.598557] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-28T18:58:09.608842] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-04. [2025-10-28T18:58:10.812105] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-28T18:58:10.822150] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-05. [2025-10-28T18:58:11.884818] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-28T18:58:11.892828] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-06. [2025-10-28T18:58:12.971140] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-28T18:58:12.979523] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-07. [2025-10-28T18:58:17.352764] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-01 (17.91 seconds). [2025-10-28T18:58:17.362339] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-02. [2025-10-28T18:58:17.617312] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-07 (26.66 seconds). [2025-10-28T18:58:17.629064] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-08. [2025-10-28T18:58:18.583438] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-28T18:58:18.592063] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-03. [2025-10-28T18:58:19.046676] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-28T18:58:19.059591] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-09. [2025-10-28T18:58:20.454338] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-28T18:58:20.465100] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-10. [2025-10-28T18:58:22.040587] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-28T18:58:22.052770] [INFO ] [REMOTE ] GEO: Full fetch complete (75374 records). [2025-10-28T18:58:22.052947] [DEBUG] [VALIDATOR ] GEO: Validating primary data. [2025-10-28T18:58:22.442147] [DEBUG] [VALIDATOR ] GEO: All expected trading days are present. [2025-10-28T18:58:22.442243] [DEBUG] [VALIDATOR ] GEO: Primary data validation passed. [2025-10-28T18:58:22.443181] [INFO ] [MAIN ] GEO: Fetched primary data is valid. [2025-10-28T18:58:22.443246] [DEBUG] [LOCAL ] GEO: Saving primary data. [2025-10-28T18:58:22.444709] [DEBUG] [LOCAL ] GEO: Trimmed 75374 records to 51534 (keeping 200 days of data) [2025-10-28T18:58:22.738704] [DEBUG] [LOCAL ] GEO: Primary data saved (51534 records). [2025-10-28T18:58:22.738843] [INFO ] [MAIN ] GEO: Full history saved. [2025-10-28T18:58:22.738920] [INFO ] [MAIN ] Update Progress: 916/2366 symbols completed. GEO took 46.9s. Estimated remaining: 3h 7m 19s. Rate: 7.7 symbols/min [2025-10-28T18:58:22.906387] [INFO ] [MAIN ] GF: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:58:22.911220] [DEBUG] [LOCAL ] GF: Loaded 2566 existing records from primary storage. [2025-10-28T18:58:22.911359] [INFO ] [MAIN ] GF: Loaded 2566 existing records. [2025-10-28T18:58:23.084537] [WARN ] [MAIN ] GF: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:58:23.084750] [INFO ] [MAIN ] GF: Wiping existing primary data before full refresh. [2025-10-28T18:58:23.084815] [INFO ] [LOCAL ] GF: Starting deletion of primary data. [2025-10-28T18:58:23.084936] [DEBUG] [LOCAL ] GF: Deleted primary data file. [2025-10-28T18:58:23.084974] [INFO ] [MAIN ] GF: Starting full primary refresh. [2025-10-28T18:58:23.435138] [INFO ] [REMOTE ] GF: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:58:23.435477] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-01. [2025-10-28T18:58:32.479550] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-03 (13.89 seconds). [2025-10-28T18:58:32.489255] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-04. [2025-10-28T18:58:32.550545] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-01 (25.10 seconds). [2025-10-28T18:58:32.561384] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-02. [2025-10-28T18:58:33.595536] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-28T18:58:33.603941] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-05. [2025-10-28T18:58:34.339743] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-28T18:58:34.349842] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-03. [2025-10-28T18:58:34.531607] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-28T18:58:34.539144] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-06. [2025-10-28T18:58:35.589306] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-28T18:58:35.597249] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-07. [2025-10-28T18:58:36.046710] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-28T18:58:36.057958] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-04. [2025-10-28T18:58:37.778260] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-01 (14.34 seconds). [2025-10-28T18:58:37.779539] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-02. [2025-10-28T18:58:37.982533] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-10-28T18:58:37.993678] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-05. [2025-10-28T18:58:38.220595] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-28T18:58:38.222130] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-03. [2025-10-28T18:58:38.696554] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-28T18:58:38.698598] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-04. [2025-10-28T18:58:39.073674] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-10-28T18:58:39.075101] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-05. [2025-10-28T18:58:39.909129] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-10-28T18:58:39.920434] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-06. [2025-10-28T18:58:41.634551] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-10-28T18:58:41.645388] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-07. [2025-10-28T18:58:43.058437] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-07 (30.08 seconds). [2025-10-28T18:58:43.066797] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-08. [2025-10-28T18:58:44.190315] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-28T18:58:44.198837] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-09. [2025-10-28T18:58:45.146234] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-28T18:58:45.154622] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-10. [2025-10-28T18:58:51.128992] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-07 (15.53 seconds). [2025-10-28T18:58:51.137875] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-08. [2025-10-28T18:58:52.171888] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-28T18:58:52.179854] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-09. [2025-10-28T18:58:52.437248] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-05 (13.36 seconds). [2025-10-28T18:58:52.439040] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-06. [2025-10-28T18:58:52.749583] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-06 (0.31 seconds). [2025-10-28T18:58:52.750962] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-07. [2025-10-28T18:58:53.054315] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-07 (0.30 seconds). [2025-10-28T18:58:53.055679] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-08. [2025-10-28T18:58:53.074964] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-28T18:58:53.082634] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-10. [2025-10-28T18:58:53.434271] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-10-28T18:58:53.435510] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-09. [2025-10-28T18:58:53.719158] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-09 (0.28 seconds). [2025-10-28T18:58:53.720883] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-10. [2025-10-28T18:58:54.118105] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-28T18:58:54.135140] [INFO ] [REMOTE ] GETY: Full fetch complete (55178 records). [2025-10-28T18:58:54.135361] [DEBUG] [VALIDATOR ] GETY: Validating primary data. [2025-10-28T18:58:54.331600] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-28T18:58:54.339525] [INFO ] [REMOTE ] GF: Full fetch complete (4816 records). [2025-10-28T18:58:54.361502] [DEBUG] [VALIDATOR ] GF: Validating primary data. [2025-10-28T18:58:55.061226] [DEBUG] [VALIDATOR ] GETY: All expected trading days are present. [2025-10-28T18:58:55.061586] [DEBUG] [VALIDATOR ] GETY: Primary data validation passed. [2025-10-28T18:58:55.072914] [INFO ] [MAIN ] GETY: Fetched primary data is valid. [2025-10-28T18:58:55.078135] [DEBUG] [LOCAL ] GETY: Saving primary data. [2025-10-28T18:58:55.136707] [DEBUG] [LOCAL ] GETY: Trimmed 55178 records to 34895 (keeping 200 days of data) [2025-10-28T18:58:55.143588] [DEBUG] [VALIDATOR ] GF: All expected trading days are present. [2025-10-28T18:58:55.143725] [DEBUG] [VALIDATOR ] GF: Primary data validation passed. [2025-10-28T18:58:55.144050] [INFO ] [MAIN ] GF: Fetched primary data is valid. [2025-10-28T18:58:55.144116] [DEBUG] [LOCAL ] GF: Saving primary data. [2025-10-28T18:58:55.144735] [DEBUG] [LOCAL ] GF: Trimmed 4816 records to 2523 (keeping 200 days of data) [2025-10-28T18:58:55.237429] [DEBUG] [LOCAL ] GF: Primary data saved (2523 records). [2025-10-28T18:58:55.246759] [INFO ] [MAIN ] GF: Full history saved. [2025-10-28T18:58:55.248428] [INFO ] [MAIN ] Update Progress: 917/2366 symbols completed. GF took 32.5s. Estimated remaining: 3h 7m 50s. Rate: 7.7 symbols/min [2025-10-28T18:58:55.351296] [DEBUG] [LOCAL ] GETY: Primary data saved (34895 records). [2025-10-28T18:58:55.351459] [INFO ] [MAIN ] GETY: Full history saved. [2025-10-28T18:58:55.351560] [INFO ] [MAIN ] Update Progress: 918/2366 symbols completed. GETY took 56.7s. Estimated remaining: 3h 7m 30s. Rate: 7.7 symbols/min [2025-10-28T18:58:56.874751] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-10 (11.72 seconds). [2025-10-28T18:58:56.883085] [INFO ] [REMOTE ] GES: Full fetch complete (58055 records). [2025-10-28T18:58:56.883384] [DEBUG] [VALIDATOR ] GES: Validating primary data. [2025-10-28T18:58:57.282884] [DEBUG] [VALIDATOR ] GES: All expected trading days are present. [2025-10-28T18:58:57.282971] [DEBUG] [VALIDATOR ] GES: Primary data validation passed. [2025-10-28T18:58:57.283830] [INFO ] [MAIN ] GES: Fetched primary data is valid. [2025-10-28T18:58:57.283893] [DEBUG] [LOCAL ] GES: Saving primary data. [2025-10-28T18:58:57.285409] [DEBUG] [LOCAL ] GES: Trimmed 58055 records to 37330 (keeping 200 days of data) [2025-10-28T18:58:57.508821] [DEBUG] [LOCAL ] GES: Primary data saved (37330 records). [2025-10-28T18:58:57.508965] [INFO ] [MAIN ] GES: Full history saved. [2025-10-28T18:58:57.509069] [INFO ] [MAIN ] Update Progress: 919/2366 symbols completed. GES took 1m 2s. Estimated remaining: 3h 7m 14s. Rate: 7.7 symbols/min [2025-10-28T18:59:06.613865] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-07 (24.97 seconds). [2025-10-28T18:59:06.627033] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-08. [2025-10-28T18:59:08.673623] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-10-28T18:59:08.684529] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-09. [2025-10-28T18:59:10.781835] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-10-28T18:59:10.793196] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-10. [2025-10-28T18:59:23.563014] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-10 (12.77 seconds). [2025-10-28T18:59:23.573816] [INFO ] [REMOTE ] GEV: Full fetch complete (77059 records). [2025-10-28T18:59:23.573948] [DEBUG] [VALIDATOR ] GEV: Validating primary data. [2025-10-28T18:59:23.964498] [DEBUG] [VALIDATOR ] GEV: All expected trading days are present. [2025-10-28T18:59:23.964574] [DEBUG] [VALIDATOR ] GEV: Primary data validation passed. [2025-10-28T18:59:23.965548] [INFO ] [MAIN ] GEV: Fetched primary data is valid. [2025-10-28T18:59:23.965614] [DEBUG] [LOCAL ] GEV: Saving primary data. [2025-10-28T18:59:23.967179] [DEBUG] [LOCAL ] GEV: Trimmed 77059 records to 52982 (keeping 200 days of data) [2025-10-28T18:59:24.301468] [DEBUG] [LOCAL ] GEV: Primary data saved (52982 records). [2025-10-28T18:59:24.301611] [INFO ] [MAIN ] GEV: Full history saved. [2025-10-28T18:59:24.302558] [INFO ] [MAIN ] Update Progress: 920/2366 symbols completed. GEV took 1m 18s. Estimated remaining: 3h 7m 36s. Rate: 7.7 symbols/min [2025-10-28T18:59:24.829816] [INFO ] [MAIN ] GFI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:59:24.953308] [INFO ] [MAIN ] GFF: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:59:25.019201] [INFO ] [MAIN ] GFR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:59:25.038311] [INFO ] [MAIN ] GFL: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T18:59:25.055340] [DEBUG] [LOCAL ] GFR: Loaded 6925 existing records from primary storage. [2025-10-28T18:59:25.055824] [INFO ] [MAIN ] GFR: Loaded 6925 existing records. [2025-10-28T18:59:25.154581] [DEBUG] [LOCAL ] GFF: Loaded 28918 existing records from primary storage. [2025-10-28T18:59:25.181123] [INFO ] [MAIN ] GFF: Loaded 28918 existing records. [2025-10-28T18:59:25.346043] [DEBUG] [LOCAL ] GFI: Loaded 53115 existing records from primary storage. [2025-10-28T18:59:25.381954] [WARN ] [MAIN ] GFR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:59:25.393259] [INFO ] [MAIN ] GFR: Wiping existing primary data before full refresh. [2025-10-28T18:59:25.387829] [INFO ] [MAIN ] GFI: Loaded 53115 existing records. [2025-10-28T18:59:25.406427] [INFO ] [LOCAL ] GFR: Starting deletion of primary data. [2025-10-28T18:59:25.416409] [DEBUG] [LOCAL ] GFR: Deleted primary data file. [2025-10-28T18:59:25.452549] [INFO ] [MAIN ] GFR: Starting full primary refresh. [2025-10-28T18:59:25.490802] [DEBUG] [LOCAL ] GFL: Loaded 47263 existing records from primary storage. [2025-10-28T18:59:25.585748] [INFO ] [MAIN ] GFL: Loaded 47263 existing records. [2025-10-28T18:59:25.703236] [WARN ] [MAIN ] GFF: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:59:25.754525] [INFO ] [MAIN ] GFF: Wiping existing primary data before full refresh. [2025-10-28T18:59:25.759936] [INFO ] [LOCAL ] GFF: Starting deletion of primary data. [2025-10-28T18:59:25.789481] [DEBUG] [LOCAL ] GFF: Deleted primary data file. [2025-10-28T18:59:25.822595] [INFO ] [MAIN ] GFF: Starting full primary refresh. [2025-10-28T18:59:26.018591] [WARN ] [MAIN ] GFI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:59:26.186344] [INFO ] [MAIN ] GFI: Wiping existing primary data before full refresh. [2025-10-28T18:59:26.223457] [INFO ] [LOCAL ] GFI: Starting deletion of primary data. [2025-10-28T18:59:26.273831] [WARN ] [MAIN ] GFL: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T18:59:26.289534] [INFO ] [MAIN ] GFL: Wiping existing primary data before full refresh. [2025-10-28T18:59:26.294766] [INFO ] [LOCAL ] GFL: Starting deletion of primary data. [2025-10-28T18:59:26.345329] [DEBUG] [LOCAL ] GFL: Deleted primary data file. [2025-10-28T18:59:26.350509] [DEBUG] [LOCAL ] GFI: Deleted primary data file. [2025-10-28T18:59:26.393715] [INFO ] [MAIN ] GFI: Starting full primary refresh. [2025-10-28T18:59:26.387778] [INFO ] [MAIN ] GFL: Starting full primary refresh. [2025-10-28T18:59:26.787704] [INFO ] [REMOTE ] GFR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:59:26.798699] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-01. [2025-10-28T18:59:27.013144] [INFO ] [REMOTE ] GFF: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:59:27.109958] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-01. [2025-10-28T18:59:27.401054] [INFO ] [REMOTE ] GFL: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:59:27.407357] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-01. [2025-10-28T18:59:27.443963] [INFO ] [REMOTE ] GFI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T18:59:27.444256] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-01. [2025-10-28T18:59:28.515991] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-28T18:59:28.525189] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-02. [2025-10-28T18:59:28.627403] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-28T18:59:28.637470] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-02. [2025-10-28T18:59:29.984288] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-28T18:59:29.994283] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-03. [2025-10-28T18:59:30.107016] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-01 (3.31 seconds). [2025-10-28T18:59:30.109431] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-02. [2025-10-28T18:59:30.786371] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-28T18:59:30.788615] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-03. [2025-10-28T18:59:31.767749] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-10-28T18:59:31.778785] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-04. [2025-10-28T18:59:36.630176] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-01 (9.52 seconds). [2025-10-28T18:59:36.636190] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-02. [2025-10-28T18:59:37.746178] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-28T18:59:37.755512] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-03. [2025-10-28T18:59:38.697022] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-28T18:59:38.705071] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-04. [2025-10-28T18:59:39.878110] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-28T18:59:39.886633] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-05. [2025-10-28T18:59:42.990753] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-02 (14.47 seconds). [2025-10-28T18:59:42.999751] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-03. [2025-10-28T18:59:44.301546] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-28T18:59:44.312240] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-04. [2025-10-28T18:59:45.584486] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-28T18:59:45.595061] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-05. [2025-10-28T18:59:46.135991] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-03 (15.35 seconds). [2025-10-28T18:59:46.139271] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-04. [2025-10-28T18:59:46.223164] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-04 (14.44 seconds). [2025-10-28T18:59:46.238806] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-05. [2025-10-28T18:59:46.743081] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-28T18:59:46.747717] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-05. [2025-10-28T18:59:46.967770] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-28T18:59:46.978576] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-06. [2025-10-28T18:59:47.274456] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-28T18:59:47.277668] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-06. [2025-10-28T18:59:47.783437] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-28T18:59:47.786292] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-10-28T18:59:47.800729] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-07. [2025-10-28T18:59:47.802441] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-06. [2025-10-28T18:59:47.898881] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-05 (8.01 seconds). [2025-10-28T18:59:47.906168] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-06. [2025-10-28T18:59:48.116309] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-07 (0.32 seconds). [2025-10-28T18:59:48.118551] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-08. [2025-10-28T18:59:48.564516] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-28T18:59:48.567011] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-09. [2025-10-28T18:59:48.829448] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-28T18:59:48.835530] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-07. [2025-10-28T18:59:49.034211] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-28T18:59:49.036733] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-10. [2025-10-28T18:59:49.388326] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-10-28T18:59:49.398915] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-07. [2025-10-28T18:59:49.723991] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-28T18:59:49.730098] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-08. [2025-10-28T18:59:51.034142] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-28T18:59:51.045797] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-08. [2025-10-28T18:59:52.673412] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-28T18:59:52.684549] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-09. [2025-10-28T19:00:00.943176] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-08 (11.21 seconds). [2025-10-28T19:00:00.950864] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-09. [2025-10-28T19:00:01.788030] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-28T19:00:01.794304] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-10. [2025-10-28T19:00:03.003396] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-28T19:00:03.013910] [INFO ] [REMOTE ] GFF: Full fetch complete (43408 records). [2025-10-28T19:00:03.014161] [DEBUG] [VALIDATOR ] GFF: Validating primary data. [2025-10-28T19:00:03.411065] [DEBUG] [VALIDATOR ] GFF: All expected trading days are present. [2025-10-28T19:00:03.411157] [DEBUG] [VALIDATOR ] GFF: Primary data validation passed. [2025-10-28T19:00:03.411896] [INFO ] [MAIN ] GFF: Fetched primary data is valid. [2025-10-28T19:00:03.411958] [DEBUG] [LOCAL ] GFF: Saving primary data. [2025-10-28T19:00:03.413039] [DEBUG] [LOCAL ] GFF: Trimmed 43408 records to 28815 (keeping 200 days of data) [2025-10-28T19:00:03.586404] [DEBUG] [LOCAL ] GFF: Primary data saved (28815 records). [2025-10-28T19:00:03.586575] [INFO ] [MAIN ] GFF: Full history saved. [2025-10-28T19:00:03.587588] [INFO ] [MAIN ] Update Progress: 921/2366 symbols completed. GFF took 39.3s. Estimated remaining: 3h 8m 17s. Rate: 7.7 symbols/min [2025-10-28T19:00:03.760287] [INFO ] [MAIN ] GGB: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:00:03.812625] [DEBUG] [LOCAL ] GGB: Loaded 51546 existing records from primary storage. [2025-10-28T19:00:03.812965] [INFO ] [MAIN ] GGB: Loaded 51546 existing records. [2025-10-28T19:00:03.991357] [WARN ] [MAIN ] GGB: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:00:03.991599] [INFO ] [MAIN ] GGB: Wiping existing primary data before full refresh. [2025-10-28T19:00:03.991670] [INFO ] [LOCAL ] GGB: Starting deletion of primary data. [2025-10-28T19:00:03.992246] [DEBUG] [LOCAL ] GGB: Deleted primary data file. [2025-10-28T19:00:03.992303] [INFO ] [MAIN ] GGB: Starting full primary refresh. [2025-10-28T19:00:04.342954] [INFO ] [REMOTE ] GGB: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:00:04.343242] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-01. [2025-10-28T19:00:05.890514] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-28T19:00:05.900825] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-02. [2025-10-28T19:00:14.189087] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-06 (27.21 seconds). [2025-10-28T19:00:14.198629] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-07. [2025-10-28T19:00:15.773620] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-10 (26.74 seconds). [2025-10-28T19:00:15.775324] [INFO ] [REMOTE ] GFR: Full fetch complete (11848 records). [2025-10-28T19:00:15.775398] [DEBUG] [VALIDATOR ] GFR: Validating primary data. [2025-10-28T19:00:16.169096] [DEBUG] [VALIDATOR ] GFR: All expected trading days are present. [2025-10-28T19:00:16.169188] [DEBUG] [VALIDATOR ] GFR: Primary data validation passed. [2025-10-28T19:00:16.169532] [INFO ] [MAIN ] GFR: Fetched primary data is valid. [2025-10-28T19:00:16.169576] [DEBUG] [LOCAL ] GFR: Saving primary data. [2025-10-28T19:00:16.170065] [DEBUG] [LOCAL ] GFR: Trimmed 11848 records to 6871 (keeping 200 days of data) [2025-10-28T19:00:16.210966] [DEBUG] [LOCAL ] GFR: Primary data saved (6871 records). [2025-10-28T19:00:16.211101] [INFO ] [MAIN ] GFR: Full history saved. [2025-10-28T19:00:16.211221] [INFO ] [MAIN ] Update Progress: 922/2366 symbols completed. GFR took 51.9s. Estimated remaining: 3h 8m 17s. Rate: 7.7 symbols/min [2025-10-28T19:00:16.409017] [INFO ] [MAIN ] GGG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:00:16.447965] [DEBUG] [LOCAL ] GGG: Loaded 40459 existing records from primary storage. [2025-10-28T19:00:16.448269] [INFO ] [MAIN ] GGG: Loaded 40459 existing records. [2025-10-28T19:00:16.673320] [WARN ] [MAIN ] GGG: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:00:16.673612] [INFO ] [MAIN ] GGG: Wiping existing primary data before full refresh. [2025-10-28T19:00:16.673708] [INFO ] [LOCAL ] GGG: Starting deletion of primary data. [2025-10-28T19:00:16.674172] [DEBUG] [LOCAL ] GGG: Deleted primary data file. [2025-10-28T19:00:16.674239] [INFO ] [MAIN ] GGG: Starting full primary refresh. [2025-10-28T19:00:17.033003] [INFO ] [REMOTE ] GGG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:00:17.033317] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-01. [2025-10-28T19:00:18.475135] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-28T19:00:18.483533] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-02. [2025-10-28T19:00:19.735455] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-28T19:00:19.743347] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-03. [2025-10-28T19:00:35.785019] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-09 (43.10 seconds). [2025-10-28T19:00:35.796773] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-10. [2025-10-28T19:00:37.935102] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-10 (2.14 seconds). [2025-10-28T19:00:37.945791] [INFO ] [REMOTE ] GFI: Full fetch complete (77030 records). [2025-10-28T19:00:37.945916] [DEBUG] [VALIDATOR ] GFI: Validating primary data. [2025-10-28T19:00:38.339884] [DEBUG] [VALIDATOR ] GFI: All expected trading days are present. [2025-10-28T19:00:38.340096] [DEBUG] [VALIDATOR ] GFI: Primary data validation passed. [2025-10-28T19:00:38.341105] [INFO ] [MAIN ] GFI: Fetched primary data is valid. [2025-10-28T19:00:38.341178] [DEBUG] [LOCAL ] GFI: Saving primary data. [2025-10-28T19:00:38.365760] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-03 (18.62 seconds). [2025-10-28T19:00:38.374679] [DEBUG] [LOCAL ] GFI: Trimmed 77030 records to 53115 (keeping 200 days of data) [2025-10-28T19:00:38.375495] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-04. [2025-10-28T19:00:38.695685] [DEBUG] [LOCAL ] GFI: Primary data saved (53115 records). [2025-10-28T19:00:38.695834] [INFO ] [MAIN ] GFI: Full history saved. [2025-10-28T19:00:38.695915] [INFO ] [MAIN ] Update Progress: 923/2366 symbols completed. GFI took 1m 14s. Estimated remaining: 3h 8m 32s. Rate: 7.7 symbols/min [2025-10-28T19:00:38.863148] [INFO ] [MAIN ] GGT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:00:38.914998] [DEBUG] [LOCAL ] GGT: Loaded 14417 existing records from primary storage. [2025-10-28T19:00:38.915261] [INFO ] [MAIN ] GGT: Loaded 14417 existing records. [2025-10-28T19:00:39.103506] [WARN ] [MAIN ] GGT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:00:39.103734] [INFO ] [MAIN ] GGT: Wiping existing primary data before full refresh. [2025-10-28T19:00:39.103787] [INFO ] [LOCAL ] GGT: Starting deletion of primary data. [2025-10-28T19:00:39.104025] [DEBUG] [LOCAL ] GGT: Deleted primary data file. [2025-10-28T19:00:39.104067] [INFO ] [MAIN ] GGT: Starting full primary refresh. [2025-10-28T19:00:39.464100] [INFO ] [REMOTE ] GGT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:00:39.464536] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-01. [2025-10-28T19:00:39.631709] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-28T19:00:39.641811] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-05. [2025-10-28T19:00:40.009158] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-28T19:00:40.011263] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-02. [2025-10-28T19:00:40.572722] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-28T19:00:40.575106] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-03. [2025-10-28T19:00:40.804890] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-10-28T19:00:40.813580] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-06. [2025-10-28T19:00:41.870289] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-28T19:00:41.880736] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-07. [2025-10-28T19:00:43.076093] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-28T19:00:43.085613] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-08. [2025-10-28T19:00:46.798083] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-03 (6.22 seconds). [2025-10-28T19:00:46.802341] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-04. [2025-10-28T19:00:51.474188] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-02 (45.57 seconds). [2025-10-28T19:00:51.483803] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-03. [2025-10-28T19:00:52.741095] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-28T19:00:52.752434] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-04. [2025-10-28T19:01:02.048534] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-08 (18.96 seconds). [2025-10-28T19:01:02.056990] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-09. [2025-10-28T19:01:03.105831] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-28T19:01:03.114416] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-10. [2025-10-28T19:01:05.815277] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-04 (19.01 seconds). [2025-10-28T19:01:05.818452] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-05. [2025-10-28T19:01:06.498705] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-10-28T19:01:06.503638] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-06. [2025-10-28T19:01:07.187622] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-28T19:01:07.191728] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-07. [2025-10-28T19:01:07.804569] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-28T19:01:07.808489] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-08. [2025-10-28T19:01:08.368718] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-28T19:01:08.372072] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-09. [2025-10-28T19:01:09.027195] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-28T19:01:09.031023] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-10. [2025-10-28T19:01:17.862139] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-07 (63.66 seconds). [2025-10-28T19:01:17.872306] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-08. [2025-10-28T19:01:22.320668] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-04 (29.57 seconds). [2025-10-28T19:01:22.331267] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-05. [2025-10-28T19:01:23.768538] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-28T19:01:23.779610] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-06. [2025-10-28T19:01:36.853628] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-10 (33.74 seconds). [2025-10-28T19:01:36.862264] [INFO ] [REMOTE ] GGG: Full fetch complete (59611 records). [2025-10-28T19:01:36.862442] [DEBUG] [VALIDATOR ] GGG: Validating primary data. [2025-10-28T19:01:37.315447] [DEBUG] [VALIDATOR ] GGG: All expected trading days are present. [2025-10-28T19:01:37.315598] [DEBUG] [VALIDATOR ] GGG: Primary data validation passed. [2025-10-28T19:01:37.316465] [INFO ] [MAIN ] GGG: Fetched primary data is valid. [2025-10-28T19:01:37.316547] [DEBUG] [LOCAL ] GGG: Saving primary data. [2025-10-28T19:01:37.317858] [DEBUG] [LOCAL ] GGG: Trimmed 59611 records to 40372 (keeping 200 days of data) [2025-10-28T19:01:37.572357] [DEBUG] [LOCAL ] GGG: Primary data saved (40372 records). [2025-10-28T19:01:37.572485] [INFO ] [MAIN ] GGG: Full history saved. [2025-10-28T19:01:37.573286] [INFO ] [MAIN ] Update Progress: 924/2366 symbols completed. GGG took 1m 21s. Estimated remaining: 3h 9m 44s. Rate: 7.6 symbols/min [2025-10-28T19:01:37.738953] [INFO ] [MAIN ] GGZ: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:01:37.744491] [DEBUG] [LOCAL ] GGZ: Loaded 2291 existing records from primary storage. [2025-10-28T19:01:37.744721] [INFO ] [MAIN ] GGZ: Loaded 2291 existing records. [2025-10-28T19:01:37.916064] [WARN ] [MAIN ] GGZ: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:01:37.916306] [INFO ] [MAIN ] GGZ: Wiping existing primary data before full refresh. [2025-10-28T19:01:37.916353] [INFO ] [LOCAL ] GGZ: Starting deletion of primary data. [2025-10-28T19:01:37.916549] [DEBUG] [LOCAL ] GGZ: Deleted primary data file. [2025-10-28T19:01:37.916607] [INFO ] [MAIN ] GGZ: Starting full primary refresh. [2025-10-28T19:01:38.270732] [INFO ] [REMOTE ] GGZ: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:01:38.271058] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-01. [2025-10-28T19:01:38.642482] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-10-28T19:01:38.644217] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-02. [2025-10-28T19:01:38.931188] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-02 (0.29 seconds). [2025-10-28T19:01:38.932963] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-03. [2025-10-28T19:01:39.258102] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-10-28T19:01:39.259434] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-04. [2025-10-28T19:01:39.571393] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-04 (0.31 seconds). [2025-10-28T19:01:39.573094] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-05. [2025-10-28T19:01:39.932240] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-10 (30.90 seconds). [2025-10-28T19:01:39.935625] [INFO ] [REMOTE ] GGT: Full fetch complete (19111 records). [2025-10-28T19:01:39.935722] [DEBUG] [VALIDATOR ] GGT: Validating primary data. [2025-10-28T19:01:40.307836] [DEBUG] [VALIDATOR ] GGT: All expected trading days are present. [2025-10-28T19:01:40.307927] [DEBUG] [VALIDATOR ] GGT: Primary data validation passed. [2025-10-28T19:01:40.308332] [INFO ] [MAIN ] GGT: Fetched primary data is valid. [2025-10-28T19:01:40.308390] [DEBUG] [LOCAL ] GGT: Saving primary data. [2025-10-28T19:01:40.308967] [DEBUG] [LOCAL ] GGT: Trimmed 19111 records to 14413 (keeping 200 days of data) [2025-10-28T19:01:40.390731] [DEBUG] [LOCAL ] GGT: Primary data saved (14413 records). [2025-10-28T19:01:40.390859] [INFO ] [MAIN ] GGT: Full history saved. [2025-10-28T19:01:40.390932] [INFO ] [MAIN ] Update Progress: 925/2366 symbols completed. GGT took 1m 2s. Estimated remaining: 3h 9m 28s. Rate: 7.6 symbols/min [2025-10-28T19:01:40.559429] [INFO ] [MAIN ] GHC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:01:40.564541] [DEBUG] [LOCAL ] GHC: Loaded 2950 existing records from primary storage. [2025-10-28T19:01:40.564718] [INFO ] [MAIN ] GHC: Loaded 2950 existing records. [2025-10-28T19:01:40.739511] [WARN ] [MAIN ] GHC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:01:40.739752] [INFO ] [MAIN ] GHC: Wiping existing primary data before full refresh. [2025-10-28T19:01:40.739807] [INFO ] [LOCAL ] GHC: Starting deletion of primary data. [2025-10-28T19:01:40.739932] [DEBUG] [LOCAL ] GHC: Deleted primary data file. [2025-10-28T19:01:40.739971] [INFO ] [MAIN ] GHC: Starting full primary refresh. [2025-10-28T19:01:41.105436] [INFO ] [REMOTE ] GHC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:01:41.105803] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-01. [2025-10-28T19:01:41.476046] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-10-28T19:01:41.477876] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-02. [2025-10-28T19:01:41.840274] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-10-28T19:01:41.842016] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-03. [2025-10-28T19:01:42.221873] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-10-28T19:01:42.223334] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-04. [2025-10-28T19:01:42.668175] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-28T19:01:42.669405] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-05. [2025-10-28T19:01:43.028018] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-10-28T19:01:43.029378] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-06. [2025-10-28T19:01:43.450671] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-10-28T19:01:43.452682] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-07. [2025-10-28T19:01:46.513606] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-08 (28.64 seconds). [2025-10-28T19:01:46.523353] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-09. [2025-10-28T19:01:47.777405] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-28T19:01:47.788155] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-10. [2025-10-28T19:01:49.093228] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-28T19:01:49.104203] [INFO ] [REMOTE ] GFL: Full fetch complete (69552 records). [2025-10-28T19:01:49.104416] [DEBUG] [VALIDATOR ] GFL: Validating primary data. [2025-10-28T19:01:49.510379] [DEBUG] [VALIDATOR ] GFL: All expected trading days are present. [2025-10-28T19:01:49.510471] [DEBUG] [VALIDATOR ] GFL: Primary data validation passed. [2025-10-28T19:01:49.511380] [INFO ] [MAIN ] GFL: Fetched primary data is valid. [2025-10-28T19:01:49.511443] [DEBUG] [LOCAL ] GFL: Saving primary data. [2025-10-28T19:01:49.512860] [DEBUG] [LOCAL ] GFL: Trimmed 69552 records to 47208 (keeping 200 days of data) [2025-10-28T19:01:49.798279] [DEBUG] [LOCAL ] GFL: Primary data saved (47208 records). [2025-10-28T19:01:49.798420] [INFO ] [MAIN ] GFL: Full history saved. [2025-10-28T19:01:49.798519] [INFO ] [MAIN ] Update Progress: 926/2366 symbols completed. GFL took 2m 25s. Estimated remaining: 3h 9m 23s. Rate: 7.6 symbols/min [2025-10-28T19:01:49.973907] [INFO ] [MAIN ] GHG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:01:49.979785] [DEBUG] [LOCAL ] GHG: Loaded 3268 existing records from primary storage. [2025-10-28T19:01:49.979974] [INFO ] [MAIN ] GHG: Loaded 3268 existing records. [2025-10-28T19:01:50.161270] [WARN ] [MAIN ] GHG: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:01:50.161500] [INFO ] [MAIN ] GHG: Wiping existing primary data before full refresh. [2025-10-28T19:01:50.161548] [INFO ] [LOCAL ] GHG: Starting deletion of primary data. [2025-10-28T19:01:50.161831] [DEBUG] [LOCAL ] GHG: Deleted primary data file. [2025-10-28T19:01:50.161902] [INFO ] [MAIN ] GHG: Starting full primary refresh. [2025-10-28T19:01:50.533446] [INFO ] [REMOTE ] GHG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:01:50.533818] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-01. [2025-10-28T19:01:50.814606] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-01 (0.28 seconds). [2025-10-28T19:01:50.815574] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-02. [2025-10-28T19:01:51.109615] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-02 (0.29 seconds). [2025-10-28T19:01:51.111002] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-03. [2025-10-28T19:02:06.420762] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-06 (42.64 seconds). [2025-10-28T19:02:06.433938] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-07. [2025-10-28T19:02:07.877689] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-05 (28.30 seconds). [2025-10-28T19:02:07.879637] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-06. [2025-10-28T19:02:07.881217] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-28T19:02:07.893579] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-08. [2025-10-28T19:02:08.174830] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-06 (0.30 seconds). [2025-10-28T19:02:08.176021] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-07. [2025-10-28T19:02:08.478765] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-07 (0.30 seconds). [2025-10-28T19:02:08.480148] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-08. [2025-10-28T19:02:08.800995] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-07 (25.35 seconds). [2025-10-28T19:02:08.802387] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-08. [2025-10-28T19:02:08.822121] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-10-28T19:02:08.823300] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-09. [2025-10-28T19:02:09.081708] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-09 (0.26 seconds). [2025-10-28T19:02:09.082922] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-10. [2025-10-28T19:02:09.433370] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-10 (0.35 seconds). [2025-10-28T19:02:09.434740] [INFO ] [REMOTE ] GGZ: Full fetch complete (3763 records). [2025-10-28T19:02:09.434826] [DEBUG] [VALIDATOR ] GGZ: Validating primary data. [2025-10-28T19:02:09.714820] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-03 (18.60 seconds). [2025-10-28T19:02:09.751874] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-04. [2025-10-28T19:02:09.839570] [DEBUG] [VALIDATOR ] GGZ: All expected trading days are present. [2025-10-28T19:02:09.839714] [DEBUG] [VALIDATOR ] GGZ: Primary data validation passed. [2025-10-28T19:02:09.839974] [INFO ] [MAIN ] GGZ: Fetched primary data is valid. [2025-10-28T19:02:09.840042] [DEBUG] [LOCAL ] GGZ: Saving primary data. [2025-10-28T19:02:09.840610] [DEBUG] [LOCAL ] GGZ: Trimmed 3763 records to 2283 (keeping 200 days of data) [2025-10-28T19:02:09.860903] [DEBUG] [LOCAL ] GGZ: Primary data saved (2283 records). [2025-10-28T19:02:09.861037] [INFO ] [MAIN ] GGZ: Full history saved. [2025-10-28T19:02:09.861123] [INFO ] [MAIN ] Update Progress: 927/2366 symbols completed. GGZ took 32.3s. Estimated remaining: 3h 9m 34s. Rate: 7.6 symbols/min [2025-10-28T19:02:10.055934] [INFO ] [MAIN ] GHI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:02:10.067116] [DEBUG] [LOCAL ] GHI: Loaded 8001 existing records from primary storage. [2025-10-28T19:02:10.067325] [INFO ] [MAIN ] GHI: Loaded 8001 existing records. [2025-10-28T19:02:10.182880] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-28T19:02:10.195313] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-05. [2025-10-28T19:02:10.262370] [WARN ] [MAIN ] GHI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:02:10.262596] [INFO ] [MAIN ] GHI: Wiping existing primary data before full refresh. [2025-10-28T19:02:10.262662] [INFO ] [LOCAL ] GHI: Starting deletion of primary data. [2025-10-28T19:02:10.263060] [DEBUG] [LOCAL ] GHI: Deleted primary data file. [2025-10-28T19:02:10.263121] [INFO ] [MAIN ] GHI: Starting full primary refresh. [2025-10-28T19:02:10.640607] [INFO ] [REMOTE ] GHI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:02:10.645163] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-01. [2025-10-28T19:02:10.646763] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-28T19:02:10.648869] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-06. [2025-10-28T19:02:11.287390] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-10-28T19:02:11.290201] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-02. [2025-10-28T19:02:11.428480] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-28T19:02:11.429560] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-07. [2025-10-28T19:02:11.696235] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-28T19:02:11.698140] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-03. [2025-10-28T19:02:11.822443] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-10-28T19:02:11.823949] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-08. [2025-10-28T19:02:12.114880] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-08 (0.29 seconds). [2025-10-28T19:02:12.116105] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-09. [2025-10-28T19:02:12.184185] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-28T19:02:12.186825] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-04. [2025-10-28T19:02:12.417521] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-09 (0.30 seconds). [2025-10-28T19:02:12.419956] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-10. [2025-10-28T19:02:13.133129] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-28T19:02:13.134410] [INFO ] [REMOTE ] GHG: Full fetch complete (4220 records). [2025-10-28T19:02:13.134488] [DEBUG] [VALIDATOR ] GHG: Validating primary data. [2025-10-28T19:02:13.513158] [DEBUG] [VALIDATOR ] GHG: All expected trading days are present. [2025-10-28T19:02:13.513237] [DEBUG] [VALIDATOR ] GHG: Primary data validation passed. [2025-10-28T19:02:13.513383] [INFO ] [MAIN ] GHG: Fetched primary data is valid. [2025-10-28T19:02:13.513423] [DEBUG] [LOCAL ] GHG: Saving primary data. [2025-10-28T19:02:13.513830] [DEBUG] [LOCAL ] GHG: Trimmed 4220 records to 3266 (keeping 200 days of data) [2025-10-28T19:02:13.531960] [DEBUG] [LOCAL ] GHG: Primary data saved (3266 records). [2025-10-28T19:02:13.532036] [INFO ] [MAIN ] GHG: Full history saved. [2025-10-28T19:02:13.532105] [INFO ] [MAIN ] Update Progress: 928/2366 symbols completed. GHG took 23.7s. Estimated remaining: 3h 9m 19s. Rate: 7.6 symbols/min [2025-10-28T19:02:13.708159] [INFO ] [MAIN ] GHLD: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:02:13.715093] [DEBUG] [LOCAL ] GHLD: Loaded 4334 existing records from primary storage. [2025-10-28T19:02:13.715281] [INFO ] [MAIN ] GHLD: Loaded 4334 existing records. [2025-10-28T19:02:13.910254] [WARN ] [MAIN ] GHLD: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:02:13.910473] [INFO ] [MAIN ] GHLD: Wiping existing primary data before full refresh. [2025-10-28T19:02:13.910559] [INFO ] [LOCAL ] GHLD: Starting deletion of primary data. [2025-10-28T19:02:13.910745] [DEBUG] [LOCAL ] GHLD: Deleted primary data file. [2025-10-28T19:02:13.910809] [INFO ] [MAIN ] GHLD: Starting full primary refresh. [2025-10-28T19:02:14.263109] [INFO ] [REMOTE ] GHLD: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:02:14.263413] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-01. [2025-10-28T19:02:15.463636] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-04 (3.28 seconds). [2025-10-28T19:02:15.465881] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-05. [2025-10-28T19:02:15.849279] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-28T19:02:15.850237] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-02. [2025-10-28T19:02:17.222866] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-28T19:02:17.223805] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-03. [2025-10-28T19:02:17.563382] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-10-28T19:02:17.564750] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-04. [2025-10-28T19:02:17.661525] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-05 (2.20 seconds). [2025-10-28T19:02:17.663522] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-06. [2025-10-28T19:02:17.880302] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-04 (0.32 seconds). [2025-10-28T19:02:17.881637] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-05. [2025-10-28T19:02:18.187078] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-05 (0.31 seconds). [2025-10-28T19:02:18.188529] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-06. [2025-10-28T19:02:18.649890] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-28T19:02:18.652470] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-07. [2025-10-28T19:02:20.368929] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-06 (2.71 seconds). [2025-10-28T19:02:20.371353] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-07. [2025-10-28T19:02:20.888847] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-28T19:02:20.892242] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-08. [2025-10-28T19:02:21.475741] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-28T19:02:21.478433] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-09. [2025-10-28T19:02:21.965370] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-10-28T19:02:21.967977] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-10. [2025-10-28T19:02:23.101031] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-07 (4.45 seconds). [2025-10-28T19:02:23.102959] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-08. [2025-10-28T19:02:32.680733] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-08 (24.79 seconds). [2025-10-28T19:02:32.691746] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-09. [2025-10-28T19:02:33.202165] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-08 (24.40 seconds). [2025-10-28T19:02:33.203460] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-09. [2025-10-28T19:02:33.937436] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-10-28T19:02:33.952772] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-10. [2025-10-28T19:02:34.414203] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-28T19:02:34.415832] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-10. [2025-10-28T19:02:34.939543] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-28T19:02:34.941205] [INFO ] [REMOTE ] GHC: Full fetch complete (3717 records). [2025-10-28T19:02:34.941277] [DEBUG] [VALIDATOR ] GHC: Validating primary data. [2025-10-28T19:02:35.331209] [DEBUG] [VALIDATOR ] GHC: All expected trading days are present. [2025-10-28T19:02:35.331352] [DEBUG] [VALIDATOR ] GHC: Primary data validation passed. [2025-10-28T19:02:35.331535] [INFO ] [MAIN ] GHC: Fetched primary data is valid. [2025-10-28T19:02:35.331691] [DEBUG] [LOCAL ] GHC: Saving primary data. [2025-10-28T19:02:35.332331] [DEBUG] [LOCAL ] GHC: Trimmed 3717 records to 2943 (keeping 200 days of data) [2025-10-28T19:02:35.352546] [DEBUG] [LOCAL ] GHC: Primary data saved (2943 records). [2025-10-28T19:02:35.352767] [INFO ] [MAIN ] GHC: Full history saved. [2025-10-28T19:02:35.352880] [INFO ] [MAIN ] Update Progress: 929/2366 symbols completed. GHC took 55.0s. Estimated remaining: 3h 9m 33s. Rate: 7.6 symbols/min [2025-10-28T19:02:35.510475] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-10 (1.56 seconds). [2025-10-28T19:02:35.577082] [INFO ] [REMOTE ] GGB: Full fetch complete (74374 records). [2025-10-28T19:02:35.578898] [DEBUG] [VALIDATOR ] GGB: Validating primary data. [2025-10-28T19:02:35.578639] [INFO ] [MAIN ] GHM: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:02:35.720366] [DEBUG] [LOCAL ] GHM: Loaded 14338 existing records from primary storage. [2025-10-28T19:02:35.736223] [INFO ] [MAIN ] GHM: Loaded 14338 existing records. [2025-10-28T19:02:36.142102] [WARN ] [MAIN ] GHM: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:02:36.162809] [INFO ] [MAIN ] GHM: Wiping existing primary data before full refresh. [2025-10-28T19:02:36.179112] [INFO ] [LOCAL ] GHM: Starting deletion of primary data. [2025-10-28T19:02:36.234727] [DEBUG] [VALIDATOR ] GGB: All expected trading days are present. [2025-10-28T19:02:36.234816] [DEBUG] [LOCAL ] GHM: Deleted primary data file. [2025-10-28T19:02:36.234917] [DEBUG] [VALIDATOR ] GGB: Primary data validation passed. [2025-10-28T19:02:36.235080] [INFO ] [MAIN ] GHM: Starting full primary refresh. [2025-10-28T19:02:36.236261] [INFO ] [MAIN ] GGB: Fetched primary data is valid. [2025-10-28T19:02:36.279538] [DEBUG] [LOCAL ] GGB: Saving primary data. [2025-10-28T19:02:36.361962] [DEBUG] [LOCAL ] GGB: Trimmed 74374 records to 51530 (keeping 200 days of data) [2025-10-28T19:02:36.731611] [INFO ] [REMOTE ] GHM: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:02:36.736009] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-01. [2025-10-28T19:02:36.943481] [DEBUG] [LOCAL ] GGB: Primary data saved (51530 records). [2025-10-28T19:02:36.943627] [INFO ] [MAIN ] GGB: Full history saved. [2025-10-28T19:02:36.943767] [INFO ] [MAIN ] Update Progress: 930/2366 symbols completed. GGB took 2m 33s. Estimated remaining: 3h 9m 15s. Rate: 7.6 symbols/min [2025-10-28T19:02:37.116075] [INFO ] [MAIN ] GHY: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:02:37.137724] [DEBUG] [LOCAL ] GHY: Loaded 20669 existing records from primary storage. [2025-10-28T19:02:37.137974] [INFO ] [MAIN ] GHY: Loaded 20669 existing records. [2025-10-28T19:02:37.320497] [WARN ] [MAIN ] GHY: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:02:37.320790] [INFO ] [MAIN ] GHY: Wiping existing primary data before full refresh. [2025-10-28T19:02:37.320840] [INFO ] [LOCAL ] GHY: Starting deletion of primary data. [2025-10-28T19:02:37.320998] [DEBUG] [LOCAL ] GHY: Deleted primary data file. [2025-10-28T19:02:37.321036] [INFO ] [MAIN ] GHY: Starting full primary refresh. [2025-10-28T19:02:37.499311] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-28T19:02:37.520458] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-02. [2025-10-28T19:02:37.757425] [INFO ] [REMOTE ] GHY: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:02:37.757891] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-01. [2025-10-28T19:02:38.662472] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-28T19:02:38.669272] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-02. [2025-10-28T19:02:39.062782] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-10 (17.09 seconds). [2025-10-28T19:02:39.066370] [INFO ] [REMOTE ] GHI: Full fetch complete (11344 records). [2025-10-28T19:02:39.066449] [DEBUG] [VALIDATOR ] GHI: Validating primary data. [2025-10-28T19:02:39.504330] [DEBUG] [VALIDATOR ] GHI: All expected trading days are present. [2025-10-28T19:02:39.504409] [DEBUG] [VALIDATOR ] GHI: Primary data validation passed. [2025-10-28T19:02:39.504974] [INFO ] [MAIN ] GHI: Fetched primary data is valid. [2025-10-28T19:02:39.505039] [DEBUG] [LOCAL ] GHI: Saving primary data. [2025-10-28T19:02:39.505546] [DEBUG] [LOCAL ] GHI: Trimmed 11344 records to 8022 (keeping 200 days of data) [2025-10-28T19:02:39.557211] [DEBUG] [LOCAL ] GHI: Primary data saved (8022 records). [2025-10-28T19:02:39.557329] [INFO ] [MAIN ] GHI: Full history saved. [2025-10-28T19:02:39.557406] [INFO ] [MAIN ] Update Progress: 931/2366 symbols completed. GHI took 29.7s. Estimated remaining: 3h 8m 59s. Rate: 7.6 symbols/min [2025-10-28T19:02:39.731139] [INFO ] [MAIN ] GIB: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:02:39.762686] [DEBUG] [LOCAL ] GIB: Loaded 30975 existing records from primary storage. [2025-10-28T19:02:39.762989] [INFO ] [MAIN ] GIB: Loaded 30975 existing records. [2025-10-28T19:02:39.936126] [WARN ] [MAIN ] GIB: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:02:39.936316] [INFO ] [MAIN ] GIB: Wiping existing primary data before full refresh. [2025-10-28T19:02:39.936363] [INFO ] [LOCAL ] GIB: Starting deletion of primary data. [2025-10-28T19:02:39.936613] [DEBUG] [LOCAL ] GIB: Deleted primary data file. [2025-10-28T19:02:39.936912] [INFO ] [MAIN ] GIB: Starting full primary refresh. [2025-10-28T19:02:40.283133] [INFO ] [REMOTE ] GIB: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:02:40.283460] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-01. [2025-10-28T19:02:41.137982] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-08 (18.04 seconds). [2025-10-28T19:02:41.149988] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-09. [2025-10-28T19:02:41.152238] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-28T19:02:41.158711] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-02. [2025-10-28T19:02:41.527517] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-10-28T19:02:41.529264] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-10. [2025-10-28T19:02:42.005997] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-10 (0.48 seconds). [2025-10-28T19:02:42.011022] [INFO ] [REMOTE ] GHLD: Full fetch complete (5189 records). [2025-10-28T19:02:42.011166] [DEBUG] [VALIDATOR ] GHLD: Validating primary data. [2025-10-28T19:02:42.363964] [DEBUG] [VALIDATOR ] GHLD: All expected trading days are present. [2025-10-28T19:02:42.364112] [DEBUG] [VALIDATOR ] GHLD: Primary data validation passed. [2025-10-28T19:02:42.364289] [INFO ] [MAIN ] GHLD: Fetched primary data is valid. [2025-10-28T19:02:42.364330] [DEBUG] [LOCAL ] GHLD: Saving primary data. [2025-10-28T19:02:42.364736] [DEBUG] [LOCAL ] GHLD: Trimmed 5189 records to 4340 (keeping 200 days of data) [2025-10-28T19:02:42.389758] [DEBUG] [LOCAL ] GHLD: Primary data saved (4340 records). [2025-10-28T19:02:42.389825] [INFO ] [MAIN ] GHLD: Full history saved. [2025-10-28T19:02:42.389893] [INFO ] [MAIN ] Update Progress: 932/2366 symbols completed. GHLD took 28.9s. Estimated remaining: 3h 8m 43s. Rate: 7.6 symbols/min [2025-10-28T19:02:42.556261] [INFO ] [MAIN ] GIC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:02:42.571334] [DEBUG] [LOCAL ] GIC: Loaded 12968 existing records from primary storage. [2025-10-28T19:02:42.571559] [INFO ] [MAIN ] GIC: Loaded 12968 existing records. [2025-10-28T19:02:42.747423] [WARN ] [MAIN ] GIC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:02:42.747733] [INFO ] [MAIN ] GIC: Wiping existing primary data before full refresh. [2025-10-28T19:02:42.747801] [INFO ] [LOCAL ] GIC: Starting deletion of primary data. [2025-10-28T19:02:42.747999] [DEBUG] [LOCAL ] GIC: Deleted primary data file. [2025-10-28T19:02:42.748075] [INFO ] [MAIN ] GIC: Starting full primary refresh. [2025-10-28T19:02:43.116485] [INFO ] [REMOTE ] GIC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:02:43.116855] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-01. [2025-10-28T19:02:43.169390] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-02 (5.65 seconds). [2025-10-28T19:02:43.174329] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-03. [2025-10-28T19:02:43.745077] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-28T19:02:43.749701] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-02. [2025-10-28T19:02:43.775940] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-28T19:02:43.779887] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-04. [2025-10-28T19:02:44.243748] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-10-28T19:02:44.247278] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-03. [2025-10-28T19:02:44.309610] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-28T19:02:44.312780] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-05. [2025-10-28T19:02:44.870455] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-28T19:02:44.873949] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-06. [2025-10-28T19:02:45.548226] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-28T19:02:45.552915] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-07. [2025-10-28T19:02:45.584785] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-02 (6.92 seconds). [2025-10-28T19:02:45.589328] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-03. [2025-10-28T19:02:49.496734] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-03 (5.25 seconds). [2025-10-28T19:02:49.500235] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-04. [2025-10-28T19:02:50.034290] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-02 (8.88 seconds). [2025-10-28T19:02:50.040735] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-03. [2025-10-28T19:02:50.279452] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-28T19:02:50.283544] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-05. [2025-10-28T19:02:50.812722] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-10-28T19:02:50.815933] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-06. [2025-10-28T19:02:51.288369] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-28T19:02:51.297174] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-04. [2025-10-28T19:02:51.449990] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-28T19:02:51.454629] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-07. [2025-10-28T19:02:52.016153] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-28T19:02:52.020075] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-08. [2025-10-28T19:02:52.726356] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-28T19:02:52.731034] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-09. [2025-10-28T19:02:53.334813] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-28T19:02:53.339323] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-10. [2025-10-28T19:02:53.883573] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-07 (8.33 seconds). [2025-10-28T19:02:53.888277] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-08. [2025-10-28T19:02:54.132774] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-28T19:02:54.136069] [INFO ] [REMOTE ] GIC: Full fetch complete (19577 records). [2025-10-28T19:02:54.136255] [DEBUG] [VALIDATOR ] GIC: Validating primary data. [2025-10-28T19:02:54.554202] [DEBUG] [VALIDATOR ] GIC: All expected trading days are present. [2025-10-28T19:02:54.554630] [DEBUG] [VALIDATOR ] GIC: Primary data validation passed. [2025-10-28T19:02:54.555401] [INFO ] [MAIN ] GIC: Fetched primary data is valid. [2025-10-28T19:02:54.555517] [DEBUG] [LOCAL ] GIC: Saving primary data. [2025-10-28T19:02:54.562274] [DEBUG] [LOCAL ] GIC: Trimmed 19577 records to 12937 (keeping 200 days of data) [2025-10-28T19:02:54.572452] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-28T19:02:54.611858] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-09. [2025-10-28T19:02:54.671175] [DEBUG] [LOCAL ] GIC: Primary data saved (12937 records). [2025-10-28T19:02:54.671404] [INFO ] [MAIN ] GIC: Full history saved. [2025-10-28T19:02:54.671533] [INFO ] [MAIN ] Update Progress: 933/2366 symbols completed. GIC took 12.3s. Estimated remaining: 3h 8m 42s. Rate: 7.6 symbols/min [2025-10-28T19:02:54.778794] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-03 (9.19 seconds). [2025-10-28T19:02:54.811022] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-04. [2025-10-28T19:02:54.884781] [INFO ] [MAIN ] GIL: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:02:54.924040] [DEBUG] [LOCAL ] GIL: Loaded 43844 existing records from primary storage. [2025-10-28T19:02:54.924322] [INFO ] [MAIN ] GIL: Loaded 43844 existing records. [2025-10-28T19:02:55.103058] [WARN ] [MAIN ] GIL: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:02:55.103240] [INFO ] [MAIN ] GIL: Wiping existing primary data before full refresh. [2025-10-28T19:02:55.103286] [INFO ] [LOCAL ] GIL: Starting deletion of primary data. [2025-10-28T19:02:55.103534] [DEBUG] [LOCAL ] GIL: Deleted primary data file. [2025-10-28T19:02:55.103590] [INFO ] [MAIN ] GIL: Starting full primary refresh. [2025-10-28T19:02:55.423971] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-28T19:02:55.462877] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-10. [2025-10-28T19:02:55.495604] [INFO ] [REMOTE ] GIL: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:02:55.496204] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-01. [2025-10-28T19:02:55.649223] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-28T19:02:55.655831] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-05. [2025-10-28T19:02:56.140413] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-28T19:02:56.144059] [INFO ] [REMOTE ] GHM: Full fetch complete (21894 records). [2025-10-28T19:02:56.144134] [DEBUG] [VALIDATOR ] GHM: Validating primary data. [2025-10-28T19:02:56.523452] [DEBUG] [VALIDATOR ] GHM: All expected trading days are present. [2025-10-28T19:02:56.523623] [DEBUG] [VALIDATOR ] GHM: Primary data validation passed. [2025-10-28T19:02:56.524215] [INFO ] [MAIN ] GHM: Fetched primary data is valid. [2025-10-28T19:02:56.524318] [DEBUG] [LOCAL ] GHM: Saving primary data. [2025-10-28T19:02:56.525230] [DEBUG] [LOCAL ] GHM: Trimmed 21894 records to 14314 (keeping 200 days of data) [2025-10-28T19:02:56.605309] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-28T19:02:56.616289] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-02. [2025-10-28T19:02:56.638114] [DEBUG] [LOCAL ] GHM: Primary data saved (14314 records). [2025-10-28T19:02:56.638250] [INFO ] [MAIN ] GHM: Full history saved. [2025-10-28T19:02:56.638332] [INFO ] [MAIN ] Update Progress: 934/2366 symbols completed. GHM took 21.3s. Estimated remaining: 3h 8m 25s. Rate: 7.6 symbols/min [2025-10-28T19:02:56.808938] [INFO ] [MAIN ] GIS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:02:56.855091] [DEBUG] [LOCAL ] GIS: Loaded 53675 existing records from primary storage. [2025-10-28T19:02:56.855375] [INFO ] [MAIN ] GIS: Loaded 53675 existing records. [2025-10-28T19:02:57.028913] [WARN ] [MAIN ] GIS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:02:57.029108] [INFO ] [MAIN ] GIS: Wiping existing primary data before full refresh. [2025-10-28T19:02:57.029155] [INFO ] [LOCAL ] GIS: Starting deletion of primary data. [2025-10-28T19:02:57.029339] [DEBUG] [LOCAL ] GIS: Deleted primary data file. [2025-10-28T19:02:57.029376] [INFO ] [MAIN ] GIS: Starting full primary refresh. [2025-10-28T19:02:57.384394] [INFO ] [REMOTE ] GIS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:02:57.384732] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-01. [2025-10-28T19:02:58.876038] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-28T19:02:58.887004] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-02. [2025-10-28T19:03:00.291338] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-28T19:03:00.301435] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-03. [2025-10-28T19:03:01.187429] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-04 (9.89 seconds). [2025-10-28T19:03:01.195399] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-05. [2025-10-28T19:03:01.953941] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-28T19:03:01.965406] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-04. [2025-10-28T19:03:03.645245] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-10-28T19:03:03.656978] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-05. [2025-10-28T19:03:04.312792] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-02 (7.70 seconds). [2025-10-28T19:03:04.321103] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-03. [2025-10-28T19:03:05.379857] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-28T19:03:05.391046] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-06. [2025-10-28T19:03:06.854275] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-05 (11.20 seconds). [2025-10-28T19:03:06.859389] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-06. [2025-10-28T19:03:07.447427] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-10-28T19:03:07.451314] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-07. [2025-10-28T19:03:08.222113] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-28T19:03:08.229904] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-08. [2025-10-28T19:03:08.954982] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-28T19:03:08.960035] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-09. [2025-10-28T19:03:09.657520] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-28T19:03:09.662435] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-10. [2025-10-28T19:03:10.590929] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-10 (0.93 seconds). [2025-10-28T19:03:10.596352] [INFO ] [REMOTE ] GHY: Full fetch complete (32116 records). [2025-10-28T19:03:10.596455] [DEBUG] [VALIDATOR ] GHY: Validating primary data. [2025-10-28T19:03:10.866079] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-05 (9.67 seconds). [2025-10-28T19:03:10.922086] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-06. [2025-10-28T19:03:11.022041] [DEBUG] [VALIDATOR ] GHY: All expected trading days are present. [2025-10-28T19:03:11.022128] [DEBUG] [VALIDATOR ] GHY: Primary data validation passed. [2025-10-28T19:03:11.022809] [INFO ] [MAIN ] GHY: Fetched primary data is valid. [2025-10-28T19:03:11.022871] [DEBUG] [LOCAL ] GHY: Saving primary data. [2025-10-28T19:03:11.023769] [DEBUG] [LOCAL ] GHY: Trimmed 32116 records to 20622 (keeping 200 days of data) [2025-10-28T19:03:11.150556] [DEBUG] [LOCAL ] GHY: Primary data saved (20622 records). [2025-10-28T19:03:11.150714] [INFO ] [MAIN ] GHY: Full history saved. [2025-10-28T19:03:11.150806] [INFO ] [MAIN ] Update Progress: 935/2366 symbols completed. GHY took 34.2s. Estimated remaining: 3h 8m 27s. Rate: 7.6 symbols/min [2025-10-28T19:03:11.328246] [INFO ] [MAIN ] GKOS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:03:11.368097] [DEBUG] [LOCAL ] GKOS: Loaded 42292 existing records from primary storage. [2025-10-28T19:03:11.368460] [INFO ] [MAIN ] GKOS: Loaded 42292 existing records. [2025-10-28T19:03:11.552276] [WARN ] [MAIN ] GKOS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:03:11.552469] [INFO ] [MAIN ] GKOS: Wiping existing primary data before full refresh. [2025-10-28T19:03:11.552523] [INFO ] [LOCAL ] GKOS: Starting deletion of primary data. [2025-10-28T19:03:11.552836] [DEBUG] [LOCAL ] GKOS: Deleted primary data file. [2025-10-28T19:03:11.552895] [INFO ] [MAIN ] GKOS: Starting full primary refresh. [2025-10-28T19:03:11.929934] [INFO ] [REMOTE ] GKOS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:03:11.930349] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-01. [2025-10-28T19:03:11.951827] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-28T19:03:11.959416] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-07. [2025-10-28T19:03:12.955955] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-28T19:03:12.964616] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-08. [2025-10-28T19:03:13.009480] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-28T19:03:13.017029] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-02. [2025-10-28T19:03:14.097275] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-28T19:03:14.105693] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-09. [2025-10-28T19:03:14.143346] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-06 (8.75 seconds). [2025-10-28T19:03:14.155342] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-07. [2025-10-28T19:03:18.395724] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-03 (14.07 seconds). [2025-10-28T19:03:18.405200] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-04. [2025-10-28T19:03:19.921688] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-02 (6.90 seconds). [2025-10-28T19:03:19.930374] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-03. [2025-10-28T19:03:21.015367] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-28T19:03:21.024889] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-04. [2025-10-28T19:03:22.950128] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-09 (8.84 seconds). [2025-10-28T19:03:22.957583] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-10. [2025-10-28T19:03:23.948505] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-28T19:03:23.971444] [INFO ] [REMOTE ] GIB: Full fetch complete (46491 records). [2025-10-28T19:03:23.986388] [DEBUG] [VALIDATOR ] GIB: Validating primary data. [2025-10-28T19:03:24.000337] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-07 (9.84 seconds). [2025-10-28T19:03:24.120199] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-08. [2025-10-28T19:03:24.440614] [DEBUG] [VALIDATOR ] GIB: All expected trading days are present. [2025-10-28T19:03:24.440741] [DEBUG] [VALIDATOR ] GIB: Primary data validation passed. [2025-10-28T19:03:24.441459] [INFO ] [MAIN ] GIB: Fetched primary data is valid. [2025-10-28T19:03:24.441521] [DEBUG] [LOCAL ] GIB: Saving primary data. [2025-10-28T19:03:24.442604] [DEBUG] [LOCAL ] GIB: Trimmed 46491 records to 30851 (keeping 200 days of data) [2025-10-28T19:03:24.626705] [DEBUG] [LOCAL ] GIB: Primary data saved (30851 records). [2025-10-28T19:03:24.626828] [INFO ] [MAIN ] GIB: Full history saved. [2025-10-28T19:03:24.626918] [INFO ] [MAIN ] Update Progress: 936/2366 symbols completed. GIB took 45.1s. Estimated remaining: 3h 8m 28s. Rate: 7.6 symbols/min [2025-10-28T19:03:24.793315] [INFO ] [MAIN ] GL: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:03:24.828969] [DEBUG] [LOCAL ] GL: Loaded 37258 existing records from primary storage. [2025-10-28T19:03:24.829232] [INFO ] [MAIN ] GL: Loaded 37258 existing records. [2025-10-28T19:03:25.004409] [WARN ] [MAIN ] GL: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:03:25.004597] [INFO ] [MAIN ] GL: Wiping existing primary data before full refresh. [2025-10-28T19:03:25.004664] [INFO ] [LOCAL ] GL: Starting deletion of primary data. [2025-10-28T19:03:25.004889] [DEBUG] [LOCAL ] GL: Deleted primary data file. [2025-10-28T19:03:25.004931] [INFO ] [MAIN ] GL: Starting full primary refresh. [2025-10-28T19:03:25.354893] [INFO ] [REMOTE ] GL: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:03:25.355190] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-01. [2025-10-28T19:03:25.557613] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-28T19:03:25.569239] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-09. [2025-10-28T19:03:26.512241] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-28T19:03:26.519969] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-02. [2025-10-28T19:03:27.034180] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-28T19:03:27.045743] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-04 (8.64 seconds). [2025-10-28T19:03:27.056675] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-05. [2025-10-28T19:03:27.056338] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-10. [2025-10-28T19:03:28.263185] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-28T19:03:28.272177] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-06. [2025-10-28T19:03:31.058240] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-02 (4.54 seconds). [2025-10-28T19:03:31.066183] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-03. [2025-10-28T19:03:31.152277] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-04 (10.13 seconds). [2025-10-28T19:03:31.161832] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-05. [2025-10-28T19:03:32.378685] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-28T19:03:32.388310] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-04. [2025-10-28T19:03:32.421158] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-28T19:03:32.430837] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-06. [2025-10-28T19:03:33.539723] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-28T19:03:33.548946] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-07. [2025-10-28T19:03:33.637112] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-28T19:03:33.646686] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-05. [2025-10-28T19:03:34.695786] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-28T19:03:34.705362] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-08. [2025-10-28T19:03:34.878896] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-28T19:03:34.887452] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-06. [2025-10-28T19:03:35.862577] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-28T19:03:35.869535] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-07. [2025-10-28T19:03:37.103110] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-28T19:03:37.112747] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-08. [2025-10-28T19:03:37.342601] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-06 (9.07 seconds). [2025-10-28T19:03:37.350966] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-07. [2025-10-28T19:03:38.571711] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-28T19:03:38.580762] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-08. [2025-10-28T19:03:39.371349] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-10 (12.31 seconds). [2025-10-28T19:03:39.384606] [INFO ] [REMOTE ] GIS: Full fetch complete (77844 records). [2025-10-28T19:03:39.384933] [DEBUG] [VALIDATOR ] GIS: Validating primary data. [2025-10-28T19:03:39.818571] [DEBUG] [VALIDATOR ] GIS: All expected trading days are present. [2025-10-28T19:03:39.818720] [DEBUG] [VALIDATOR ] GIS: Primary data validation passed. [2025-10-28T19:03:39.820132] [INFO ] [MAIN ] GIS: Fetched primary data is valid. [2025-10-28T19:03:39.820200] [DEBUG] [LOCAL ] GIS: Saving primary data. [2025-10-28T19:03:39.822345] [DEBUG] [LOCAL ] GIS: Trimmed 77844 records to 53675 (keeping 200 days of data) [2025-10-28T19:03:40.184408] [DEBUG] [LOCAL ] GIS: Primary data saved (53675 records). [2025-10-28T19:03:40.184608] [INFO ] [MAIN ] GIS: Full history saved. [2025-10-28T19:03:40.184742] [INFO ] [MAIN ] Update Progress: 937/2366 symbols completed. GIS took 43.5s. Estimated remaining: 3h 8m 32s. Rate: 7.6 symbols/min [2025-10-28T19:03:40.364956] [INFO ] [MAIN ] GLOB: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:03:40.414939] [DEBUG] [LOCAL ] GLOB: Loaded 48001 existing records from primary storage. [2025-10-28T19:03:40.415349] [INFO ] [MAIN ] GLOB: Loaded 48001 existing records. [2025-10-28T19:03:40.618889] [WARN ] [MAIN ] GLOB: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:03:40.619154] [INFO ] [MAIN ] GLOB: Wiping existing primary data before full refresh. [2025-10-28T19:03:40.619206] [INFO ] [LOCAL ] GLOB: Starting deletion of primary data. [2025-10-28T19:03:40.620236] [DEBUG] [LOCAL ] GLOB: Deleted primary data file. [2025-10-28T19:03:40.620297] [INFO ] [MAIN ] GLOB: Starting full primary refresh. [2025-10-28T19:03:41.024769] [INFO ] [REMOTE ] GLOB: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:03:41.025183] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-01. [2025-10-28T19:03:42.173388] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-28T19:03:42.180756] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-02. [2025-10-28T19:03:43.263970] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-28T19:03:43.271628] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-03. [2025-10-28T19:03:44.286525] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-08 (9.58 seconds). [2025-10-28T19:03:44.296402] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-09. [2025-10-28T19:03:44.547953] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-08 (5.97 seconds). [2025-10-28T19:03:44.558389] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-09. [2025-10-28T19:03:44.585048] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-28T19:03:44.594947] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-04. [2025-10-28T19:03:45.383674] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-10-28T19:03:45.392599] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-10. [2025-10-28T19:03:45.656404] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-28T19:03:45.667287] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-10. [2025-10-28T19:03:45.835732] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-28T19:03:45.844964] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-05. [2025-10-28T19:03:46.649731] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-28T19:03:46.658938] [INFO ] [REMOTE ] GKOS: Full fetch complete (60751 records). [2025-10-28T19:03:46.659123] [DEBUG] [VALIDATOR ] GKOS: Validating primary data. [2025-10-28T19:03:47.082447] [DEBUG] [VALIDATOR ] GKOS: All expected trading days are present. [2025-10-28T19:03:47.082635] [DEBUG] [VALIDATOR ] GKOS: Primary data validation passed. [2025-10-28T19:03:47.083974] [INFO ] [MAIN ] GKOS: Fetched primary data is valid. [2025-10-28T19:03:47.084063] [DEBUG] [LOCAL ] GKOS: Saving primary data. [2025-10-28T19:03:47.110576] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-28T19:03:47.120033] [DEBUG] [LOCAL ] GKOS: Trimmed 60751 records to 42280 (keeping 200 days of data) [2025-10-28T19:03:47.121312] [INFO ] [REMOTE ] GIL: Full fetch complete (62689 records). [2025-10-28T19:03:47.121870] [DEBUG] [VALIDATOR ] GIL: Validating primary data. [2025-10-28T19:03:47.791850] [DEBUG] [VALIDATOR ] GIL: All expected trading days are present. [2025-10-28T19:03:47.788548] [DEBUG] [LOCAL ] GKOS: Primary data saved (42280 records). [2025-10-28T19:03:47.792048] [DEBUG] [VALIDATOR ] GIL: Primary data validation passed. [2025-10-28T19:03:47.793176] [INFO ] [MAIN ] GIL: Fetched primary data is valid. [2025-10-28T19:03:47.793266] [DEBUG] [LOCAL ] GIL: Saving primary data. [2025-10-28T19:03:47.793397] [INFO ] [MAIN ] GKOS: Full history saved. [2025-10-28T19:03:47.793755] [INFO ] [MAIN ] Update Progress: 938/2366 symbols completed. GKOS took 36.6s. Estimated remaining: 3h 8m 23s. Rate: 7.6 symbols/min [2025-10-28T19:03:47.871866] [DEBUG] [LOCAL ] GIL: Trimmed 62689 records to 43779 (keeping 200 days of data) [2025-10-28T19:03:48.091850] [INFO ] [MAIN ] GLP: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:03:48.210543] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-08 (11.10 seconds). [2025-10-28T19:03:48.280985] [DEBUG] [LOCAL ] GLP: Loaded 9104 existing records from primary storage. [2025-10-28T19:03:48.271253] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-09. [2025-10-28T19:03:48.303332] [INFO ] [MAIN ] GLP: Loaded 9104 existing records. [2025-10-28T19:03:48.320674] [DEBUG] [LOCAL ] GIL: Primary data saved (43779 records). [2025-10-28T19:03:48.355853] [INFO ] [MAIN ] GIL: Full history saved. [2025-10-28T19:03:48.380578] [INFO ] [MAIN ] Update Progress: 939/2366 symbols completed. GIL took 53.7s. Estimated remaining: 3h 8m 4s. Rate: 7.6 symbols/min [2025-10-28T19:03:48.673827] [WARN ] [MAIN ] GLP: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:03:48.709764] [INFO ] [MAIN ] GLW: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:03:48.709863] [INFO ] [MAIN ] GLP: Wiping existing primary data before full refresh. [2025-10-28T19:03:48.710469] [INFO ] [LOCAL ] GLP: Starting deletion of primary data. [2025-10-28T19:03:48.710993] [DEBUG] [LOCAL ] GLP: Deleted primary data file. [2025-10-28T19:03:48.711068] [INFO ] [MAIN ] GLP: Starting full primary refresh. [2025-10-28T19:03:49.094797] [DEBUG] [LOCAL ] GLW: Loaded 53635 existing records from primary storage. [2025-10-28T19:03:49.106594] [INFO ] [MAIN ] GLW: Loaded 53635 existing records. [2025-10-28T19:03:49.226680] [INFO ] [REMOTE ] GLP: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:03:49.250833] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-01. [2025-10-28T19:03:49.343559] [WARN ] [MAIN ] GLW: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:03:49.343879] [INFO ] [MAIN ] GLW: Wiping existing primary data before full refresh. [2025-10-28T19:03:49.343931] [INFO ] [LOCAL ] GLW: Starting deletion of primary data. [2025-10-28T19:03:49.345127] [DEBUG] [LOCAL ] GLW: Deleted primary data file. [2025-10-28T19:03:49.345189] [INFO ] [MAIN ] GLW: Starting full primary refresh. [2025-10-28T19:03:49.727090] [INFO ] [REMOTE ] GLW: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:03:49.727468] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-01. [2025-10-28T19:03:50.050509] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-28T19:03:50.053789] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-02. [2025-10-28T19:03:50.695715] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-28T19:03:50.699029] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-03. [2025-10-28T19:03:51.037617] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-28T19:03:51.049012] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-02. [2025-10-28T19:03:51.272520] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-10-28T19:03:51.276088] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-04. [2025-10-28T19:03:51.753595] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-28T19:03:51.755983] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-05. [2025-10-28T19:03:52.240178] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-28T19:03:52.243295] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-06. [2025-10-28T19:03:52.336997] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-28T19:03:52.351302] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-03. [2025-10-28T19:03:52.618481] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-10-28T19:03:52.621718] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-07. [2025-10-28T19:03:52.746408] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-05 (6.90 seconds). [2025-10-28T19:03:52.757929] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-06. [2025-10-28T19:03:52.959253] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-09 (4.69 seconds). [2025-10-28T19:03:52.966553] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-10. [2025-10-28T19:03:53.102199] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-28T19:03:53.104557] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-08. [2025-10-28T19:03:53.624743] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-28T19:03:53.627847] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-09. [2025-10-28T19:03:53.876574] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-28T19:03:53.887327] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-07. [2025-10-28T19:03:53.942228] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-28T19:03:53.957488] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-04. [2025-10-28T19:03:54.193746] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-10-28T19:03:54.197276] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-10. [2025-10-28T19:03:54.944540] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-28T19:03:54.955364] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-08. [2025-10-28T19:03:55.367836] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-28T19:03:55.379180] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-05. [2025-10-28T19:03:56.062748] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-28T19:03:56.064881] [INFO ] [REMOTE ] GLP: Full fetch complete (14257 records). [2025-10-28T19:03:56.064969] [DEBUG] [VALIDATOR ] GLP: Validating primary data. [2025-10-28T19:03:56.430474] [DEBUG] [VALIDATOR ] GLP: All expected trading days are present. [2025-10-28T19:03:56.430559] [DEBUG] [VALIDATOR ] GLP: Primary data validation passed. [2025-10-28T19:03:56.430930] [INFO ] [MAIN ] GLP: Fetched primary data is valid. [2025-10-28T19:03:56.430997] [DEBUG] [LOCAL ] GLP: Saving primary data. [2025-10-28T19:03:56.431621] [DEBUG] [LOCAL ] GLP: Trimmed 14257 records to 9089 (keeping 200 days of data) [2025-10-28T19:03:56.486904] [DEBUG] [LOCAL ] GLP: Primary data saved (9089 records). [2025-10-28T19:03:56.487035] [INFO ] [MAIN ] GLP: Full history saved. [2025-10-28T19:03:56.487112] [INFO ] [MAIN ] Update Progress: 940/2366 symbols completed. GLP took 8.7s. Estimated remaining: 3h 7m 57s. Rate: 7.6 symbols/min [2025-10-28T19:03:56.660639] [INFO ] [MAIN ] GM: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:03:56.713162] [DEBUG] [LOCAL ] GM: Loaded 53729 existing records from primary storage. [2025-10-28T19:03:56.713574] [INFO ] [MAIN ] GM: Loaded 53729 existing records. [2025-10-28T19:03:56.910286] [WARN ] [MAIN ] GM: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:03:56.910910] [INFO ] [MAIN ] GM: Wiping existing primary data before full refresh. [2025-10-28T19:03:56.910998] [INFO ] [LOCAL ] GM: Starting deletion of primary data. [2025-10-28T19:03:56.911240] [DEBUG] [LOCAL ] GM: Deleted primary data file. [2025-10-28T19:03:56.911282] [INFO ] [MAIN ] GM: Starting full primary refresh. [2025-10-28T19:03:57.136381] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-10-28T19:03:57.232219] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-06. [2025-10-28T19:03:57.360301] [INFO ] [REMOTE ] GM: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:03:57.360938] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-01. [2025-10-28T19:03:58.922393] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-10-28T19:03:58.924608] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-10 (5.96 seconds). [2025-10-28T19:03:58.945862] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-07. [2025-10-28T19:03:58.946067] [INFO ] [REMOTE ] GL: Full fetch complete (54798 records). [2025-10-28T19:03:58.946453] [DEBUG] [VALIDATOR ] GL: Validating primary data. [2025-10-28T19:03:59.342072] [DEBUG] [VALIDATOR ] GL: All expected trading days are present. [2025-10-28T19:03:59.342177] [DEBUG] [VALIDATOR ] GL: Primary data validation passed. [2025-10-28T19:03:59.343108] [INFO ] [MAIN ] GL: Fetched primary data is valid. [2025-10-28T19:03:59.343214] [DEBUG] [LOCAL ] GL: Saving primary data. [2025-10-28T19:03:59.344714] [DEBUG] [LOCAL ] GL: Trimmed 54798 records to 37187 (keeping 200 days of data) [2025-10-28T19:03:59.477025] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-10-28T19:03:59.489377] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-02. [2025-10-28T19:03:59.612325] [DEBUG] [LOCAL ] GL: Primary data saved (37187 records). [2025-10-28T19:03:59.612461] [INFO ] [MAIN ] GL: Full history saved. [2025-10-28T19:03:59.612553] [INFO ] [MAIN ] Update Progress: 941/2366 symbols completed. GL took 35.0s. Estimated remaining: 3h 7m 42s. Rate: 7.6 symbols/min [2025-10-28T19:03:59.777768] [INFO ] [MAIN ] GME: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:03:59.828429] [DEBUG] [LOCAL ] GME: Loaded 53777 existing records from primary storage. [2025-10-28T19:03:59.828771] [INFO ] [MAIN ] GME: Loaded 53777 existing records. [2025-10-28T19:04:00.005167] [WARN ] [MAIN ] GME: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:04:00.005352] [INFO ] [MAIN ] GME: Wiping existing primary data before full refresh. [2025-10-28T19:04:00.005399] [INFO ] [LOCAL ] GME: Starting deletion of primary data. [2025-10-28T19:04:00.005727] [DEBUG] [LOCAL ] GME: Deleted primary data file. [2025-10-28T19:04:00.005783] [INFO ] [MAIN ] GME: Starting full primary refresh. [2025-10-28T19:04:00.353559] [INFO ] [REMOTE ] GME: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:04:00.353887] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-01. [2025-10-28T19:04:01.213215] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-28T19:04:01.223292] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-03. [2025-10-28T19:04:02.326267] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-10-28T19:04:02.336787] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-02. [2025-10-28T19:04:02.489680] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-08 (7.53 seconds). [2025-10-28T19:04:02.500791] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-09. [2025-10-28T19:04:02.821887] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-10-28T19:04:02.832918] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-04. [2025-10-28T19:04:03.844904] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-28T19:04:03.855718] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-10. [2025-10-28T19:04:04.708206] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-10-28T19:04:04.719379] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-05. [2025-10-28T19:04:05.233850] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-28T19:04:05.244221] [INFO ] [REMOTE ] GLOB: Full fetch complete (66724 records). [2025-10-28T19:04:05.244381] [DEBUG] [VALIDATOR ] GLOB: Validating primary data. [2025-10-28T19:04:05.656716] [DEBUG] [VALIDATOR ] GLOB: All expected trading days are present. [2025-10-28T19:04:05.656872] [DEBUG] [VALIDATOR ] GLOB: Primary data validation passed. [2025-10-28T19:04:05.658092] [INFO ] [MAIN ] GLOB: Fetched primary data is valid. [2025-10-28T19:04:05.658162] [DEBUG] [LOCAL ] GLOB: Saving primary data. [2025-10-28T19:04:05.660097] [DEBUG] [LOCAL ] GLOB: Trimmed 66724 records to 48028 (keeping 200 days of data) [2025-10-28T19:04:05.981177] [DEBUG] [LOCAL ] GLOB: Primary data saved (48028 records). [2025-10-28T19:04:05.981337] [INFO ] [MAIN ] GLOB: Full history saved. [2025-10-28T19:04:05.981427] [INFO ] [MAIN ] Update Progress: 942/2366 symbols completed. GLOB took 25.8s. Estimated remaining: 3h 7m 31s. Rate: 7.6 symbols/min [2025-10-28T19:04:06.154754] [INFO ] [MAIN ] GMED: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:04:06.195534] [DEBUG] [LOCAL ] GMED: Loaded 48055 existing records from primary storage. [2025-10-28T19:04:06.195843] [INFO ] [MAIN ] GMED: Loaded 48055 existing records. [2025-10-28T19:04:06.382897] [WARN ] [MAIN ] GMED: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:04:06.383713] [INFO ] [MAIN ] GMED: Wiping existing primary data before full refresh. [2025-10-28T19:04:06.383781] [INFO ] [LOCAL ] GMED: Starting deletion of primary data. [2025-10-28T19:04:06.384801] [DEBUG] [LOCAL ] GMED: Deleted primary data file. [2025-10-28T19:04:06.384866] [INFO ] [MAIN ] GMED: Starting full primary refresh. [2025-10-28T19:04:06.531391] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-07 (7.59 seconds). [2025-10-28T19:04:06.592848] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-08. [2025-10-28T19:04:06.739113] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-10-28T19:04:06.792632] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-06. [2025-10-28T19:04:06.880738] [INFO ] [REMOTE ] GMED: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:04:06.881139] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-01. [2025-10-28T19:04:08.185004] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-10-28T19:04:08.196819] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-09. [2025-10-28T19:04:08.229107] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-28T19:04:08.238699] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-02. [2025-10-28T19:04:08.317574] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-28T19:04:08.328856] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-07. [2025-10-28T19:04:09.504023] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-28T19:04:09.515733] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-03. [2025-10-28T19:04:09.912311] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-28T19:04:09.923717] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-10. [2025-10-28T19:04:10.915529] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-28T19:04:10.927395] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-04. [2025-10-28T19:04:11.740311] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-10 (1.82 seconds). [2025-10-28T19:04:11.752813] [INFO ] [REMOTE ] GLW: Full fetch complete (77799 records). [2025-10-28T19:04:11.753283] [DEBUG] [VALIDATOR ] GLW: Validating primary data. [2025-10-28T19:04:12.219273] [DEBUG] [VALIDATOR ] GLW: All expected trading days are present. [2025-10-28T19:04:12.219379] [DEBUG] [VALIDATOR ] GLW: Primary data validation passed. [2025-10-28T19:04:12.220437] [INFO ] [MAIN ] GLW: Fetched primary data is valid. [2025-10-28T19:04:12.220500] [DEBUG] [LOCAL ] GLW: Saving primary data. [2025-10-28T19:04:12.222054] [DEBUG] [LOCAL ] GLW: Trimmed 77799 records to 53635 (keeping 200 days of data) [2025-10-28T19:04:12.542766] [DEBUG] [LOCAL ] GLW: Primary data saved (53635 records). [2025-10-28T19:04:12.542903] [INFO ] [MAIN ] GLW: Full history saved. [2025-10-28T19:04:12.542981] [INFO ] [MAIN ] Update Progress: 943/2366 symbols completed. GLW took 24.1s. Estimated remaining: 3h 7m 21s. Rate: 7.6 symbols/min [2025-10-28T19:04:12.727735] [INFO ] [MAIN ] GMRE: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:04:12.748993] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-02 (10.41 seconds). [2025-10-28T19:04:12.759935] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-03. [2025-10-28T19:04:12.791345] [DEBUG] [LOCAL ] GMRE: Loaded 35708 existing records from primary storage. [2025-10-28T19:04:12.791625] [INFO ] [MAIN ] GMRE: Loaded 35708 existing records. [2025-10-28T19:04:12.975249] [WARN ] [MAIN ] GMRE: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:04:12.975566] [INFO ] [MAIN ] GMRE: Wiping existing primary data before full refresh. [2025-10-28T19:04:12.975615] [INFO ] [LOCAL ] GMRE: Starting deletion of primary data. [2025-10-28T19:04:12.975955] [DEBUG] [LOCAL ] GMRE: Deleted primary data file. [2025-10-28T19:04:12.976016] [INFO ] [MAIN ] GMRE: Starting full primary refresh. [2025-10-28T19:04:13.333698] [INFO ] [REMOTE ] GMRE: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:04:13.333997] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-01. [2025-10-28T19:04:14.653606] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-28T19:04:14.665118] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-04. [2025-10-28T19:04:18.706287] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-01 (5.37 seconds). [2025-10-28T19:04:18.713705] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-02. [2025-10-28T19:04:19.705412] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-28T19:04:19.712319] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-03. [2025-10-28T19:04:20.693333] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-28T19:04:20.702180] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-04. [2025-10-28T19:04:20.848080] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-07 (12.52 seconds). [2025-10-28T19:04:20.859814] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-08. [2025-10-28T19:04:21.822508] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-28T19:04:21.832371] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-05. [2025-10-28T19:04:22.838792] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-28T19:04:22.847428] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-06. [2025-10-28T19:04:23.769185] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-04 (9.10 seconds). [2025-10-28T19:04:23.780146] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-05. [2025-10-28T19:04:24.018623] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-28T19:04:24.028115] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-07. [2025-10-28T19:04:25.946181] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-10-28T19:04:25.957767] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-06. [2025-10-28T19:04:28.106724] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-06 (2.15 seconds). [2025-10-28T19:04:28.117613] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-07. [2025-10-28T19:04:28.968969] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-04 (18.04 seconds). [2025-10-28T19:04:28.979230] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-05. [2025-10-28T19:04:29.777861] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-08 (8.92 seconds). [2025-10-28T19:04:29.789299] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-09. [2025-10-28T19:04:30.054165] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-10-28T19:04:30.066428] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-08. [2025-10-28T19:04:30.255103] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-28T19:04:30.266277] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-06. [2025-10-28T19:04:31.158259] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-28T19:04:31.171465] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-10. [2025-10-28T19:04:31.343596] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-28T19:04:31.353357] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-07. [2025-10-28T19:04:34.420705] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-07 (10.39 seconds). [2025-10-28T19:04:34.429177] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-08. [2025-10-28T19:04:35.565207] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-28T19:04:35.573604] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-09. [2025-10-28T19:04:36.646033] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-28T19:04:36.654287] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-10. [2025-10-28T19:04:37.572354] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-28T19:04:37.577490] [INFO ] [REMOTE ] GMRE: Full fetch complete (51232 records). [2025-10-28T19:04:37.577613] [DEBUG] [VALIDATOR ] GMRE: Validating primary data. [2025-10-28T19:04:37.986117] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-10 (6.81 seconds). [2025-10-28T19:04:38.013790] [DEBUG] [VALIDATOR ] GMRE: All expected trading days are present. [2025-10-28T19:04:38.014000] [DEBUG] [VALIDATOR ] GMRE: Primary data validation passed. [2025-10-28T19:04:38.015047] [INFO ] [MAIN ] GMRE: Fetched primary data is valid. [2025-10-28T19:04:38.015169] [DEBUG] [LOCAL ] GMRE: Saving primary data. [2025-10-28T19:04:38.015402] [INFO ] [REMOTE ] GM: Full fetch complete (77907 records). [2025-10-28T19:04:38.015490] [DEBUG] [VALIDATOR ] GM: Validating primary data. [2025-10-28T19:04:38.016516] [DEBUG] [LOCAL ] GMRE: Trimmed 51232 records to 35511 (keeping 200 days of data) [2025-10-28T19:04:38.629144] [DEBUG] [VALIDATOR ] GM: All expected trading days are present. [2025-10-28T19:04:38.629349] [DEBUG] [VALIDATOR ] GM: Primary data validation passed. [2025-10-28T19:04:38.630920] [INFO ] [MAIN ] GM: Fetched primary data is valid. [2025-10-28T19:04:38.632637] [DEBUG] [LOCAL ] GM: Saving primary data. [2025-10-28T19:04:38.650219] [DEBUG] [LOCAL ] GM: Trimmed 77907 records to 53729 (keeping 200 days of data) [2025-10-28T19:04:38.709791] [DEBUG] [LOCAL ] GMRE: Primary data saved (35511 records). [2025-10-28T19:04:38.718513] [INFO ] [MAIN ] GMRE: Full history saved. [2025-10-28T19:04:38.718718] [INFO ] [MAIN ] Update Progress: 944/2366 symbols completed. GMRE took 26.2s. Estimated remaining: 3h 7m 41s. Rate: 7.6 symbols/min [2025-10-28T19:04:38.941265] [INFO ] [MAIN ] GNE: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:04:39.064129] [DEBUG] [LOCAL ] GNE: Loaded 18127 existing records from primary storage. [2025-10-28T19:04:39.068950] [INFO ] [MAIN ] GNE: Loaded 18127 existing records. [2025-10-28T19:04:39.330366] [WARN ] [MAIN ] GNE: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:04:39.342735] [INFO ] [MAIN ] GNE: Wiping existing primary data before full refresh. [2025-10-28T19:04:39.344724] [INFO ] [LOCAL ] GNE: Starting deletion of primary data. [2025-10-28T19:04:39.347898] [DEBUG] [LOCAL ] GNE: Deleted primary data file. [2025-10-28T19:04:39.348471] [INFO ] [MAIN ] GNE: Starting full primary refresh. [2025-10-28T19:04:39.392938] [DEBUG] [LOCAL ] GM: Primary data saved (53729 records). [2025-10-28T19:04:39.414284] [INFO ] [MAIN ] GM: Full history saved. [2025-10-28T19:04:39.414441] [INFO ] [MAIN ] Update Progress: 945/2366 symbols completed. GM took 42.9s. Estimated remaining: 3h 7m 22s. Rate: 7.6 symbols/min [2025-10-28T19:04:39.801011] [INFO ] [MAIN ] GNK: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:04:39.888832] [INFO ] [REMOTE ] GNE: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:04:39.889216] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-01. [2025-10-28T19:04:39.921028] [DEBUG] [LOCAL ] GNK: Loaded 39008 existing records from primary storage. [2025-10-28T19:04:39.921327] [INFO ] [MAIN ] GNK: Loaded 39008 existing records. [2025-10-28T19:04:40.102239] [WARN ] [MAIN ] GNK: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:04:40.102512] [INFO ] [MAIN ] GNK: Wiping existing primary data before full refresh. [2025-10-28T19:04:40.102569] [INFO ] [LOCAL ] GNK: Starting deletion of primary data. [2025-10-28T19:04:40.102905] [DEBUG] [LOCAL ] GNK: Deleted primary data file. [2025-10-28T19:04:40.102963] [INFO ] [MAIN ] GNK: Starting full primary refresh. [2025-10-28T19:04:40.468414] [INFO ] [REMOTE ] GNK: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:04:40.468943] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-01. [2025-10-28T19:04:40.480553] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-28T19:04:40.484094] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-02. [2025-10-28T19:04:40.959297] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-28T19:04:40.961889] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-03. [2025-10-28T19:04:41.533070] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-28T19:04:41.540421] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-02. [2025-10-28T19:04:42.526047] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-28T19:04:42.533561] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-03. [2025-10-28T19:04:42.634364] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-28T19:04:42.637181] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-04. [2025-10-28T19:04:43.247347] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-28T19:04:43.250341] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-05. [2025-10-28T19:04:43.850696] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-28T19:04:43.854439] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-06. [2025-10-28T19:04:44.301745] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-08 (14.24 seconds). [2025-10-28T19:04:44.313216] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-09. [2025-10-28T19:04:44.655729] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-28T19:04:44.661495] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-07. [2025-10-28T19:04:45.459106] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-28T19:04:45.464769] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-08. [2025-10-28T19:04:46.096283] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-10-28T19:04:46.107880] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-10. [2025-10-28T19:04:47.776112] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-03 (5.24 seconds). [2025-10-28T19:04:47.785369] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-04. [2025-10-28T19:04:48.012523] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-07 (16.66 seconds). [2025-10-28T19:04:48.023383] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-08. [2025-10-28T19:04:48.208203] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-10 (2.10 seconds). [2025-10-28T19:04:48.219373] [INFO ] [REMOTE ] GME: Full fetch complete (77918 records). [2025-10-28T19:04:48.219541] [DEBUG] [VALIDATOR ] GME: Validating primary data. [2025-10-28T19:04:48.618541] [DEBUG] [VALIDATOR ] GME: All expected trading days are present. [2025-10-28T19:04:48.618622] [DEBUG] [VALIDATOR ] GME: Primary data validation passed. [2025-10-28T19:04:48.619952] [INFO ] [MAIN ] GME: Fetched primary data is valid. [2025-10-28T19:04:48.620025] [DEBUG] [LOCAL ] GME: Saving primary data. [2025-10-28T19:04:48.621756] [DEBUG] [LOCAL ] GME: Trimmed 77918 records to 53776 (keeping 200 days of data) [2025-10-28T19:04:48.959359] [DEBUG] [LOCAL ] GME: Primary data saved (53776 records). [2025-10-28T19:04:48.959492] [INFO ] [MAIN ] GME: Full history saved. [2025-10-28T19:04:48.960078] [INFO ] [MAIN ] Update Progress: 946/2366 symbols completed. GME took 49.3s. Estimated remaining: 3h 7m 17s. Rate: 7.6 symbols/min [2025-10-28T19:04:49.126837] [INFO ] [MAIN ] GNL: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:04:49.172934] [DEBUG] [LOCAL ] GNL: Loaded 46279 existing records from primary storage. [2025-10-28T19:04:49.173224] [INFO ] [MAIN ] GNL: Loaded 46279 existing records. [2025-10-28T19:04:49.348284] [WARN ] [MAIN ] GNL: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:04:49.348516] [INFO ] [MAIN ] GNL: Wiping existing primary data before full refresh. [2025-10-28T19:04:49.348561] [INFO ] [LOCAL ] GNL: Starting deletion of primary data. [2025-10-28T19:04:49.348907] [DEBUG] [LOCAL ] GNL: Deleted primary data file. [2025-10-28T19:04:49.348964] [INFO ] [MAIN ] GNL: Starting full primary refresh. [2025-10-28T19:04:49.696720] [INFO ] [REMOTE ] GNL: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:04:49.697020] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-01. [2025-10-28T19:04:50.481580] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-08 (5.02 seconds). [2025-10-28T19:04:50.487479] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-09. [2025-10-28T19:04:51.123291] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-28T19:04:51.127719] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-10. [2025-10-28T19:04:51.854441] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-28T19:04:51.857707] [INFO ] [REMOTE ] GNE: Full fetch complete (22622 records). [2025-10-28T19:04:51.857788] [DEBUG] [VALIDATOR ] GNE: Validating primary data. [2025-10-28T19:04:52.224139] [DEBUG] [VALIDATOR ] GNE: All expected trading days are present. [2025-10-28T19:04:52.224213] [DEBUG] [VALIDATOR ] GNE: Primary data validation passed. [2025-10-28T19:04:52.224746] [INFO ] [MAIN ] GNE: Fetched primary data is valid. [2025-10-28T19:04:52.224825] [DEBUG] [LOCAL ] GNE: Saving primary data. [2025-10-28T19:04:52.225441] [DEBUG] [LOCAL ] GNE: Trimmed 22622 records to 18106 (keeping 200 days of data) [2025-10-28T19:04:52.330673] [DEBUG] [LOCAL ] GNE: Primary data saved (18106 records). [2025-10-28T19:04:52.330828] [INFO ] [MAIN ] GNE: Full history saved. [2025-10-28T19:04:52.330920] [INFO ] [MAIN ] Update Progress: 947/2366 symbols completed. GNE took 13.6s. Estimated remaining: 3h 7m 2s. Rate: 7.6 symbols/min [2025-10-28T19:04:52.463341] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-04 (4.68 seconds). [2025-10-28T19:04:52.512925] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-05. [2025-10-28T19:04:52.544093] [INFO ] [MAIN ] GNRC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:04:52.586009] [DEBUG] [LOCAL ] GNRC: Loaded 45165 existing records from primary storage. [2025-10-28T19:04:52.586292] [INFO ] [MAIN ] GNRC: Loaded 45165 existing records. [2025-10-28T19:04:52.775554] [WARN ] [MAIN ] GNRC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:04:52.775803] [INFO ] [MAIN ] GNRC: Wiping existing primary data before full refresh. [2025-10-28T19:04:52.775854] [INFO ] [LOCAL ] GNRC: Starting deletion of primary data. [2025-10-28T19:04:52.776098] [DEBUG] [LOCAL ] GNRC: Deleted primary data file. [2025-10-28T19:04:52.776139] [INFO ] [MAIN ] GNRC: Starting full primary refresh. [2025-10-28T19:04:53.135436] [INFO ] [REMOTE ] GNRC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:04:53.135754] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-01. [2025-10-28T19:04:53.559056] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-28T19:04:53.567993] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-06. [2025-10-28T19:04:54.436742] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-28T19:04:54.446949] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-02. [2025-10-28T19:04:54.566599] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-28T19:04:54.575811] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-07. [2025-10-28T19:04:55.580723] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-28T19:04:55.589615] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-03. [2025-10-28T19:04:55.732858] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-28T19:04:55.742859] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-08. [2025-10-28T19:04:56.167036] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-08 (8.14 seconds). [2025-10-28T19:04:56.177960] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-09. [2025-10-28T19:04:56.726538] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-28T19:04:56.736295] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-04. [2025-10-28T19:04:57.307453] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-28T19:04:57.318882] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-10. [2025-10-28T19:04:57.364858] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-01 (7.67 seconds). [2025-10-28T19:04:57.374418] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-02. [2025-10-28T19:04:57.936206] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-28T19:04:57.946490] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-05. [2025-10-28T19:04:58.416144] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-28T19:04:58.425965] [INFO ] [REMOTE ] GMED: Full fetch complete (70166 records). [2025-10-28T19:04:58.426089] [DEBUG] [VALIDATOR ] GMED: Validating primary data. [2025-10-28T19:04:58.825364] [DEBUG] [VALIDATOR ] GMED: All expected trading days are present. [2025-10-28T19:04:58.825442] [DEBUG] [VALIDATOR ] GMED: Primary data validation passed. [2025-10-28T19:04:58.826339] [INFO ] [MAIN ] GMED: Fetched primary data is valid. [2025-10-28T19:04:58.826424] [DEBUG] [LOCAL ] GMED: Saving primary data. [2025-10-28T19:04:58.827840] [DEBUG] [LOCAL ] GMED: Trimmed 70166 records to 48070 (keeping 200 days of data) [2025-10-28T19:04:59.110762] [DEBUG] [LOCAL ] GMED: Primary data saved (48070 records). [2025-10-28T19:04:59.110991] [INFO ] [MAIN ] GMED: Full history saved. [2025-10-28T19:04:59.111118] [INFO ] [MAIN ] Update Progress: 948/2366 symbols completed. GMED took 53.1s. Estimated remaining: 3h 6m 53s. Rate: 7.6 symbols/min [2025-10-28T19:04:59.307164] [INFO ] [MAIN ] GNT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:04:59.318635] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-28T19:04:59.328583] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-06. [2025-10-28T19:04:59.336365] [DEBUG] [LOCAL ] GNT: Loaded 8608 existing records from primary storage. [2025-10-28T19:04:59.336733] [INFO ] [MAIN ] GNT: Loaded 8608 existing records. [2025-10-28T19:04:59.513841] [WARN ] [MAIN ] GNT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:04:59.514054] [INFO ] [MAIN ] GNT: Wiping existing primary data before full refresh. [2025-10-28T19:04:59.514101] [INFO ] [LOCAL ] GNT: Starting deletion of primary data. [2025-10-28T19:04:59.514293] [DEBUG] [LOCAL ] GNT: Deleted primary data file. [2025-10-28T19:04:59.514350] [INFO ] [MAIN ] GNT: Starting full primary refresh. [2025-10-28T19:04:59.866073] [INFO ] [REMOTE ] GNT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:04:59.866390] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-01. [2025-10-28T19:05:00.252408] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-10-28T19:05:00.254298] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-02. [2025-10-28T19:05:00.506373] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-28T19:05:00.516258] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-07. [2025-10-28T19:05:00.673450] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-28T19:05:00.675284] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-03. [2025-10-28T19:05:01.142201] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-10-28T19:05:01.144415] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-04. [2025-10-28T19:05:01.633137] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-10-28T19:05:01.635794] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-05. [2025-10-28T19:05:02.130900] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-28T19:05:02.130610] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-28T19:05:02.143067] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-06. [2025-10-28T19:05:02.144982] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-08. [2025-10-28T19:05:02.700037] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-28T19:05:02.703165] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-07. [2025-10-28T19:05:03.401731] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-08 (7.66 seconds). [2025-10-28T19:05:03.411421] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-09. [2025-10-28T19:05:03.490439] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-28T19:05:03.500710] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-09. [2025-10-28T19:05:04.387943] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-28T19:05:04.396248] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-10. [2025-10-28T19:05:04.568824] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-28T19:05:04.579098] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-10. [2025-10-28T19:05:05.464275] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-28T19:05:05.471549] [INFO ] [REMOTE ] GNK: Full fetch complete (56996 records). [2025-10-28T19:05:05.471723] [DEBUG] [VALIDATOR ] GNK: Validating primary data. [2025-10-28T19:05:05.896171] [DEBUG] [VALIDATOR ] GNK: All expected trading days are present. [2025-10-28T19:05:05.896317] [DEBUG] [VALIDATOR ] GNK: Primary data validation passed. [2025-10-28T19:05:05.897399] [INFO ] [MAIN ] GNK: Fetched primary data is valid. [2025-10-28T19:05:05.897533] [DEBUG] [LOCAL ] GNK: Saving primary data. [2025-10-28T19:05:05.898858] [DEBUG] [LOCAL ] GNK: Trimmed 56996 records to 38830 (keeping 200 days of data) [2025-10-28T19:05:06.133326] [DEBUG] [LOCAL ] GNK: Primary data saved (38830 records). [2025-10-28T19:05:06.133459] [INFO ] [MAIN ] GNK: Full history saved. [2025-10-28T19:05:06.133538] [INFO ] [MAIN ] Update Progress: 949/2366 symbols completed. GNK took 26.7s. Estimated remaining: 3h 6m 43s. Rate: 7.6 symbols/min [2025-10-28T19:05:06.307830] [INFO ] [MAIN ] GNW: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:05:06.355162] [DEBUG] [LOCAL ] GNW: Loaded 51289 existing records from primary storage. [2025-10-28T19:05:06.355454] [INFO ] [MAIN ] GNW: Loaded 51289 existing records. [2025-10-28T19:05:06.549213] [WARN ] [MAIN ] GNW: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:05:06.549443] [INFO ] [MAIN ] GNW: Wiping existing primary data before full refresh. [2025-10-28T19:05:06.549497] [INFO ] [LOCAL ] GNW: Starting deletion of primary data. [2025-10-28T19:05:06.549779] [DEBUG] [LOCAL ] GNW: Deleted primary data file. [2025-10-28T19:05:06.549839] [INFO ] [MAIN ] GNW: Starting full primary refresh. [2025-10-28T19:05:06.908201] [INFO ] [REMOTE ] GNW: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:05:06.908521] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-01. [2025-10-28T19:05:07.998613] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-02 (10.62 seconds). [2025-10-28T19:05:08.007857] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-03. [2025-10-28T19:05:08.133469] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-28T19:05:08.143092] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-02. [2025-10-28T19:05:09.154768] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-28T19:05:09.166427] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-04. [2025-10-28T19:05:09.305740] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-28T19:05:09.315289] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-03. [2025-10-28T19:05:10.627108] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-28T19:05:10.637714] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-04. [2025-10-28T19:05:10.836977] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-07 (8.13 seconds). [2025-10-28T19:05:10.839196] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-08. [2025-10-28T19:05:11.190996] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-10-28T19:05:11.193160] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-09. [2025-10-28T19:05:11.669896] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-28T19:05:11.673564] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-10. [2025-10-28T19:05:11.779744] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-28T19:05:11.790558] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-05. [2025-10-28T19:05:12.192288] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-28T19:05:12.195517] [INFO ] [REMOTE ] GNT: Full fetch complete (11480 records). [2025-10-28T19:05:12.195633] [DEBUG] [VALIDATOR ] GNT: Validating primary data. [2025-10-28T19:05:12.613358] [DEBUG] [VALIDATOR ] GNT: All expected trading days are present. [2025-10-28T19:05:12.613460] [DEBUG] [VALIDATOR ] GNT: Primary data validation passed. [2025-10-28T19:05:12.613937] [INFO ] [MAIN ] GNT: Fetched primary data is valid. [2025-10-28T19:05:12.614015] [DEBUG] [LOCAL ] GNT: Saving primary data. [2025-10-28T19:05:12.614700] [DEBUG] [LOCAL ] GNT: Trimmed 11480 records to 8606 (keeping 200 days of data) [2025-10-28T19:05:12.673195] [DEBUG] [LOCAL ] GNT: Primary data saved (8606 records). [2025-10-28T19:05:12.673335] [INFO ] [MAIN ] GNT: Full history saved. [2025-10-28T19:05:12.673416] [INFO ] [MAIN ] Update Progress: 950/2366 symbols completed. GNT took 13.6s. Estimated remaining: 3h 6m 33s. Rate: 7.6 symbols/min [2025-10-28T19:05:12.841764] [INFO ] [MAIN ] GOF: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:05:12.886127] [DEBUG] [LOCAL ] GOF: Loaded 42668 existing records from primary storage. [2025-10-28T19:05:12.886420] [INFO ] [MAIN ] GOF: Loaded 42668 existing records. [2025-10-28T19:05:13.063153] [WARN ] [MAIN ] GOF: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:05:13.063482] [INFO ] [MAIN ] GOF: Wiping existing primary data before full refresh. [2025-10-28T19:05:13.063538] [INFO ] [LOCAL ] GOF: Starting deletion of primary data. [2025-10-28T19:05:13.063827] [DEBUG] [LOCAL ] GOF: Deleted primary data file. [2025-10-28T19:05:13.063885] [INFO ] [MAIN ] GOF: Starting full primary refresh. [2025-10-28T19:05:13.430515] [INFO ] [REMOTE ] GOF: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:05:13.430936] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-01. [2025-10-28T19:05:14.753233] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-28T19:05:14.762889] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-02. [2025-10-28T19:05:18.814891] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-10 (14.24 seconds). [2025-10-28T19:05:18.824149] [INFO ] [REMOTE ] GNRC: Full fetch complete (65721 records). [2025-10-28T19:05:18.824271] [DEBUG] [VALIDATOR ] GNRC: Validating primary data. [2025-10-28T19:05:19.215551] [DEBUG] [VALIDATOR ] GNRC: All expected trading days are present. [2025-10-28T19:05:19.215624] [DEBUG] [VALIDATOR ] GNRC: Primary data validation passed. [2025-10-28T19:05:19.216715] [INFO ] [MAIN ] GNRC: Fetched primary data is valid. [2025-10-28T19:05:19.216785] [DEBUG] [LOCAL ] GNRC: Saving primary data. [2025-10-28T19:05:19.218090] [DEBUG] [LOCAL ] GNRC: Trimmed 65721 records to 45153 (keeping 200 days of data) [2025-10-28T19:05:19.489356] [DEBUG] [LOCAL ] GNRC: Primary data saved (45153 records). [2025-10-28T19:05:19.489478] [INFO ] [MAIN ] GNRC: Full history saved. [2025-10-28T19:05:19.489555] [INFO ] [MAIN ] Update Progress: 951/2366 symbols completed. GNRC took 27.2s. Estimated remaining: 3h 6m 24s. Rate: 7.6 symbols/min [2025-10-28T19:05:19.667193] [INFO ] [MAIN ] GOLF: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:05:19.697299] [DEBUG] [LOCAL ] GOLF: Loaded 29787 existing records from primary storage. [2025-10-28T19:05:19.697729] [INFO ] [MAIN ] GOLF: Loaded 29787 existing records. [2025-10-28T19:05:19.886708] [WARN ] [MAIN ] GOLF: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:05:19.886950] [INFO ] [MAIN ] GOLF: Wiping existing primary data before full refresh. [2025-10-28T19:05:19.887001] [INFO ] [LOCAL ] GOLF: Starting deletion of primary data. [2025-10-28T19:05:19.887241] [DEBUG] [LOCAL ] GOLF: Deleted primary data file. [2025-10-28T19:05:19.887311] [INFO ] [MAIN ] GOLF: Starting full primary refresh. [2025-10-28T19:05:20.253615] [INFO ] [REMOTE ] GOLF: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:05:20.254009] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-01. [2025-10-28T19:05:21.152808] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-28T19:05:21.158456] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-02. [2025-10-28T19:05:22.154611] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-28T19:05:22.161887] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-03. [2025-10-28T19:05:23.202208] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-28T19:05:23.209551] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-04. [2025-10-28T19:05:27.901373] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-04 (18.73 seconds). [2025-10-28T19:05:27.913135] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-05. [2025-10-28T19:05:30.192870] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-04 (6.98 seconds). [2025-10-28T19:05:30.200872] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-05. [2025-10-28T19:05:31.167186] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-28T19:05:31.174300] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-06. [2025-10-28T19:05:32.074543] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-28T19:05:32.080963] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-07. [2025-10-28T19:05:32.995692] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-10-28T19:05:33.002760] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-08. [2025-10-28T19:05:33.908424] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-28T19:05:33.915253] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-09. [2025-10-28T19:05:34.817805] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-28T19:05:34.823755] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-10. [2025-10-28T19:05:35.725359] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-28T19:05:35.731007] [INFO ] [REMOTE ] GOLF: Full fetch complete (45189 records). [2025-10-28T19:05:35.731106] [DEBUG] [VALIDATOR ] GOLF: Validating primary data. [2025-10-28T19:05:36.103901] [DEBUG] [VALIDATOR ] GOLF: All expected trading days are present. [2025-10-28T19:05:36.104034] [DEBUG] [VALIDATOR ] GOLF: Primary data validation passed. [2025-10-28T19:05:36.104880] [INFO ] [MAIN ] GOLF: Fetched primary data is valid. [2025-10-28T19:05:36.104945] [DEBUG] [LOCAL ] GOLF: Saving primary data. [2025-10-28T19:05:36.105931] [DEBUG] [LOCAL ] GOLF: Trimmed 45189 records to 29624 (keeping 200 days of data) [2025-10-28T19:05:36.286905] [DEBUG] [LOCAL ] GOLF: Primary data saved (29624 records). [2025-10-28T19:05:36.287066] [INFO ] [MAIN ] GOLF: Full history saved. [2025-10-28T19:05:36.287178] [INFO ] [MAIN ] Update Progress: 952/2366 symbols completed. GOLF took 16.8s. Estimated remaining: 3h 6m 29s. Rate: 7.6 symbols/min [2025-10-28T19:05:36.472245] [INFO ] [MAIN ] GOOS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:05:36.515623] [DEBUG] [LOCAL ] GOOS: Loaded 43756 existing records from primary storage. [2025-10-28T19:05:36.515952] [INFO ] [MAIN ] GOOS: Loaded 43756 existing records. [2025-10-28T19:05:36.740395] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-05 (24.95 seconds). [2025-10-28T19:05:36.745312] [WARN ] [MAIN ] GOOS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:05:36.745712] [INFO ] [MAIN ] GOOS: Wiping existing primary data before full refresh. [2025-10-28T19:05:36.745938] [INFO ] [LOCAL ] GOOS: Starting deletion of primary data. [2025-10-28T19:05:36.756765] [DEBUG] [LOCAL ] GOOS: Deleted primary data file. [2025-10-28T19:05:36.756725] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-06. [2025-10-28T19:05:36.756882] [INFO ] [MAIN ] GOOS: Starting full primary refresh. [2025-10-28T19:05:37.124953] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-05 (9.21 seconds). [2025-10-28T19:05:37.165148] [INFO ] [REMOTE ] GOOS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:05:37.166342] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-01. [2025-10-28T19:05:37.167840] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-06. [2025-10-28T19:05:38.205186] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-10-28T19:05:38.216725] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-07. [2025-10-28T19:05:38.324823] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-28T19:05:38.333894] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-02. [2025-10-28T19:05:38.397894] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-28T19:05:38.409260] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-07. [2025-10-28T19:05:39.318710] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-28T19:05:39.332373] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-08. [2025-10-28T19:05:40.545803] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-28T19:05:40.560959] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-09. [2025-10-28T19:05:41.801127] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-28T19:05:41.811856] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-10. [2025-10-28T19:05:43.054832] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-02 (28.29 seconds). [2025-10-28T19:05:43.063130] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-03. [2025-10-28T19:05:43.159076] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-28T19:05:43.169199] [INFO ] [REMOTE ] GNW: Full fetch complete (73866 records). [2025-10-28T19:05:43.169329] [DEBUG] [VALIDATOR ] GNW: Validating primary data. [2025-10-28T19:05:43.547121] [DEBUG] [VALIDATOR ] GNW: All expected trading days are present. [2025-10-28T19:05:43.547202] [DEBUG] [VALIDATOR ] GNW: Primary data validation passed. [2025-10-28T19:05:43.548133] [INFO ] [MAIN ] GNW: Fetched primary data is valid. [2025-10-28T19:05:43.548197] [DEBUG] [LOCAL ] GNW: Saving primary data. [2025-10-28T19:05:43.549524] [DEBUG] [LOCAL ] GNW: Trimmed 73866 records to 51232 (keeping 200 days of data) [2025-10-28T19:05:43.836910] [DEBUG] [LOCAL ] GNW: Primary data saved (51232 records). [2025-10-28T19:05:43.837079] [INFO ] [MAIN ] GNW: Full history saved. [2025-10-28T19:05:43.837204] [INFO ] [MAIN ] Update Progress: 953/2366 symbols completed. GNW took 37.7s. Estimated remaining: 3h 6m 21s. Rate: 7.6 symbols/min [2025-10-28T19:05:44.002326] [INFO ] [MAIN ] GOTU: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:05:44.034197] [DEBUG] [LOCAL ] GOTU: Loaded 36496 existing records from primary storage. [2025-10-28T19:05:44.034479] [INFO ] [MAIN ] GOTU: Loaded 36496 existing records. [2025-10-28T19:05:44.209250] [WARN ] [MAIN ] GOTU: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:05:44.209423] [INFO ] [MAIN ] GOTU: Wiping existing primary data before full refresh. [2025-10-28T19:05:44.209469] [INFO ] [LOCAL ] GOTU: Starting deletion of primary data. [2025-10-28T19:05:44.209673] [DEBUG] [LOCAL ] GOTU: Deleted primary data file. [2025-10-28T19:05:44.209730] [INFO ] [MAIN ] GOTU: Starting full primary refresh. [2025-10-28T19:05:44.595505] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-28T19:05:44.594153] [INFO ] [REMOTE ] GOTU: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:05:44.595889] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-01. [2025-10-28T19:05:44.605987] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-04. [2025-10-28T19:05:45.689446] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-28T19:05:45.698410] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-02. [2025-10-28T19:05:45.883264] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-28T19:05:45.896666] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-05. [2025-10-28T19:05:46.861324] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-28T19:05:46.870452] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-03. [2025-10-28T19:05:47.190908] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-28T19:05:47.199977] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-06. [2025-10-28T19:05:47.899545] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-28T19:05:47.910350] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-04. [2025-10-28T19:05:48.245555] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-28T19:05:48.253950] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-07. [2025-10-28T19:05:48.956858] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-28T19:05:48.965723] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-05. [2025-10-28T19:05:49.563211] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-28T19:05:49.573121] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-08. [2025-10-28T19:05:49.892421] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-28T19:05:49.901534] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-06. [2025-10-28T19:05:50.859456] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-28T19:05:50.867889] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-07. [2025-10-28T19:05:50.909591] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-28T19:05:50.919126] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-09. [2025-10-28T19:05:51.500779] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-02 (13.17 seconds). [2025-10-28T19:05:51.509859] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-03. [2025-10-28T19:05:51.897033] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-28T19:05:51.904911] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-08. [2025-10-28T19:05:52.218163] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-28T19:05:52.227171] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-10. [2025-10-28T19:05:52.615627] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-28T19:05:52.625704] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-04. [2025-10-28T19:05:52.911930] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-28T19:05:52.920060] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-09. [2025-10-28T19:05:53.753022] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-28T19:05:53.762332] [INFO ] [REMOTE ] GOF: Full fetch complete (62853 records). [2025-10-28T19:05:53.762438] [DEBUG] [VALIDATOR ] GOF: Validating primary data. [2025-10-28T19:05:54.097632] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-28T19:05:54.136026] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-10. [2025-10-28T19:05:54.209624] [DEBUG] [VALIDATOR ] GOF: All expected trading days are present. [2025-10-28T19:05:54.209744] [DEBUG] [VALIDATOR ] GOF: Primary data validation passed. [2025-10-28T19:05:54.210717] [INFO ] [MAIN ] GOF: Fetched primary data is valid. [2025-10-28T19:05:54.210780] [DEBUG] [LOCAL ] GOF: Saving primary data. [2025-10-28T19:05:54.212075] [DEBUG] [LOCAL ] GOF: Trimmed 62853 records to 42723 (keeping 200 days of data) [2025-10-28T19:05:54.465069] [DEBUG] [LOCAL ] GOF: Primary data saved (42723 records). [2025-10-28T19:05:54.465184] [INFO ] [MAIN ] GOF: Full history saved. [2025-10-28T19:05:54.465255] [INFO ] [MAIN ] Update Progress: 954/2366 symbols completed. GOF took 41.8s. Estimated remaining: 3h 6m 17s. Rate: 7.6 symbols/min [2025-10-28T19:05:54.632440] [INFO ] [MAIN ] GPC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:05:54.674980] [DEBUG] [LOCAL ] GPC: Loaded 45800 existing records from primary storage. [2025-10-28T19:05:54.675259] [INFO ] [MAIN ] GPC: Loaded 45800 existing records. [2025-10-28T19:05:54.848934] [WARN ] [MAIN ] GPC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:05:54.849120] [INFO ] [MAIN ] GPC: Wiping existing primary data before full refresh. [2025-10-28T19:05:54.849169] [INFO ] [LOCAL ] GPC: Starting deletion of primary data. [2025-10-28T19:05:54.849621] [DEBUG] [LOCAL ] GPC: Deleted primary data file. [2025-10-28T19:05:54.849712] [INFO ] [MAIN ] GPC: Starting full primary refresh. [2025-10-28T19:05:55.200180] [INFO ] [REMOTE ] GPC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:05:55.200460] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-01. [2025-10-28T19:05:55.352515] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-28T19:05:55.359496] [INFO ] [REMOTE ] GOTU: Full fetch complete (57869 records). [2025-10-28T19:05:55.359601] [DEBUG] [VALIDATOR ] GOTU: Validating primary data. [2025-10-28T19:05:55.755684] [DEBUG] [VALIDATOR ] GOTU: All expected trading days are present. [2025-10-28T19:05:55.755768] [DEBUG] [VALIDATOR ] GOTU: Primary data validation passed. [2025-10-28T19:05:55.756807] [INFO ] [MAIN ] GOTU: Fetched primary data is valid. [2025-10-28T19:05:55.756866] [DEBUG] [LOCAL ] GOTU: Saving primary data. [2025-10-28T19:05:55.757925] [DEBUG] [LOCAL ] GOTU: Trimmed 57869 records to 36448 (keeping 200 days of data) [2025-10-28T19:05:55.963160] [DEBUG] [LOCAL ] GOTU: Primary data saved (36448 records). [2025-10-28T19:05:55.963306] [INFO ] [MAIN ] GOTU: Full history saved. [2025-10-28T19:05:55.963386] [INFO ] [MAIN ] Update Progress: 955/2366 symbols completed. GOTU took 12.1s. Estimated remaining: 3h 5m 59s. Rate: 7.6 symbols/min [2025-10-28T19:05:56.132704] [INFO ] [MAIN ] GPI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:05:56.147950] [DEBUG] [LOCAL ] GPI: Loaded 14518 existing records from primary storage. [2025-10-28T19:05:56.148164] [INFO ] [MAIN ] GPI: Loaded 14518 existing records. [2025-10-28T19:05:56.322903] [WARN ] [MAIN ] GPI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:05:56.323097] [INFO ] [MAIN ] GPI: Wiping existing primary data before full refresh. [2025-10-28T19:05:56.323143] [INFO ] [LOCAL ] GPI: Starting deletion of primary data. [2025-10-28T19:05:56.323510] [DEBUG] [LOCAL ] GPI: Deleted primary data file. [2025-10-28T19:05:56.323567] [INFO ] [MAIN ] GPI: Starting full primary refresh. [2025-10-28T19:05:56.655601] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-07 (18.25 seconds). [2025-10-28T19:05:56.704694] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-08. [2025-10-28T19:05:56.717035] [INFO ] [REMOTE ] GPI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:05:56.717958] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-01. [2025-10-28T19:05:57.339222] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-28T19:05:57.342518] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-02. [2025-10-28T19:05:57.883945] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-28T19:05:57.893729] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-09. [2025-10-28T19:05:57.923362] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-10-28T19:05:57.926816] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-03. [2025-10-28T19:05:58.704622] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-28T19:05:58.708911] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-04. [2025-10-28T19:05:59.425850] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-10-28T19:05:59.432934] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-05. [2025-10-28T19:05:59.489413] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-04 (6.86 seconds). [2025-10-28T19:05:59.499677] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-05. [2025-10-28T19:06:00.036347] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-10-28T19:06:00.039859] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-06. [2025-10-28T19:06:00.779796] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-28T19:06:00.783438] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-07. [2025-10-28T19:06:00.873084] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-28T19:06:00.882520] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-06. [2025-10-28T19:06:01.614929] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-28T19:06:01.619239] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-08. [2025-10-28T19:06:02.093906] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-28T19:06:02.103200] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-07. [2025-10-28T19:06:02.286740] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-28T19:06:02.290347] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-09. [2025-10-28T19:06:04.568886] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-01 (9.37 seconds). [2025-10-28T19:06:04.580426] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-02. [2025-10-28T19:06:05.781459] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-28T19:06:05.792405] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-03. [2025-10-28T19:06:07.052405] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-28T19:06:07.062796] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-04. [2025-10-28T19:06:08.337612] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-28T19:06:08.350843] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-05. [2025-10-28T19:06:09.695446] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-28T19:06:09.705823] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-06. [2025-10-28T19:06:10.462012] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-09 (12.57 seconds). [2025-10-28T19:06:10.471604] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-10. [2025-10-28T19:06:10.875956] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-28T19:06:10.885174] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-07. [2025-10-28T19:06:12.066158] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-28T19:06:12.076402] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-08. [2025-10-28T19:06:13.154362] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-28T19:06:13.163497] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-09. [2025-10-28T19:06:13.610203] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-09 (11.32 seconds). [2025-10-28T19:06:13.613806] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-10. [2025-10-28T19:06:14.431679] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-28T19:06:14.441916] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-10. [2025-10-28T19:06:14.467506] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-28T19:06:14.471695] [INFO ] [REMOTE ] GPI: Full fetch complete (22132 records). [2025-10-28T19:06:14.471811] [DEBUG] [VALIDATOR ] GPI: Validating primary data. [2025-10-28T19:06:14.842723] [DEBUG] [VALIDATOR ] GPI: All expected trading days are present. [2025-10-28T19:06:14.842819] [DEBUG] [VALIDATOR ] GPI: Primary data validation passed. [2025-10-28T19:06:14.843331] [INFO ] [MAIN ] GPI: Fetched primary data is valid. [2025-10-28T19:06:14.843374] [DEBUG] [LOCAL ] GPI: Saving primary data. [2025-10-28T19:06:14.844132] [DEBUG] [LOCAL ] GPI: Trimmed 22132 records to 14578 (keeping 200 days of data) [2025-10-28T19:06:14.932251] [DEBUG] [LOCAL ] GPI: Primary data saved (14578 records). [2025-10-28T19:06:14.932375] [INFO ] [MAIN ] GPI: Full history saved. [2025-10-28T19:06:14.932452] [INFO ] [MAIN ] Update Progress: 956/2366 symbols completed. GPI took 19.0s. Estimated remaining: 3h 6m 8s. Rate: 7.6 symbols/min [2025-10-28T19:06:15.101273] [INFO ] [MAIN ] GPJA: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:06:15.107207] [DEBUG] [LOCAL ] GPJA: Loaded 4035 existing records from primary storage. [2025-10-28T19:06:15.107366] [INFO ] [MAIN ] GPJA: Loaded 4035 existing records. [2025-10-28T19:06:15.303153] [WARN ] [MAIN ] GPJA: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:06:15.303354] [INFO ] [MAIN ] GPJA: Wiping existing primary data before full refresh. [2025-10-28T19:06:15.303400] [INFO ] [LOCAL ] GPJA: Starting deletion of primary data. [2025-10-28T19:06:15.303575] [DEBUG] [LOCAL ] GPJA: Deleted primary data file. [2025-10-28T19:06:15.303632] [INFO ] [MAIN ] GPJA: Starting full primary refresh. [2025-10-28T19:06:15.651919] [INFO ] [REMOTE ] GPJA: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:06:15.652210] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-01. [2025-10-28T19:06:15.903057] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-28T19:06:15.912537] [INFO ] [REMOTE ] GPC: Full fetch complete (68633 records). [2025-10-28T19:06:15.912717] [DEBUG] [VALIDATOR ] GPC: Validating primary data. [2025-10-28T19:06:16.297790] [DEBUG] [VALIDATOR ] GPC: All expected trading days are present. [2025-10-28T19:06:16.297867] [DEBUG] [VALIDATOR ] GPC: Primary data validation passed. [2025-10-28T19:06:16.298745] [INFO ] [MAIN ] GPC: Fetched primary data is valid. [2025-10-28T19:06:16.298811] [DEBUG] [LOCAL ] GPC: Saving primary data. [2025-10-28T19:06:16.300042] [DEBUG] [LOCAL ] GPC: Trimmed 68633 records to 45740 (keeping 200 days of data) [2025-10-28T19:06:16.580622] [DEBUG] [LOCAL ] GPC: Primary data saved (45740 records). [2025-10-28T19:06:16.580769] [INFO ] [MAIN ] GPC: Full history saved. [2025-10-28T19:06:16.580874] [INFO ] [MAIN ] Update Progress: 957/2366 symbols completed. GPC took 22.1s. Estimated remaining: 3h 5m 51s. Rate: 7.6 symbols/min [2025-10-28T19:06:19.339234] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-07 (17.24 seconds). [2025-10-28T19:06:19.349629] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-08. [2025-10-28T19:06:30.871786] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-10 (20.40 seconds). [2025-10-28T19:06:30.883826] [INFO ] [REMOTE ] GNL: Full fetch complete (67923 records). [2025-10-28T19:06:30.883998] [DEBUG] [VALIDATOR ] GNL: Validating primary data. [2025-10-28T19:06:31.272712] [DEBUG] [VALIDATOR ] GNL: All expected trading days are present. [2025-10-28T19:06:31.272799] [DEBUG] [VALIDATOR ] GNL: Primary data validation passed. [2025-10-28T19:06:31.273790] [INFO ] [MAIN ] GNL: Fetched primary data is valid. [2025-10-28T19:06:31.273852] [DEBUG] [LOCAL ] GNL: Saving primary data. [2025-10-28T19:06:31.275223] [DEBUG] [LOCAL ] GNL: Trimmed 67923 records to 46178 (keeping 200 days of data) [2025-10-28T19:06:31.563621] [DEBUG] [LOCAL ] GNL: Primary data saved (46178 records). [2025-10-28T19:06:31.563782] [INFO ] [MAIN ] GNL: Full history saved. [2025-10-28T19:06:31.564531] [INFO ] [MAIN ] Update Progress: 958/2366 symbols completed. GNL took 1m 43s. Estimated remaining: 3h 5m 53s. Rate: 7.6 symbols/min [2025-10-28T19:06:32.280013] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-01 (16.63 seconds). [2025-10-28T19:06:32.283174] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-02. [2025-10-28T19:06:32.610966] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-10-28T19:06:32.612403] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-03. [2025-10-28T19:06:32.982205] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-10-28T19:06:32.983530] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-04. [2025-10-28T19:06:33.314159] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-04 (0.33 seconds). [2025-10-28T19:06:33.315686] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-05. [2025-10-28T19:06:33.689079] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-10-28T19:06:33.690358] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-06. [2025-10-28T19:06:34.067519] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-10-28T19:06:34.069278] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-07. [2025-10-28T19:06:34.453619] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-10-28T19:06:34.455259] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-08. [2025-10-28T19:06:34.819092] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-10-28T19:06:34.820774] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-09. [2025-10-28T19:06:40.358041] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-08 (21.01 seconds). [2025-10-28T19:06:40.367970] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-09. [2025-10-28T19:06:41.515422] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-28T19:06:41.526861] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-10. [2025-10-28T19:06:41.786206] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-09 (6.97 seconds). [2025-10-28T19:06:41.788157] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-10. [2025-10-28T19:06:42.676134] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-28T19:06:42.677452] [INFO ] [REMOTE ] GPJA: Full fetch complete (6760 records). [2025-10-28T19:06:42.677523] [DEBUG] [VALIDATOR ] GPJA: Validating primary data. [2025-10-28T19:06:43.050293] [DEBUG] [VALIDATOR ] GPJA: All expected trading days are present. [2025-10-28T19:06:43.050378] [DEBUG] [VALIDATOR ] GPJA: Primary data validation passed. [2025-10-28T19:06:43.050579] [INFO ] [MAIN ] GPJA: Fetched primary data is valid. [2025-10-28T19:06:43.050618] [DEBUG] [LOCAL ] GPJA: Saving primary data. [2025-10-28T19:06:43.051112] [DEBUG] [LOCAL ] GPJA: Trimmed 6760 records to 4026 (keeping 200 days of data) [2025-10-28T19:06:43.075449] [DEBUG] [LOCAL ] GPJA: Primary data saved (4026 records). [2025-10-28T19:06:43.075566] [INFO ] [MAIN ] GPJA: Full history saved. [2025-10-28T19:06:43.075664] [INFO ] [MAIN ] Update Progress: 959/2366 symbols completed. GPJA took 28.1s. Estimated remaining: 3h 5m 50s. Rate: 7.6 symbols/min [2025-10-28T19:06:49.561576] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-10 (8.03 seconds). [2025-10-28T19:06:49.569552] [INFO ] [REMOTE ] GOOS: Full fetch complete (64500 records). [2025-10-28T19:06:49.569751] [DEBUG] [VALIDATOR ] GOOS: Validating primary data. [2025-10-28T19:06:49.967841] [DEBUG] [VALIDATOR ] GOOS: All expected trading days are present. [2025-10-28T19:06:49.967916] [DEBUG] [VALIDATOR ] GOOS: Primary data validation passed. [2025-10-28T19:06:49.968813] [INFO ] [MAIN ] GOOS: Fetched primary data is valid. [2025-10-28T19:06:49.968897] [DEBUG] [LOCAL ] GOOS: Saving primary data. [2025-10-28T19:06:49.970059] [DEBUG] [LOCAL ] GOOS: Trimmed 64500 records to 43634 (keeping 200 days of data) [2025-10-28T19:06:50.226052] [DEBUG] [LOCAL ] GOOS: Primary data saved (43634 records). [2025-10-28T19:06:50.226171] [INFO ] [MAIN ] GOOS: Full history saved. [2025-10-28T19:06:50.226245] [INFO ] [MAIN ] Update Progress: 960/2366 symbols completed. GOOS took 1m 14s. Estimated remaining: 3h 5m 41s. Rate: 7.6 symbols/min [2025-10-28T19:06:50.858409] [INFO ] [MAIN ] GPOR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:06:50.808253] [INFO ] [MAIN ] GPMT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:06:50.951445] [INFO ] [MAIN ] GPN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:06:50.953008] [INFO ] [MAIN ] GPK: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:06:50.986987] [DEBUG] [LOCAL ] GPMT: Loaded 25517 existing records from primary storage. [2025-10-28T19:06:50.988188] [INFO ] [MAIN ] GPMT: Loaded 25517 existing records. [2025-10-28T19:06:50.988621] [DEBUG] [LOCAL ] GPOR: Loaded 23320 existing records from primary storage. [2025-10-28T19:06:50.999612] [INFO ] [MAIN ] GPOR: Loaded 23320 existing records. [2025-10-28T19:06:51.391716] [WARN ] [MAIN ] GPMT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:06:51.411959] [WARN ] [MAIN ] GPOR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:06:51.429539] [INFO ] [MAIN ] GPMT: Wiping existing primary data before full refresh. [2025-10-28T19:06:51.430547] [INFO ] [MAIN ] GPOR: Wiping existing primary data before full refresh. [2025-10-28T19:06:51.430300] [DEBUG] [LOCAL ] GPN: Loaded 51720 existing records from primary storage. [2025-10-28T19:06:51.431944] [INFO ] [LOCAL ] GPMT: Starting deletion of primary data. [2025-10-28T19:06:51.431755] [DEBUG] [LOCAL ] GPK: Loaded 52765 existing records from primary storage. [2025-10-28T19:06:51.432310] [INFO ] [MAIN ] GPN: Loaded 51720 existing records. [2025-10-28T19:06:51.432573] [INFO ] [LOCAL ] GPOR: Starting deletion of primary data. [2025-10-28T19:06:51.437880] [DEBUG] [LOCAL ] GPMT: Deleted primary data file. [2025-10-28T19:06:51.444016] [INFO ] [MAIN ] GPK: Loaded 52765 existing records. [2025-10-28T19:06:51.479222] [DEBUG] [LOCAL ] GPOR: Deleted primary data file. [2025-10-28T19:06:51.494494] [INFO ] [MAIN ] GPMT: Starting full primary refresh. [2025-10-28T19:06:51.484547] [INFO ] [MAIN ] GPOR: Starting full primary refresh. [2025-10-28T19:06:51.992799] [WARN ] [MAIN ] GPK: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:06:52.048106] [INFO ] [MAIN ] GPK: Wiping existing primary data before full refresh. [2025-10-28T19:06:52.099600] [INFO ] [LOCAL ] GPK: Starting deletion of primary data. [2025-10-28T19:06:52.204685] [WARN ] [MAIN ] GPN: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:06:52.257582] [INFO ] [MAIN ] GPN: Wiping existing primary data before full refresh. [2025-10-28T19:06:52.317993] [INFO ] [LOCAL ] GPN: Starting deletion of primary data. [2025-10-28T19:06:52.252275] [DEBUG] [LOCAL ] GPK: Deleted primary data file. [2025-10-28T19:06:52.328550] [INFO ] [MAIN ] GPK: Starting full primary refresh. [2025-10-28T19:06:52.407878] [DEBUG] [LOCAL ] GPN: Deleted primary data file. [2025-10-28T19:06:52.466190] [INFO ] [MAIN ] GPN: Starting full primary refresh. [2025-10-28T19:06:52.689224] [INFO ] [REMOTE ] GPMT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:06:52.780120] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-01. [2025-10-28T19:06:52.895095] [INFO ] [REMOTE ] GPOR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:06:52.990214] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-01. [2025-10-28T19:06:53.392350] [INFO ] [REMOTE ] GPK: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:06:53.409315] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-01. [2025-10-28T19:06:53.413350] [INFO ] [REMOTE ] GPN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:06:53.413996] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-01. [2025-10-28T19:06:53.755356] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-28T19:06:53.760413] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-02. [2025-10-28T19:06:54.095168] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-28T19:06:54.102786] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-02. [2025-10-28T19:06:54.498487] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-28T19:06:54.506393] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-03. [2025-10-28T19:06:54.732871] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-28T19:06:54.743037] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-02. [2025-10-28T19:06:55.154405] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-10-28T19:06:55.159894] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-04. [2025-10-28T19:06:55.946521] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-28T19:06:55.957173] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-03. [2025-10-28T19:06:56.080265] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-28T19:06:56.092400] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-05. [2025-10-28T19:06:57.030515] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-28T19:06:57.037756] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-06. [2025-10-28T19:06:58.199460] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-28T19:06:58.207866] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-07. [2025-10-28T19:06:59.093498] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-28T19:06:59.099260] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-08. [2025-10-28T19:06:59.444455] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-02 (5.34 seconds). [2025-10-28T19:06:59.449354] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-03. [2025-10-28T19:06:59.833327] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-28T19:06:59.839694] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-09. [2025-10-28T19:07:00.357928] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-28T19:07:00.363445] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-04. [2025-10-28T19:07:00.547125] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-28T19:07:00.551166] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-10. [2025-10-28T19:07:01.126569] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-28T19:07:01.131812] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-05. [2025-10-28T19:07:01.442158] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-28T19:07:01.446963] [INFO ] [REMOTE ] GPMT: Full fetch complete (35979 records). [2025-10-28T19:07:01.447122] [DEBUG] [VALIDATOR ] GPMT: Validating primary data. [2025-10-28T19:07:01.891516] [DEBUG] [VALIDATOR ] GPMT: All expected trading days are present. [2025-10-28T19:07:01.891677] [DEBUG] [VALIDATOR ] GPMT: Primary data validation passed. [2025-10-28T19:07:01.893442] [INFO ] [MAIN ] GPMT: Fetched primary data is valid. [2025-10-28T19:07:01.893535] [DEBUG] [LOCAL ] GPMT: Saving primary data. [2025-10-28T19:07:01.895122] [DEBUG] [LOCAL ] GPMT: Trimmed 35979 records to 25367 (keeping 200 days of data) [2025-10-28T19:07:02.072102] [DEBUG] [LOCAL ] GPMT: Primary data saved (25367 records). [2025-10-28T19:07:02.081901] [INFO ] [MAIN ] GPMT: Full history saved. [2025-10-28T19:07:02.083543] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-28T19:07:02.083967] [INFO ] [MAIN ] Update Progress: 961/2366 symbols completed. GPMT took 11.8s. Estimated remaining: 3h 5m 39s. Rate: 7.6 symbols/min [2025-10-28T19:07:02.124839] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-06. [2025-10-28T19:07:02.281086] [INFO ] [MAIN ] GPRK: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:07:02.323766] [DEBUG] [LOCAL ] GPRK: Loaded 39943 existing records from primary storage. [2025-10-28T19:07:02.324222] [INFO ] [MAIN ] GPRK: Loaded 39943 existing records. [2025-10-28T19:07:02.554435] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-01 (9.14 seconds). [2025-10-28T19:07:02.559091] [WARN ] [MAIN ] GPRK: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:07:02.569699] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-02. [2025-10-28T19:07:02.569942] [INFO ] [MAIN ] GPRK: Wiping existing primary data before full refresh. [2025-10-28T19:07:02.570944] [INFO ] [LOCAL ] GPRK: Starting deletion of primary data. [2025-10-28T19:07:02.571560] [DEBUG] [LOCAL ] GPRK: Deleted primary data file. [2025-10-28T19:07:02.571621] [INFO ] [MAIN ] GPRK: Starting full primary refresh. [2025-10-28T19:07:03.019861] [INFO ] [REMOTE ] GPRK: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:07:03.020266] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-01. [2025-10-28T19:07:03.980672] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-10-28T19:07:03.990670] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-03. [2025-10-28T19:07:04.114949] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-28T19:07:04.123984] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-02. [2025-10-28T19:07:05.446689] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-06 (3.32 seconds). [2025-10-28T19:07:05.451277] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-07. [2025-10-28T19:07:06.065409] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-03 (10.11 seconds). [2025-10-28T19:07:06.075995] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-04. [2025-10-28T19:07:06.281251] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-28T19:07:06.286769] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-08. [2025-10-28T19:07:07.285723] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-28T19:07:07.297361] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-05. [2025-10-28T19:07:09.169028] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-08 (2.88 seconds). [2025-10-28T19:07:09.174446] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-09. [2025-10-28T19:07:10.217771] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-03 (6.23 seconds). [2025-10-28T19:07:10.229373] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-04. [2025-10-28T19:07:11.192599] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-02 (7.07 seconds). [2025-10-28T19:07:11.200732] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-03. [2025-10-28T19:07:11.595677] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-28T19:07:11.606978] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-05. [2025-10-28T19:07:12.109871] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-05 (4.81 seconds). [2025-10-28T19:07:12.121902] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-06. [2025-10-28T19:07:12.354394] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-09 (3.18 seconds). [2025-10-28T19:07:12.360694] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-10. [2025-10-28T19:07:12.605322] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-28T19:07:12.614013] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-04. [2025-10-28T19:07:12.916504] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-28T19:07:12.927455] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-06. [2025-10-28T19:07:13.349359] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-28T19:07:13.360510] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-07. [2025-10-28T19:07:13.407533] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-28T19:07:13.413535] [INFO ] [REMOTE ] GPOR: Full fetch complete (34896 records). [2025-10-28T19:07:13.413618] [DEBUG] [VALIDATOR ] GPOR: Validating primary data. [2025-10-28T19:07:13.799070] [DEBUG] [VALIDATOR ] GPOR: All expected trading days are present. [2025-10-28T19:07:13.807088] [DEBUG] [VALIDATOR ] GPOR: Primary data validation passed. [2025-10-28T19:07:13.821032] [INFO ] [MAIN ] GPOR: Fetched primary data is valid. [2025-10-28T19:07:13.821129] [DEBUG] [LOCAL ] GPOR: Saving primary data. [2025-10-28T19:07:13.823243] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-28T19:07:13.832273] [DEBUG] [LOCAL ] GPOR: Trimmed 34896 records to 23382 (keeping 200 days of data) [2025-10-28T19:07:13.832566] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-05. [2025-10-28T19:07:13.969411] [DEBUG] [LOCAL ] GPOR: Primary data saved (23382 records). [2025-10-28T19:07:13.969543] [INFO ] [MAIN ] GPOR: Full history saved. [2025-10-28T19:07:13.969622] [INFO ] [MAIN ] Update Progress: 962/2366 symbols completed. GPOR took 23.7s. Estimated remaining: 3h 5m 37s. Rate: 7.6 symbols/min [2025-10-28T19:07:14.139202] [INFO ] [MAIN ] GRBK: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:07:14.163380] [DEBUG] [LOCAL ] GRBK: Loaded 26261 existing records from primary storage. [2025-10-28T19:07:14.163622] [INFO ] [MAIN ] GRBK: Loaded 26261 existing records. [2025-10-28T19:07:14.344062] [WARN ] [MAIN ] GRBK: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:07:14.344699] [INFO ] [MAIN ] GRBK: Wiping existing primary data before full refresh. [2025-10-28T19:07:14.344781] [INFO ] [LOCAL ] GRBK: Starting deletion of primary data. [2025-10-28T19:07:14.345342] [DEBUG] [LOCAL ] GRBK: Deleted primary data file. [2025-10-28T19:07:14.345405] [INFO ] [MAIN ] GRBK: Starting full primary refresh. [2025-10-28T19:07:14.568348] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-10-28T19:07:14.653380] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-07. [2025-10-28T19:07:14.754897] [INFO ] [REMOTE ] GRBK: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:07:14.755374] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-01. [2025-10-28T19:07:14.786302] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-28T19:07:14.799000] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-08. [2025-10-28T19:07:15.014012] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-28T19:07:15.023565] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-06. [2025-10-28T19:07:15.816995] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-28T19:07:15.822923] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-02. [2025-10-28T19:07:16.040031] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-10-28T19:07:16.051960] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-08. [2025-10-28T19:07:16.083926] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-28T19:07:16.110167] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-07. [2025-10-28T19:07:16.112476] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-28T19:07:16.124528] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-09. [2025-10-28T19:07:16.631259] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-10-28T19:07:16.637337] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-03. [2025-10-28T19:07:17.128109] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-28T19:07:17.136394] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-08. [2025-10-28T19:07:17.405831] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-28T19:07:17.418288] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-09. [2025-10-28T19:07:17.506890] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-28T19:07:17.513478] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-04. [2025-10-28T19:07:17.560856] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-28T19:07:17.571995] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-10. [2025-10-28T19:07:17.972214] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-28T19:07:17.980261] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-09. [2025-10-28T19:07:18.572042] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-28T19:07:18.578964] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-05. [2025-10-28T19:07:18.677468] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-28T19:07:18.688369] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-10. [2025-10-28T19:07:18.996318] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-28T19:07:19.005542] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-10. [2025-10-28T19:07:19.061912] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-28T19:07:19.072946] [INFO ] [REMOTE ] GPK: Full fetch complete (76117 records). [2025-10-28T19:07:19.073102] [DEBUG] [VALIDATOR ] GPK: Validating primary data. [2025-10-28T19:07:19.495930] [DEBUG] [VALIDATOR ] GPK: All expected trading days are present. [2025-10-28T19:07:19.496072] [DEBUG] [VALIDATOR ] GPK: Primary data validation passed. [2025-10-28T19:07:19.497091] [INFO ] [MAIN ] GPK: Fetched primary data is valid. [2025-10-28T19:07:19.497176] [DEBUG] [LOCAL ] GPK: Saving primary data. [2025-10-28T19:07:19.515189] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-28T19:07:19.522283] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-06. [2025-10-28T19:07:19.521949] [DEBUG] [LOCAL ] GPK: Trimmed 76117 records to 52757 (keeping 200 days of data) [2025-10-28T19:07:19.836682] [DEBUG] [LOCAL ] GPK: Primary data saved (52757 records). [2025-10-28T19:07:19.836811] [INFO ] [MAIN ] GPK: Full history saved. [2025-10-28T19:07:19.836931] [INFO ] [MAIN ] Update Progress: 963/2366 symbols completed. GPK took 29.6s. Estimated remaining: 3h 5m 26s. Rate: 7.6 symbols/min [2025-10-28T19:07:20.005590] [INFO ] [MAIN ] GRC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:07:20.015454] [DEBUG] [LOCAL ] GRC: Loaded 9285 existing records from primary storage. [2025-10-28T19:07:20.015704] [INFO ] [MAIN ] GRC: Loaded 9285 existing records. [2025-10-28T19:07:20.194365] [WARN ] [MAIN ] GRC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:07:20.194737] [INFO ] [MAIN ] GRC: Wiping existing primary data before full refresh. [2025-10-28T19:07:20.194908] [INFO ] [LOCAL ] GRC: Starting deletion of primary data. [2025-10-28T19:07:20.195309] [DEBUG] [LOCAL ] GRC: Deleted primary data file. [2025-10-28T19:07:20.195368] [INFO ] [MAIN ] GRC: Starting full primary refresh. [2025-10-28T19:07:20.541032] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-28T19:07:20.612968] [INFO ] [REMOTE ] GRC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:07:20.613590] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-01. [2025-10-28T19:07:20.614007] [INFO ] [REMOTE ] GPRK: Full fetch complete (58567 records). [2025-10-28T19:07:20.630418] [DEBUG] [VALIDATOR ] GPRK: Validating primary data. [2025-10-28T19:07:20.631968] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-28T19:07:20.682390] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-07. [2025-10-28T19:07:21.034185] [DEBUG] [VALIDATOR ] GPRK: All expected trading days are present. [2025-10-28T19:07:21.034331] [DEBUG] [VALIDATOR ] GPRK: Primary data validation passed. [2025-10-28T19:07:21.035159] [INFO ] [MAIN ] GPRK: Fetched primary data is valid. [2025-10-28T19:07:21.035220] [DEBUG] [LOCAL ] GPRK: Saving primary data. [2025-10-28T19:07:21.036311] [DEBUG] [LOCAL ] GPRK: Trimmed 58567 records to 39986 (keeping 200 days of data) [2025-10-28T19:07:21.264951] [DEBUG] [LOCAL ] GPRK: Primary data saved (39986 records). [2025-10-28T19:07:21.265213] [INFO ] [MAIN ] GPRK: Full history saved. [2025-10-28T19:07:21.272105] [INFO ] [MAIN ] Update Progress: 964/2366 symbols completed. GPRK took 19.2s. Estimated remaining: 3h 5m 9s. Rate: 7.6 symbols/min [2025-10-28T19:07:21.284430] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-28T19:07:21.308133] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-02. [2025-10-28T19:07:21.455143] [INFO ] [MAIN ] GRDN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:07:21.477266] [DEBUG] [LOCAL ] GRDN: Loaded 21538 existing records from primary storage. [2025-10-28T19:07:21.477495] [INFO ] [MAIN ] GRDN: Loaded 21538 existing records. [2025-10-28T19:07:21.683992] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-10 (3.00 seconds). [2025-10-28T19:07:21.689677] [WARN ] [MAIN ] GRDN: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:07:21.700504] [INFO ] [MAIN ] GRDN: Wiping existing primary data before full refresh. [2025-10-28T19:07:21.700858] [INFO ] [LOCAL ] GRDN: Starting deletion of primary data. [2025-10-28T19:07:21.707152] [DEBUG] [LOCAL ] GRDN: Deleted primary data file. [2025-10-28T19:07:21.717088] [INFO ] [MAIN ] GRDN: Starting full primary refresh. [2025-10-28T19:07:21.716997] [INFO ] [REMOTE ] GPN: Full fetch complete (74960 records). [2025-10-28T19:07:21.739456] [DEBUG] [VALIDATOR ] GPN: Validating primary data. [2025-10-28T19:07:21.751987] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-28T19:07:21.835542] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-08. [2025-10-28T19:07:21.999439] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-28T19:07:22.029787] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-03. [2025-10-28T19:07:22.519578] [INFO ] [REMOTE ] GRDN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:07:22.539567] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-01. [2025-10-28T19:07:22.558528] [DEBUG] [VALIDATOR ] GPN: All expected trading days are present. [2025-10-28T19:07:22.558625] [DEBUG] [VALIDATOR ] GPN: Primary data validation passed. [2025-10-28T19:07:22.559830] [INFO ] [MAIN ] GPN: Fetched primary data is valid. [2025-10-28T19:07:22.560144] [DEBUG] [LOCAL ] GPN: Saving primary data. [2025-10-28T19:07:22.562054] [DEBUG] [LOCAL ] GPN: Trimmed 74960 records to 51691 (keeping 200 days of data) [2025-10-28T19:07:22.809202] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-28T19:07:22.865196] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-04. [2025-10-28T19:07:22.907466] [DEBUG] [LOCAL ] GPN: Primary data saved (51691 records). [2025-10-28T19:07:22.907998] [INFO ] [MAIN ] GPN: Full history saved. [2025-10-28T19:07:22.908113] [INFO ] [MAIN ] Update Progress: 965/2366 symbols completed. GPN took 32.6s. Estimated remaining: 3h 4m 52s. Rate: 7.6 symbols/min [2025-10-28T19:07:22.970991] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-28T19:07:23.035404] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-09. [2025-10-28T19:07:23.106037] [INFO ] [MAIN ] GRMN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:07:23.140467] [DEBUG] [LOCAL ] GRMN: Loaded 39400 existing records from primary storage. [2025-10-28T19:07:23.140781] [INFO ] [MAIN ] GRMN: Loaded 39400 existing records. [2025-10-28T19:07:23.264078] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-28T19:07:23.277376] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-02. [2025-10-28T19:07:23.329538] [WARN ] [MAIN ] GRMN: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:07:23.330182] [INFO ] [MAIN ] GRMN: Wiping existing primary data before full refresh. [2025-10-28T19:07:23.330238] [INFO ] [LOCAL ] GRMN: Starting deletion of primary data. [2025-10-28T19:07:23.331004] [DEBUG] [LOCAL ] GRMN: Deleted primary data file. [2025-10-28T19:07:23.331061] [INFO ] [MAIN ] GRMN: Starting full primary refresh. [2025-10-28T19:07:23.624135] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-28T19:07:23.655311] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-05. [2025-10-28T19:07:23.696509] [INFO ] [REMOTE ] GRMN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:07:23.696985] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-01. [2025-10-28T19:07:23.705566] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-28T19:07:23.708517] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-03. [2025-10-28T19:07:23.958563] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-28T19:07:23.966566] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-10. [2025-10-28T19:07:24.164811] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-28T19:07:24.167248] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-06. [2025-10-28T19:07:24.306772] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-28T19:07:24.310426] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-04. [2025-10-28T19:07:24.621290] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-28T19:07:24.623696] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-07. [2025-10-28T19:07:24.776876] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-28T19:07:24.785287] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-02. [2025-10-28T19:07:24.888709] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-28T19:07:24.894261] [INFO ] [REMOTE ] GRBK: Full fetch complete (39820 records). [2025-10-28T19:07:24.894392] [DEBUG] [VALIDATOR ] GRBK: Validating primary data. [2025-10-28T19:07:25.140752] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-28T19:07:25.180689] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-05. [2025-10-28T19:07:25.257610] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-28T19:07:25.299561] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-08. [2025-10-28T19:07:25.332524] [DEBUG] [VALIDATOR ] GRBK: All expected trading days are present. [2025-10-28T19:07:25.332611] [DEBUG] [VALIDATOR ] GRBK: Primary data validation passed. [2025-10-28T19:07:25.333461] [INFO ] [MAIN ] GRBK: Fetched primary data is valid. [2025-10-28T19:07:25.333520] [DEBUG] [LOCAL ] GRBK: Saving primary data. [2025-10-28T19:07:25.334367] [DEBUG] [LOCAL ] GRBK: Trimmed 39820 records to 26209 (keeping 200 days of data) [2025-10-28T19:07:25.481972] [DEBUG] [LOCAL ] GRBK: Primary data saved (26209 records). [2025-10-28T19:07:25.482109] [INFO ] [MAIN ] GRBK: Full history saved. [2025-10-28T19:07:25.482188] [INFO ] [MAIN ] Update Progress: 966/2366 symbols completed. GRBK took 11.5s. Estimated remaining: 3h 4m 36s. Rate: 7.6 symbols/min [2025-10-28T19:07:25.650087] [INFO ] [MAIN ] GRND: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:07:25.693510] [DEBUG] [LOCAL ] GRND: Loaded 50170 existing records from primary storage. [2025-10-28T19:07:25.693845] [INFO ] [MAIN ] GRND: Loaded 50170 existing records. [2025-10-28T19:07:25.879193] [WARN ] [MAIN ] GRND: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:07:25.879453] [INFO ] [MAIN ] GRND: Wiping existing primary data before full refresh. [2025-10-28T19:07:25.879502] [INFO ] [LOCAL ] GRND: Starting deletion of primary data. [2025-10-28T19:07:25.879801] [DEBUG] [LOCAL ] GRND: Deleted primary data file. [2025-10-28T19:07:25.879865] [INFO ] [MAIN ] GRND: Starting full primary refresh. [2025-10-28T19:07:25.989478] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-10-28T19:07:26.009423] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-09. [2025-10-28T19:07:26.298292] [INFO ] [REMOTE ] GRND: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:07:26.327200] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-28T19:07:26.333678] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-06. [2025-10-28T19:07:26.328127] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-01. [2025-10-28T19:07:26.335456] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-10-28T19:07:26.347364] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-03. [2025-10-28T19:07:26.619683] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-28T19:07:26.623212] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-10. [2025-10-28T19:07:27.005306] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-28T19:07:27.010433] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-07. [2025-10-28T19:07:27.308463] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-28T19:07:27.311577] [INFO ] [REMOTE ] GRC: Full fetch complete (13608 records). [2025-10-28T19:07:27.311693] [DEBUG] [VALIDATOR ] GRC: Validating primary data. [2025-10-28T19:07:27.702839] [DEBUG] [VALIDATOR ] GRC: All expected trading days are present. [2025-10-28T19:07:27.703011] [DEBUG] [VALIDATOR ] GRC: Primary data validation passed. [2025-10-28T19:07:27.715739] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-28T19:07:27.715202] [INFO ] [MAIN ] GRC: Fetched primary data is valid. [2025-10-28T19:07:27.721057] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-08. [2025-10-28T19:07:27.720757] [DEBUG] [LOCAL ] GRC: Saving primary data. [2025-10-28T19:07:27.723048] [DEBUG] [LOCAL ] GRC: Trimmed 13608 records to 9304 (keeping 200 days of data) [2025-10-28T19:07:27.806107] [DEBUG] [LOCAL ] GRC: Primary data saved (9304 records). [2025-10-28T19:07:27.807020] [INFO ] [MAIN ] GRC: Full history saved. [2025-10-28T19:07:27.808083] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-28T19:07:27.816621] [INFO ] [MAIN ] Update Progress: 967/2366 symbols completed. GRC took 8.0s. Estimated remaining: 3h 4m 20s. Rate: 7.6 symbols/min [2025-10-28T19:07:27.817853] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-02. [2025-10-28T19:07:28.019285] [INFO ] [MAIN ] GRNT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:07:28.020751] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-10-28T19:07:28.031180] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-04. [2025-10-28T19:07:28.063096] [DEBUG] [LOCAL ] GRNT: Loaded 33640 existing records from primary storage. [2025-10-28T19:07:28.063395] [INFO ] [MAIN ] GRNT: Loaded 33640 existing records. [2025-10-28T19:07:28.239519] [WARN ] [MAIN ] GRNT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:07:28.239754] [INFO ] [MAIN ] GRNT: Wiping existing primary data before full refresh. [2025-10-28T19:07:28.239806] [INFO ] [LOCAL ] GRNT: Starting deletion of primary data. [2025-10-28T19:07:28.240044] [DEBUG] [LOCAL ] GRNT: Deleted primary data file. [2025-10-28T19:07:28.240086] [INFO ] [MAIN ] GRNT: Starting full primary refresh. [2025-10-28T19:07:28.617672] [INFO ] [REMOTE ] GRNT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:07:28.625948] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-01. [2025-10-28T19:07:28.626436] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-28T19:07:28.632539] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-09. [2025-10-28T19:07:29.175212] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-28T19:07:29.184090] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-03. [2025-10-28T19:07:29.327343] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-28T19:07:29.338538] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-05. [2025-10-28T19:07:29.483794] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-28T19:07:29.491820] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-10. [2025-10-28T19:07:29.541634] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-28T19:07:29.549185] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-02. [2025-10-28T19:07:30.409821] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-28T19:07:30.416732] [INFO ] [REMOTE ] GRDN: Full fetch complete (27033 records). [2025-10-28T19:07:30.416842] [DEBUG] [VALIDATOR ] GRDN: Validating primary data. [2025-10-28T19:07:30.752564] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-28T19:07:30.759616] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-03. [2025-10-28T19:07:30.903272] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-28T19:07:30.921696] [DEBUG] [VALIDATOR ] GRDN: All expected trading days are present. [2025-10-28T19:07:30.921789] [DEBUG] [VALIDATOR ] GRDN: Primary data validation passed. [2025-10-28T19:07:30.925691] [INFO ] [MAIN ] GRDN: Fetched primary data is valid. [2025-10-28T19:07:30.924407] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-28T19:07:30.924848] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-04. [2025-10-28T19:07:30.934927] [DEBUG] [LOCAL ] GRDN: Saving primary data. [2025-10-28T19:07:30.935889] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-06. [2025-10-28T19:07:30.937084] [DEBUG] [LOCAL ] GRDN: Trimmed 27033 records to 21652 (keeping 200 days of data) [2025-10-28T19:07:31.060173] [DEBUG] [LOCAL ] GRDN: Primary data saved (21652 records). [2025-10-28T19:07:31.060297] [INFO ] [MAIN ] GRDN: Full history saved. [2025-10-28T19:07:31.060371] [INFO ] [MAIN ] Update Progress: 968/2366 symbols completed. GRDN took 9.8s. Estimated remaining: 3h 4m 5s. Rate: 7.6 symbols/min [2025-10-28T19:07:31.224458] [INFO ] [MAIN ] GROV: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:07:31.234224] [DEBUG] [LOCAL ] GROV: Loaded 8633 existing records from primary storage. [2025-10-28T19:07:31.234395] [INFO ] [MAIN ] GROV: Loaded 8633 existing records. [2025-10-28T19:07:31.408968] [WARN ] [MAIN ] GROV: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:07:31.409190] [INFO ] [MAIN ] GROV: Wiping existing primary data before full refresh. [2025-10-28T19:07:31.409237] [INFO ] [LOCAL ] GROV: Starting deletion of primary data. [2025-10-28T19:07:31.409383] [DEBUG] [LOCAL ] GROV: Deleted primary data file. [2025-10-28T19:07:31.409420] [INFO ] [MAIN ] GROV: Starting full primary refresh. [2025-10-28T19:07:31.824095] [INFO ] [REMOTE ] GROV: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:07:31.824501] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-01. [2025-10-28T19:07:31.844615] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-28T19:07:31.852112] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-04. [2025-10-28T19:07:32.127862] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-28T19:07:32.136542] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-07. [2025-10-28T19:07:32.295983] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-28T19:07:32.306874] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-05. [2025-10-28T19:07:32.439613] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-28T19:07:32.442853] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-02. [2025-10-28T19:07:32.856066] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-28T19:07:32.864484] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-05. [2025-10-28T19:07:33.051626] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-10-28T19:07:33.054192] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-03. [2025-10-28T19:07:33.319969] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-28T19:07:33.328949] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-08. [2025-10-28T19:07:33.672122] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-28T19:07:33.692451] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-06. [2025-10-28T19:07:33.704957] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-28T19:07:33.711604] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-06. [2025-10-28T19:07:33.741702] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-10-28T19:07:33.744377] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-04. [2025-10-28T19:07:34.246801] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-28T19:07:34.249629] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-05. [2025-10-28T19:07:34.340913] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-28T19:07:34.349760] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-09. [2025-10-28T19:07:34.661335] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-28T19:07:34.669922] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-07. [2025-10-28T19:07:34.787181] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-28T19:07:34.803945] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-07. [2025-10-28T19:07:34.805606] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-28T19:07:34.808743] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-06. [2025-10-28T19:07:35.347683] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-28T19:07:35.349984] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-07. [2025-10-28T19:07:35.458272] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-28T19:07:35.467019] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-10. [2025-10-28T19:07:35.615412] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-28T19:07:35.623004] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-08. [2025-10-28T19:07:35.859189] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-28T19:07:35.863322] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-08. [2025-10-28T19:07:36.096522] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-28T19:07:36.107425] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-08. [2025-10-28T19:07:36.327003] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-28T19:07:36.329853] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-09. [2025-10-28T19:07:36.654012] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-28T19:07:36.662542] [INFO ] [REMOTE ] GRMN: Full fetch complete (59335 records). [2025-10-28T19:07:36.684999] [DEBUG] [VALIDATOR ] GRMN: Validating primary data. [2025-10-28T19:07:36.687162] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-10-28T19:07:36.745334] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-09. [2025-10-28T19:07:36.776308] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-10-28T19:07:36.796030] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-10. [2025-10-28T19:07:37.125355] [DEBUG] [VALIDATOR ] GRMN: All expected trading days are present. [2025-10-28T19:07:37.125476] [DEBUG] [VALIDATOR ] GRMN: Primary data validation passed. [2025-10-28T19:07:37.126309] [INFO ] [MAIN ] GRMN: Fetched primary data is valid. [2025-10-28T19:07:37.126370] [DEBUG] [LOCAL ] GRMN: Saving primary data. [2025-10-28T19:07:37.127507] [DEBUG] [LOCAL ] GRMN: Trimmed 59335 records to 39341 (keeping 200 days of data) [2025-10-28T19:07:37.372486] [DEBUG] [LOCAL ] GRMN: Primary data saved (39341 records). [2025-10-28T19:07:37.372675] [INFO ] [MAIN ] GRMN: Full history saved. [2025-10-28T19:07:37.373501] [INFO ] [MAIN ] Update Progress: 969/2366 symbols completed. GRMN took 14.5s. Estimated remaining: 3h 3m 55s. Rate: 7.6 symbols/min [2025-10-28T19:07:37.552821] [INFO ] [MAIN ] GRX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:07:37.560173] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-28T19:07:37.563171] [INFO ] [REMOTE ] GROV: Full fetch complete (13443 records). [2025-10-28T19:07:37.564566] [DEBUG] [VALIDATOR ] GROV: Validating primary data. [2025-10-28T19:07:37.622193] [DEBUG] [LOCAL ] GRX: Loaded 4811 existing records from primary storage. [2025-10-28T19:07:37.647913] [INFO ] [MAIN ] GRX: Loaded 4811 existing records. [2025-10-28T19:07:38.040975] [WARN ] [MAIN ] GRX: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:07:38.026512] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-10-28T19:07:38.079998] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-28T19:07:38.072031] [INFO ] [MAIN ] GRX: Wiping existing primary data before full refresh. [2025-10-28T19:07:38.134396] [INFO ] [LOCAL ] GRX: Starting deletion of primary data. [2025-10-28T19:07:38.138146] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-10. [2025-10-28T19:07:38.122499] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-09. [2025-10-28T19:07:38.138285] [DEBUG] [LOCAL ] GRX: Deleted primary data file. [2025-10-28T19:07:38.150471] [INFO ] [MAIN ] GRX: Starting full primary refresh. [2025-10-28T19:07:38.282069] [DEBUG] [VALIDATOR ] GROV: All expected trading days are present. [2025-10-28T19:07:38.303515] [DEBUG] [VALIDATOR ] GROV: Primary data validation passed. [2025-10-28T19:07:38.309124] [INFO ] [MAIN ] GROV: Fetched primary data is valid. [2025-10-28T19:07:38.320251] [DEBUG] [LOCAL ] GROV: Saving primary data. [2025-10-28T19:07:38.341754] [DEBUG] [LOCAL ] GROV: Trimmed 13443 records to 8721 (keeping 200 days of data) [2025-10-28T19:07:38.500497] [DEBUG] [LOCAL ] GROV: Primary data saved (8721 records). [2025-10-28T19:07:38.521421] [INFO ] [MAIN ] GROV: Full history saved. [2025-10-28T19:07:38.538556] [INFO ] [MAIN ] Update Progress: 970/2366 symbols completed. GROV took 7.5s. Estimated remaining: 3h 3m 38s. Rate: 7.6 symbols/min [2025-10-28T19:07:38.756359] [INFO ] [REMOTE ] GRX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:07:38.767067] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-01. [2025-10-28T19:07:38.829090] [INFO ] [MAIN ] GS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:07:38.877331] [DEBUG] [LOCAL ] GS: Loaded 51743 existing records from primary storage. [2025-10-28T19:07:38.877614] [INFO ] [MAIN ] GS: Loaded 51743 existing records. [2025-10-28T19:07:39.084627] [WARN ] [MAIN ] GS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:07:39.084946] [INFO ] [MAIN ] GS: Wiping existing primary data before full refresh. [2025-10-28T19:07:39.084999] [INFO ] [LOCAL ] GS: Starting deletion of primary data. [2025-10-28T19:07:39.085468] [DEBUG] [LOCAL ] GS: Deleted primary data file. [2025-10-28T19:07:39.085538] [INFO ] [MAIN ] GS: Starting full primary refresh. [2025-10-28T19:07:39.200121] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-10-28T19:07:39.241998] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-02. [2025-10-28T19:07:39.452315] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-28T19:07:39.491489] [INFO ] [REMOTE ] GS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:07:39.498209] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-01. [2025-10-28T19:07:39.499760] [INFO ] [REMOTE ] GRNT: Full fetch complete (48243 records). [2025-10-28T19:07:39.500198] [DEBUG] [VALIDATOR ] GRNT: Validating primary data. [2025-10-28T19:07:39.614188] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-10-28T19:07:39.646636] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-03. [2025-10-28T19:07:39.779085] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-10-28T19:07:39.875880] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-10. [2025-10-28T19:07:39.978863] [DEBUG] [VALIDATOR ] GRNT: All expected trading days are present. [2025-10-28T19:07:39.978937] [DEBUG] [VALIDATOR ] GRNT: Primary data validation passed. [2025-10-28T19:07:39.979754] [INFO ] [MAIN ] GRNT: Fetched primary data is valid. [2025-10-28T19:07:39.979818] [DEBUG] [LOCAL ] GRNT: Saving primary data. [2025-10-28T19:07:39.980853] [DEBUG] [LOCAL ] GRNT: Trimmed 48243 records to 33544 (keeping 200 days of data) [2025-10-28T19:07:40.172455] [DEBUG] [LOCAL ] GRNT: Primary data saved (33544 records). [2025-10-28T19:07:40.172576] [INFO ] [MAIN ] GRNT: Full history saved. [2025-10-28T19:07:40.172670] [INFO ] [MAIN ] Update Progress: 971/2366 symbols completed. GRNT took 12.4s. Estimated remaining: 3h 3m 21s. Rate: 7.6 symbols/min [2025-10-28T19:07:40.274472] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-28T19:07:40.278326] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-04. [2025-10-28T19:07:40.346846] [INFO ] [MAIN ] GSBD: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:07:40.383110] [DEBUG] [LOCAL ] GSBD: Loaded 39315 existing records from primary storage. [2025-10-28T19:07:40.383373] [INFO ] [MAIN ] GSBD: Loaded 39315 existing records. [2025-10-28T19:07:40.556777] [WARN ] [MAIN ] GSBD: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:07:40.556963] [INFO ] [MAIN ] GSBD: Wiping existing primary data before full refresh. [2025-10-28T19:07:40.557009] [INFO ] [LOCAL ] GSBD: Starting deletion of primary data. [2025-10-28T19:07:40.557314] [DEBUG] [LOCAL ] GSBD: Deleted primary data file. [2025-10-28T19:07:40.557377] [INFO ] [MAIN ] GSBD: Starting full primary refresh. [2025-10-28T19:07:40.842553] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-28T19:07:40.860234] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-05. [2025-10-28T19:07:40.922418] [INFO ] [REMOTE ] GSBD: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:07:40.922749] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-01. [2025-10-28T19:07:41.200216] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-28T19:07:41.210797] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-02. [2025-10-28T19:07:41.292010] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-28T19:07:41.293994] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-06. [2025-10-28T19:07:41.570089] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-10 (1.69 seconds). [2025-10-28T19:07:41.581006] [INFO ] [REMOTE ] GRND: Full fetch complete (72082 records). [2025-10-28T19:07:41.581149] [DEBUG] [VALIDATOR ] GRND: Validating primary data. [2025-10-28T19:07:41.696898] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-10-28T19:07:41.708988] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-07. [2025-10-28T19:07:42.015472] [DEBUG] [VALIDATOR ] GRND: All expected trading days are present. [2025-10-28T19:07:42.015613] [DEBUG] [VALIDATOR ] GRND: Primary data validation passed. [2025-10-28T19:07:42.016613] [INFO ] [MAIN ] GRND: Fetched primary data is valid. [2025-10-28T19:07:42.016708] [DEBUG] [LOCAL ] GRND: Saving primary data. [2025-10-28T19:07:42.032016] [DEBUG] [LOCAL ] GRND: Trimmed 72082 records to 50168 (keeping 200 days of data) [2025-10-28T19:07:42.046150] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-28T19:07:42.115189] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-02. [2025-10-28T19:07:42.150247] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-10-28T19:07:42.154375] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-08. [2025-10-28T19:07:42.356338] [DEBUG] [LOCAL ] GRND: Primary data saved (50168 records). [2025-10-28T19:07:42.356498] [INFO ] [MAIN ] GRND: Full history saved. [2025-10-28T19:07:42.356585] [INFO ] [MAIN ] Update Progress: 972/2366 symbols completed. GRND took 16.9s. Estimated remaining: 3h 3m 5s. Rate: 7.6 symbols/min [2025-10-28T19:07:42.524207] [INFO ] [MAIN ] GSK: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:07:42.558320] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-10-28T19:07:42.561113] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-09. [2025-10-28T19:07:42.579872] [DEBUG] [LOCAL ] GSK: Loaded 53510 existing records from primary storage. [2025-10-28T19:07:42.580189] [INFO ] [MAIN ] GSK: Loaded 53510 existing records. [2025-10-28T19:07:42.758224] [WARN ] [MAIN ] GSK: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:07:42.758427] [INFO ] [MAIN ] GSK: Wiping existing primary data before full refresh. [2025-10-28T19:07:42.758482] [INFO ] [LOCAL ] GSK: Starting deletion of primary data. [2025-10-28T19:07:42.758784] [DEBUG] [LOCAL ] GSK: Deleted primary data file. [2025-10-28T19:07:42.758844] [INFO ] [MAIN ] GSK: Starting full primary refresh. [2025-10-28T19:07:43.142274] [INFO ] [REMOTE ] GSK: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:07:43.149609] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-01. [2025-10-28T19:07:43.149963] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-28T19:07:43.179624] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-10. [2025-10-28T19:07:43.180631] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-10-28T19:07:43.192695] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-03. [2025-10-28T19:07:43.331312] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-28T19:07:43.338843] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-03. [2025-10-28T19:07:43.732219] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-10 (0.55 seconds). [2025-10-28T19:07:43.734045] [INFO ] [REMOTE ] GRX: Full fetch complete (6532 records). [2025-10-28T19:07:43.734126] [DEBUG] [VALIDATOR ] GRX: Validating primary data. [2025-10-28T19:07:44.298676] [DEBUG] [VALIDATOR ] GRX: All expected trading days are present. [2025-10-28T19:07:44.298773] [DEBUG] [VALIDATOR ] GRX: Primary data validation passed. [2025-10-28T19:07:44.298987] [INFO ] [MAIN ] GRX: Fetched primary data is valid. [2025-10-28T19:07:44.299050] [DEBUG] [LOCAL ] GRX: Saving primary data. [2025-10-28T19:07:44.299738] [DEBUG] [LOCAL ] GRX: Trimmed 6532 records to 4799 (keeping 200 days of data) [2025-10-28T19:07:44.337032] [DEBUG] [LOCAL ] GRX: Primary data saved (4799 records). [2025-10-28T19:07:44.337175] [INFO ] [MAIN ] GRX: Full history saved. [2025-10-28T19:07:44.337263] [INFO ] [MAIN ] Update Progress: 973/2366 symbols completed. GRX took 7.0s. Estimated remaining: 3h 2m 48s. Rate: 7.6 symbols/min [2025-10-28T19:07:44.588473] [INFO ] [MAIN ] GSL: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:07:44.620215] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-28T19:07:44.630514] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-04. [2025-10-28T19:07:44.678688] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-10-28T19:07:44.689951] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-02. [2025-10-28T19:07:44.708636] [DEBUG] [LOCAL ] GSL: Loaded 32535 existing records from primary storage. [2025-10-28T19:07:44.709214] [INFO ] [MAIN ] GSL: Loaded 32535 existing records. [2025-10-28T19:07:44.897873] [WARN ] [MAIN ] GSL: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:07:44.898218] [INFO ] [MAIN ] GSL: Wiping existing primary data before full refresh. [2025-10-28T19:07:44.898389] [INFO ] [LOCAL ] GSL: Starting deletion of primary data. [2025-10-28T19:07:44.899191] [DEBUG] [LOCAL ] GSL: Deleted primary data file. [2025-10-28T19:07:44.899265] [INFO ] [MAIN ] GSL: Starting full primary refresh. [2025-10-28T19:07:45.219238] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-10-28T19:07:45.246733] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-04. [2025-10-28T19:07:45.309890] [INFO ] [REMOTE ] GSL: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:07:45.580359] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-01. [2025-10-28T19:07:45.937833] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-28T19:07:46.109485] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-28T19:07:46.380242] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-05. [2025-10-28T19:07:46.439589] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-10-28T19:07:47.011605] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-28T19:07:47.180260] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-05. [2025-10-28T19:07:47.340400] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-28T19:07:47.980249] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-02. [2025-10-28T19:07:48.780254] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-03. [2025-10-28T19:07:48.854940] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-28T19:07:48.914717] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-28T19:07:49.580279] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-06. [2025-10-28T19:07:50.257407] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-28T19:07:50.380268] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-04. [2025-10-28T19:07:50.696267] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-28T19:07:51.180303] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-07. [2025-10-28T19:07:51.901790] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-28T19:07:51.980266] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-06. [2025-10-28T19:07:52.232730] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-28T19:07:52.780281] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-03. [2025-10-28T19:07:53.563540] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-10-28T19:07:53.580215] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-07. [2025-10-28T19:07:53.797347] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-28T19:07:54.380277] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-04. [2025-10-28T19:07:55.183877] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-05. [2025-10-28T19:07:55.185852] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-10-28T19:07:55.424875] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-28T19:07:55.980288] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-08. [2025-10-28T19:07:56.744243] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-28T19:07:56.780210] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-06. [2025-10-28T19:07:57.422263] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-28T19:07:57.580254] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-09. [2025-10-28T19:07:58.062561] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-28T19:07:58.380309] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-07. [2025-10-28T19:07:59.180283] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-08. [2025-10-28T19:07:59.235257] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-28T19:07:59.841178] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-28T19:07:59.980256] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-08. [2025-10-28T19:08:00.234144] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-28T19:08:00.780313] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-09. [2025-10-28T19:08:01.520394] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-28T19:08:01.580301] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-10. [2025-10-28T19:08:01.943338] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-28T19:08:02.380277] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-10. [2025-10-28T19:08:03.180348] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-09. [2025-10-28T19:08:03.649284] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-10 (2.07 seconds). [2025-10-28T19:08:03.660292] [INFO ] [REMOTE ] GS: Full fetch complete (75819 records). [2025-10-28T19:08:03.660450] [DEBUG] [VALIDATOR ] GS: Validating primary data. [2025-10-28T19:08:03.973899] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-28T19:08:03.989793] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-05. [2025-10-28T19:08:04.055328] [INFO ] [REMOTE ] GSBD: Full fetch complete (58494 records). [2025-10-28T19:08:04.074603] [DEBUG] [VALIDATOR ] GSBD: Validating primary data. [2025-10-28T19:08:04.131754] [DEBUG] [VALIDATOR ] GS: All expected trading days are present. [2025-10-28T19:08:04.145336] [DEBUG] [VALIDATOR ] GS: Primary data validation passed. [2025-10-28T19:08:04.171554] [INFO ] [MAIN ] GS: Fetched primary data is valid. [2025-10-28T19:08:04.197590] [DEBUG] [LOCAL ] GS: Saving primary data. [2025-10-28T19:08:04.241115] [DEBUG] [LOCAL ] GS: Trimmed 75819 records to 51731 (keeping 200 days of data) [2025-10-28T19:08:04.639519] [DEBUG] [VALIDATOR ] GSBD: All expected trading days are present. [2025-10-28T19:08:04.655487] [DEBUG] [VALIDATOR ] GSBD: Primary data validation passed. [2025-10-28T19:08:04.656521] [INFO ] [MAIN ] GSBD: Fetched primary data is valid. [2025-10-28T19:08:04.711234] [DEBUG] [LOCAL ] GSBD: Saving primary data. [2025-10-28T19:08:04.752716] [DEBUG] [LOCAL ] GSBD: Trimmed 58494 records to 39288 (keeping 200 days of data) [2025-10-28T19:08:05.068867] [DEBUG] [LOCAL ] GS: Primary data saved (51731 records). [2025-10-28T19:08:05.072427] [INFO ] [MAIN ] GS: Full history saved. [2025-10-28T19:08:05.072755] [INFO ] [MAIN ] Update Progress: 974/2366 symbols completed. GS took 26.5s. Estimated remaining: 3h 2m 59s. Rate: 7.6 symbols/min [2025-10-28T19:08:05.148246] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-10-28T19:08:05.242989] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-10. [2025-10-28T19:08:05.331039] [INFO ] [MAIN ] GTES: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:08:05.359052] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-28T19:08:05.384925] [DEBUG] [LOCAL ] GSBD: Primary data saved (39288 records). [2025-10-28T19:08:05.385491] [INFO ] [MAIN ] GSBD: Full history saved. [2025-10-28T19:08:05.385590] [INFO ] [MAIN ] Update Progress: 975/2366 symbols completed. GSBD took 25.2s. Estimated remaining: 3h 2m 40s. Rate: 7.6 symbols/min [2025-10-28T19:08:05.581119] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-06. [2025-10-28T19:08:05.582700] [INFO ] [MAIN ] GTLS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:08:05.599157] [DEBUG] [LOCAL ] GTES: Loaded 50229 existing records from primary storage. [2025-10-28T19:08:05.599425] [INFO ] [MAIN ] GTES: Loaded 50229 existing records. [2025-10-28T19:08:05.797577] [WARN ] [MAIN ] GTES: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:08:05.797879] [INFO ] [MAIN ] GTES: Wiping existing primary data before full refresh. [2025-10-28T19:08:05.797926] [INFO ] [LOCAL ] GTES: Starting deletion of primary data. [2025-10-28T19:08:05.798329] [DEBUG] [LOCAL ] GTES: Deleted primary data file. [2025-10-28T19:08:05.798371] [INFO ] [MAIN ] GTES: Starting full primary refresh. [2025-10-28T19:08:05.919498] [DEBUG] [LOCAL ] GTLS: Loaded 42877 existing records from primary storage. [2025-10-28T19:08:05.930578] [INFO ] [MAIN ] GTLS: Loaded 42877 existing records. [2025-10-28T19:08:06.330397] [WARN ] [MAIN ] GTLS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:08:06.358975] [INFO ] [MAIN ] GTLS: Wiping existing primary data before full refresh. [2025-10-28T19:08:06.359062] [INFO ] [LOCAL ] GTLS: Starting deletion of primary data. [2025-10-28T19:08:06.358916] [INFO ] [REMOTE ] GTES: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:08:06.359405] [DEBUG] [LOCAL ] GTLS: Deleted primary data file. [2025-10-28T19:08:06.359463] [INFO ] [MAIN ] GTLS: Starting full primary refresh. [2025-10-28T19:08:06.390683] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-01. [2025-10-28T19:08:06.715307] [INFO ] [REMOTE ] GTLS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:08:06.737570] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-10-28T19:08:06.977813] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-28T19:08:06.988443] [INFO ] [REMOTE ] GSK: Full fetch complete (77637 records). [2025-10-28T19:08:06.988574] [DEBUG] [VALIDATOR ] GSK: Validating primary data. [2025-10-28T19:08:07.185448] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-01. [2025-10-28T19:08:07.377392] [DEBUG] [VALIDATOR ] GSK: All expected trading days are present. [2025-10-28T19:08:07.377461] [DEBUG] [VALIDATOR ] GSK: Primary data validation passed. [2025-10-28T19:08:07.378457] [INFO ] [MAIN ] GSK: Fetched primary data is valid. [2025-10-28T19:08:07.378520] [DEBUG] [LOCAL ] GSK: Saving primary data. [2025-10-28T19:08:07.379929] [DEBUG] [LOCAL ] GSK: Trimmed 77637 records to 53510 (keeping 200 days of data) [2025-10-28T19:08:07.680744] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-28T19:08:07.756467] [DEBUG] [LOCAL ] GSK: Primary data saved (53510 records). [2025-10-28T19:08:07.756588] [INFO ] [MAIN ] GSK: Full history saved. [2025-10-28T19:08:07.756687] [INFO ] [MAIN ] Update Progress: 976/2366 symbols completed. GSK took 25.4s. Estimated remaining: 3h 2m 24s. Rate: 7.6 symbols/min [2025-10-28T19:08:07.924108] [INFO ] [MAIN ] GTN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:08:07.964206] [DEBUG] [LOCAL ] GTN: Loaded 44461 existing records from primary storage. [2025-10-28T19:08:07.964473] [INFO ] [MAIN ] GTN: Loaded 44461 existing records. [2025-10-28T19:08:07.985355] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-02. [2025-10-28T19:08:08.140369] [WARN ] [MAIN ] GTN: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:08:08.140558] [INFO ] [MAIN ] GTN: Wiping existing primary data before full refresh. [2025-10-28T19:08:08.140604] [INFO ] [LOCAL ] GTN: Starting deletion of primary data. [2025-10-28T19:08:08.140964] [DEBUG] [LOCAL ] GTN: Deleted primary data file. [2025-10-28T19:08:08.141017] [INFO ] [MAIN ] GTN: Starting full primary refresh. [2025-10-28T19:08:08.495291] [INFO ] [REMOTE ] GTN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:08:08.528356] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-28T19:08:08.780253] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-07. [2025-10-28T19:08:09.346310] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-10-28T19:08:09.580223] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-01. [2025-10-28T19:08:09.772412] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-28T19:08:10.380254] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-02. [2025-10-28T19:08:10.701029] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-28T19:08:11.180250] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-08. [2025-10-28T19:08:11.270561] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-28T19:08:11.980268] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-02. [2025-10-28T19:08:12.249579] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-28T19:08:12.780276] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-09. [2025-10-28T19:08:13.063873] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-28T19:08:13.580303] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-03. [2025-10-28T19:08:13.711094] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-28T19:08:14.380247] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-10. [2025-10-28T19:08:14.800626] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-28T19:08:15.180249] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-03. [2025-10-28T19:08:15.831154] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-28T19:08:15.837878] [INFO ] [REMOTE ] GSL: Full fetch complete (48201 records). [2025-10-28T19:08:15.837988] [DEBUG] [VALIDATOR ] GSL: Validating primary data. [2025-10-28T19:08:15.985710] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-03. [2025-10-28T19:08:16.224668] [DEBUG] [VALIDATOR ] GSL: All expected trading days are present. [2025-10-28T19:08:16.224776] [DEBUG] [VALIDATOR ] GSL: Primary data validation passed. [2025-10-28T19:08:16.225752] [INFO ] [MAIN ] GSL: Fetched primary data is valid. [2025-10-28T19:08:16.225815] [DEBUG] [LOCAL ] GSL: Saving primary data. [2025-10-28T19:08:16.227031] [DEBUG] [LOCAL ] GSL: Trimmed 48201 records to 32477 (keeping 200 days of data) [2025-10-28T19:08:16.430425] [DEBUG] [LOCAL ] GSL: Primary data saved (32477 records). [2025-10-28T19:08:16.430639] [INFO ] [MAIN ] GSL: Full history saved. [2025-10-28T19:08:16.430793] [INFO ] [MAIN ] Update Progress: 977/2366 symbols completed. GSL took 32.1s. Estimated remaining: 3h 2m 18s. Rate: 7.6 symbols/min [2025-10-28T19:08:16.579920] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-10-28T19:08:16.662428] [INFO ] [MAIN ] GTY: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:08:16.692925] [DEBUG] [LOCAL ] GTY: Loaded 29754 existing records from primary storage. [2025-10-28T19:08:16.693189] [INFO ] [MAIN ] GTY: Loaded 29754 existing records. [2025-10-28T19:08:16.785362] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-04. [2025-10-28T19:08:16.880094] [WARN ] [MAIN ] GTY: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:08:16.880588] [INFO ] [MAIN ] GTY: Wiping existing primary data before full refresh. [2025-10-28T19:08:16.880636] [INFO ] [LOCAL ] GTY: Starting deletion of primary data. [2025-10-28T19:08:16.880964] [DEBUG] [LOCAL ] GTY: Deleted primary data file. [2025-10-28T19:08:16.881005] [INFO ] [MAIN ] GTY: Starting full primary refresh. [2025-10-28T19:08:17.232723] [INFO ] [REMOTE ] GTY: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:08:17.417719] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-28T19:08:17.580250] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-04. [2025-10-28T19:08:18.221901] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-28T19:08:18.380257] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-01. [2025-10-28T19:08:18.934382] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-28T19:08:19.180213] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-04. [2025-10-28T19:08:19.248905] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-28T19:08:19.980287] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-05. [2025-10-28T19:08:20.427725] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-28T19:08:20.780287] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-05. [2025-10-28T19:08:21.122888] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-28T19:08:21.580313] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-06. [2025-10-28T19:08:21.917793] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-28T19:08:22.380270] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-02. [2025-10-28T19:08:22.905553] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-28T19:08:23.089593] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-10-28T19:08:23.180219] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-03. [2025-10-28T19:08:23.980258] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-06. [2025-10-28T19:08:24.123041] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-28T19:08:24.780375] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-05. [2025-10-28T19:08:25.232933] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-28T19:08:25.580251] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-04. [2025-10-28T19:08:25.964954] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-28T19:08:26.380251] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-06. [2025-10-28T19:08:26.611986] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-28T19:08:27.180256] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-05. [2025-10-28T19:08:27.735727] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-28T19:08:27.980259] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-07. [2025-10-28T19:08:28.266008] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-28T19:08:28.780263] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-07. [2025-10-28T19:08:29.257184] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-28T19:08:29.580265] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-06. [2025-10-28T19:08:29.868850] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-28T19:08:30.380231] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-08. [2025-10-28T19:08:30.565887] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-28T19:08:31.180314] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-07. [2025-10-28T19:08:31.571684] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-28T19:08:31.980250] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-08. [2025-10-28T19:08:32.241531] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-28T19:08:32.780268] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-08. [2025-10-28T19:08:33.295877] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-28T19:08:33.580984] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-28T19:08:33.580337] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-09. [2025-10-28T19:08:34.380310] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-09. [2025-10-28T19:08:34.843778] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-28T19:08:35.180272] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-10. [2025-10-28T19:08:35.690743] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-28T19:08:35.980318] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-10. [2025-10-28T19:08:36.516470] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-28T19:08:36.525365] [INFO ] [REMOTE ] GTN: Full fetch complete (65503 records). [2025-10-28T19:08:36.525539] [DEBUG] [VALIDATOR ] GTN: Validating primary data. [2025-10-28T19:08:36.788199] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-09. [2025-10-28T19:08:36.927931] [DEBUG] [VALIDATOR ] GTN: All expected trading days are present. [2025-10-28T19:08:36.928018] [DEBUG] [VALIDATOR ] GTN: Primary data validation passed. [2025-10-28T19:08:36.929195] [INFO ] [MAIN ] GTN: Fetched primary data is valid. [2025-10-28T19:08:36.929284] [DEBUG] [LOCAL ] GTN: Saving primary data. [2025-10-28T19:08:36.931024] [DEBUG] [LOCAL ] GTN: Trimmed 65503 records to 44374 (keeping 200 days of data) [2025-10-28T19:08:37.188324] [DEBUG] [LOCAL ] GTN: Primary data saved (44374 records). [2025-10-28T19:08:37.188488] [INFO ] [MAIN ] GTN: Full history saved. [2025-10-28T19:08:37.188633] [INFO ] [MAIN ] Update Progress: 978/2366 symbols completed. GTN took 29.4s. Estimated remaining: 3h 2m 28s. Rate: 7.6 symbols/min [2025-10-28T19:08:37.309503] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-28T19:08:37.344417] [INFO ] [REMOTE ] GTLS: Full fetch complete (61440 records). [2025-10-28T19:08:37.367272] [DEBUG] [VALIDATOR ] GTLS: Validating primary data. [2025-10-28T19:08:37.449147] [INFO ] [MAIN ] GUG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:08:37.579366] [DEBUG] [LOCAL ] GUG: Loaded 11956 existing records from primary storage. [2025-10-28T19:08:37.604560] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-07. [2025-10-28T19:08:37.610252] [INFO ] [MAIN ] GUG: Loaded 11956 existing records. [2025-10-28T19:08:37.959893] [DEBUG] [VALIDATOR ] GTLS: All expected trading days are present. [2025-10-28T19:08:37.982956] [DEBUG] [VALIDATOR ] GTLS: Primary data validation passed. [2025-10-28T19:08:37.994102] [INFO ] [MAIN ] GTLS: Fetched primary data is valid. [2025-10-28T19:08:37.994228] [DEBUG] [LOCAL ] GTLS: Saving primary data. [2025-10-28T19:08:38.024360] [WARN ] [MAIN ] GUG: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:08:38.038175] [INFO ] [MAIN ] GUG: Wiping existing primary data before full refresh. [2025-10-28T19:08:38.040423] [DEBUG] [LOCAL ] GTLS: Trimmed 61440 records to 42859 (keeping 200 days of data) [2025-10-28T19:08:38.040971] [INFO ] [LOCAL ] GUG: Starting deletion of primary data. [2025-10-28T19:08:38.041861] [DEBUG] [LOCAL ] GUG: Deleted primary data file. [2025-10-28T19:08:38.043253] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-28T19:08:38.091492] [INFO ] [MAIN ] GUG: Starting full primary refresh. [2025-10-28T19:08:38.393672] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-10. [2025-10-28T19:08:38.676557] [INFO ] [REMOTE ] GUG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:08:38.681108] [DEBUG] [LOCAL ] GTLS: Primary data saved (42859 records). [2025-10-28T19:08:38.681468] [INFO ] [MAIN ] GTLS: Full history saved. [2025-10-28T19:08:38.681564] [INFO ] [MAIN ] Update Progress: 979/2366 symbols completed. GTLS took 33.3s. Estimated remaining: 3h 2m 11s. Rate: 7.6 symbols/min [2025-10-28T19:08:38.846670] [INFO ] [MAIN ] GUT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:08:38.862232] [DEBUG] [LOCAL ] GUT: Loaded 15426 existing records from primary storage. [2025-10-28T19:08:38.862498] [INFO ] [MAIN ] GUT: Loaded 15426 existing records. [2025-10-28T19:08:39.048045] [WARN ] [MAIN ] GUT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:08:39.048384] [INFO ] [MAIN ] GUT: Wiping existing primary data before full refresh. [2025-10-28T19:08:39.048495] [INFO ] [LOCAL ] GUT: Starting deletion of primary data. [2025-10-28T19:08:39.048759] [DEBUG] [LOCAL ] GUT: Deleted primary data file. [2025-10-28T19:08:39.048929] [INFO ] [MAIN ] GUT: Starting full primary refresh. [2025-10-28T19:08:39.189926] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-01. [2025-10-28T19:08:39.332874] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-10-28T19:08:39.486214] [INFO ] [REMOTE ] GUT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:08:39.625382] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-28T19:08:39.632006] [INFO ] [REMOTE ] GTY: Full fetch complete (43819 records). [2025-10-28T19:08:39.632117] [DEBUG] [VALIDATOR ] GTY: Validating primary data. [2025-10-28T19:08:39.985383] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-08. [2025-10-28T19:08:40.026559] [DEBUG] [VALIDATOR ] GTY: All expected trading days are present. [2025-10-28T19:08:40.026665] [DEBUG] [VALIDATOR ] GTY: Primary data validation passed. [2025-10-28T19:08:40.027553] [INFO ] [MAIN ] GTY: Fetched primary data is valid. [2025-10-28T19:08:40.027753] [DEBUG] [LOCAL ] GTY: Saving primary data. [2025-10-28T19:08:40.040824] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-28T19:08:40.042607] [DEBUG] [LOCAL ] GTY: Trimmed 43819 records to 29639 (keeping 200 days of data) [2025-10-28T19:08:40.222128] [DEBUG] [LOCAL ] GTY: Primary data saved (29639 records). [2025-10-28T19:08:40.222282] [INFO ] [MAIN ] GTY: Full history saved. [2025-10-28T19:08:40.222369] [INFO ] [MAIN ] Update Progress: 980/2366 symbols completed. GTY took 23.8s. Estimated remaining: 3h 1m 54s. Rate: 7.6 symbols/min [2025-10-28T19:08:40.391577] [INFO ] [MAIN ] GVA: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:08:40.422791] [DEBUG] [LOCAL ] GVA: Loaded 32201 existing records from primary storage. [2025-10-28T19:08:40.423070] [INFO ] [MAIN ] GVA: Loaded 32201 existing records. [2025-10-28T19:08:40.603708] [WARN ] [MAIN ] GVA: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:08:40.603977] [INFO ] [MAIN ] GVA: Wiping existing primary data before full refresh. [2025-10-28T19:08:40.604076] [INFO ] [LOCAL ] GVA: Starting deletion of primary data. [2025-10-28T19:08:40.604515] [DEBUG] [LOCAL ] GVA: Deleted primary data file. [2025-10-28T19:08:40.604595] [INFO ] [MAIN ] GVA: Starting full primary refresh. [2025-10-28T19:08:40.791570] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-01. [2025-10-28T19:08:40.989944] [INFO ] [REMOTE ] GVA: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:08:41.423630] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-28T19:08:41.580219] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-01. [2025-10-28T19:08:41.639472] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-28T19:08:42.380284] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-02. [2025-10-28T19:08:42.603503] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-10-28T19:08:42.910794] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-28T19:08:43.180332] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-09. [2025-10-28T19:08:43.980266] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-03. [2025-10-28T19:08:44.488780] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-28T19:08:44.508357] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-28T19:08:44.780271] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-02. [2025-10-28T19:08:45.580308] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-02. [2025-10-28T19:08:45.826265] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-10-28T19:08:46.199049] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-28T19:08:46.380238] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-03. [2025-10-28T19:08:47.180330] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-04. [2025-10-28T19:08:47.547730] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-28T19:08:47.736213] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-28T19:08:47.980259] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-10. [2025-10-28T19:08:48.780291] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-03. [2025-10-28T19:08:49.382153] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-28T19:08:49.400949] [INFO ] [REMOTE ] GTES: Full fetch complete (73840 records). [2025-10-28T19:08:49.401957] [DEBUG] [VALIDATOR ] GTES: Validating primary data. [2025-10-28T19:08:49.401842] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-28T19:08:49.596844] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-04. [2025-10-28T19:08:49.792858] [DEBUG] [VALIDATOR ] GTES: All expected trading days are present. [2025-10-28T19:08:49.792935] [DEBUG] [VALIDATOR ] GTES: Primary data validation passed. [2025-10-28T19:08:49.793856] [INFO ] [MAIN ] GTES: Fetched primary data is valid. [2025-10-28T19:08:49.793919] [DEBUG] [LOCAL ] GTES: Saving primary data. [2025-10-28T19:08:49.795368] [DEBUG] [LOCAL ] GTES: Trimmed 73840 records to 50234 (keeping 200 days of data) [2025-10-28T19:08:50.073613] [DEBUG] [LOCAL ] GTES: Primary data saved (50234 records). [2025-10-28T19:08:50.073763] [INFO ] [MAIN ] GTES: Full history saved. [2025-10-28T19:08:50.074465] [INFO ] [MAIN ] Update Progress: 981/2366 symbols completed. GTES took 45.0s. Estimated remaining: 3h 1m 49s. Rate: 7.6 symbols/min [2025-10-28T19:08:50.243557] [INFO ] [MAIN ] GWH: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:08:50.265866] [DEBUG] [LOCAL ] GWH: Loaded 20891 existing records from primary storage. [2025-10-28T19:08:50.266112] [INFO ] [MAIN ] GWH: Loaded 20891 existing records. [2025-10-28T19:08:50.385310] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-05. [2025-10-28T19:08:50.452165] [WARN ] [MAIN ] GWH: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:08:50.464466] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-28T19:08:50.464058] [INFO ] [MAIN ] GWH: Wiping existing primary data before full refresh. [2025-10-28T19:08:50.469301] [INFO ] [LOCAL ] GWH: Starting deletion of primary data. [2025-10-28T19:08:50.469611] [DEBUG] [LOCAL ] GWH: Deleted primary data file. [2025-10-28T19:08:50.469708] [INFO ] [MAIN ] GWH: Starting full primary refresh. [2025-10-28T19:08:50.849138] [INFO ] [REMOTE ] GWH: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:08:50.977195] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-28T19:08:51.180271] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-06. [2025-10-28T19:08:51.775578] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-28T19:08:51.980313] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-05. [2025-10-28T19:08:52.629389] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-28T19:08:52.780302] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-07. [2025-10-28T19:08:53.351004] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-28T19:08:53.580288] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-04. [2025-10-28T19:08:54.380255] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-08. [2025-10-28T19:08:54.670071] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-28T19:08:54.807872] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-28T19:08:55.180315] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-06. [2025-10-28T19:08:55.869042] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-28T19:08:55.980273] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-01. [2025-10-28T19:08:56.518457] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-28T19:08:56.780343] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-02. [2025-10-28T19:08:57.302558] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-28T19:08:57.580227] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-03. [2025-10-28T19:08:58.117464] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-28T19:08:58.380286] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-09. [2025-10-28T19:08:58.932897] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-28T19:08:59.180241] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-05. [2025-10-28T19:08:59.980219] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-07. [2025-10-28T19:09:00.182000] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-28T19:09:00.780223] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-10. [2025-10-28T19:09:00.900230] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-28T19:09:01.580253] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-08. [2025-10-28T19:09:01.903367] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-28T19:09:01.906225] [INFO ] [REMOTE ] GUG: Full fetch complete (18747 records). [2025-10-28T19:09:01.906314] [DEBUG] [VALIDATOR ] GUG: Validating primary data. [2025-10-28T19:09:02.268400] [DEBUG] [VALIDATOR ] GUG: All expected trading days are present. [2025-10-28T19:09:02.268498] [DEBUG] [VALIDATOR ] GUG: Primary data validation passed. [2025-10-28T19:09:02.268922] [INFO ] [MAIN ] GUG: Fetched primary data is valid. [2025-10-28T19:09:02.268981] [DEBUG] [LOCAL ] GUG: Saving primary data. [2025-10-28T19:09:02.269492] [DEBUG] [LOCAL ] GUG: Trimmed 18747 records to 12023 (keeping 200 days of data) [2025-10-28T19:09:02.341898] [DEBUG] [LOCAL ] GUG: Primary data saved (12023 records). [2025-10-28T19:09:02.342017] [INFO ] [MAIN ] GUG: Full history saved. [2025-10-28T19:09:02.342097] [INFO ] [MAIN ] Update Progress: 982/2366 symbols completed. GUG took 25.2s. Estimated remaining: 3h 1m 48s. Rate: 7.6 symbols/min [2025-10-28T19:09:02.384716] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-04. [2025-10-28T19:09:02.500552] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-10-28T19:09:02.526622] [INFO ] [MAIN ] GWRE: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:09:02.566407] [DEBUG] [LOCAL ] GWRE: Loaded 39239 existing records from primary storage. [2025-10-28T19:09:02.566705] [INFO ] [MAIN ] GWRE: Loaded 39239 existing records. [2025-10-28T19:09:02.743606] [WARN ] [MAIN ] GWRE: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:09:02.743830] [INFO ] [MAIN ] GWRE: Wiping existing primary data before full refresh. [2025-10-28T19:09:02.743878] [INFO ] [LOCAL ] GWRE: Starting deletion of primary data. [2025-10-28T19:09:02.744191] [DEBUG] [LOCAL ] GWRE: Deleted primary data file. [2025-10-28T19:09:02.744252] [INFO ] [MAIN ] GWRE: Starting full primary refresh. [2025-10-28T19:09:03.018018] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-28T19:09:03.127725] [INFO ] [REMOTE ] GWRE: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:09:03.180205] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-01. [2025-10-28T19:09:03.980282] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-06. [2025-10-28T19:09:04.308294] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-28T19:09:04.780260] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-02. [2025-10-28T19:09:04.995844] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-28T19:09:05.580295] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-07. [2025-10-28T19:09:05.874759] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-28T19:09:06.380246] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-05. [2025-10-28T19:09:06.543258] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-28T19:09:07.128729] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-28T19:09:07.180235] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-09. [2025-10-28T19:09:07.790736] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-10-28T19:09:07.980240] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-03. [2025-10-28T19:09:08.780293] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-06. [2025-10-28T19:09:09.334624] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-28T19:09:09.580284] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-08. [2025-10-28T19:09:09.597313] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-28T19:09:10.380275] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-07. [2025-10-28T19:09:10.676621] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-28T19:09:11.180275] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-10. [2025-10-28T19:09:11.233301] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-28T19:09:11.939368] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-28T19:09:11.943114] [INFO ] [REMOTE ] GUT: Full fetch complete (22463 records). [2025-10-28T19:09:11.943188] [DEBUG] [VALIDATOR ] GUT: Validating primary data. [2025-10-28T19:09:11.985363] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-08. [2025-10-28T19:09:12.301757] [DEBUG] [VALIDATOR ] GUT: All expected trading days are present. [2025-10-28T19:09:12.301852] [DEBUG] [VALIDATOR ] GUT: Primary data validation passed. [2025-10-28T19:09:12.302345] [INFO ] [MAIN ] GUT: Fetched primary data is valid. [2025-10-28T19:09:12.302387] [DEBUG] [LOCAL ] GUT: Saving primary data. [2025-10-28T19:09:12.303177] [DEBUG] [LOCAL ] GUT: Trimmed 22463 records to 15398 (keeping 200 days of data) [2025-10-28T19:09:12.389464] [DEBUG] [LOCAL ] GUT: Primary data saved (15398 records). [2025-10-28T19:09:12.389588] [INFO ] [MAIN ] GUT: Full history saved. [2025-10-28T19:09:12.389685] [INFO ] [MAIN ] Update Progress: 983/2366 symbols completed. GUT took 33.7s. Estimated remaining: 3h 1m 43s. Rate: 7.6 symbols/min [2025-10-28T19:09:12.561729] [INFO ] [MAIN ] GWW: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:09:12.581558] [DEBUG] [LOCAL ] GWW: Loaded 18953 existing records from primary storage. [2025-10-28T19:09:12.581849] [INFO ] [MAIN ] GWW: Loaded 18953 existing records. [2025-10-28T19:09:12.759782] [WARN ] [MAIN ] GWW: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:09:12.770897] [INFO ] [MAIN ] GWW: Wiping existing primary data before full refresh. [2025-10-28T19:09:12.771032] [INFO ] [LOCAL ] GWW: Starting deletion of primary data. [2025-10-28T19:09:12.772226] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-28T19:09:12.772300] [DEBUG] [LOCAL ] GWW: Deleted primary data file. [2025-10-28T19:09:12.772552] [INFO ] [MAIN ] GWW: Starting full primary refresh. [2025-10-28T19:09:12.787962] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-04. [2025-10-28T19:09:13.124996] [INFO ] [REMOTE ] GWW: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:09:13.580246] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-01. [2025-10-28T19:09:14.019567] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-28T19:09:14.380266] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-09. [2025-10-28T19:09:14.475142] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-28T19:09:15.075865] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-28T19:09:15.180273] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-10. [2025-10-28T19:09:15.980247] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-02. [2025-10-28T19:09:16.747403] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-28T19:09:16.780219] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-05. [2025-10-28T19:09:17.059159] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-10 (1.88 seconds). [2025-10-28T19:09:17.067924] [INFO ] [REMOTE ] GWH: Full fetch complete (25662 records). [2025-10-28T19:09:17.068028] [DEBUG] [VALIDATOR ] GWH: Validating primary data. [2025-10-28T19:09:17.435421] [DEBUG] [VALIDATOR ] GWH: All expected trading days are present. [2025-10-28T19:09:17.435496] [DEBUG] [VALIDATOR ] GWH: Primary data validation passed. [2025-10-28T19:09:17.436087] [INFO ] [MAIN ] GWH: Fetched primary data is valid. [2025-10-28T19:09:17.436148] [DEBUG] [LOCAL ] GWH: Saving primary data. [2025-10-28T19:09:17.436845] [DEBUG] [LOCAL ] GWH: Trimmed 25662 records to 21187 (keeping 200 days of data) [2025-10-28T19:09:17.552810] [DEBUG] [LOCAL ] GWH: Primary data saved (21187 records). [2025-10-28T19:09:17.552937] [INFO ] [MAIN ] GWH: Full history saved. [2025-10-28T19:09:17.553011] [INFO ] [MAIN ] Update Progress: 984/2366 symbols completed. GWH took 27.5s. Estimated remaining: 3h 1m 31s. Rate: 7.6 symbols/min [2025-10-28T19:09:17.585337] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-03. [2025-10-28T19:09:17.727598] [INFO ] [MAIN ] GXO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:09:17.768053] [DEBUG] [LOCAL ] GXO: Loaded 46145 existing records from primary storage. [2025-10-28T19:09:17.768467] [INFO ] [MAIN ] GXO: Loaded 46145 existing records. [2025-10-28T19:09:17.947054] [WARN ] [MAIN ] GXO: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:09:17.947439] [INFO ] [MAIN ] GXO: Wiping existing primary data before full refresh. [2025-10-28T19:09:17.954959] [INFO ] [LOCAL ] GXO: Starting deletion of primary data. [2025-10-28T19:09:17.969357] [DEBUG] [LOCAL ] GXO: Deleted primary data file. [2025-10-28T19:09:17.969302] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-28T19:09:17.977101] [INFO ] [MAIN ] GXO: Starting full primary refresh. [2025-10-28T19:09:18.328423] [INFO ] [REMOTE ] GXO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:09:18.380223] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-01. [2025-10-28T19:09:18.546867] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-28T19:09:19.180322] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-09. [2025-10-28T19:09:19.431792] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-28T19:09:19.980224] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-02. [2025-10-28T19:09:20.140133] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-28T19:09:20.780290] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-04. [2025-10-28T19:09:21.246449] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-28T19:09:21.485350] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-28T19:09:21.580220] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-05. [2025-10-28T19:09:22.253784] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-28T19:09:22.380245] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-06. [2025-10-28T19:09:23.180251] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-03. [2025-10-28T19:09:23.599166] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-28T19:09:23.980261] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-10. [2025-10-28T19:09:24.459516] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-28T19:09:24.780228] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-04. [2025-10-28T19:09:25.125408] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-28T19:09:25.132300] [INFO ] [REMOTE ] GVA: Full fetch complete (48464 records). [2025-10-28T19:09:25.132401] [DEBUG] [VALIDATOR ] GVA: Validating primary data. [2025-10-28T19:09:25.510172] [DEBUG] [VALIDATOR ] GVA: All expected trading days are present. [2025-10-28T19:09:25.510248] [DEBUG] [VALIDATOR ] GVA: Primary data validation passed. [2025-10-28T19:09:25.510987] [INFO ] [MAIN ] GVA: Fetched primary data is valid. [2025-10-28T19:09:25.511048] [DEBUG] [LOCAL ] GVA: Saving primary data. [2025-10-28T19:09:25.512013] [DEBUG] [LOCAL ] GVA: Trimmed 48464 records to 32061 (keeping 200 days of data) [2025-10-28T19:09:25.599227] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-07. [2025-10-28T19:09:25.713447] [DEBUG] [LOCAL ] GVA: Primary data saved (32061 records). [2025-10-28T19:09:25.714063] [INFO ] [MAIN ] GVA: Full history saved. [2025-10-28T19:09:25.714182] [INFO ] [MAIN ] Update Progress: 985/2366 symbols completed. GVA took 45.5s. Estimated remaining: 3h 1m 24s. Rate: 7.6 symbols/min [2025-10-28T19:09:25.884986] [INFO ] [MAIN ] GYLD: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:09:25.888435] [DEBUG] [LOCAL ] GYLD: Loaded 1514 existing records from primary storage. [2025-10-28T19:09:25.888598] [INFO ] [MAIN ] GYLD: Loaded 1514 existing records. [2025-10-28T19:09:26.099377] [WARN ] [MAIN ] GYLD: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:09:26.101887] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-28T19:09:26.102098] [INFO ] [MAIN ] GYLD: Wiping existing primary data before full refresh. [2025-10-28T19:09:26.112787] [INFO ] [LOCAL ] GYLD: Starting deletion of primary data. [2025-10-28T19:09:26.113766] [DEBUG] [LOCAL ] GYLD: Deleted primary data file. [2025-10-28T19:09:26.113833] [INFO ] [MAIN ] GYLD: Starting full primary refresh. [2025-10-28T19:09:26.384223] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-06. [2025-10-28T19:09:26.468240] [INFO ] [REMOTE ] GYLD: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:09:26.596090] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-28T19:09:27.080508] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-28T19:09:27.180272] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-07. [2025-10-28T19:09:27.980242] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-01. [2025-10-28T19:09:28.006564] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-28T19:09:28.213689] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-01 (0.23 seconds). [2025-10-28T19:09:28.780252] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-05. [2025-10-28T19:09:29.580261] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-02. [2025-10-28T19:09:29.838406] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-02 (0.26 seconds). [2025-10-28T19:09:29.873189] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-28T19:09:30.380265] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-06. [2025-10-28T19:09:31.180263] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-03. [2025-10-28T19:09:31.425967] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-28T19:09:31.481061] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-03 (0.30 seconds). [2025-10-28T19:09:31.980285] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-08. [2025-10-28T19:09:32.696279] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-28T19:09:32.780307] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-04. [2025-10-28T19:09:33.083637] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-04 (0.30 seconds). [2025-10-28T19:09:33.580282] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-07. [2025-10-28T19:09:34.380404] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-09. [2025-10-28T19:09:34.649264] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-28T19:09:35.159940] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-10-28T19:09:35.180238] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-10. [2025-10-28T19:09:35.980260] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-05. [2025-10-28T19:09:36.145718] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-28T19:09:36.149964] [INFO ] [REMOTE ] GWW: Full fetch complete (28975 records). [2025-10-28T19:09:36.150071] [DEBUG] [VALIDATOR ] GWW: Validating primary data. [2025-10-28T19:09:36.314948] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-10-28T19:09:36.534520] [DEBUG] [VALIDATOR ] GWW: All expected trading days are present. [2025-10-28T19:09:36.534617] [DEBUG] [VALIDATOR ] GWW: Primary data validation passed. [2025-10-28T19:09:36.535238] [INFO ] [MAIN ] GWW: Fetched primary data is valid. [2025-10-28T19:09:36.535298] [DEBUG] [LOCAL ] GWW: Saving primary data. [2025-10-28T19:09:36.535981] [DEBUG] [LOCAL ] GWW: Trimmed 28975 records to 18883 (keeping 200 days of data) [2025-10-28T19:09:36.652055] [DEBUG] [LOCAL ] GWW: Primary data saved (18883 records). [2025-10-28T19:09:36.652183] [INFO ] [MAIN ] GWW: Full history saved. [2025-10-28T19:09:36.652256] [INFO ] [MAIN ] Update Progress: 986/2366 symbols completed. GWW took 24.3s. Estimated remaining: 3h 1m 20s. Rate: 7.6 symbols/min [2025-10-28T19:09:36.790414] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-06. [2025-10-28T19:09:36.822191] [INFO ] [MAIN ] H: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:09:36.863618] [DEBUG] [LOCAL ] H: Loaded 44189 existing records from primary storage. [2025-10-28T19:09:36.863906] [INFO ] [MAIN ] H: Loaded 44189 existing records. [2025-10-28T19:09:37.037899] [WARN ] [MAIN ] H: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:09:37.038085] [INFO ] [MAIN ] H: Wiping existing primary data before full refresh. [2025-10-28T19:09:37.038131] [INFO ] [LOCAL ] H: Starting deletion of primary data. [2025-10-28T19:09:37.038868] [DEBUG] [LOCAL ] H: Deleted primary data file. [2025-10-28T19:09:37.038925] [INFO ] [MAIN ] H: Starting full primary refresh. [2025-10-28T19:09:37.143430] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-28T19:09:37.397475] [INFO ] [REMOTE ] H: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:09:37.580273] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-08. [2025-10-28T19:09:38.380265] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-08. [2025-10-28T19:09:38.836313] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-28T19:09:39.180235] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-07. [2025-10-28T19:09:39.416833] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-28T19:09:39.484547] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-07 (0.30 seconds). [2025-10-28T19:09:39.980335] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-08. [2025-10-28T19:09:40.266080] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-08 (0.29 seconds). [2025-10-28T19:09:40.780293] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-09. [2025-10-28T19:09:41.580260] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-09. [2025-10-28T19:09:41.831780] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-28T19:09:42.380281] [INFO ] [REMOTE ] H: Fetching primary data for 2025-01. [2025-10-28T19:09:42.641340] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-28T19:09:43.180239] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-10. [2025-10-28T19:09:43.515190] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-28T19:09:43.980313] [INFO ] [REMOTE ] H: Fetching primary data for 2025-02. [2025-10-28T19:09:44.552765] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-28T19:09:44.561486] [INFO ] [REMOTE ] GXO: Full fetch complete (69124 records). [2025-10-28T19:09:44.561620] [DEBUG] [VALIDATOR ] GXO: Validating primary data. [2025-10-28T19:09:44.786700] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-09. [2025-10-28T19:09:44.947578] [DEBUG] [VALIDATOR ] GXO: All expected trading days are present. [2025-10-28T19:09:44.947681] [DEBUG] [VALIDATOR ] GXO: Primary data validation passed. [2025-10-28T19:09:44.948566] [INFO ] [MAIN ] GXO: Fetched primary data is valid. [2025-10-28T19:09:44.948606] [DEBUG] [LOCAL ] GXO: Saving primary data. [2025-10-28T19:09:44.949965] [DEBUG] [LOCAL ] GXO: Trimmed 69124 records to 46093 (keeping 200 days of data) [2025-10-28T19:09:45.157710] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-10-28T19:09:45.241163] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-28T19:09:45.259202] [DEBUG] [LOCAL ] GXO: Primary data saved (46093 records). [2025-10-28T19:09:45.259699] [INFO ] [MAIN ] GXO: Full history saved. [2025-10-28T19:09:45.260482] [INFO ] [MAIN ] Update Progress: 987/2366 symbols completed. GXO took 27.7s. Estimated remaining: 3h 1m 13s. Rate: 7.6 symbols/min [2025-10-28T19:09:45.424701] [INFO ] [MAIN ] HAE: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:09:45.464965] [DEBUG] [LOCAL ] HAE: Loaded 38963 existing records from primary storage. [2025-10-28T19:09:45.465247] [INFO ] [MAIN ] HAE: Loaded 38963 existing records. [2025-10-28T19:09:45.585329] [INFO ] [REMOTE ] H: Fetching primary data for 2025-03. [2025-10-28T19:09:45.662987] [WARN ] [MAIN ] HAE: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:09:45.663188] [INFO ] [MAIN ] HAE: Wiping existing primary data before full refresh. [2025-10-28T19:09:45.663233] [INFO ] [LOCAL ] HAE: Starting deletion of primary data. [2025-10-28T19:09:45.663618] [DEBUG] [LOCAL ] HAE: Deleted primary data file. [2025-10-28T19:09:45.663711] [INFO ] [MAIN ] HAE: Starting full primary refresh. [2025-10-28T19:09:46.009073] [INFO ] [REMOTE ] HAE: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:09:46.380308] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-10. [2025-10-28T19:09:46.777251] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-10 (0.40 seconds). [2025-10-28T19:09:46.778216] [INFO ] [REMOTE ] GYLD: Full fetch complete (2113 records). [2025-10-28T19:09:46.778285] [DEBUG] [VALIDATOR ] GYLD: Validating primary data. [2025-10-28T19:09:46.970149] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-28T19:09:47.176539] [DEBUG] [VALIDATOR ] GYLD: All expected trading days are present. [2025-10-28T19:09:47.176616] [DEBUG] [VALIDATOR ] GYLD: Primary data validation passed. [2025-10-28T19:09:47.176734] [INFO ] [MAIN ] GYLD: Fetched primary data is valid. [2025-10-28T19:09:47.176788] [DEBUG] [LOCAL ] GYLD: Saving primary data. [2025-10-28T19:09:47.177113] [DEBUG] [LOCAL ] GYLD: Trimmed 2113 records to 1514 (keeping 200 days of data) [2025-10-28T19:09:47.182206] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-10. [2025-10-28T19:09:47.186910] [DEBUG] [LOCAL ] GYLD: Primary data saved (1514 records). [2025-10-28T19:09:47.187831] [INFO ] [MAIN ] GYLD: Full history saved. [2025-10-28T19:09:47.187920] [INFO ] [MAIN ] Update Progress: 988/2366 symbols completed. GYLD took 21.5s. Estimated remaining: 3h 0m 57s. Rate: 7.6 symbols/min [2025-10-28T19:09:47.359827] [INFO ] [MAIN ] HAFN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:09:47.398308] [DEBUG] [LOCAL ] HAFN: Loaded 42433 existing records from primary storage. [2025-10-28T19:09:47.398597] [INFO ] [MAIN ] HAFN: Loaded 42433 existing records. [2025-10-28T19:09:47.572095] [WARN ] [MAIN ] HAFN: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:09:47.572352] [INFO ] [MAIN ] HAFN: Wiping existing primary data before full refresh. [2025-10-28T19:09:47.572407] [INFO ] [LOCAL ] HAFN: Starting deletion of primary data. [2025-10-28T19:09:47.573165] [DEBUG] [LOCAL ] HAFN: Deleted primary data file. [2025-10-28T19:09:47.573222] [INFO ] [MAIN ] HAFN: Starting full primary refresh. [2025-10-28T19:09:47.918526] [INFO ] [REMOTE ] HAFN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:09:47.980230] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-01. [2025-10-28T19:09:48.381441] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-10 (1.20 seconds). [2025-10-28T19:09:48.391883] [INFO ] [REMOTE ] GWRE: Full fetch complete (59830 records). [2025-10-28T19:09:48.392005] [DEBUG] [VALIDATOR ] GWRE: Validating primary data. [2025-10-28T19:09:48.771468] [DEBUG] [VALIDATOR ] GWRE: All expected trading days are present. [2025-10-28T19:09:48.771544] [DEBUG] [VALIDATOR ] GWRE: Primary data validation passed. [2025-10-28T19:09:48.772368] [INFO ] [MAIN ] GWRE: Fetched primary data is valid. [2025-10-28T19:09:48.772428] [DEBUG] [LOCAL ] GWRE: Saving primary data. [2025-10-28T19:09:48.773561] [DEBUG] [LOCAL ] GWRE: Trimmed 59830 records to 39159 (keeping 200 days of data) [2025-10-28T19:09:48.822866] [INFO ] [REMOTE ] H: Fetching primary data for 2025-04. [2025-10-28T19:09:49.012089] [DEBUG] [LOCAL ] GWRE: Primary data saved (39159 records). [2025-10-28T19:09:49.012228] [INFO ] [MAIN ] GWRE: Full history saved. [2025-10-28T19:09:49.012308] [INFO ] [MAIN ] Update Progress: 989/2366 symbols completed. GWRE took 46.7s. Estimated remaining: 3h 0m 41s. Rate: 7.6 symbols/min [2025-10-28T19:09:49.180110] [INFO ] [MAIN ] HAL: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:09:49.229178] [DEBUG] [LOCAL ] HAL: Loaded 53718 existing records from primary storage. [2025-10-28T19:09:49.229467] [INFO ] [MAIN ] HAL: Loaded 53718 existing records. [2025-10-28T19:09:49.415562] [WARN ] [MAIN ] HAL: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:09:49.415898] [INFO ] [MAIN ] HAL: Wiping existing primary data before full refresh. [2025-10-28T19:09:49.416002] [INFO ] [LOCAL ] HAL: Starting deletion of primary data. [2025-10-28T19:09:49.416880] [DEBUG] [LOCAL ] HAL: Deleted primary data file. [2025-10-28T19:09:49.416975] [INFO ] [MAIN ] HAL: Starting full primary refresh. [2025-10-28T19:09:49.586753] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-10-28T19:09:49.584832] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-01. [2025-10-28T19:09:49.809941] [INFO ] [REMOTE ] HAL: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:09:50.099005] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-28T19:09:50.380316] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-02. [2025-10-28T19:09:50.768219] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-28T19:09:51.180250] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-01. [2025-10-28T19:09:51.594841] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-28T19:09:51.980290] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-02. [2025-10-28T19:09:52.780228] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-03. [2025-10-28T19:09:52.873976] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-10-28T19:09:53.580304] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-02. [2025-10-28T19:09:53.897824] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-28T19:09:54.380259] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-03. [2025-10-28T19:09:54.691850] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-10-28T19:09:55.099456] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-10-28T19:09:55.180306] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-03. [2025-10-28T19:09:55.586336] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-28T19:09:55.980323] [INFO ] [REMOTE ] H: Fetching primary data for 2025-05. [2025-10-28T19:09:56.524176] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-28T19:09:56.780232] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-04. [2025-10-28T19:09:57.108554] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-28T19:09:57.580342] [INFO ] [REMOTE ] H: Fetching primary data for 2025-06. [2025-10-28T19:09:58.094317] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-28T19:09:58.380282] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-04. [2025-10-28T19:09:58.596556] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-28T19:09:59.180295] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-05. [2025-10-28T19:09:59.666436] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-28T19:09:59.980326] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-05. [2025-10-28T19:10:00.780321] [INFO ] [REMOTE ] H: Fetching primary data for 2025-07. [2025-10-28T19:10:00.972447] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-10-28T19:10:01.127123] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-28T19:10:01.580314] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-04. [2025-10-28T19:10:01.864102] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-28T19:10:02.380262] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-06. [2025-10-28T19:10:03.180251] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-06. [2025-10-28T19:10:03.470867] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-28T19:10:03.570123] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-28T19:10:03.980246] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-07. [2025-10-28T19:10:04.388785] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-28T19:10:04.780262] [INFO ] [REMOTE ] H: Fetching primary data for 2025-08. [2025-10-28T19:10:05.101152] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-28T19:10:05.580318] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-07. [2025-10-28T19:10:06.098594] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-28T19:10:06.380299] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-05. [2025-10-28T19:10:06.547546] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-28T19:10:07.180264] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-08. [2025-10-28T19:10:07.980229] [INFO ] [REMOTE ] H: Fetching primary data for 2025-09. [2025-10-28T19:10:08.037409] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-10-28T19:10:08.310590] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-28T19:10:08.780255] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-08. [2025-10-28T19:10:09.243725] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-28T19:10:09.580230] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-09. [2025-10-28T19:10:10.242922] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-28T19:10:10.380246] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-09. [2025-10-28T19:10:10.613059] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-10-28T19:10:11.180251] [INFO ] [REMOTE ] H: Fetching primary data for 2025-10. [2025-10-28T19:10:11.462033] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-28T19:10:11.980244] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-10. [2025-10-28T19:10:12.608845] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-28T19:10:12.618547] [INFO ] [REMOTE ] H: Full fetch complete (63613 records). [2025-10-28T19:10:12.618779] [DEBUG] [VALIDATOR ] H: Validating primary data. [2025-10-28T19:10:12.785077] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-06. [2025-10-28T19:10:13.031819] [DEBUG] [VALIDATOR ] H: All expected trading days are present. [2025-10-28T19:10:13.031938] [DEBUG] [VALIDATOR ] H: Primary data validation passed. [2025-10-28T19:10:13.033378] [INFO ] [MAIN ] H: Fetched primary data is valid. [2025-10-28T19:10:13.033450] [DEBUG] [LOCAL ] H: Saving primary data. [2025-10-28T19:10:13.035252] [DEBUG] [LOCAL ] H: Trimmed 63613 records to 44158 (keeping 200 days of data) [2025-10-28T19:10:13.365460] [DEBUG] [LOCAL ] H: Primary data saved (44158 records). [2025-10-28T19:10:13.366214] [INFO ] [MAIN ] H: Full history saved. [2025-10-28T19:10:13.367026] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-28T19:10:13.367250] [INFO ] [MAIN ] Update Progress: 990/2366 symbols completed. H took 36.7s. Estimated remaining: 3h 0m 56s. Rate: 7.6 symbols/min [2025-10-28T19:10:13.444891] [INFO ] [REMOTE ] HAFN: Full fetch complete (64472 records). [2025-10-28T19:10:13.455943] [DEBUG] [VALIDATOR ] HAFN: Validating primary data. [2025-10-28T19:10:13.607219] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-10. [2025-10-28T19:10:13.659738] [INFO ] [MAIN ] HASI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:10:13.989489] [DEBUG] [VALIDATOR ] HAFN: All expected trading days are present. [2025-10-28T19:10:13.990784] [DEBUG] [VALIDATOR ] HAFN: Primary data validation passed. [2025-10-28T19:10:13.990675] [DEBUG] [LOCAL ] HASI: Loaded 47503 existing records from primary storage. [2025-10-28T19:10:13.991947] [INFO ] [MAIN ] HAFN: Fetched primary data is valid. [2025-10-28T19:10:13.992037] [DEBUG] [LOCAL ] HAFN: Saving primary data. [2025-10-28T19:10:13.992455] [INFO ] [MAIN ] HASI: Loaded 47503 existing records. [2025-10-28T19:10:14.100965] [DEBUG] [LOCAL ] HAFN: Trimmed 64472 records to 42374 (keeping 200 days of data) [2025-10-28T19:10:14.274959] [WARN ] [MAIN ] HASI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:10:14.277921] [INFO ] [MAIN ] HASI: Wiping existing primary data before full refresh. [2025-10-28T19:10:14.278251] [INFO ] [LOCAL ] HASI: Starting deletion of primary data. [2025-10-28T19:10:14.279671] [DEBUG] [LOCAL ] HASI: Deleted primary data file. [2025-10-28T19:10:14.280512] [INFO ] [MAIN ] HASI: Starting full primary refresh. [2025-10-28T19:10:14.796839] [INFO ] [REMOTE ] HASI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:10:14.805301] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-01. [2025-10-28T19:10:14.839331] [DEBUG] [LOCAL ] HAFN: Primary data saved (42374 records). [2025-10-28T19:10:14.839768] [INFO ] [MAIN ] HAFN: Full history saved. [2025-10-28T19:10:14.840316] [INFO ] [MAIN ] Update Progress: 991/2366 symbols completed. HAFN took 27.7s. Estimated remaining: 3h 0m 39s. Rate: 7.6 symbols/min [2025-10-28T19:10:15.088189] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-28T19:10:15.091205] [INFO ] [MAIN ] HAYW: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:10:15.094259] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-06 (2.31 seconds). [2025-10-28T19:10:15.114039] [INFO ] [REMOTE ] HAE: Full fetch complete (59310 records). [2025-10-28T19:10:15.114535] [DEBUG] [VALIDATOR ] HAE: Validating primary data. [2025-10-28T19:10:15.184503] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-07. [2025-10-28T19:10:15.445955] [DEBUG] [LOCAL ] HAYW: Loaded 48740 existing records from primary storage. [2025-10-28T19:10:15.452146] [INFO ] [MAIN ] HAYW: Loaded 48740 existing records. [2025-10-28T19:10:15.658228] [DEBUG] [VALIDATOR ] HAE: All expected trading days are present. [2025-10-28T19:10:15.663471] [DEBUG] [VALIDATOR ] HAE: Primary data validation passed. [2025-10-28T19:10:15.683912] [INFO ] [MAIN ] HAE: Fetched primary data is valid. [2025-10-28T19:10:15.689166] [DEBUG] [LOCAL ] HAE: Saving primary data. [2025-10-28T19:10:15.726867] [WARN ] [MAIN ] HAYW: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:10:15.727197] [INFO ] [MAIN ] HAYW: Wiping existing primary data before full refresh. [2025-10-28T19:10:15.727422] [INFO ] [LOCAL ] HAYW: Starting deletion of primary data. [2025-10-28T19:10:15.727318] [DEBUG] [LOCAL ] HAE: Trimmed 59310 records to 38836 (keeping 200 days of data) [2025-10-28T19:10:15.727878] [DEBUG] [LOCAL ] HAYW: Deleted primary data file. [2025-10-28T19:10:15.727947] [INFO ] [MAIN ] HAYW: Starting full primary refresh. [2025-10-28T19:10:16.264384] [DEBUG] [LOCAL ] HAE: Primary data saved (38836 records). [2025-10-28T19:10:16.298869] [INFO ] [MAIN ] HAE: Full history saved. [2025-10-28T19:10:16.334907] [INFO ] [MAIN ] Update Progress: 992/2366 symbols completed. HAE took 31.1s. Estimated remaining: 3h 0m 22s. Rate: 7.6 symbols/min [2025-10-28T19:10:16.333800] [INFO ] [REMOTE ] HAYW: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:10:16.346803] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-01. [2025-10-28T19:10:16.553171] [INFO ] [MAIN ] HBB: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:10:16.558153] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-10-28T19:10:16.578344] [DEBUG] [LOCAL ] HBB: Loaded 6050 existing records from primary storage. [2025-10-28T19:10:16.578591] [INFO ] [MAIN ] HBB: Loaded 6050 existing records. [2025-10-28T19:10:16.756153] [WARN ] [MAIN ] HBB: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:10:16.756449] [INFO ] [MAIN ] HBB: Wiping existing primary data before full refresh. [2025-10-28T19:10:16.756506] [INFO ] [LOCAL ] HBB: Starting deletion of primary data. [2025-10-28T19:10:16.756685] [DEBUG] [LOCAL ] HBB: Deleted primary data file. [2025-10-28T19:10:16.756743] [INFO ] [MAIN ] HBB: Starting full primary refresh. [2025-10-28T19:10:16.787403] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-02. [2025-10-28T19:10:17.140200] [INFO ] [REMOTE ] HBB: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:10:17.185738] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-10-28T19:10:17.580272] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-01. [2025-10-28T19:10:17.655180] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-28T19:10:18.061607] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-10-28T19:10:18.099753] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-10-28T19:10:18.380339] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-08. [2025-10-28T19:10:19.180244] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-02. [2025-10-28T19:10:19.605223] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-28T19:10:19.792259] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-28T19:10:19.980271] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-03. [2025-10-28T19:10:20.502958] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-10-28T19:10:20.780299] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-03. [2025-10-28T19:10:21.580324] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-02. [2025-10-28T19:10:21.911326] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-10-28T19:10:22.380318] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-09. [2025-10-28T19:10:22.797822] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-28T19:10:23.180302] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-03. [2025-10-28T19:10:23.905309] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-10-28T19:10:23.980229] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-04. [2025-10-28T19:10:24.484521] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-28T19:10:24.607732] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-28T19:10:24.780228] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-05. [2025-10-28T19:10:25.275963] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-28T19:10:25.580307] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-04. [2025-10-28T19:10:26.380333] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-06. [2025-10-28T19:10:26.737763] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-10-28T19:10:26.808237] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-28T19:10:27.180332] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-04. [2025-10-28T19:10:27.980311] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-05. [2025-10-28T19:10:28.424882] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-28T19:10:28.780273] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-05. [2025-10-28T19:10:29.222721] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-28T19:10:29.580249] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-07. [2025-10-28T19:10:30.005481] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-28T19:10:30.156633] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-28T19:10:30.380269] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-08. [2025-10-28T19:10:30.906823] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-10-28T19:10:31.180288] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-06. [2025-10-28T19:10:31.980318] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-09. [2025-10-28T19:10:32.383417] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-10-28T19:10:32.413947] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-28T19:10:32.780261] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-06. [2025-10-28T19:10:33.580250] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-10. [2025-10-28T19:10:34.046404] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-28T19:10:34.163268] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-28T19:10:34.174082] [INFO ] [REMOTE ] HAL: Full fetch complete (77897 records). [2025-10-28T19:10:34.174237] [DEBUG] [VALIDATOR ] HAL: Validating primary data. [2025-10-28T19:10:34.385449] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-07. [2025-10-28T19:10:34.569228] [DEBUG] [VALIDATOR ] HAL: All expected trading days are present. [2025-10-28T19:10:34.569347] [DEBUG] [VALIDATOR ] HAL: Primary data validation passed. [2025-10-28T19:10:34.570680] [INFO ] [MAIN ] HAL: Fetched primary data is valid. [2025-10-28T19:10:34.570759] [DEBUG] [LOCAL ] HAL: Saving primary data. [2025-10-28T19:10:34.572574] [DEBUG] [LOCAL ] HAL: Trimmed 77897 records to 53718 (keeping 200 days of data) [2025-10-28T19:10:34.898694] [DEBUG] [LOCAL ] HAL: Primary data saved (53718 records). [2025-10-28T19:10:34.898834] [INFO ] [MAIN ] HAL: Full history saved. [2025-10-28T19:10:34.898910] [INFO ] [MAIN ] Update Progress: 993/2366 symbols completed. HAL took 45.9s. Estimated remaining: 3h 0m 29s. Rate: 7.6 symbols/min [2025-10-28T19:10:35.064597] [INFO ] [MAIN ] HBI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:10:35.112772] [DEBUG] [LOCAL ] HBI: Loaded 52899 existing records from primary storage. [2025-10-28T19:10:35.113092] [INFO ] [MAIN ] HBI: Loaded 52899 existing records. [2025-10-28T19:10:35.187451] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-10. [2025-10-28T19:10:35.291916] [WARN ] [MAIN ] HBI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:10:35.292130] [INFO ] [MAIN ] HBI: Wiping existing primary data before full refresh. [2025-10-28T19:10:35.292197] [INFO ] [LOCAL ] HBI: Starting deletion of primary data. [2025-10-28T19:10:35.292484] [DEBUG] [LOCAL ] HBI: Deleted primary data file. [2025-10-28T19:10:35.292541] [INFO ] [MAIN ] HBI: Starting full primary refresh. [2025-10-28T19:10:35.644614] [INFO ] [REMOTE ] HBI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:10:35.727461] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-28T19:10:35.783876] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-28T19:10:35.785313] [INFO ] [REMOTE ] HBB: Full fetch complete (9140 records). [2025-10-28T19:10:35.785384] [DEBUG] [VALIDATOR ] HBB: Validating primary data. [2025-10-28T19:10:35.990291] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-08. [2025-10-28T19:10:36.144547] [DEBUG] [VALIDATOR ] HBB: All expected trading days are present. [2025-10-28T19:10:36.144614] [DEBUG] [VALIDATOR ] HBB: Primary data validation passed. [2025-10-28T19:10:36.144846] [INFO ] [MAIN ] HBB: Fetched primary data is valid. [2025-10-28T19:10:36.144901] [DEBUG] [LOCAL ] HBB: Saving primary data. [2025-10-28T19:10:36.145304] [DEBUG] [LOCAL ] HBB: Trimmed 9140 records to 5976 (keeping 200 days of data) [2025-10-28T19:10:36.181096] [DEBUG] [LOCAL ] HBB: Primary data saved (5976 records). [2025-10-28T19:10:36.181191] [INFO ] [MAIN ] HBB: Full history saved. [2025-10-28T19:10:36.181262] [INFO ] [MAIN ] Update Progress: 994/2366 symbols completed. HBB took 19.8s. Estimated remaining: 3h 0m 12s. Rate: 7.6 symbols/min [2025-10-28T19:10:36.345527] [INFO ] [MAIN ] HBM: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:10:36.395285] [DEBUG] [LOCAL ] HBM: Loaded 52979 existing records from primary storage. [2025-10-28T19:10:36.395591] [INFO ] [MAIN ] HBM: Loaded 52979 existing records. [2025-10-28T19:10:36.590142] [WARN ] [MAIN ] HBM: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:10:36.590322] [INFO ] [MAIN ] HBM: Wiping existing primary data before full refresh. [2025-10-28T19:10:36.590367] [INFO ] [LOCAL ] HBM: Starting deletion of primary data. [2025-10-28T19:10:36.590714] [DEBUG] [LOCAL ] HBM: Deleted primary data file. [2025-10-28T19:10:36.590789] [INFO ] [MAIN ] HBM: Starting full primary refresh. [2025-10-28T19:10:36.786591] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-07. [2025-10-28T19:10:36.943083] [INFO ] [REMOTE ] HBM: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:10:37.426272] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-28T19:10:37.580308] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-01. [2025-10-28T19:10:38.020886] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-28T19:10:38.380250] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-01. [2025-10-28T19:10:38.818609] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-28T19:10:39.180235] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-09. [2025-10-28T19:10:39.630803] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-10-28T19:10:39.980317] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-02. [2025-10-28T19:10:40.413766] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-28T19:10:40.780288] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-10. [2025-10-28T19:10:41.215023] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-28T19:10:41.580329] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-08. [2025-10-28T19:10:42.143757] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-28T19:10:42.153875] [INFO ] [REMOTE ] HAYW: Full fetch complete (70930 records). [2025-10-28T19:10:42.154035] [DEBUG] [VALIDATOR ] HAYW: Validating primary data. [2025-10-28T19:10:42.385546] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-03. [2025-10-28T19:10:42.579340] [DEBUG] [VALIDATOR ] HAYW: All expected trading days are present. [2025-10-28T19:10:42.579436] [DEBUG] [VALIDATOR ] HAYW: Primary data validation passed. [2025-10-28T19:10:42.580577] [INFO ] [MAIN ] HAYW: Fetched primary data is valid. [2025-10-28T19:10:42.580679] [DEBUG] [LOCAL ] HAYW: Saving primary data. [2025-10-28T19:10:42.582572] [DEBUG] [LOCAL ] HAYW: Trimmed 70930 records to 48731 (keeping 200 days of data) [2025-10-28T19:10:42.909719] [DEBUG] [LOCAL ] HAYW: Primary data saved (48731 records). [2025-10-28T19:10:42.910069] [INFO ] [MAIN ] HAYW: Full history saved. [2025-10-28T19:10:42.910189] [INFO ] [MAIN ] Update Progress: 995/2366 symbols completed. HAYW took 28.1s. Estimated remaining: 3h 0m 3s. Rate: 7.6 symbols/min [2025-10-28T19:10:43.111775] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-28T19:10:43.131564] [INFO ] [MAIN ] HCA: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:10:43.188162] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-02. [2025-10-28T19:10:43.192854] [DEBUG] [LOCAL ] HCA: Loaded 46869 existing records from primary storage. [2025-10-28T19:10:43.193406] [INFO ] [MAIN ] HCA: Loaded 46869 existing records. [2025-10-28T19:10:43.406557] [WARN ] [MAIN ] HCA: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:10:43.407081] [INFO ] [MAIN ] HCA: Wiping existing primary data before full refresh. [2025-10-28T19:10:43.407160] [INFO ] [LOCAL ] HCA: Starting deletion of primary data. [2025-10-28T19:10:43.407890] [DEBUG] [LOCAL ] HCA: Deleted primary data file. [2025-10-28T19:10:43.407960] [INFO ] [MAIN ] HCA: Starting full primary refresh. [2025-10-28T19:10:43.845024] [INFO ] [REMOTE ] HCA: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:10:43.876181] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-28T19:10:43.980256] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-09. [2025-10-28T19:10:44.383961] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-28T19:10:44.780303] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-04. [2025-10-28T19:10:45.206868] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-28T19:10:45.580255] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-01. [2025-10-28T19:10:46.254128] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-28T19:10:46.380258] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-05. [2025-10-28T19:10:47.072071] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-28T19:10:47.180287] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-10. [2025-10-28T19:10:47.474611] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-10-28T19:10:47.980307] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-06. [2025-10-28T19:10:48.576448] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-28T19:10:48.585854] [INFO ] [REMOTE ] HASI: Full fetch complete (68208 records). [2025-10-28T19:10:48.585995] [DEBUG] [VALIDATOR ] HASI: Validating primary data. [2025-10-28T19:10:48.785470] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-03. [2025-10-28T19:10:48.977330] [DEBUG] [VALIDATOR ] HASI: All expected trading days are present. [2025-10-28T19:10:48.977405] [DEBUG] [VALIDATOR ] HASI: Primary data validation passed. [2025-10-28T19:10:48.978312] [INFO ] [MAIN ] HASI: Fetched primary data is valid. [2025-10-28T19:10:48.978375] [DEBUG] [LOCAL ] HASI: Saving primary data. [2025-10-28T19:10:48.979581] [DEBUG] [LOCAL ] HASI: Trimmed 68208 records to 47390 (keeping 200 days of data) [2025-10-28T19:10:49.258336] [DEBUG] [LOCAL ] HASI: Primary data saved (47390 records). [2025-10-28T19:10:49.258583] [INFO ] [MAIN ] HASI: Full history saved. [2025-10-28T19:10:49.258697] [INFO ] [MAIN ] Update Progress: 996/2366 symbols completed. HASI took 35.9s. Estimated remaining: 2h 59m 53s. Rate: 7.6 symbols/min [2025-10-28T19:10:49.428488] [INFO ] [MAIN ] HCC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:10:49.461563] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-28T19:10:49.504629] [DEBUG] [LOCAL ] HCC: Loaded 44733 existing records from primary storage. [2025-10-28T19:10:49.504996] [INFO ] [MAIN ] HCC: Loaded 44733 existing records. [2025-10-28T19:10:49.585388] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-02. [2025-10-28T19:10:49.683962] [WARN ] [MAIN ] HCC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:10:49.684242] [INFO ] [MAIN ] HCC: Wiping existing primary data before full refresh. [2025-10-28T19:10:49.684296] [INFO ] [LOCAL ] HCC: Starting deletion of primary data. [2025-10-28T19:10:49.684550] [DEBUG] [LOCAL ] HCC: Deleted primary data file. [2025-10-28T19:10:49.684606] [INFO ] [MAIN ] HCC: Starting full primary refresh. [2025-10-28T19:10:50.029432] [INFO ] [REMOTE ] HCC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:10:50.380229] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-01. [2025-10-28T19:10:50.493482] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-28T19:10:50.874752] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-28T19:10:51.180230] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-03. [2025-10-28T19:10:51.513958] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-28T19:10:51.980230] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-02. [2025-10-28T19:10:52.696937] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-28T19:10:52.780231] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-07. [2025-10-28T19:10:52.964414] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-28T19:10:53.580268] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-04. [2025-10-28T19:10:53.962249] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-28T19:10:54.380317] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-04. [2025-10-28T19:10:54.901765] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-28T19:10:55.180299] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-03. [2025-10-28T19:10:55.719251] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-28T19:10:55.980362] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-05. [2025-10-28T19:10:56.299340] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-28T19:10:56.780250] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-08. [2025-10-28T19:10:57.257868] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-28T19:10:57.580285] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-06. [2025-10-28T19:10:57.946588] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-28T19:10:58.380310] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-04. [2025-10-28T19:10:58.648050] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-28T19:10:59.180261] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-07. [2025-10-28T19:10:59.542574] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-28T19:10:59.980266] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-05. [2025-10-28T19:11:00.780295] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-09. [2025-10-28T19:11:01.310895] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-28T19:11:01.449543] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-07 (2.27 seconds). [2025-10-28T19:11:01.580269] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-06. [2025-10-28T19:11:02.139020] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-28T19:11:02.380256] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-10. [2025-10-28T19:11:02.572301] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-28T19:11:03.180261] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-05. [2025-10-28T19:11:03.843155] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-28T19:11:03.854183] [INFO ] [REMOTE ] HBI: Full fetch complete (76949 records). [2025-10-28T19:11:03.854357] [DEBUG] [VALIDATOR ] HBI: Validating primary data. [2025-10-28T19:11:03.985369] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-08. [2025-10-28T19:11:04.272191] [DEBUG] [VALIDATOR ] HBI: All expected trading days are present. [2025-10-28T19:11:04.272265] [DEBUG] [VALIDATOR ] HBI: Primary data validation passed. [2025-10-28T19:11:04.273322] [INFO ] [MAIN ] HBI: Fetched primary data is valid. [2025-10-28T19:11:04.273398] [DEBUG] [LOCAL ] HBI: Saving primary data. [2025-10-28T19:11:04.274870] [DEBUG] [LOCAL ] HBI: Trimmed 76949 records to 52883 (keeping 200 days of data) [2025-10-28T19:11:04.589155] [DEBUG] [LOCAL ] HBI: Primary data saved (52883 records). [2025-10-28T19:11:04.600409] [INFO ] [MAIN ] HBI: Full history saved. [2025-10-28T19:11:04.600521] [INFO ] [MAIN ] Update Progress: 997/2366 symbols completed. HBI took 29.7s. Estimated remaining: 2h 59m 55s. Rate: 7.6 symbols/min [2025-10-28T19:11:04.602359] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-28T19:11:04.780320] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-06. [2025-10-28T19:11:05.392890] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-10-28T19:11:05.580270] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-09. [2025-10-28T19:11:05.925853] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-28T19:11:06.380269] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-07. [2025-10-28T19:11:07.116455] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-10-28T19:11:07.180269] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-10. [2025-10-28T19:11:07.436543] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-28T19:11:07.980293] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-08. [2025-10-28T19:11:08.780303] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-07. [2025-10-28T19:11:09.122894] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-28T19:11:09.175937] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-10 (2.00 seconds). [2025-10-28T19:11:09.187109] [INFO ] [REMOTE ] HBM: Full fetch complete (76773 records). [2025-10-28T19:11:09.187259] [DEBUG] [VALIDATOR ] HBM: Validating primary data. [2025-10-28T19:11:09.585678] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-09. [2025-10-28T19:11:09.586683] [DEBUG] [VALIDATOR ] HBM: All expected trading days are present. [2025-10-28T19:11:09.587983] [DEBUG] [VALIDATOR ] HBM: Primary data validation passed. [2025-10-28T19:11:09.589074] [INFO ] [MAIN ] HBM: Fetched primary data is valid. [2025-10-28T19:11:09.589181] [DEBUG] [LOCAL ] HBM: Saving primary data. [2025-10-28T19:11:09.590835] [DEBUG] [LOCAL ] HBM: Trimmed 76773 records to 52979 (keeping 200 days of data) [2025-10-28T19:11:09.914611] [DEBUG] [LOCAL ] HBM: Primary data saved (52979 records). [2025-10-28T19:11:09.914820] [INFO ] [MAIN ] HBM: Full history saved. [2025-10-28T19:11:09.915624] [INFO ] [MAIN ] Update Progress: 998/2366 symbols completed. HBM took 33.7s. Estimated remaining: 2h 59m 44s. Rate: 7.6 symbols/min [2025-10-28T19:11:10.310006] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-28T19:11:10.380214] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-08. [2025-10-28T19:11:10.767178] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-28T19:11:11.180251] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-10. [2025-10-28T19:11:11.729849] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-28T19:11:11.980279] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-09. [2025-10-28T19:11:12.687834] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-10 (1.51 seconds). [2025-10-28T19:11:12.696325] [INFO ] [REMOTE ] HCC: Full fetch complete (64713 records). [2025-10-28T19:11:12.696468] [DEBUG] [VALIDATOR ] HCC: Validating primary data. [2025-10-28T19:11:13.074207] [DEBUG] [VALIDATOR ] HCC: All expected trading days are present. [2025-10-28T19:11:13.074320] [DEBUG] [VALIDATOR ] HCC: Primary data validation passed. [2025-10-28T19:11:13.075236] [INFO ] [MAIN ] HCC: Fetched primary data is valid. [2025-10-28T19:11:13.075738] [DEBUG] [LOCAL ] HCC: Saving primary data. [2025-10-28T19:11:13.077056] [DEBUG] [LOCAL ] HCC: Trimmed 64713 records to 44630 (keeping 200 days of data) [2025-10-28T19:11:13.359741] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-28T19:11:13.377059] [DEBUG] [LOCAL ] HCC: Primary data saved (44630 records). [2025-10-28T19:11:13.377441] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-10. [2025-10-28T19:11:13.377537] [INFO ] [MAIN ] HCC: Full history saved. [2025-10-28T19:11:13.377824] [INFO ] [MAIN ] Update Progress: 999/2366 symbols completed. HCC took 24.1s. Estimated remaining: 2h 59m 30s. Rate: 7.6 symbols/min [2025-10-28T19:11:14.862045] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-28T19:11:14.871464] [INFO ] [REMOTE ] HCA: Full fetch complete (68889 records). [2025-10-28T19:11:14.871618] [DEBUG] [VALIDATOR ] HCA: Validating primary data. [2025-10-28T19:11:15.271393] [DEBUG] [VALIDATOR ] HCA: All expected trading days are present. [2025-10-28T19:11:15.271485] [DEBUG] [VALIDATOR ] HCA: Primary data validation passed. [2025-10-28T19:11:15.272442] [INFO ] [MAIN ] HCA: Fetched primary data is valid. [2025-10-28T19:11:15.272503] [DEBUG] [LOCAL ] HCA: Saving primary data. [2025-10-28T19:11:15.273884] [DEBUG] [LOCAL ] HCA: Trimmed 68889 records to 46820 (keeping 200 days of data) [2025-10-28T19:11:15.564487] [DEBUG] [LOCAL ] HCA: Primary data saved (46820 records). [2025-10-28T19:11:15.564624] [INFO ] [MAIN ] HCA: Full history saved. [2025-10-28T19:11:15.565401] [INFO ] [MAIN ] Update Progress: 1000/2366 symbols completed. HCA took 32.7s. Estimated remaining: 2h 59m 14s. Rate: 7.6 symbols/min [2025-10-28T19:11:16.132005] [INFO ] [MAIN ] HD: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:11:16.221579] [INFO ] [MAIN ] HDB: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:11:16.251211] [INFO ] [MAIN ] HCI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:11:16.311870] [INFO ] [MAIN ] HCXY: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:11:16.312305] [DEBUG] [LOCAL ] HCXY: No existing data file found in primary storage. [2025-10-28T19:11:16.312713] [WARN ] [MAIN ] HCXY: No existing data found, performing full refresh instead. [2025-10-28T19:11:16.312873] [INFO ] [MAIN ] HCXY: Wiping existing primary data before full refresh. [2025-10-28T19:11:16.313049] [INFO ] [LOCAL ] HCXY: Starting deletion of primary data. [2025-10-28T19:11:16.313203] [DEBUG] [LOCAL ] HCXY: No primary data file found to delete. [2025-10-28T19:11:16.313255] [INFO ] [MAIN ] HCXY: Starting full primary refresh. [2025-10-28T19:11:16.471143] [DEBUG] [LOCAL ] HCI: Loaded 13895 existing records from primary storage. [2025-10-28T19:11:16.521544] [INFO ] [MAIN ] HCI: Loaded 13895 existing records. [2025-10-28T19:11:16.727238] [DEBUG] [LOCAL ] HD: Loaded 53453 existing records from primary storage. [2025-10-28T19:11:16.762665] [INFO ] [MAIN ] HD: Loaded 53453 existing records. [2025-10-28T19:11:16.768902] [DEBUG] [LOCAL ] HDB: Loaded 51901 existing records from primary storage. [2025-10-28T19:11:16.895698] [INFO ] [MAIN ] HDB: Loaded 51901 existing records. [2025-10-28T19:11:17.097507] [WARN ] [MAIN ] HCI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:11:17.170785] [INFO ] [MAIN ] HCI: Wiping existing primary data before full refresh. [2025-10-28T19:11:17.187470] [INFO ] [REMOTE ] HCXY: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:11:17.235365] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-01. [2025-10-28T19:11:17.234757] [INFO ] [LOCAL ] HCI: Starting deletion of primary data. [2025-10-28T19:11:17.262195] [DEBUG] [LOCAL ] HCI: Deleted primary data file. [2025-10-28T19:11:17.295768] [WARN ] [MAIN ] HD: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:11:17.329992] [INFO ] [MAIN ] HD: Wiping existing primary data before full refresh. [2025-10-28T19:11:17.310257] [INFO ] [MAIN ] HCI: Starting full primary refresh. [2025-10-28T19:11:17.330178] [INFO ] [LOCAL ] HD: Starting deletion of primary data. [2025-10-28T19:11:17.388324] [DEBUG] [LOCAL ] HD: Deleted primary data file. [2025-10-28T19:11:17.389162] [INFO ] [MAIN ] HD: Starting full primary refresh. [2025-10-28T19:11:17.378006] [WARN ] [MAIN ] HDB: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:11:17.405680] [INFO ] [MAIN ] HDB: Wiping existing primary data before full refresh. [2025-10-28T19:11:17.492048] [INFO ] [LOCAL ] HDB: Starting deletion of primary data. [2025-10-28T19:11:17.533966] [DEBUG] [LOCAL ] HDB: Deleted primary data file. [2025-10-28T19:11:17.581519] [INFO ] [MAIN ] HDB: Starting full primary refresh. [2025-10-28T19:11:17.581804] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-10-28T19:11:17.677043] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-02. [2025-10-28T19:11:18.151072] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-28T19:11:18.257582] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-03. [2025-10-28T19:11:18.427143] [INFO ] [REMOTE ] HD: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:11:18.495215] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-01. [2025-10-28T19:11:18.551871] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-03 (0.29 seconds). [2025-10-28T19:11:18.603114] [INFO ] [REMOTE ] HCI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:11:18.609933] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-04. [2025-10-28T19:11:18.620955] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-01. [2025-10-28T19:11:18.713206] [INFO ] [REMOTE ] HDB: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:11:18.713552] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-01. [2025-10-28T19:11:18.956465] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-10-28T19:11:19.180340] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-05. [2025-10-28T19:11:19.214939] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-10-28T19:11:19.686609] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-28T19:11:19.980285] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-02. [2025-10-28T19:11:20.098320] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-28T19:11:20.145184] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-28T19:11:20.430526] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-28T19:11:20.780265] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-02. [2025-10-28T19:11:21.580288] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-02. [2025-10-28T19:11:22.060262] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-28T19:11:22.380272] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-03. [2025-10-28T19:11:22.923074] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-28T19:11:23.106878] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-28T19:11:23.180277] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-03. [2025-10-28T19:11:23.980282] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-04. [2025-10-28T19:11:24.633378] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-28T19:11:24.635210] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-28T19:11:24.780301] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-05. [2025-10-28T19:11:25.514715] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-28T19:11:25.580252] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-06. [2025-10-28T19:11:26.283044] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-28T19:11:26.380301] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-03. [2025-10-28T19:11:27.180265] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-06. [2025-10-28T19:11:27.399293] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-06 (0.22 seconds). [2025-10-28T19:11:27.716268] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-28T19:11:27.980296] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-04. [2025-10-28T19:11:28.780286] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-07. [2025-10-28T19:11:28.992315] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-07 (0.21 seconds). [2025-10-28T19:11:29.240000] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-28T19:11:29.580317] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-07. [2025-10-28T19:11:30.191451] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-28T19:11:30.380275] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-04. [2025-10-28T19:11:31.180252] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-08. [2025-10-28T19:11:31.856767] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-28T19:11:31.980884] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-08. [2025-10-28T19:11:31.987016] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-10-28T19:11:32.200587] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-08 (0.22 seconds). [2025-10-28T19:11:32.780303] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-05. [2025-10-28T19:11:33.580283] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-09. [2025-10-28T19:11:33.840307] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-09 (0.26 seconds). [2025-10-28T19:11:34.380265] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-10. [2025-10-28T19:11:34.665154] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-10-28T19:11:34.690136] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-10 (0.31 seconds). [2025-10-28T19:11:34.690795] [INFO ] [REMOTE ] HCXY: Full fetch complete (517 records). [2025-10-28T19:11:34.690864] [DEBUG] [VALIDATOR ] HCXY: Validating primary data. [2025-10-28T19:11:34.872623] [WARN ] [VALIDATOR ] HCXY: Validation failed - insufficient historical data. Have 162 unique days, need 200 days [2025-10-28T19:11:34.872804] [FATAL] [MAIN ] HCXY: Fetched primary data is invalid. Refusing to save it. [2025-10-28T19:11:34.872871] [WARN ] [MAIN ] HCXY: Deleting existing primary and derivative data due to validation failure. [2025-10-28T19:11:34.872941] [INFO ] [LOCAL ] HCXY: Starting deletion of primary data. [2025-10-28T19:11:34.873020] [DEBUG] [LOCAL ] HCXY: No primary data file found to delete. [2025-10-28T19:11:34.873056] [INFO ] [LOCAL ] HCXY: Starting deletion of derivative data. [2025-10-28T19:11:34.873095] [DEBUG] [LOCAL ] HCXY: No derivative data file found to delete. [2025-10-28T19:11:34.873148] [INFO ] [MAIN ] Update Progress: 1001/2366 symbols completed. HCXY took 19.3s. Estimated remaining: 2h 59m 22s. Rate: 7.6 symbols/min [2025-10-28T19:11:35.045382] [INFO ] [MAIN ] HE: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:11:35.092070] [DEBUG] [LOCAL ] HE: Loaded 48626 existing records from primary storage. [2025-10-28T19:11:35.092357] [INFO ] [MAIN ] HE: Loaded 48626 existing records. [2025-10-28T19:11:35.185454] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-09. [2025-10-28T19:11:35.275750] [WARN ] [MAIN ] HE: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:11:35.275961] [INFO ] [MAIN ] HE: Wiping existing primary data before full refresh. [2025-10-28T19:11:35.276008] [INFO ] [LOCAL ] HE: Starting deletion of primary data. [2025-10-28T19:11:35.276625] [DEBUG] [LOCAL ] HE: Deleted primary data file. [2025-10-28T19:11:35.276715] [INFO ] [MAIN ] HE: Starting full primary refresh. [2025-10-28T19:11:35.624179] [INFO ] [REMOTE ] HE: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:11:35.933240] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-28T19:11:35.980237] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-01. [2025-10-28T19:11:36.780280] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-10. [2025-10-28T19:11:37.239216] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-28T19:11:37.545992] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-28T19:11:37.551162] [INFO ] [REMOTE ] HCI: Full fetch complete (19494 records). [2025-10-28T19:11:37.551289] [DEBUG] [VALIDATOR ] HCI: Validating primary data. [2025-10-28T19:11:37.585387] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-05. [2025-10-28T19:11:37.934062] [DEBUG] [VALIDATOR ] HCI: All expected trading days are present. [2025-10-28T19:11:37.934138] [DEBUG] [VALIDATOR ] HCI: Primary data validation passed. [2025-10-28T19:11:37.934542] [INFO ] [MAIN ] HCI: Fetched primary data is valid. [2025-10-28T19:11:37.934581] [DEBUG] [LOCAL ] HCI: Saving primary data. [2025-10-28T19:11:37.935131] [DEBUG] [LOCAL ] HCI: Trimmed 19494 records to 13859 (keeping 200 days of data) [2025-10-28T19:11:38.024416] [DEBUG] [LOCAL ] HCI: Primary data saved (13859 records). [2025-10-28T19:11:38.024839] [INFO ] [MAIN ] HCI: Full history saved. [2025-10-28T19:11:38.024929] [INFO ] [MAIN ] Update Progress: 1002/2366 symbols completed. HCI took 22.5s. Estimated remaining: 2h 59m 7s. Rate: 7.6 symbols/min [2025-10-28T19:11:38.188797] [INFO ] [MAIN ] HEI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:11:38.219018] [DEBUG] [LOCAL ] HEI: Loaded 30061 existing records from primary storage. [2025-10-28T19:11:38.219286] [INFO ] [MAIN ] HEI: Loaded 30061 existing records. [2025-10-28T19:11:38.387754] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-02. [2025-10-28T19:11:38.392365] [WARN ] [MAIN ] HEI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:11:38.393468] [INFO ] [MAIN ] HEI: Wiping existing primary data before full refresh. [2025-10-28T19:11:38.393519] [INFO ] [LOCAL ] HEI: Starting deletion of primary data. [2025-10-28T19:11:38.394134] [DEBUG] [LOCAL ] HEI: Deleted primary data file. [2025-10-28T19:11:38.394197] [INFO ] [MAIN ] HEI: Starting full primary refresh. [2025-10-28T19:11:38.736778] [INFO ] [REMOTE ] HEI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:11:38.986522] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-28T19:11:39.180282] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-01. [2025-10-28T19:11:39.877349] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-28T19:11:39.980247] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-03. [2025-10-28T19:11:40.310518] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-10-28T19:11:40.780234] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-06. [2025-10-28T19:11:41.180242] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-28T19:11:41.580308] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-02. [2025-10-28T19:11:42.311124] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-28T19:11:42.380204] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-07. [2025-10-28T19:11:42.642488] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-28T19:11:43.180298] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-04. [2025-10-28T19:11:43.936553] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-28T19:11:43.980287] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-08. [2025-10-28T19:11:44.364968] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-28T19:11:44.780355] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-06. [2025-10-28T19:11:45.580235] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-03. [2025-10-28T19:11:45.671623] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-28T19:11:45.858872] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-28T19:11:46.380247] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-07. [2025-10-28T19:11:46.691112] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-28T19:11:47.180326] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-05. [2025-10-28T19:11:47.836026] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-28T19:11:47.980271] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-08. [2025-10-28T19:11:48.597162] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-28T19:11:48.780229] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-06. [2025-10-28T19:11:49.229763] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-28T19:11:49.580272] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-04. [2025-10-28T19:11:50.021498] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-28T19:11:50.380306] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-09. [2025-10-28T19:11:50.650081] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-28T19:11:51.180283] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-05. [2025-10-28T19:11:51.931179] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-28T19:11:51.980213] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-10. [2025-10-28T19:11:52.212775] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-28T19:11:52.780308] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-06. [2025-10-28T19:11:53.580235] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-09. [2025-10-28T19:11:53.702805] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-10 (1.72 seconds). [2025-10-28T19:11:53.716112] [INFO ] [REMOTE ] HD: Full fetch complete (77530 records). [2025-10-28T19:11:53.716408] [DEBUG] [VALIDATOR ] HD: Validating primary data. [2025-10-28T19:11:54.092693] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-28T19:11:54.199538] [DEBUG] [VALIDATOR ] HD: All expected trading days are present. [2025-10-28T19:11:54.199636] [DEBUG] [VALIDATOR ] HD: Primary data validation passed. [2025-10-28T19:11:54.200787] [INFO ] [MAIN ] HD: Fetched primary data is valid. [2025-10-28T19:11:54.200858] [DEBUG] [LOCAL ] HD: Saving primary data. [2025-10-28T19:11:54.202411] [DEBUG] [LOCAL ] HD: Trimmed 77530 records to 53446 (keeping 200 days of data) [2025-10-28T19:11:54.381303] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-07. [2025-10-28T19:11:54.546885] [DEBUG] [LOCAL ] HD: Primary data saved (53446 records). [2025-10-28T19:11:54.547054] [INFO ] [MAIN ] HD: Full history saved. [2025-10-28T19:11:54.547157] [INFO ] [MAIN ] Update Progress: 1003/2366 symbols completed. HD took 39.0s. Estimated remaining: 2h 59m 11s. Rate: 7.6 symbols/min [2025-10-28T19:11:54.723772] [INFO ] [MAIN ] HEQ: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:11:54.732458] [DEBUG] [LOCAL ] HEQ: Loaded 6624 existing records from primary storage. [2025-10-28T19:11:54.732704] [INFO ] [MAIN ] HEQ: Loaded 6624 existing records. [2025-10-28T19:11:54.922835] [WARN ] [MAIN ] HEQ: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:11:54.923311] [INFO ] [MAIN ] HEQ: Wiping existing primary data before full refresh. [2025-10-28T19:11:54.923387] [INFO ] [LOCAL ] HEQ: Starting deletion of primary data. [2025-10-28T19:11:54.923826] [DEBUG] [LOCAL ] HEQ: Deleted primary data file. [2025-10-28T19:11:54.923954] [INFO ] [MAIN ] HEQ: Starting full primary refresh. [2025-10-28T19:11:55.192481] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-07. [2025-10-28T19:11:55.340005] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-10-28T19:11:55.371245] [INFO ] [REMOTE ] HEQ: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:11:55.713835] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-28T19:11:55.980249] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-10. [2025-10-28T19:11:56.246990] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-28T19:11:56.780252] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-01. [2025-10-28T19:11:57.281059] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-10-28T19:11:57.443030] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-28T19:11:57.453765] [INFO ] [REMOTE ] HDB: Full fetch complete (75665 records). [2025-10-28T19:11:57.453885] [DEBUG] [VALIDATOR ] HDB: Validating primary data. [2025-10-28T19:11:57.585474] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-08. [2025-10-28T19:11:57.857785] [DEBUG] [VALIDATOR ] HDB: All expected trading days are present. [2025-10-28T19:11:57.857861] [DEBUG] [VALIDATOR ] HDB: Primary data validation passed. [2025-10-28T19:11:57.858811] [INFO ] [MAIN ] HDB: Fetched primary data is valid. [2025-10-28T19:11:57.858872] [DEBUG] [LOCAL ] HDB: Saving primary data. [2025-10-28T19:11:57.860243] [DEBUG] [LOCAL ] HDB: Trimmed 75665 records to 51896 (keeping 200 days of data) [2025-10-28T19:11:58.169851] [DEBUG] [LOCAL ] HDB: Primary data saved (51896 records). [2025-10-28T19:11:58.169979] [INFO ] [MAIN ] HDB: Full history saved. [2025-10-28T19:11:58.171094] [INFO ] [MAIN ] Update Progress: 1004/2366 symbols completed. HDB took 42.6s. Estimated remaining: 2h 58m 58s. Rate: 7.6 symbols/min [2025-10-28T19:11:58.337257] [INFO ] [MAIN ] HESM: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:11:58.380253] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-08. [2025-10-28T19:11:58.382739] [DEBUG] [LOCAL ] HESM: Loaded 48557 existing records from primary storage. [2025-10-28T19:11:58.383066] [INFO ] [MAIN ] HESM: Loaded 48557 existing records. [2025-10-28T19:11:58.563794] [WARN ] [MAIN ] HESM: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:11:58.563981] [INFO ] [MAIN ] HESM: Wiping existing primary data before full refresh. [2025-10-28T19:11:58.564028] [INFO ] [LOCAL ] HESM: Starting deletion of primary data. [2025-10-28T19:11:58.564212] [DEBUG] [LOCAL ] HESM: Deleted primary data file. [2025-10-28T19:11:58.564253] [INFO ] [MAIN ] HESM: Starting full primary refresh. [2025-10-28T19:11:58.932292] [INFO ] [REMOTE ] HESM: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:11:58.950355] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-28T19:11:59.180289] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-02. [2025-10-28T19:11:59.590455] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-28T19:11:59.780814] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-28T19:11:59.980266] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-01. [2025-10-28T19:12:00.780264] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-09. [2025-10-28T19:12:01.337917] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-28T19:12:01.580255] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-03. [2025-10-28T19:12:01.925100] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-10-28T19:12:02.154999] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-28T19:12:02.380257] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-09. [2025-10-28T19:12:03.180245] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-10. [2025-10-28T19:12:03.321061] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-28T19:12:03.980261] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-02. [2025-10-28T19:12:04.680619] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-28T19:12:04.690204] [INFO ] [REMOTE ] HE: Full fetch complete (71863 records). [2025-10-28T19:12:04.690318] [DEBUG] [VALIDATOR ] HE: Validating primary data. [2025-10-28T19:12:04.786823] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-04. [2025-10-28T19:12:05.084392] [DEBUG] [VALIDATOR ] HE: All expected trading days are present. [2025-10-28T19:12:05.084470] [DEBUG] [VALIDATOR ] HE: Primary data validation passed. [2025-10-28T19:12:05.085409] [INFO ] [MAIN ] HE: Fetched primary data is valid. [2025-10-28T19:12:05.085471] [DEBUG] [LOCAL ] HE: Saving primary data. [2025-10-28T19:12:05.086827] [DEBUG] [LOCAL ] HE: Trimmed 71863 records to 48563 (keeping 200 days of data) [2025-10-28T19:12:05.361182] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-28T19:12:05.390836] [DEBUG] [LOCAL ] HE: Primary data saved (48563 records). [2025-10-28T19:12:05.391130] [INFO ] [MAIN ] HE: Full history saved. [2025-10-28T19:12:05.391923] [INFO ] [MAIN ] Update Progress: 1005/2366 symbols completed. HE took 30.5s. Estimated remaining: 2h 58m 49s. Rate: 7.6 symbols/min [2025-10-28T19:12:05.563467] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-10-28T19:12:05.581144] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-05. [2025-10-28T19:12:05.605084] [INFO ] [MAIN ] HF: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:12:05.606596] [DEBUG] [LOCAL ] HF: No existing data file found in primary storage. [2025-10-28T19:12:05.606794] [WARN ] [MAIN ] HF: No existing data found, performing full refresh instead. [2025-10-28T19:12:05.606967] [INFO ] [MAIN ] HF: Wiping existing primary data before full refresh. [2025-10-28T19:12:05.607017] [INFO ] [LOCAL ] HF: Starting deletion of primary data. [2025-10-28T19:12:05.607060] [DEBUG] [LOCAL ] HF: No primary data file found to delete. [2025-10-28T19:12:05.607096] [INFO ] [MAIN ] HF: Starting full primary refresh. [2025-10-28T19:12:05.973462] [INFO ] [REMOTE ] HF: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:12:06.097127] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-28T19:12:06.380307] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-06. [2025-10-28T19:12:06.892830] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-28T19:12:07.180252] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-10. [2025-10-28T19:12:07.980235] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-03. [2025-10-28T19:12:08.076223] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-28T19:12:08.081272] [INFO ] [REMOTE ] HEI: Full fetch complete (46697 records). [2025-10-28T19:12:08.081364] [DEBUG] [VALIDATOR ] HEI: Validating primary data. [2025-10-28T19:12:08.471589] [DEBUG] [VALIDATOR ] HEI: All expected trading days are present. [2025-10-28T19:12:08.471695] [DEBUG] [VALIDATOR ] HEI: Primary data validation passed. [2025-10-28T19:12:08.472422] [INFO ] [MAIN ] HEI: Fetched primary data is valid. [2025-10-28T19:12:08.472463] [DEBUG] [LOCAL ] HEI: Saving primary data. [2025-10-28T19:12:08.473483] [DEBUG] [LOCAL ] HEI: Trimmed 46697 records to 29971 (keeping 200 days of data) [2025-10-28T19:12:08.653924] [DEBUG] [LOCAL ] HEI: Primary data saved (29971 records). [2025-10-28T19:12:08.654046] [INFO ] [MAIN ] HEI: Full history saved. [2025-10-28T19:12:08.654121] [INFO ] [MAIN ] Update Progress: 1006/2366 symbols completed. HEI took 30.6s. Estimated remaining: 2h 58m 35s. Rate: 7.6 symbols/min [2025-10-28T19:12:08.785420] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-01. [2025-10-28T19:12:08.837319] [INFO ] [MAIN ] HFND: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:12:08.837510] [DEBUG] [LOCAL ] HFND: No existing data file found in primary storage. [2025-10-28T19:12:08.837562] [WARN ] [MAIN ] HFND: No existing data found, performing full refresh instead. [2025-10-28T19:12:08.837691] [INFO ] [MAIN ] HFND: Wiping existing primary data before full refresh. [2025-10-28T19:12:08.837748] [INFO ] [LOCAL ] HFND: Starting deletion of primary data. [2025-10-28T19:12:08.837793] [DEBUG] [LOCAL ] HFND: No primary data file found to delete. [2025-10-28T19:12:08.837833] [INFO ] [MAIN ] HFND: Starting full primary refresh. [2025-10-28T19:12:09.122786] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-10-28T19:12:09.215700] [INFO ] [REMOTE ] HFND: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:12:09.289660] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-28T19:12:09.580225] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-01. [2025-10-28T19:12:09.826428] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-01 (0.25 seconds). [2025-10-28T19:12:10.380293] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-02. [2025-10-28T19:12:10.669456] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-02 (0.29 seconds). [2025-10-28T19:12:11.180354] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-07. [2025-10-28T19:12:11.652454] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-28T19:12:11.980250] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-02. [2025-10-28T19:12:12.180356] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-02 (0.20 seconds). [2025-10-28T19:12:12.780250] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-08. [2025-10-28T19:12:13.175274] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-10-28T19:12:13.580302] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-03. [2025-10-28T19:12:13.851420] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-03 (0.27 seconds). [2025-10-28T19:12:14.380309] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-04. [2025-10-28T19:12:14.619698] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-04 (0.24 seconds). [2025-10-28T19:12:15.180278] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-04. [2025-10-28T19:12:15.980322] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-03. [2025-10-28T19:12:16.181249] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-03 (0.20 seconds). [2025-10-28T19:12:16.392222] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-28T19:12:16.780312] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-09. [2025-10-28T19:12:17.243343] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-28T19:12:17.580249] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-04. [2025-10-28T19:12:17.814329] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-04 (0.23 seconds). [2025-10-28T19:12:18.380251] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-05. [2025-10-28T19:12:18.584805] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-05 (0.20 seconds). [2025-10-28T19:12:19.180274] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-05. [2025-10-28T19:12:19.980338] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-06. [2025-10-28T19:12:20.191954] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-06 (0.21 seconds). [2025-10-28T19:12:20.275908] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-28T19:12:20.780251] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-07. [2025-10-28T19:12:20.951996] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-07 (0.17 seconds). [2025-10-28T19:12:21.580255] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-05. [2025-10-28T19:12:21.792435] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-05 (0.21 seconds). [2025-10-28T19:12:22.380249] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-08. [2025-10-28T19:12:22.557824] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-08 (0.18 seconds). [2025-10-28T19:12:23.180264] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-06. [2025-10-28T19:12:23.394428] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-06 (0.21 seconds). [2025-10-28T19:12:23.980252] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-06. [2025-10-28T19:12:24.780248] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-07. [2025-10-28T19:12:25.059241] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-07 (0.28 seconds). [2025-10-28T19:12:25.247331] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-28T19:12:25.580259] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-10. [2025-10-28T19:12:26.195876] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-10 (0.62 seconds). [2025-10-28T19:12:26.198259] [INFO ] [REMOTE ] HEQ: Full fetch complete (9684 records). [2025-10-28T19:12:26.198330] [DEBUG] [VALIDATOR ] HEQ: Validating primary data. [2025-10-28T19:12:26.385686] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-09. [2025-10-28T19:12:26.553207] [DEBUG] [VALIDATOR ] HEQ: All expected trading days are present. [2025-10-28T19:12:26.553284] [DEBUG] [VALIDATOR ] HEQ: Primary data validation passed. [2025-10-28T19:12:26.553535] [INFO ] [MAIN ] HEQ: Fetched primary data is valid. [2025-10-28T19:12:26.553635] [DEBUG] [LOCAL ] HEQ: Saving primary data. [2025-10-28T19:12:26.554133] [DEBUG] [LOCAL ] HEQ: Trimmed 9684 records to 6561 (keeping 200 days of data) [2025-10-28T19:12:26.591419] [DEBUG] [LOCAL ] HEQ: Primary data saved (6561 records). [2025-10-28T19:12:26.591499] [INFO ] [MAIN ] HEQ: Full history saved. [2025-10-28T19:12:26.591580] [INFO ] [MAIN ] Update Progress: 1007/2366 symbols completed. HEQ took 32.0s. Estimated remaining: 2h 58m 40s. Rate: 7.6 symbols/min [2025-10-28T19:12:26.706444] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-09 (0.32 seconds). [2025-10-28T19:12:26.782635] [INFO ] [MAIN ] HFRO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:12:26.798770] [DEBUG] [LOCAL ] HFRO: Loaded 15780 existing records from primary storage. [2025-10-28T19:12:26.799003] [INFO ] [MAIN ] HFRO: Loaded 15780 existing records. [2025-10-28T19:12:26.988863] [WARN ] [MAIN ] HFRO: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:12:26.989096] [INFO ] [MAIN ] HFRO: Wiping existing primary data before full refresh. [2025-10-28T19:12:26.989160] [INFO ] [LOCAL ] HFRO: Starting deletion of primary data. [2025-10-28T19:12:26.989359] [DEBUG] [LOCAL ] HFRO: Deleted primary data file. [2025-10-28T19:12:26.989404] [INFO ] [MAIN ] HFRO: Starting full primary refresh. [2025-10-28T19:12:27.187318] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-10. [2025-10-28T19:12:27.344243] [INFO ] [REMOTE ] HFRO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:12:27.565201] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-10 (0.38 seconds). [2025-10-28T19:12:27.565840] [INFO ] [REMOTE ] HF: Full fetch complete (420 records). [2025-10-28T19:12:27.565908] [DEBUG] [VALIDATOR ] HF: Validating primary data. [2025-10-28T19:12:27.758022] [WARN ] [VALIDATOR ] HF: Validation failed - insufficient historical data. Have 144 unique days, need 200 days [2025-10-28T19:12:27.758166] [FATAL] [MAIN ] HF: Fetched primary data is invalid. Refusing to save it. [2025-10-28T19:12:27.758261] [WARN ] [MAIN ] HF: Deleting existing primary and derivative data due to validation failure. [2025-10-28T19:12:27.758345] [INFO ] [LOCAL ] HF: Starting deletion of primary data. [2025-10-28T19:12:27.758424] [DEBUG] [LOCAL ] HF: No primary data file found to delete. [2025-10-28T19:12:27.758475] [INFO ] [LOCAL ] HF: Starting deletion of derivative data. [2025-10-28T19:12:27.758771] [DEBUG] [LOCAL ] HF: No derivative data file found to delete. [2025-10-28T19:12:27.758853] [INFO ] [MAIN ] Update Progress: 1008/2366 symbols completed. HF took 22.4s. Estimated remaining: 2h 58m 23s. Rate: 7.6 symbols/min [2025-10-28T19:12:27.980254] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-08. [2025-10-28T19:12:27.980126] [INFO ] [MAIN ] HGER: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:12:28.000779] [DEBUG] [LOCAL ] HGER: Loaded 15806 existing records from primary storage. [2025-10-28T19:12:28.001061] [INFO ] [MAIN ] HGER: Loaded 15806 existing records. [2025-10-28T19:12:28.256505] [WARN ] [MAIN ] HGER: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:12:28.256789] [INFO ] [MAIN ] HGER: Wiping existing primary data before full refresh. [2025-10-28T19:12:28.256848] [INFO ] [LOCAL ] HGER: Starting deletion of primary data. [2025-10-28T19:12:28.257045] [DEBUG] [LOCAL ] HGER: Deleted primary data file. [2025-10-28T19:12:28.257121] [INFO ] [MAIN ] HGER: Starting full primary refresh. [2025-10-28T19:12:28.342538] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-10-28T19:12:28.773304] [INFO ] [REMOTE ] HGER: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:12:28.780257] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-01. [2025-10-28T19:12:29.225331] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-28T19:12:29.580305] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-09. [2025-10-28T19:12:29.897862] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-09 (0.32 seconds). [2025-10-28T19:12:30.380255] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-02. [2025-10-28T19:12:30.762524] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-10-28T19:12:31.180250] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-03. [2025-10-28T19:12:31.660964] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-28T19:12:31.980250] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-04. [2025-10-28T19:12:32.507555] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-28T19:12:32.780252] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-05. [2025-10-28T19:12:33.319607] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-28T19:12:33.580310] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-10. [2025-10-28T19:12:33.993769] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-28T19:12:33.994633] [INFO ] [REMOTE ] HFND: Full fetch complete (1786 records). [2025-10-28T19:12:33.994730] [DEBUG] [VALIDATOR ] HFND: Validating primary data. [2025-10-28T19:12:34.178717] [WARN ] [VALIDATOR ] HFND: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-10-28T19:12:34.178900] [FATAL] [MAIN ] HFND: Fetched primary data is invalid. Refusing to save it. [2025-10-28T19:12:34.178969] [WARN ] [MAIN ] HFND: Deleting existing primary and derivative data due to validation failure. [2025-10-28T19:12:34.179041] [INFO ] [LOCAL ] HFND: Starting deletion of primary data. [2025-10-28T19:12:34.179105] [DEBUG] [LOCAL ] HFND: No primary data file found to delete. [2025-10-28T19:12:34.179142] [INFO ] [LOCAL ] HFND: Starting deletion of derivative data. [2025-10-28T19:12:34.179182] [DEBUG] [LOCAL ] HFND: No derivative data file found to delete. [2025-10-28T19:12:34.179237] [INFO ] [MAIN ] Update Progress: 1009/2366 symbols completed. HFND took 25.5s. Estimated remaining: 2h 58m 14s. Rate: 7.6 symbols/min [2025-10-28T19:12:34.370937] [INFO ] [MAIN ] HGLB: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:12:34.381745] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-01. [2025-10-28T19:12:34.382191] [DEBUG] [LOCAL ] HGLB: Loaded 9325 existing records from primary storage. [2025-10-28T19:12:34.382399] [INFO ] [MAIN ] HGLB: Loaded 9325 existing records. [2025-10-28T19:12:34.562468] [WARN ] [MAIN ] HGLB: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:12:34.562686] [INFO ] [MAIN ] HGLB: Wiping existing primary data before full refresh. [2025-10-28T19:12:34.562745] [INFO ] [LOCAL ] HGLB: Starting deletion of primary data. [2025-10-28T19:12:34.562944] [DEBUG] [LOCAL ] HGLB: Deleted primary data file. [2025-10-28T19:12:34.563003] [INFO ] [MAIN ] HGLB: Starting full primary refresh. [2025-10-28T19:12:34.911169] [INFO ] [REMOTE ] HGLB: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:12:35.180224] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-06. [2025-10-28T19:12:35.292803] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-28T19:12:35.717095] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-28T19:12:35.980297] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-07. [2025-10-28T19:12:36.647275] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-28T19:12:36.780310] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-01. [2025-10-28T19:12:37.235249] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-28T19:12:37.580266] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-02. [2025-10-28T19:12:38.180578] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-28T19:12:38.380268] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-03. [2025-10-28T19:12:38.921230] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-28T19:12:39.180253] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-04. [2025-10-28T19:12:39.749016] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-28T19:12:39.980234] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-05. [2025-10-28T19:12:40.429733] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-28T19:12:40.780246] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-02. [2025-10-28T19:12:41.574198] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-28T19:12:41.580245] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-07. [2025-10-28T19:12:42.380253] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-03. [2025-10-28T19:12:42.950724] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-28T19:12:43.143005] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-28T19:12:43.180211] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-04. [2025-10-28T19:12:43.853760] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-10-28T19:12:43.980253] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-06. [2025-10-28T19:12:44.542290] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-10-28T19:12:44.780271] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-05. [2025-10-28T19:12:45.346100] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-28T19:12:45.580270] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-07. [2025-10-28T19:12:46.043313] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-28T19:12:46.380295] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-08. [2025-10-28T19:12:46.864075] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-28T19:12:47.180242] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-09. [2025-10-28T19:12:47.761461] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-28T19:12:47.980250] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-10. [2025-10-28T19:12:48.608212] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-28T19:12:48.610924] [INFO ] [REMOTE ] HGLB: Full fetch complete (14400 records). [2025-10-28T19:12:48.611020] [DEBUG] [VALIDATOR ] HGLB: Validating primary data. [2025-10-28T19:12:48.783326] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-08. [2025-10-28T19:12:48.978627] [DEBUG] [VALIDATOR ] HGLB: All expected trading days are present. [2025-10-28T19:12:48.978728] [DEBUG] [VALIDATOR ] HGLB: Primary data validation passed. [2025-10-28T19:12:48.979062] [INFO ] [MAIN ] HGLB: Fetched primary data is valid. [2025-10-28T19:12:48.979100] [DEBUG] [LOCAL ] HGLB: Saving primary data. [2025-10-28T19:12:48.979563] [DEBUG] [LOCAL ] HGLB: Trimmed 14400 records to 9253 (keeping 200 days of data) [2025-10-28T19:12:49.032507] [DEBUG] [LOCAL ] HGLB: Primary data saved (9253 records). [2025-10-28T19:12:49.032626] [INFO ] [MAIN ] HGLB: Full history saved. [2025-10-28T19:12:49.032735] [INFO ] [MAIN ] Update Progress: 1010/2366 symbols completed. HGLB took 14.9s. Estimated remaining: 2h 58m 15s. Rate: 7.6 symbols/min [2025-10-28T19:12:49.195446] [INFO ] [MAIN ] HGTY: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:12:49.209887] [DEBUG] [LOCAL ] HGTY: Loaded 13404 existing records from primary storage. [2025-10-28T19:12:49.210096] [INFO ] [MAIN ] HGTY: Loaded 13404 existing records. [2025-10-28T19:12:49.382852] [WARN ] [MAIN ] HGTY: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:12:49.383073] [INFO ] [MAIN ] HGTY: Wiping existing primary data before full refresh. [2025-10-28T19:12:49.383138] [INFO ] [LOCAL ] HGTY: Starting deletion of primary data. [2025-10-28T19:12:49.383316] [DEBUG] [LOCAL ] HGTY: Deleted primary data file. [2025-10-28T19:12:49.383372] [INFO ] [MAIN ] HGTY: Starting full primary refresh. [2025-10-28T19:12:49.589439] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-06. [2025-10-28T19:12:49.739114] [INFO ] [REMOTE ] HGTY: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:12:50.114463] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-28T19:12:50.281348] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-28T19:12:50.380221] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-01. [2025-10-28T19:12:50.818947] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-28T19:12:51.180256] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-09. [2025-10-28T19:12:51.980277] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-08. [2025-10-28T19:12:52.386027] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-28T19:12:52.628486] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-10-28T19:12:52.780288] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-02. [2025-10-28T19:12:53.198869] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-28T19:12:53.580255] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-09. [2025-10-28T19:12:54.237167] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-28T19:12:54.380290] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-07. [2025-10-28T19:12:55.066677] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-28T19:12:55.180259] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-08. [2025-10-28T19:12:55.881133] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-10-28T19:12:55.980266] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-10. [2025-10-28T19:12:56.780271] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-09. [2025-10-28T19:12:57.328349] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-28T19:12:57.338638] [INFO ] [REMOTE ] HESM: Full fetch complete (70062 records). [2025-10-28T19:12:57.338785] [DEBUG] [VALIDATOR ] HESM: Validating primary data. [2025-10-28T19:12:57.492117] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-10-28T19:12:57.585372] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-03. [2025-10-28T19:12:57.753525] [DEBUG] [VALIDATOR ] HESM: All expected trading days are present. [2025-10-28T19:12:57.753607] [DEBUG] [VALIDATOR ] HESM: Primary data validation passed. [2025-10-28T19:12:57.754633] [INFO ] [MAIN ] HESM: Fetched primary data is valid. [2025-10-28T19:12:57.754727] [DEBUG] [LOCAL ] HESM: Saving primary data. [2025-10-28T19:12:57.756102] [DEBUG] [LOCAL ] HESM: Trimmed 70062 records to 48536 (keeping 200 days of data) [2025-10-28T19:12:58.042607] [DEBUG] [LOCAL ] HESM: Primary data saved (48536 records). [2025-10-28T19:12:58.042758] [INFO ] [MAIN ] HESM: Full history saved. [2025-10-28T19:12:58.042856] [INFO ] [MAIN ] Update Progress: 1011/2366 symbols completed. HESM took 59.9s. Estimated remaining: 2h 58m 9s. Rate: 7.6 symbols/min [2025-10-28T19:12:58.212361] [INFO ] [MAIN ] HGV: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:12:58.221243] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-28T19:12:58.260760] [DEBUG] [LOCAL ] HGV: Loaded 45936 existing records from primary storage. [2025-10-28T19:12:58.261098] [INFO ] [MAIN ] HGV: Loaded 45936 existing records. [2025-10-28T19:12:58.385398] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-04. [2025-10-28T19:12:58.435474] [WARN ] [MAIN ] HGV: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:12:58.435676] [INFO ] [MAIN ] HGV: Wiping existing primary data before full refresh. [2025-10-28T19:12:58.435732] [INFO ] [LOCAL ] HGV: Starting deletion of primary data. [2025-10-28T19:12:58.436051] [DEBUG] [LOCAL ] HGV: Deleted primary data file. [2025-10-28T19:12:58.436108] [INFO ] [MAIN ] HGV: Starting full primary refresh. [2025-10-28T19:12:58.784732] [INFO ] [REMOTE ] HGV: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:12:58.950527] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-10-28T19:12:59.180256] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-05. [2025-10-28T19:12:59.628721] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-10-28T19:12:59.980255] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-06. [2025-10-28T19:13:00.557920] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-10-28T19:13:00.780259] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-07. [2025-10-28T19:13:01.552551] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-28T19:13:01.580210] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-08. [2025-10-28T19:13:02.324794] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-28T19:13:02.380265] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-01. [2025-10-28T19:13:03.180279] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-10. [2025-10-28T19:13:03.541818] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-28T19:13:03.814370] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-28T19:13:03.817503] [INFO ] [REMOTE ] HFRO: Full fetch complete (26142 records). [2025-10-28T19:13:03.817629] [DEBUG] [VALIDATOR ] HFRO: Validating primary data. [2025-10-28T19:13:03.991163] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-09. [2025-10-28T19:13:04.194268] [DEBUG] [VALIDATOR ] HFRO: All expected trading days are present. [2025-10-28T19:13:04.194343] [DEBUG] [VALIDATOR ] HFRO: Primary data validation passed. [2025-10-28T19:13:04.194955] [INFO ] [MAIN ] HFRO: Fetched primary data is valid. [2025-10-28T19:13:04.195018] [DEBUG] [LOCAL ] HFRO: Saving primary data. [2025-10-28T19:13:04.195625] [DEBUG] [LOCAL ] HFRO: Trimmed 26142 records to 15711 (keeping 200 days of data) [2025-10-28T19:13:04.286575] [DEBUG] [LOCAL ] HFRO: Primary data saved (15711 records). [2025-10-28T19:13:04.286731] [INFO ] [MAIN ] HFRO: Full history saved. [2025-10-28T19:13:04.286817] [INFO ] [MAIN ] Update Progress: 1012/2366 symbols completed. HFRO took 37.7s. Estimated remaining: 2h 57m 59s. Rate: 7.6 symbols/min [2025-10-28T19:13:04.475629] [INFO ] [MAIN ] HHH: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:13:04.508184] [DEBUG] [LOCAL ] HHH: Loaded 32806 existing records from primary storage. [2025-10-28T19:13:04.508447] [INFO ] [MAIN ] HHH: Loaded 32806 existing records. [2025-10-28T19:13:04.708767] [WARN ] [MAIN ] HHH: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:13:04.709109] [INFO ] [MAIN ] HHH: Wiping existing primary data before full refresh. [2025-10-28T19:13:04.709169] [INFO ] [LOCAL ] HHH: Starting deletion of primary data. [2025-10-28T19:13:04.709367] [DEBUG] [LOCAL ] HHH: Deleted primary data file. [2025-10-28T19:13:04.709424] [INFO ] [MAIN ] HHH: Starting full primary refresh. [2025-10-28T19:13:04.785385] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-02. [2025-10-28T19:13:04.900247] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-28T19:13:05.139569] [INFO ] [REMOTE ] HHH: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:13:05.580253] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-10. [2025-10-28T19:13:05.908941] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-28T19:13:06.365017] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-28T19:13:06.368075] [INFO ] [REMOTE ] HGTY: Full fetch complete (17628 records). [2025-10-28T19:13:06.368150] [DEBUG] [VALIDATOR ] HGTY: Validating primary data. [2025-10-28T19:13:06.388393] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-10. [2025-10-28T19:13:06.750155] [DEBUG] [VALIDATOR ] HGTY: All expected trading days are present. [2025-10-28T19:13:06.750232] [DEBUG] [VALIDATOR ] HGTY: Primary data validation passed. [2025-10-28T19:13:06.750609] [INFO ] [MAIN ] HGTY: Fetched primary data is valid. [2025-10-28T19:13:06.750676] [DEBUG] [LOCAL ] HGTY: Saving primary data. [2025-10-28T19:13:06.751210] [DEBUG] [LOCAL ] HGTY: Trimmed 17628 records to 13398 (keeping 200 days of data) [2025-10-28T19:13:06.826030] [DEBUG] [LOCAL ] HGTY: Primary data saved (13398 records). [2025-10-28T19:13:06.826155] [INFO ] [MAIN ] HGTY: Full history saved. [2025-10-28T19:13:06.826230] [INFO ] [MAIN ] Update Progress: 1013/2366 symbols completed. HGTY took 17.8s. Estimated remaining: 2h 57m 43s. Rate: 7.6 symbols/min [2025-10-28T19:13:06.997609] [INFO ] [MAIN ] HI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:13:07.032762] [DEBUG] [LOCAL ] HI: Loaded 36099 existing records from primary storage. [2025-10-28T19:13:07.033042] [INFO ] [MAIN ] HI: Loaded 36099 existing records. [2025-10-28T19:13:07.188556] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-01. [2025-10-28T19:13:07.221025] [WARN ] [MAIN ] HI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:13:07.221823] [INFO ] [MAIN ] HI: Wiping existing primary data before full refresh. [2025-10-28T19:13:07.221874] [INFO ] [LOCAL ] HI: Starting deletion of primary data. [2025-10-28T19:13:07.222075] [DEBUG] [LOCAL ] HI: Deleted primary data file. [2025-10-28T19:13:07.222118] [INFO ] [MAIN ] HI: Starting full primary refresh. [2025-10-28T19:13:07.523949] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-28T19:13:07.546393] [INFO ] [REMOTE ] HGER: Full fetch complete (19546 records). [2025-10-28T19:13:07.556834] [DEBUG] [VALIDATOR ] HGER: Validating primary data. [2025-10-28T19:13:07.696485] [INFO ] [REMOTE ] HI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:13:07.982022] [DEBUG] [VALIDATOR ] HGER: All expected trading days are present. [2025-10-28T19:13:07.981773] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-01. [2025-10-28T19:13:07.982205] [DEBUG] [VALIDATOR ] HGER: Primary data validation passed. [2025-10-28T19:13:07.982711] [INFO ] [MAIN ] HGER: Fetched primary data is valid. [2025-10-28T19:13:07.982976] [DEBUG] [LOCAL ] HGER: Saving primary data. [2025-10-28T19:13:07.984458] [DEBUG] [LOCAL ] HGER: Trimmed 19546 records to 15888 (keeping 200 days of data) [2025-10-28T19:13:08.078518] [DEBUG] [LOCAL ] HGER: Primary data saved (15888 records). [2025-10-28T19:13:08.078673] [INFO ] [MAIN ] HGER: Full history saved. [2025-10-28T19:13:08.078770] [INFO ] [MAIN ] Update Progress: 1014/2366 symbols completed. HGER took 40.3s. Estimated remaining: 2h 57m 27s. Rate: 7.6 symbols/min [2025-10-28T19:13:08.248277] [INFO ] [MAIN ] HIG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:13:08.265226] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-28T19:13:08.316949] [DEBUG] [LOCAL ] HIG: Loaded 51028 existing records from primary storage. [2025-10-28T19:13:08.317246] [INFO ] [MAIN ] HIG: Loaded 51028 existing records. [2025-10-28T19:13:08.488444] [WARN ] [MAIN ] HIG: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:13:08.488631] [INFO ] [MAIN ] HIG: Wiping existing primary data before full refresh. [2025-10-28T19:13:08.488713] [INFO ] [LOCAL ] HIG: Starting deletion of primary data. [2025-10-28T19:13:08.488967] [DEBUG] [LOCAL ] HIG: Deleted primary data file. [2025-10-28T19:13:08.489008] [INFO ] [MAIN ] HIG: Starting full primary refresh. [2025-10-28T19:13:08.785360] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-03. [2025-10-28T19:13:08.839159] [INFO ] [REMOTE ] HIG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:13:09.118885] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-28T19:13:09.580316] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-01. [2025-10-28T19:13:10.129674] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-28T19:13:10.380303] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-02. [2025-10-28T19:13:10.801097] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-28T19:13:11.180294] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-04. [2025-10-28T19:13:11.406531] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-28T19:13:11.980268] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-02. [2025-10-28T19:13:12.532191] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-28T19:13:12.780263] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-03. [2025-10-28T19:13:13.375533] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-28T19:13:13.580262] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-02. [2025-10-28T19:13:13.715437] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-28T19:13:14.380264] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-05. [2025-10-28T19:13:14.696030] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-28T19:13:15.180323] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-03. [2025-10-28T19:13:15.945798] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-28T19:13:15.980322] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-06. [2025-10-28T19:13:16.502188] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-28T19:13:16.780303] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-04. [2025-10-28T19:13:17.113876] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-28T19:13:17.580238] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-07. [2025-10-28T19:13:17.634576] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-28T19:13:18.380249] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-04. [2025-10-28T19:13:18.961186] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-28T19:13:19.180220] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-03. [2025-10-28T19:13:19.202899] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-28T19:13:19.980247] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-05. [2025-10-28T19:13:20.660703] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-10-28T19:13:20.780296] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-04. [2025-10-28T19:13:21.059889] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-28T19:13:21.580271] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-06. [2025-10-28T19:13:22.225099] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-28T19:13:22.380216] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-05. [2025-10-28T19:13:22.403582] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-28T19:13:23.180354] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-07. [2025-10-28T19:13:23.708449] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-28T19:13:23.980301] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-06. [2025-10-28T19:13:24.222280] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-28T19:13:24.780306] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-08. [2025-10-28T19:13:25.257574] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-28T19:13:25.580245] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-07. [2025-10-28T19:13:25.726623] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-28T19:13:26.380246] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-05. [2025-10-28T19:13:26.875269] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-10-28T19:13:27.180248] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-08. [2025-10-28T19:13:27.712887] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-28T19:13:27.980310] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-08. [2025-10-28T19:13:28.464341] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-28T19:13:28.780298] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-06. [2025-10-28T19:13:29.111232] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-28T19:13:29.580250] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-09. [2025-10-28T19:13:29.845993] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-28T19:13:30.380244] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-09. [2025-10-28T19:13:31.034972] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-28T19:13:31.180237] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-07. [2025-10-28T19:13:31.382987] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-28T19:13:31.980245] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-09. [2025-10-28T19:13:32.283792] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-28T19:13:32.780257] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-10. [2025-10-28T19:13:32.964484] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-28T19:13:33.580239] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-08. [2025-10-28T19:13:33.999051] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-28T19:13:34.007563] [INFO ] [REMOTE ] HGV: Full fetch complete (65872 records). [2025-10-28T19:13:34.007739] [DEBUG] [VALIDATOR ] HGV: Validating primary data. [2025-10-28T19:13:34.387944] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-10. [2025-10-28T19:13:34.391537] [DEBUG] [VALIDATOR ] HGV: All expected trading days are present. [2025-10-28T19:13:34.392443] [DEBUG] [VALIDATOR ] HGV: Primary data validation passed. [2025-10-28T19:13:34.393380] [INFO ] [MAIN ] HGV: Fetched primary data is valid. [2025-10-28T19:13:34.393551] [DEBUG] [LOCAL ] HGV: Saving primary data. [2025-10-28T19:13:34.394828] [DEBUG] [LOCAL ] HGV: Trimmed 65872 records to 45892 (keeping 200 days of data) [2025-10-28T19:13:34.656122] [DEBUG] [LOCAL ] HGV: Primary data saved (45892 records). [2025-10-28T19:13:34.656381] [INFO ] [MAIN ] HGV: Full history saved. [2025-10-28T19:13:34.656607] [INFO ] [MAIN ] Update Progress: 1015/2366 symbols completed. HGV took 36.6s. Estimated remaining: 2h 57m 44s. Rate: 7.6 symbols/min [2025-10-28T19:13:34.801165] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-28T19:13:34.859041] [INFO ] [MAIN ] HII: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:13:34.891613] [DEBUG] [LOCAL ] HII: Loaded 33058 existing records from primary storage. [2025-10-28T19:13:34.891907] [INFO ] [MAIN ] HII: Loaded 33058 existing records. [2025-10-28T19:13:35.070117] [WARN ] [MAIN ] HII: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:13:35.070344] [INFO ] [MAIN ] HII: Wiping existing primary data before full refresh. [2025-10-28T19:13:35.070389] [INFO ] [LOCAL ] HII: Starting deletion of primary data. [2025-10-28T19:13:35.070565] [DEBUG] [LOCAL ] HII: Deleted primary data file. [2025-10-28T19:13:35.070602] [INFO ] [MAIN ] HII: Starting full primary refresh. [2025-10-28T19:13:35.185484] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-10. [2025-10-28T19:13:35.434257] [INFO ] [REMOTE ] HII: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:13:35.639330] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-28T19:13:35.648182] [INFO ] [REMOTE ] HI: Full fetch complete (51730 records). [2025-10-28T19:13:35.648275] [DEBUG] [VALIDATOR ] HI: Validating primary data. [2025-10-28T19:13:35.985317] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-01. [2025-10-28T19:13:36.029912] [DEBUG] [VALIDATOR ] HI: All expected trading days are present. [2025-10-28T19:13:36.029995] [DEBUG] [VALIDATOR ] HI: Primary data validation passed. [2025-10-28T19:13:36.030938] [INFO ] [MAIN ] HI: Fetched primary data is valid. [2025-10-28T19:13:36.031005] [DEBUG] [LOCAL ] HI: Saving primary data. [2025-10-28T19:13:36.032381] [DEBUG] [LOCAL ] HI: Trimmed 51730 records to 36061 (keeping 200 days of data) [2025-10-28T19:13:36.243385] [DEBUG] [LOCAL ] HI: Primary data saved (36061 records). [2025-10-28T19:13:36.243515] [INFO ] [MAIN ] HI: Full history saved. [2025-10-28T19:13:36.243592] [INFO ] [MAIN ] Update Progress: 1016/2366 symbols completed. HI took 29.4s. Estimated remaining: 2h 57m 28s. Rate: 7.6 symbols/min [2025-10-28T19:13:36.412635] [INFO ] [MAIN ] HIMS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:13:36.459713] [DEBUG] [LOCAL ] HIMS: Loaded 53817 existing records from primary storage. [2025-10-28T19:13:36.460083] [INFO ] [MAIN ] HIMS: Loaded 53817 existing records. [2025-10-28T19:13:36.648913] [WARN ] [MAIN ] HIMS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:13:36.649285] [INFO ] [MAIN ] HIMS: Wiping existing primary data before full refresh. [2025-10-28T19:13:36.649398] [INFO ] [LOCAL ] HIMS: Starting deletion of primary data. [2025-10-28T19:13:36.650381] [DEBUG] [LOCAL ] HIMS: Deleted primary data file. [2025-10-28T19:13:36.650441] [INFO ] [MAIN ] HIMS: Starting full primary refresh. [2025-10-28T19:13:36.783803] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-09. [2025-10-28T19:13:36.969514] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-10 (1.78 seconds). [2025-10-28T19:13:37.030445] [INFO ] [REMOTE ] HIG: Full fetch complete (73705 records). [2025-10-28T19:13:37.051006] [DEBUG] [VALIDATOR ] HIG: Validating primary data. [2025-10-28T19:13:37.070967] [INFO ] [REMOTE ] HIMS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:13:37.324203] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-10-28T19:13:37.543840] [DEBUG] [VALIDATOR ] HIG: All expected trading days are present. [2025-10-28T19:13:37.543958] [DEBUG] [VALIDATOR ] HIG: Primary data validation passed. [2025-10-28T19:13:37.545249] [INFO ] [MAIN ] HIG: Fetched primary data is valid. [2025-10-28T19:13:37.545324] [DEBUG] [LOCAL ] HIG: Saving primary data. [2025-10-28T19:13:37.547479] [DEBUG] [LOCAL ] HIG: Trimmed 73705 records to 51022 (keeping 200 days of data) [2025-10-28T19:13:37.605242] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-02. [2025-10-28T19:13:37.903709] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-28T19:13:37.934590] [DEBUG] [LOCAL ] HIG: Primary data saved (51022 records). [2025-10-28T19:13:37.934990] [INFO ] [MAIN ] HIG: Full history saved. [2025-10-28T19:13:37.936494] [INFO ] [MAIN ] Update Progress: 1017/2366 symbols completed. HIG took 29.9s. Estimated remaining: 2h 57m 11s. Rate: 7.6 symbols/min [2025-10-28T19:13:38.117514] [INFO ] [MAIN ] HIO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:13:38.145757] [DEBUG] [LOCAL ] HIO: Loaded 23581 existing records from primary storage. [2025-10-28T19:13:38.146137] [INFO ] [MAIN ] HIO: Loaded 23581 existing records. [2025-10-28T19:13:38.331921] [WARN ] [MAIN ] HIO: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:13:38.332223] [INFO ] [MAIN ] HIO: Wiping existing primary data before full refresh. [2025-10-28T19:13:38.332272] [INFO ] [LOCAL ] HIO: Starting deletion of primary data. [2025-10-28T19:13:38.332538] [DEBUG] [LOCAL ] HIO: Deleted primary data file. [2025-10-28T19:13:38.332580] [INFO ] [MAIN ] HIO: Starting full primary refresh. [2025-10-28T19:13:38.390449] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-10. [2025-10-28T19:13:38.724421] [INFO ] [REMOTE ] HIO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:13:38.800465] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-28T19:13:39.180292] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-01. [2025-10-28T19:13:39.408799] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-28T19:13:39.414485] [INFO ] [REMOTE ] HHH: Full fetch complete (46183 records). [2025-10-28T19:13:39.414569] [DEBUG] [VALIDATOR ] HHH: Validating primary data. [2025-10-28T19:13:39.786120] [DEBUG] [VALIDATOR ] HHH: All expected trading days are present. [2025-10-28T19:13:39.786204] [DEBUG] [VALIDATOR ] HHH: Primary data validation passed. [2025-10-28T19:13:39.786977] [INFO ] [MAIN ] HHH: Fetched primary data is valid. [2025-10-28T19:13:39.787041] [DEBUG] [LOCAL ] HHH: Saving primary data. [2025-10-28T19:13:39.787990] [DEBUG] [LOCAL ] HHH: Trimmed 46183 records to 32707 (keeping 200 days of data) [2025-10-28T19:13:39.977032] [DEBUG] [LOCAL ] HHH: Primary data saved (32707 records). [2025-10-28T19:13:39.977149] [INFO ] [MAIN ] HHH: Full history saved. [2025-10-28T19:13:39.977224] [INFO ] [MAIN ] Update Progress: 1018/2366 symbols completed. HHH took 35.7s. Estimated remaining: 2h 56m 56s. Rate: 7.6 symbols/min [2025-10-28T19:13:39.988345] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-03. [2025-10-28T19:13:40.151805] [INFO ] [MAIN ] HIPO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:13:40.168419] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-28T19:13:40.192455] [DEBUG] [LOCAL ] HIPO: Loaded 21121 existing records from primary storage. [2025-10-28T19:13:40.192704] [INFO ] [MAIN ] HIPO: Loaded 21121 existing records. [2025-10-28T19:13:40.375144] [WARN ] [MAIN ] HIPO: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:13:40.375341] [INFO ] [MAIN ] HIPO: Wiping existing primary data before full refresh. [2025-10-28T19:13:40.375388] [INFO ] [LOCAL ] HIPO: Starting deletion of primary data. [2025-10-28T19:13:40.375543] [DEBUG] [LOCAL ] HIPO: Deleted primary data file. [2025-10-28T19:13:40.375580] [INFO ] [MAIN ] HIPO: Starting full primary refresh. [2025-10-28T19:13:40.719871] [INFO ] [REMOTE ] HIPO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:13:40.780237] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-01. [2025-10-28T19:13:41.313030] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-28T19:13:41.452344] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-28T19:13:41.580218] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-02. [2025-10-28T19:13:42.260783] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-28T19:13:42.380271] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-03. [2025-10-28T19:13:43.115130] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-28T19:13:43.180234] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-02. [2025-10-28T19:13:43.926740] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-28T19:13:43.980222] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-04. [2025-10-28T19:13:44.785169] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-01. [2025-10-28T19:13:44.788863] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-28T19:13:45.580254] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-03. [2025-10-28T19:13:46.380227] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-04. [2025-10-28T19:13:46.562181] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-28T19:13:46.818196] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-10-28T19:13:47.180247] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-04. [2025-10-28T19:13:47.696061] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-28T19:13:47.980246] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-02. [2025-10-28T19:13:48.029696] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-28T19:13:48.780272] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-05. [2025-10-28T19:13:49.580277] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-05. [2025-10-28T19:13:49.696812] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-28T19:13:49.832678] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-10-28T19:13:50.240871] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-28T19:13:50.380222] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-05. [2025-10-28T19:13:51.180295] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-06. [2025-10-28T19:13:51.200270] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-28T19:13:51.899939] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-28T19:13:51.980234] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-07. [2025-10-28T19:13:52.718492] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-28T19:13:52.780212] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-08. [2025-10-28T19:13:53.572115] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-28T19:13:53.580219] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-06. [2025-10-28T19:13:54.380264] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-09. [2025-10-28T19:13:54.574498] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-28T19:13:55.180291] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-06. [2025-10-28T19:13:55.333754] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-28T19:13:55.980229] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-10. [2025-10-28T19:13:56.033070] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-28T19:13:56.780222] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-07. [2025-10-28T19:13:56.962628] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-28T19:13:56.969439] [INFO ] [REMOTE ] HIO: Full fetch complete (38262 records). [2025-10-28T19:13:56.969532] [DEBUG] [VALIDATOR ] HIO: Validating primary data. [2025-10-28T19:13:57.345498] [DEBUG] [VALIDATOR ] HIO: All expected trading days are present. [2025-10-28T19:13:57.345581] [DEBUG] [VALIDATOR ] HIO: Primary data validation passed. [2025-10-28T19:13:57.346370] [INFO ] [MAIN ] HIO: Fetched primary data is valid. [2025-10-28T19:13:57.346438] [DEBUG] [LOCAL ] HIO: Saving primary data. [2025-10-28T19:13:57.347303] [DEBUG] [LOCAL ] HIO: Trimmed 38262 records to 23411 (keeping 200 days of data) [2025-10-28T19:13:57.479638] [DEBUG] [LOCAL ] HIO: Primary data saved (23411 records). [2025-10-28T19:13:57.479783] [INFO ] [MAIN ] HIO: Full history saved. [2025-10-28T19:13:57.479860] [INFO ] [MAIN ] Update Progress: 1019/2366 symbols completed. HIO took 19.5s. Estimated remaining: 2h 57m 1s. Rate: 7.6 symbols/min [2025-10-28T19:13:57.583350] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-03. [2025-10-28T19:13:57.657502] [INFO ] [MAIN ] HIW: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:13:57.695208] [DEBUG] [LOCAL ] HIW: Loaded 44271 existing records from primary storage. [2025-10-28T19:13:57.695488] [INFO ] [MAIN ] HIW: Loaded 44271 existing records. [2025-10-28T19:13:57.893334] [WARN ] [MAIN ] HIW: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:13:57.893745] [INFO ] [MAIN ] HIW: Wiping existing primary data before full refresh. [2025-10-28T19:13:57.893846] [INFO ] [LOCAL ] HIW: Starting deletion of primary data. [2025-10-28T19:13:57.901185] [DEBUG] [LOCAL ] HIW: Deleted primary data file. [2025-10-28T19:13:57.912162] [INFO ] [MAIN ] HIW: Starting full primary refresh. [2025-10-28T19:13:57.918788] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-28T19:13:58.298203] [INFO ] [REMOTE ] HIW: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:13:58.380225] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-08. [2025-10-28T19:13:59.180233] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-01. [2025-10-28T19:13:59.279201] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-28T19:13:59.799214] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-10-28T19:13:59.980258] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-09. [2025-10-28T19:14:00.495994] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-28T19:14:00.780263] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-02. [2025-10-28T19:14:01.028748] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-28T19:14:01.580253] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-04. [2025-10-28T19:14:02.181711] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-28T19:14:02.380259] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-03. [2025-10-28T19:14:03.180256] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-10. [2025-10-28T19:14:03.676368] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-28T19:14:03.861213] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-10-28T19:14:03.980250] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-05. [2025-10-28T19:14:04.420615] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-28T19:14:04.427807] [INFO ] [REMOTE ] HII: Full fetch complete (52184 records). [2025-10-28T19:14:04.427977] [DEBUG] [VALIDATOR ] HII: Validating primary data. [2025-10-28T19:14:04.783440] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-07. [2025-10-28T19:14:04.826278] [DEBUG] [VALIDATOR ] HII: All expected trading days are present. [2025-10-28T19:14:04.826454] [DEBUG] [VALIDATOR ] HII: Primary data validation passed. [2025-10-28T19:14:04.827411] [INFO ] [MAIN ] HII: Fetched primary data is valid. [2025-10-28T19:14:04.827477] [DEBUG] [LOCAL ] HII: Saving primary data. [2025-10-28T19:14:04.828790] [DEBUG] [LOCAL ] HII: Trimmed 52184 records to 32873 (keeping 200 days of data) [2025-10-28T19:14:05.031584] [DEBUG] [LOCAL ] HII: Primary data saved (32873 records). [2025-10-28T19:14:05.031737] [INFO ] [MAIN ] HII: Full history saved. [2025-10-28T19:14:05.032851] [INFO ] [MAIN ] Update Progress: 1020/2366 symbols completed. HII took 30.4s. Estimated remaining: 2h 56m 52s. Rate: 7.6 symbols/min [2025-10-28T19:14:05.197351] [INFO ] [MAIN ] HIX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:14:05.216111] [DEBUG] [LOCAL ] HIX: Loaded 20160 existing records from primary storage. [2025-10-28T19:14:05.216365] [INFO ] [MAIN ] HIX: Loaded 20160 existing records. [2025-10-28T19:14:05.393756] [WARN ] [MAIN ] HIX: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:14:05.393989] [INFO ] [MAIN ] HIX: Wiping existing primary data before full refresh. [2025-10-28T19:14:05.394036] [INFO ] [LOCAL ] HIX: Starting deletion of primary data. [2025-10-28T19:14:05.394502] [DEBUG] [LOCAL ] HIX: Deleted primary data file. [2025-10-28T19:14:05.394559] [INFO ] [MAIN ] HIX: Starting full primary refresh. [2025-10-28T19:14:05.589815] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-04. [2025-10-28T19:14:05.772514] [INFO ] [REMOTE ] HIX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:14:05.768926] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-10-28T19:14:06.278134] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-05 (2.30 seconds). [2025-10-28T19:14:06.380239] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-06. [2025-10-28T19:14:06.878793] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-28T19:14:07.180250] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-01. [2025-10-28T19:14:07.980269] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-05. [2025-10-28T19:14:08.050549] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-28T19:14:08.609314] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-06 (2.23 seconds). [2025-10-28T19:14:08.780237] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-07. [2025-10-28T19:14:09.223232] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-28T19:14:09.580276] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-06. [2025-10-28T19:14:10.380323] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-02. [2025-10-28T19:14:10.674080] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-28T19:14:11.005392] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-28T19:14:11.102787] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-07 (2.32 seconds). [2025-10-28T19:14:11.180233] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-03. [2025-10-28T19:14:11.912316] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-28T19:14:11.980249] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-04. [2025-10-28T19:14:12.770472] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-10-28T19:14:12.780208] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-05. [2025-10-28T19:14:13.525167] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-10-28T19:14:13.580254] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-07. [2025-10-28T19:14:14.380316] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-08. [2025-10-28T19:14:14.708173] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-28T19:14:15.180316] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-08. [2025-10-28T19:14:15.980271] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-06. [2025-10-28T19:14:16.407203] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-10-28T19:14:16.445228] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-28T19:14:16.700729] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-28T19:14:16.780253] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-09. [2025-10-28T19:14:17.580307] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-08. [2025-10-28T19:14:18.305179] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-10-28T19:14:18.380279] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-09. [2025-10-28T19:14:18.920491] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-10-28T19:14:19.180303] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-10. [2025-10-28T19:14:19.567684] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-28T19:14:19.980290] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-09. [2025-10-28T19:14:20.646868] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-10-28T19:14:20.780217] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-07. [2025-10-28T19:14:21.536758] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-10 (2.36 seconds). [2025-10-28T19:14:21.555889] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-28T19:14:21.562271] [INFO ] [REMOTE ] HIMS: Full fetch complete (77996 records). [2025-10-28T19:14:21.563097] [DEBUG] [VALIDATOR ] HIMS: Validating primary data. [2025-10-28T19:14:21.586395] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-10. [2025-10-28T19:14:21.973827] [DEBUG] [VALIDATOR ] HIMS: All expected trading days are present. [2025-10-28T19:14:21.973912] [DEBUG] [VALIDATOR ] HIMS: Primary data validation passed. [2025-10-28T19:14:21.974923] [INFO ] [MAIN ] HIMS: Fetched primary data is valid. [2025-10-28T19:14:21.974986] [DEBUG] [LOCAL ] HIMS: Saving primary data. [2025-10-28T19:14:21.976514] [DEBUG] [LOCAL ] HIMS: Trimmed 77996 records to 53817 (keeping 200 days of data) [2025-10-28T19:14:22.286880] [DEBUG] [LOCAL ] HIMS: Primary data saved (53817 records). [2025-10-28T19:14:22.287012] [INFO ] [MAIN ] HIMS: Full history saved. [2025-10-28T19:14:22.287096] [INFO ] [MAIN ] Update Progress: 1021/2366 symbols completed. HIMS took 46.0s. Estimated remaining: 2h 56m 57s. Rate: 7.6 symbols/min [2025-10-28T19:14:22.385388] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-08. [2025-10-28T19:14:22.470189] [INFO ] [MAIN ] HKD: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:14:22.481637] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-28T19:14:22.485634] [INFO ] [REMOTE ] HIPO: Full fetch complete (30844 records). [2025-10-28T19:14:22.485815] [DEBUG] [VALIDATOR ] HIPO: Validating primary data. [2025-10-28T19:14:22.618989] [DEBUG] [LOCAL ] HKD: Loaded 18741 existing records from primary storage. [2025-10-28T19:14:22.634786] [INFO ] [MAIN ] HKD: Loaded 18741 existing records. [2025-10-28T19:14:23.006552] [WARN ] [MAIN ] HKD: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:14:23.012631] [INFO ] [MAIN ] HKD: Wiping existing primary data before full refresh. [2025-10-28T19:14:23.018013] [INFO ] [LOCAL ] HKD: Starting deletion of primary data. [2025-10-28T19:14:23.046393] [DEBUG] [LOCAL ] HKD: Deleted primary data file. [2025-10-28T19:14:23.056346] [INFO ] [MAIN ] HKD: Starting full primary refresh. [2025-10-28T19:14:23.151984] [DEBUG] [VALIDATOR ] HIPO: All expected trading days are present. [2025-10-28T19:14:23.183492] [DEBUG] [VALIDATOR ] HIPO: Primary data validation passed. [2025-10-28T19:14:23.189504] [INFO ] [MAIN ] HIPO: Fetched primary data is valid. [2025-10-28T19:14:23.189848] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-10. [2025-10-28T19:14:23.190120] [DEBUG] [LOCAL ] HIPO: Saving primary data. [2025-10-28T19:14:23.268805] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-28T19:14:23.276970] [DEBUG] [LOCAL ] HIPO: Trimmed 30844 records to 21001 (keeping 200 days of data) [2025-10-28T19:14:23.560732] [DEBUG] [LOCAL ] HIPO: Primary data saved (21001 records). [2025-10-28T19:14:23.571117] [INFO ] [MAIN ] HIPO: Full history saved. [2025-10-28T19:14:23.576374] [INFO ] [MAIN ] Update Progress: 1022/2366 symbols completed. HIPO took 43.6s. Estimated remaining: 2h 56m 40s. Rate: 7.6 symbols/min [2025-10-28T19:14:23.762879] [INFO ] [REMOTE ] HKD: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:14:23.834342] [INFO ] [MAIN ] HL: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:14:23.885108] [DEBUG] [LOCAL ] HL: Loaded 53676 existing records from primary storage. [2025-10-28T19:14:23.885497] [INFO ] [MAIN ] HL: Loaded 53676 existing records. [2025-10-28T19:14:23.985359] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-01. [2025-10-28T19:14:24.105054] [WARN ] [MAIN ] HL: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:14:24.105244] [INFO ] [MAIN ] HL: Wiping existing primary data before full refresh. [2025-10-28T19:14:24.105292] [INFO ] [LOCAL ] HL: Starting deletion of primary data. [2025-10-28T19:14:24.105513] [DEBUG] [LOCAL ] HL: Deleted primary data file. [2025-10-28T19:14:24.105572] [INFO ] [MAIN ] HL: Starting full primary refresh. [2025-10-28T19:14:24.472055] [INFO ] [REMOTE ] HL: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:14:24.499412] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-10 (1.31 seconds). [2025-10-28T19:14:24.508821] [INFO ] [REMOTE ] HIW: Full fetch complete (64940 records). [2025-10-28T19:14:24.508932] [DEBUG] [VALIDATOR ] HIW: Validating primary data. [2025-10-28T19:14:24.780750] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-09. [2025-10-28T19:14:24.942116] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-28T19:14:24.964634] [DEBUG] [VALIDATOR ] HIW: All expected trading days are present. [2025-10-28T19:14:24.964754] [DEBUG] [VALIDATOR ] HIW: Primary data validation passed. [2025-10-28T19:14:24.965899] [INFO ] [MAIN ] HIW: Fetched primary data is valid. [2025-10-28T19:14:24.965961] [DEBUG] [LOCAL ] HIW: Saving primary data. [2025-10-28T19:14:24.967328] [DEBUG] [LOCAL ] HIW: Trimmed 64940 records to 44259 (keeping 200 days of data) [2025-10-28T19:14:25.249503] [DEBUG] [LOCAL ] HIW: Primary data saved (44259 records). [2025-10-28T19:14:25.249628] [INFO ] [MAIN ] HIW: Full history saved. [2025-10-28T19:14:25.249742] [INFO ] [MAIN ] Update Progress: 1023/2366 symbols completed. HIW took 27.8s. Estimated remaining: 2h 56m 24s. Rate: 7.6 symbols/min [2025-10-28T19:14:25.448887] [INFO ] [MAIN ] HLF: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:14:25.492988] [DEBUG] [LOCAL ] HLF: Loaded 48241 existing records from primary storage. [2025-10-28T19:14:25.493283] [INFO ] [MAIN ] HLF: Loaded 48241 existing records. [2025-10-28T19:14:25.582451] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-01. [2025-10-28T19:14:25.658757] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-28T19:14:25.703314] [WARN ] [MAIN ] HLF: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:14:25.703515] [INFO ] [MAIN ] HLF: Wiping existing primary data before full refresh. [2025-10-28T19:14:25.703561] [INFO ] [LOCAL ] HLF: Starting deletion of primary data. [2025-10-28T19:14:25.703885] [DEBUG] [LOCAL ] HLF: Deleted primary data file. [2025-10-28T19:14:25.703942] [INFO ] [MAIN ] HLF: Starting full primary refresh. [2025-10-28T19:14:26.053479] [INFO ] [REMOTE ] HLF: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:14:26.380490] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-01. [2025-10-28T19:14:27.088225] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-28T19:14:27.180261] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-02. [2025-10-28T19:14:27.615937] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-28T19:14:27.980292] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-02. [2025-10-28T19:14:28.615793] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-28T19:14:28.780252] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-03. [2025-10-28T19:14:29.175272] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-28T19:14:29.580318] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-02. [2025-10-28T19:14:30.085627] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-28T19:14:30.380223] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-10. [2025-10-28T19:14:30.416268] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-28T19:14:31.180282] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-03. [2025-10-28T19:14:31.266731] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-28T19:14:31.271072] [INFO ] [REMOTE ] HIX: Full fetch complete (30059 records). [2025-10-28T19:14:31.271157] [DEBUG] [VALIDATOR ] HIX: Validating primary data. [2025-10-28T19:14:31.680843] [DEBUG] [VALIDATOR ] HIX: All expected trading days are present. [2025-10-28T19:14:31.680917] [DEBUG] [VALIDATOR ] HIX: Primary data validation passed. [2025-10-28T19:14:31.681517] [INFO ] [MAIN ] HIX: Fetched primary data is valid. [2025-10-28T19:14:31.681576] [DEBUG] [LOCAL ] HIX: Saving primary data. [2025-10-28T19:14:31.682311] [DEBUG] [LOCAL ] HIX: Trimmed 30059 records to 20042 (keeping 200 days of data) [2025-10-28T19:14:31.796185] [DEBUG] [LOCAL ] HIX: Primary data saved (20042 records). [2025-10-28T19:14:31.796325] [INFO ] [MAIN ] HIX: Full history saved. [2025-10-28T19:14:31.796608] [INFO ] [MAIN ] Update Progress: 1024/2366 symbols completed. HIX took 26.8s. Estimated remaining: 2h 56m 15s. Rate: 7.6 symbols/min [2025-10-28T19:14:31.938793] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-28T19:14:31.985298] [INFO ] [MAIN ] HLI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:14:31.984482] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-03. [2025-10-28T19:14:32.016681] [DEBUG] [LOCAL ] HLI: Loaded 30327 existing records from primary storage. [2025-10-28T19:14:32.016927] [INFO ] [MAIN ] HLI: Loaded 30327 existing records. [2025-10-28T19:14:32.191368] [WARN ] [MAIN ] HLI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:14:32.191563] [INFO ] [MAIN ] HLI: Wiping existing primary data before full refresh. [2025-10-28T19:14:32.191611] [INFO ] [LOCAL ] HLI: Starting deletion of primary data. [2025-10-28T19:14:32.191997] [DEBUG] [LOCAL ] HLI: Deleted primary data file. [2025-10-28T19:14:32.192055] [INFO ] [MAIN ] HLI: Starting full primary refresh. [2025-10-28T19:14:32.539676] [INFO ] [REMOTE ] HLI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:14:32.780262] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-04. [2025-10-28T19:14:33.247073] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-28T19:14:33.580286] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-04. [2025-10-28T19:14:34.316517] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-28T19:14:34.380265] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-04. [2025-10-28T19:14:34.907858] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-28T19:14:35.113285] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-28T19:14:35.180298] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-05. [2025-10-28T19:14:35.980243] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-01. [2025-10-28T19:14:36.532808] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-28T19:14:36.780253] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-06. [2025-10-28T19:14:37.020168] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-28T19:14:37.580304] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-05. [2025-10-28T19:14:38.168013] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-10-28T19:14:38.380278] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-07. [2025-10-28T19:14:39.104317] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-10-28T19:14:39.180222] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-06. [2025-10-28T19:14:39.647683] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-28T19:14:39.980309] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-08. [2025-10-28T19:14:40.780228] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-05. [2025-10-28T19:14:40.828079] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-28T19:14:41.101941] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-28T19:14:41.280590] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-28T19:14:41.580311] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-07. [2025-10-28T19:14:42.380250] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-02. [2025-10-28T19:14:43.141006] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-10-28T19:14:43.180215] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-08. [2025-10-28T19:14:43.255402] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-28T19:14:43.980250] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-06. [2025-10-28T19:14:44.780282] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-09. [2025-10-28T19:14:44.908803] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-10-28T19:14:44.937523] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-28T19:14:45.580252] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-07. [2025-10-28T19:14:45.833843] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-28T19:14:46.385325] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-10. [2025-10-28T19:14:46.393748] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-28T19:14:47.180247] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-08. [2025-10-28T19:14:47.711023] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-28T19:14:47.720345] [INFO ] [REMOTE ] HLF: Full fetch complete (70654 records). [2025-10-28T19:14:47.720463] [DEBUG] [VALIDATOR ] HLF: Validating primary data. [2025-10-28T19:14:47.911755] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-10-28T19:14:47.985364] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-09. [2025-10-28T19:14:48.125270] [DEBUG] [VALIDATOR ] HLF: All expected trading days are present. [2025-10-28T19:14:48.125344] [DEBUG] [VALIDATOR ] HLF: Primary data validation passed. [2025-10-28T19:14:48.126339] [INFO ] [MAIN ] HLF: Fetched primary data is valid. [2025-10-28T19:14:48.126408] [DEBUG] [LOCAL ] HLF: Saving primary data. [2025-10-28T19:14:48.127845] [DEBUG] [LOCAL ] HLF: Trimmed 70654 records to 48171 (keeping 200 days of data) [2025-10-28T19:14:48.389346] [DEBUG] [LOCAL ] HLF: Primary data saved (48171 records). [2025-10-28T19:14:48.389462] [INFO ] [MAIN ] HLF: Full history saved. [2025-10-28T19:14:48.390208] [INFO ] [MAIN ] Update Progress: 1025/2366 symbols completed. HLF took 23.1s. Estimated remaining: 2h 56m 18s. Rate: 7.6 symbols/min [2025-10-28T19:14:48.554525] [INFO ] [MAIN ] HLIO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:14:48.584320] [DEBUG] [LOCAL ] HLIO: Loaded 27820 existing records from primary storage. [2025-10-28T19:14:48.584559] [INFO ] [MAIN ] HLIO: Loaded 27820 existing records. [2025-10-28T19:14:48.776714] [WARN ] [MAIN ] HLIO: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:14:48.776915] [INFO ] [MAIN ] HLIO: Wiping existing primary data before full refresh. [2025-10-28T19:14:48.776959] [INFO ] [LOCAL ] HLIO: Starting deletion of primary data. [2025-10-28T19:14:48.777136] [DEBUG] [LOCAL ] HLIO: Deleted primary data file. [2025-10-28T19:14:48.777173] [INFO ] [MAIN ] HLIO: Starting full primary refresh. [2025-10-28T19:14:48.788236] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-03. [2025-10-28T19:14:49.125793] [INFO ] [REMOTE ] HLIO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:14:49.580272] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-01. [2025-10-28T19:14:49.831534] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-28T19:14:49.970588] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-10-28T19:14:50.265947] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-28T19:14:50.380265] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-02. [2025-10-28T19:14:51.041848] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-28T19:14:51.180247] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-03. [2025-10-28T19:14:51.938119] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-28T19:14:51.980211] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-04. [2025-10-28T19:14:52.780220] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-04. [2025-10-28T19:14:52.831887] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-28T19:14:53.580219] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-09. [2025-10-28T19:14:53.765233] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-28T19:14:54.380247] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-05. [2025-10-28T19:14:54.454790] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-10-28T19:14:55.180315] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-05. [2025-10-28T19:14:55.312861] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-28T19:14:55.980226] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-06. [2025-10-28T19:14:56.030393] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-28T19:14:56.780224] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-06. [2025-10-28T19:14:56.851615] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-28T19:14:57.417969] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-28T19:14:57.580263] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-10. [2025-10-28T19:14:58.380263] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-07. [2025-10-28T19:14:59.180268] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-07. [2025-10-28T19:14:59.632043] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-28T19:14:59.678993] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-10 (2.10 seconds). [2025-10-28T19:14:59.689806] [INFO ] [REMOTE ] HL: Full fetch complete (77827 records). [2025-10-28T19:14:59.689939] [DEBUG] [VALIDATOR ] HL: Validating primary data. [2025-10-28T19:14:59.985449] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-10. [2025-10-28T19:15:00.091282] [DEBUG] [VALIDATOR ] HL: All expected trading days are present. [2025-10-28T19:15:00.091415] [DEBUG] [VALIDATOR ] HL: Primary data validation passed. [2025-10-28T19:15:00.092472] [INFO ] [MAIN ] HL: Fetched primary data is valid. [2025-10-28T19:15:00.092586] [DEBUG] [LOCAL ] HL: Saving primary data. [2025-10-28T19:15:00.094330] [DEBUG] [LOCAL ] HL: Trimmed 77827 records to 53676 (keeping 200 days of data) [2025-10-28T19:15:00.226195] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-28T19:15:00.428772] [DEBUG] [LOCAL ] HL: Primary data saved (53676 records). [2025-10-28T19:15:00.428893] [INFO ] [MAIN ] HL: Full history saved. [2025-10-28T19:15:00.428970] [INFO ] [MAIN ] Update Progress: 1026/2366 symbols completed. HL took 36.8s. Estimated remaining: 2h 56m 16s. Rate: 7.6 symbols/min [2025-10-28T19:15:00.596302] [INFO ] [MAIN ] HLLY: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:15:00.626576] [DEBUG] [LOCAL ] HLLY: Loaded 33098 existing records from primary storage. [2025-10-28T19:15:00.626862] [INFO ] [MAIN ] HLLY: Loaded 33098 existing records. [2025-10-28T19:15:00.791376] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-08. [2025-10-28T19:15:00.804400] [WARN ] [MAIN ] HLLY: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:15:00.805310] [INFO ] [MAIN ] HLLY: Wiping existing primary data before full refresh. [2025-10-28T19:15:00.805363] [INFO ] [LOCAL ] HLLY: Starting deletion of primary data. [2025-10-28T19:15:00.805715] [DEBUG] [LOCAL ] HLLY: Deleted primary data file. [2025-10-28T19:15:00.805772] [INFO ] [MAIN ] HLLY: Starting full primary refresh. [2025-10-28T19:15:01.167666] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-28T19:15:01.203509] [INFO ] [REMOTE ] HLLY: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:15:01.203729] [INFO ] [REMOTE ] HKD: Full fetch complete (27718 records). [2025-10-28T19:15:01.204260] [DEBUG] [VALIDATOR ] HKD: Validating primary data. [2025-10-28T19:15:01.570302] [DEBUG] [VALIDATOR ] HKD: All expected trading days are present. [2025-10-28T19:15:01.570386] [DEBUG] [VALIDATOR ] HKD: Primary data validation passed. [2025-10-28T19:15:01.570998] [INFO ] [MAIN ] HKD: Fetched primary data is valid. [2025-10-28T19:15:01.571059] [DEBUG] [LOCAL ] HKD: Saving primary data. [2025-10-28T19:15:01.571940] [DEBUG] [LOCAL ] HKD: Trimmed 27718 records to 18680 (keeping 200 days of data) [2025-10-28T19:15:01.613057] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-08. [2025-10-28T19:15:01.681252] [DEBUG] [LOCAL ] HKD: Primary data saved (18680 records). [2025-10-28T19:15:01.681388] [INFO ] [MAIN ] HKD: Full history saved. [2025-10-28T19:15:01.681468] [INFO ] [MAIN ] Update Progress: 1027/2366 symbols completed. HKD took 39.4s. Estimated remaining: 2h 55m 59s. Rate: 7.6 symbols/min [2025-10-28T19:15:01.859362] [INFO ] [MAIN ] HLN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:15:01.909850] [DEBUG] [LOCAL ] HLN: Loaded 53110 existing records from primary storage. [2025-10-28T19:15:01.910218] [INFO ] [MAIN ] HLN: Loaded 53110 existing records. [2025-10-28T19:15:02.119400] [WARN ] [MAIN ] HLN: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:15:02.119750] [INFO ] [MAIN ] HLN: Wiping existing primary data before full refresh. [2025-10-28T19:15:02.119883] [INFO ] [LOCAL ] HLN: Starting deletion of primary data. [2025-10-28T19:15:02.120157] [DEBUG] [LOCAL ] HLN: Deleted primary data file. [2025-10-28T19:15:02.120213] [INFO ] [MAIN ] HLN: Starting full primary refresh. [2025-10-28T19:15:02.380878] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-01. [2025-10-28T19:15:02.555174] [INFO ] [REMOTE ] HLN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:15:02.570825] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-10-28T19:15:02.607282] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-28T19:15:03.180221] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-01. [2025-10-28T19:15:03.287996] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-28T19:15:03.980259] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-02. [2025-10-28T19:15:04.337078] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-28T19:15:04.780241] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-02. [2025-10-28T19:15:04.834598] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-10-28T19:15:05.580241] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-09. [2025-10-28T19:15:06.083721] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-10-28T19:15:06.380208] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-03. [2025-10-28T19:15:06.586109] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-28T19:15:07.180271] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-10. [2025-10-28T19:15:07.792346] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-10-28T19:15:07.980263] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-04. [2025-10-28T19:15:08.243060] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-28T19:15:08.249760] [INFO ] [REMOTE ] HLI: Full fetch complete (45425 records). [2025-10-28T19:15:08.249894] [DEBUG] [VALIDATOR ] HLI: Validating primary data. [2025-10-28T19:15:08.704970] [DEBUG] [VALIDATOR ] HLI: All expected trading days are present. [2025-10-28T19:15:08.705096] [DEBUG] [VALIDATOR ] HLI: Primary data validation passed. [2025-10-28T19:15:08.706070] [INFO ] [MAIN ] HLI: Fetched primary data is valid. [2025-10-28T19:15:08.706147] [DEBUG] [LOCAL ] HLI: Saving primary data. [2025-10-28T19:15:08.707350] [DEBUG] [LOCAL ] HLI: Trimmed 45425 records to 30307 (keeping 200 days of data) [2025-10-28T19:15:08.803357] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-09. [2025-10-28T19:15:08.905290] [DEBUG] [LOCAL ] HLI: Primary data saved (30307 records). [2025-10-28T19:15:08.905412] [INFO ] [MAIN ] HLI: Full history saved. [2025-10-28T19:15:08.905484] [INFO ] [MAIN ] Update Progress: 1028/2366 symbols completed. HLI took 37.1s. Estimated remaining: 2h 55m 50s. Rate: 7.6 symbols/min [2025-10-28T19:15:09.082709] [INFO ] [MAIN ] HLT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:15:09.128724] [DEBUG] [LOCAL ] HLT: Loaded 50413 existing records from primary storage. [2025-10-28T19:15:09.129070] [INFO ] [MAIN ] HLT: Loaded 50413 existing records. [2025-10-28T19:15:09.324169] [WARN ] [MAIN ] HLT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:15:09.324432] [INFO ] [MAIN ] HLT: Wiping existing primary data before full refresh. [2025-10-28T19:15:09.324550] [INFO ] [LOCAL ] HLT: Starting deletion of primary data. [2025-10-28T19:15:09.325373] [DEBUG] [LOCAL ] HLT: Deleted primary data file. [2025-10-28T19:15:09.325478] [INFO ] [MAIN ] HLT: Starting full primary refresh. [2025-10-28T19:15:09.548220] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-10-28T19:15:09.587987] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-03. [2025-10-28T19:15:09.769373] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-10-28T19:15:09.768730] [INFO ] [REMOTE ] HLT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:15:10.380221] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-01. [2025-10-28T19:15:10.547466] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-10-28T19:15:11.180252] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-05. [2025-10-28T19:15:11.671212] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-28T19:15:11.980321] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-10. [2025-10-28T19:15:12.533707] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-28T19:15:12.780265] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-06. [2025-10-28T19:15:12.928243] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-28T19:15:12.933758] [INFO ] [REMOTE ] HLIO: Full fetch complete (37276 records). [2025-10-28T19:15:12.933877] [DEBUG] [VALIDATOR ] HLIO: Validating primary data. [2025-10-28T19:15:13.300143] [DEBUG] [VALIDATOR ] HLIO: All expected trading days are present. [2025-10-28T19:15:13.300218] [DEBUG] [VALIDATOR ] HLIO: Primary data validation passed. [2025-10-28T19:15:13.300905] [INFO ] [MAIN ] HLIO: Fetched primary data is valid. [2025-10-28T19:15:13.300965] [DEBUG] [LOCAL ] HLIO: Saving primary data. [2025-10-28T19:15:13.301873] [DEBUG] [LOCAL ] HLIO: Trimmed 37276 records to 27808 (keeping 200 days of data) [2025-10-28T19:15:13.469382] [DEBUG] [LOCAL ] HLIO: Primary data saved (27808 records). [2025-10-28T19:15:13.469549] [INFO ] [MAIN ] HLIO: Full history saved. [2025-10-28T19:15:13.469665] [INFO ] [MAIN ] Update Progress: 1029/2366 symbols completed. HLIO took 25.1s. Estimated remaining: 2h 55m 38s. Rate: 7.6 symbols/min [2025-10-28T19:15:13.585343] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-04. [2025-10-28T19:15:13.638414] [INFO ] [MAIN ] HLX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:15:13.680398] [DEBUG] [LOCAL ] HLX: Loaded 47244 existing records from primary storage. [2025-10-28T19:15:13.680776] [INFO ] [MAIN ] HLX: Loaded 47244 existing records. [2025-10-28T19:15:13.855884] [WARN ] [MAIN ] HLX: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:15:13.856208] [INFO ] [MAIN ] HLX: Wiping existing primary data before full refresh. [2025-10-28T19:15:13.856370] [INFO ] [LOCAL ] HLX: Starting deletion of primary data. [2025-10-28T19:15:13.856935] [DEBUG] [LOCAL ] HLX: Deleted primary data file. [2025-10-28T19:15:13.857011] [INFO ] [MAIN ] HLX: Starting full primary refresh. [2025-10-28T19:15:14.221522] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-28T19:15:14.254232] [INFO ] [REMOTE ] HLX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:15:14.380257] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-01. [2025-10-28T19:15:14.657041] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-28T19:15:15.180256] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-02. [2025-10-28T19:15:15.686521] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-28T19:15:15.980256] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-02. [2025-10-28T19:15:16.688495] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-10-28T19:15:16.780248] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-03. [2025-10-28T19:15:17.152053] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-28T19:15:17.580267] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-05. [2025-10-28T19:15:18.323152] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-10-28T19:15:18.389075] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-03. [2025-10-28T19:15:18.394574] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-28T19:15:19.180294] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-04. [2025-10-28T19:15:19.710888] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-28T19:15:19.980253] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-07. [2025-10-28T19:15:20.533764] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-10-28T19:15:20.780249] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-04. [2025-10-28T19:15:21.496799] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-10-28T19:15:21.580266] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-08. [2025-10-28T19:15:22.098522] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-10-28T19:15:22.380252] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-05. [2025-10-28T19:15:23.130425] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-10-28T19:15:23.180297] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-05. [2025-10-28T19:15:23.647429] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-28T19:15:23.980271] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-06. [2025-10-28T19:15:24.532731] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-28T19:15:24.780295] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-06. [2025-10-28T19:15:25.024400] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-28T19:15:25.510836] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-28T19:15:25.580267] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-06. [2025-10-28T19:15:26.380332] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-07. [2025-10-28T19:15:26.752244] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-28T19:15:27.159274] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-28T19:15:27.180230] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-07. [2025-10-28T19:15:27.980266] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-08. [2025-10-28T19:15:28.521490] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-28T19:15:28.780263] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-08. [2025-10-28T19:15:28.955470] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-28T19:15:29.580263] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-07. [2025-10-28T19:15:30.108394] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-28T19:15:30.380244] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-09. [2025-10-28T19:15:30.944921] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-28T19:15:31.180269] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-09. [2025-10-28T19:15:31.650427] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-28T19:15:31.980230] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-10. [2025-10-28T19:15:32.167756] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-28T19:15:32.780363] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-08. [2025-10-28T19:15:33.396237] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-28T19:15:33.406899] [INFO ] [REMOTE ] HLN: Full fetch complete (77021 records). [2025-10-28T19:15:33.407031] [DEBUG] [VALIDATOR ] HLN: Validating primary data. [2025-10-28T19:15:33.580832] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-09. [2025-10-28T19:15:33.804750] [DEBUG] [VALIDATOR ] HLN: All expected trading days are present. [2025-10-28T19:15:33.804843] [DEBUG] [VALIDATOR ] HLN: Primary data validation passed. [2025-10-28T19:15:33.806043] [INFO ] [MAIN ] HLN: Fetched primary data is valid. [2025-10-28T19:15:33.806117] [DEBUG] [LOCAL ] HLN: Saving primary data. [2025-10-28T19:15:33.807695] [DEBUG] [LOCAL ] HLN: Trimmed 77021 records to 53097 (keeping 200 days of data) [2025-10-28T19:15:34.135878] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-10-28T19:15:34.164934] [DEBUG] [LOCAL ] HLN: Primary data saved (53097 records). [2025-10-28T19:15:34.165055] [INFO ] [MAIN ] HLN: Full history saved. [2025-10-28T19:15:34.165145] [INFO ] [MAIN ] Update Progress: 1030/2366 symbols completed. HLN took 32.5s. Estimated remaining: 2h 55m 47s. Rate: 7.6 symbols/min [2025-10-28T19:15:34.334922] [INFO ] [MAIN ] HMC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:15:34.374966] [DEBUG] [LOCAL ] HMC: Loaded 46041 existing records from primary storage. [2025-10-28T19:15:34.375273] [INFO ] [MAIN ] HMC: Loaded 46041 existing records. [2025-10-28T19:15:34.386220] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-09. [2025-10-28T19:15:34.554312] [WARN ] [MAIN ] HMC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:15:34.554530] [INFO ] [MAIN ] HMC: Wiping existing primary data before full refresh. [2025-10-28T19:15:34.554603] [INFO ] [LOCAL ] HMC: Starting deletion of primary data. [2025-10-28T19:15:34.554994] [DEBUG] [LOCAL ] HMC: Deleted primary data file. [2025-10-28T19:15:34.555051] [INFO ] [MAIN ] HMC: Starting full primary refresh. [2025-10-28T19:15:34.921419] [INFO ] [REMOTE ] HMC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:15:34.970096] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-28T19:15:35.180310] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-10. [2025-10-28T19:15:35.759356] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-28T19:15:35.980239] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-10. [2025-10-28T19:15:36.176641] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-28T19:15:36.183323] [INFO ] [REMOTE ] HLLY: Full fetch complete (46052 records). [2025-10-28T19:15:36.183425] [DEBUG] [VALIDATOR ] HLLY: Validating primary data. [2025-10-28T19:15:36.575093] [DEBUG] [VALIDATOR ] HLLY: All expected trading days are present. [2025-10-28T19:15:36.575180] [DEBUG] [VALIDATOR ] HLLY: Primary data validation passed. [2025-10-28T19:15:36.575952] [INFO ] [MAIN ] HLLY: Fetched primary data is valid. [2025-10-28T19:15:36.576014] [DEBUG] [LOCAL ] HLLY: Saving primary data. [2025-10-28T19:15:36.577100] [DEBUG] [LOCAL ] HLLY: Trimmed 46052 records to 33119 (keeping 200 days of data) [2025-10-28T19:15:36.755822] [DEBUG] [LOCAL ] HLLY: Primary data saved (33119 records). [2025-10-28T19:15:36.755946] [INFO ] [MAIN ] HLLY: Full history saved. [2025-10-28T19:15:36.756065] [INFO ] [MAIN ] Update Progress: 1031/2366 symbols completed. HLLY took 36.3s. Estimated remaining: 2h 55m 32s. Rate: 7.6 symbols/min [2025-10-28T19:15:36.789175] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-10. [2025-10-28T19:15:36.938754] [INFO ] [MAIN ] HMN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:15:36.960896] [DEBUG] [LOCAL ] HMN: Loaded 22910 existing records from primary storage. [2025-10-28T19:15:36.961154] [INFO ] [MAIN ] HMN: Loaded 22910 existing records. [2025-10-28T19:15:37.144797] [WARN ] [MAIN ] HMN: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:15:37.144987] [INFO ] [MAIN ] HMN: Wiping existing primary data before full refresh. [2025-10-28T19:15:37.145034] [INFO ] [LOCAL ] HMN: Starting deletion of primary data. [2025-10-28T19:15:37.145349] [DEBUG] [LOCAL ] HMN: Deleted primary data file. [2025-10-28T19:15:37.145406] [INFO ] [MAIN ] HMN: Starting full primary refresh. [2025-10-28T19:15:37.539422] [INFO ] [REMOTE ] HMN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:15:37.568126] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-28T19:15:37.578689] [INFO ] [REMOTE ] HLT: Full fetch complete (73643 records). [2025-10-28T19:15:37.578837] [DEBUG] [VALIDATOR ] HLT: Validating primary data. [2025-10-28T19:15:37.591262] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-01. [2025-10-28T19:15:37.982102] [DEBUG] [VALIDATOR ] HLT: All expected trading days are present. [2025-10-28T19:15:37.982181] [DEBUG] [VALIDATOR ] HLT: Primary data validation passed. [2025-10-28T19:15:37.983195] [INFO ] [MAIN ] HLT: Fetched primary data is valid. [2025-10-28T19:15:37.983255] [DEBUG] [LOCAL ] HLT: Saving primary data. [2025-10-28T19:15:37.984638] [DEBUG] [LOCAL ] HLT: Trimmed 73643 records to 50372 (keeping 200 days of data) [2025-10-28T19:15:38.327044] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-28T19:15:38.330676] [DEBUG] [LOCAL ] HLT: Primary data saved (50372 records). [2025-10-28T19:15:38.339967] [INFO ] [MAIN ] HLT: Full history saved. [2025-10-28T19:15:38.340995] [INFO ] [MAIN ] Update Progress: 1032/2366 symbols completed. HLT took 29.4s. Estimated remaining: 2h 55m 16s. Rate: 7.6 symbols/min [2025-10-28T19:15:38.352619] [INFO ] [REMOTE ] HLX: Full fetch complete (69004 records). [2025-10-28T19:15:38.384877] [DEBUG] [VALIDATOR ] HLX: Validating primary data. [2025-10-28T19:15:38.384633] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-01. [2025-10-28T19:15:38.650529] [INFO ] [MAIN ] HMY: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:15:38.975940] [DEBUG] [VALIDATOR ] HLX: All expected trading days are present. [2025-10-28T19:15:38.976381] [DEBUG] [VALIDATOR ] HLX: Primary data validation passed. [2025-10-28T19:15:38.996727] [INFO ] [MAIN ] HLX: Fetched primary data is valid. [2025-10-28T19:15:38.998408] [DEBUG] [LOCAL ] HMY: Loaded 53166 existing records from primary storage. [2025-10-28T19:15:38.998806] [DEBUG] [LOCAL ] HLX: Saving primary data. [2025-10-28T19:15:38.999161] [INFO ] [MAIN ] HMY: Loaded 53166 existing records. [2025-10-28T19:15:39.075843] [DEBUG] [LOCAL ] HLX: Trimmed 69004 records to 47235 (keeping 200 days of data) [2025-10-28T19:15:39.425732] [WARN ] [MAIN ] HMY: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:15:39.506503] [INFO ] [MAIN ] HMY: Wiping existing primary data before full refresh. [2025-10-28T19:15:39.512231] [INFO ] [LOCAL ] HMY: Starting deletion of primary data. [2025-10-28T19:15:39.556680] [DEBUG] [LOCAL ] HMY: Deleted primary data file. [2025-10-28T19:15:39.545499] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-28T19:15:39.559837] [INFO ] [MAIN ] HMY: Starting full primary refresh. [2025-10-28T19:15:39.581067] [DEBUG] [LOCAL ] HLX: Primary data saved (47235 records). [2025-10-28T19:15:39.581681] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-02. [2025-10-28T19:15:39.559753] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-28T19:15:39.602505] [INFO ] [MAIN ] HLX: Full history saved. [2025-10-28T19:15:39.636447] [INFO ] [MAIN ] Update Progress: 1033/2366 symbols completed. HLX took 26.2s. Estimated remaining: 2h 54m 60s. Rate: 7.6 symbols/min [2025-10-28T19:15:39.947254] [INFO ] [MAIN ] HNGE: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:15:39.981099] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-02. [2025-10-28T19:15:40.013020] [DEBUG] [LOCAL ] HNGE: No existing data file found in primary storage. [2025-10-28T19:15:40.019794] [WARN ] [MAIN ] HNGE: No existing data found, performing full refresh instead. [2025-10-28T19:15:40.043400] [INFO ] [MAIN ] HNGE: Wiping existing primary data before full refresh. [2025-10-28T19:15:40.055190] [INFO ] [LOCAL ] HNGE: Starting deletion of primary data. [2025-10-28T19:15:40.055328] [DEBUG] [LOCAL ] HNGE: No primary data file found to delete. [2025-10-28T19:15:40.055379] [INFO ] [MAIN ] HNGE: Starting full primary refresh. [2025-10-28T19:15:40.246217] [INFO ] [REMOTE ] HMY: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:15:40.529348] [INFO ] [REMOTE ] HNGE: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:15:40.775906] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-28T19:15:40.780156] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-03. [2025-10-28T19:15:41.110216] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-28T19:15:41.553022] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-28T19:15:41.580212] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-04. [2025-10-28T19:15:42.342078] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-28T19:15:42.380208] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-05. [2025-10-28T19:15:43.180229] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-01. [2025-10-28T19:15:43.255928] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-10-28T19:15:43.319958] [DEBUG] [REMOTE ] HNGE: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-28T19:15:43.320229] [WARN ] [REMOTE ] HNGE: No data returned for month 2025-01 [2025-10-28T19:15:43.320316] [FATAL] [REMOTE ] HNGE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-28T19:15:43.320362] [FATAL] [MAIN ] HNGE: Failed to fetch primary data. [2025-10-28T19:15:43.320395] [WARN ] [MAIN ] HNGE: Deleting existing primary and derivative data due to fetch failure. [2025-10-28T19:15:43.320429] [INFO ] [LOCAL ] HNGE: Starting deletion of primary data. [2025-10-28T19:15:43.320490] [DEBUG] [LOCAL ] HNGE: No primary data file found to delete. [2025-10-28T19:15:43.320528] [INFO ] [LOCAL ] HNGE: Starting deletion of derivative data. [2025-10-28T19:15:43.320567] [DEBUG] [LOCAL ] HNGE: No derivative data file found to delete. [2025-10-28T19:15:43.320610] [INFO ] [MAIN ] Update Progress: 1034/2366 symbols completed. HNGE took 3.7s. Estimated remaining: 2h 54m 46s. Rate: 7.6 symbols/min [2025-10-28T19:15:43.490285] [INFO ] [MAIN ] HNI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:15:43.521618] [DEBUG] [LOCAL ] HNI: Loaded 29700 existing records from primary storage. [2025-10-28T19:15:43.521920] [INFO ] [MAIN ] HNI: Loaded 29700 existing records. [2025-10-28T19:15:43.700273] [WARN ] [MAIN ] HNI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:15:43.700494] [INFO ] [MAIN ] HNI: Wiping existing primary data before full refresh. [2025-10-28T19:15:43.700593] [INFO ] [LOCAL ] HNI: Starting deletion of primary data. [2025-10-28T19:15:43.701017] [DEBUG] [LOCAL ] HNI: Deleted primary data file. [2025-10-28T19:15:43.701105] [INFO ] [MAIN ] HNI: Starting full primary refresh. [2025-10-28T19:15:43.985418] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-06. [2025-10-28T19:15:44.057134] [INFO ] [REMOTE ] HNI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:15:44.780309] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-03. [2025-10-28T19:15:44.807802] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-28T19:15:45.580244] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-01. [2025-10-28T19:15:46.092571] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-28T19:15:46.380233] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-04. [2025-10-28T19:15:46.980329] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-28T19:15:47.180253] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-01. [2025-10-28T19:15:47.747610] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-28T19:15:47.944732] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-28T19:15:47.980234] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-05. [2025-10-28T19:15:48.780268] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-02. [2025-10-28T19:15:49.163675] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-28T19:15:49.521542] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-10-28T19:15:49.580289] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-03. [2025-10-28T19:15:50.380282] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-07. [2025-10-28T19:15:50.461289] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-28T19:15:51.131413] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-10-28T19:15:51.180256] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-02. [2025-10-28T19:15:51.980266] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-04. [2025-10-28T19:15:52.780215] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-08. [2025-10-28T19:15:52.816388] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-10-28T19:15:52.844762] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-10-28T19:15:53.488344] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-10-28T19:15:53.580400] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-09. [2025-10-28T19:15:54.269818] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-28T19:15:54.380247] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-05. [2025-10-28T19:15:55.135912] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-10-28T19:15:55.180249] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-06. [2025-10-28T19:15:55.876429] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-28T19:15:55.980257] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-07. [2025-10-28T19:15:56.742568] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-28T19:15:56.780211] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-08. [2025-10-28T19:15:57.580230] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-03. [2025-10-28T19:15:58.071700] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-28T19:15:58.380248] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-10. [2025-10-28T19:15:59.049820] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-28T19:15:59.180261] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-09. [2025-10-28T19:15:59.279203] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-28T19:15:59.283241] [INFO ] [REMOTE ] HMN: Full fetch complete (31724 records). [2025-10-28T19:15:59.283335] [DEBUG] [VALIDATOR ] HMN: Validating primary data. [2025-10-28T19:15:59.669327] [DEBUG] [VALIDATOR ] HMN: All expected trading days are present. [2025-10-28T19:15:59.669409] [DEBUG] [VALIDATOR ] HMN: Primary data validation passed. [2025-10-28T19:15:59.670126] [INFO ] [MAIN ] HMN: Fetched primary data is valid. [2025-10-28T19:15:59.670188] [DEBUG] [LOCAL ] HMN: Saving primary data. [2025-10-28T19:15:59.671082] [DEBUG] [LOCAL ] HMN: Trimmed 31724 records to 22876 (keeping 200 days of data) [2025-10-28T19:15:59.811139] [DEBUG] [LOCAL ] HMN: Primary data saved (22876 records). [2025-10-28T19:15:59.811264] [INFO ] [MAIN ] HMN: Full history saved. [2025-10-28T19:15:59.811371] [INFO ] [MAIN ] Update Progress: 1035/2366 symbols completed. HMN took 23.1s. Estimated remaining: 2h 54m 50s. Rate: 7.6 symbols/min [2025-10-28T19:15:59.981456] [INFO ] [MAIN ] HOG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:15:59.981696] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-04. [2025-10-28T19:16:00.030722] [DEBUG] [LOCAL ] HOG: Loaded 50529 existing records from primary storage. [2025-10-28T19:16:00.031059] [INFO ] [MAIN ] HOG: Loaded 50529 existing records. [2025-10-28T19:16:00.221151] [WARN ] [MAIN ] HOG: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:16:00.221425] [INFO ] [MAIN ] HOG: Wiping existing primary data before full refresh. [2025-10-28T19:16:00.221502] [INFO ] [LOCAL ] HOG: Starting deletion of primary data. [2025-10-28T19:16:00.222056] [DEBUG] [LOCAL ] HOG: Deleted primary data file. [2025-10-28T19:16:00.222145] [INFO ] [MAIN ] HOG: Starting full primary refresh. [2025-10-28T19:16:00.403258] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-10-28T19:16:00.626127] [INFO ] [REMOTE ] HOG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:16:00.780246] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-01. [2025-10-28T19:16:01.580219] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-10. [2025-10-28T19:16:01.837314] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-10-28T19:16:02.041602] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-28T19:16:02.380226] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-05. [2025-10-28T19:16:02.711611] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-28T19:16:02.718719] [INFO ] [REMOTE ] HNI: Full fetch complete (42342 records). [2025-10-28T19:16:02.718882] [DEBUG] [VALIDATOR ] HNI: Validating primary data. [2025-10-28T19:16:03.131189] [DEBUG] [VALIDATOR ] HNI: All expected trading days are present. [2025-10-28T19:16:03.131316] [DEBUG] [VALIDATOR ] HNI: Primary data validation passed. [2025-10-28T19:16:03.132510] [INFO ] [MAIN ] HNI: Fetched primary data is valid. [2025-10-28T19:16:03.132597] [DEBUG] [LOCAL ] HNI: Saving primary data. [2025-10-28T19:16:03.134057] [DEBUG] [LOCAL ] HNI: Trimmed 42342 records to 29761 (keeping 200 days of data) [2025-10-28T19:16:03.213413] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-06. [2025-10-28T19:16:03.432330] [DEBUG] [LOCAL ] HNI: Primary data saved (29761 records). [2025-10-28T19:16:03.432519] [INFO ] [MAIN ] HNI: Full history saved. [2025-10-28T19:16:03.432670] [INFO ] [MAIN ] Update Progress: 1036/2366 symbols completed. HNI took 20.1s. Estimated remaining: 2h 54m 36s. Rate: 7.6 symbols/min [2025-10-28T19:16:03.675232] [INFO ] [MAIN ] HOMB: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:16:03.721141] [DEBUG] [LOCAL ] HOMB: Loaded 43589 existing records from primary storage. [2025-10-28T19:16:03.721556] [INFO ] [MAIN ] HOMB: Loaded 43589 existing records. [2025-10-28T19:16:03.955166] [WARN ] [MAIN ] HOMB: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:16:03.955544] [INFO ] [MAIN ] HOMB: Wiping existing primary data before full refresh. [2025-10-28T19:16:03.955737] [INFO ] [LOCAL ] HOMB: Starting deletion of primary data. [2025-10-28T19:16:03.956011] [DEBUG] [LOCAL ] HOMB: Deleted primary data file. [2025-10-28T19:16:03.956090] [INFO ] [MAIN ] HOMB: Starting full primary refresh. [2025-10-28T19:16:03.984040] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-02. [2025-10-28T19:16:04.192959] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-10-28T19:16:04.398818] [INFO ] [REMOTE ] HOMB: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:16:04.424739] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-10-28T19:16:04.780267] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-01. [2025-10-28T19:16:05.360470] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-10-28T19:16:05.580298] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-03. [2025-10-28T19:16:05.937093] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-28T19:16:06.380243] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-06. [2025-10-28T19:16:06.841110] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-28T19:16:07.180199] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-02. [2025-10-28T19:16:07.936888] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-28T19:16:07.980206] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-07. [2025-10-28T19:16:08.201148] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-28T19:16:08.780272] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-07. [2025-10-28T19:16:09.560980] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-28T19:16:09.580215] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-08. [2025-10-28T19:16:10.002527] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-28T19:16:10.380282] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-03. [2025-10-28T19:16:11.118562] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-28T19:16:11.180236] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-09. [2025-10-28T19:16:11.315598] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-28T19:16:11.980254] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-04. [2025-10-28T19:16:12.780244] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-04. [2025-10-28T19:16:12.883726] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-10-28T19:16:13.254481] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-28T19:16:13.580258] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-08. [2025-10-28T19:16:14.153558] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-28T19:16:14.380307] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-05. [2025-10-28T19:16:14.806021] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-28T19:16:15.180225] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-05. [2025-10-28T19:16:15.365997] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-28T19:16:15.980256] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-10. [2025-10-28T19:16:16.458315] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-28T19:16:16.780257] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-06. [2025-10-28T19:16:17.580252] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-09. [2025-10-28T19:16:17.747917] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-28T19:16:17.778839] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-28T19:16:17.787227] [INFO ] [REMOTE ] HMY: Full fetch complete (77158 records). [2025-10-28T19:16:17.787440] [DEBUG] [VALIDATOR ] HMY: Validating primary data. [2025-10-28T19:16:18.170208] [DEBUG] [VALIDATOR ] HMY: All expected trading days are present. [2025-10-28T19:16:18.170287] [DEBUG] [VALIDATOR ] HMY: Primary data validation passed. [2025-10-28T19:16:18.171268] [INFO ] [MAIN ] HMY: Fetched primary data is valid. [2025-10-28T19:16:18.171335] [DEBUG] [LOCAL ] HMY: Saving primary data. [2025-10-28T19:16:18.172804] [DEBUG] [LOCAL ] HMY: Trimmed 77158 records to 53165 (keeping 200 days of data) [2025-10-28T19:16:18.388778] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-07. [2025-10-28T19:16:18.523043] [DEBUG] [LOCAL ] HMY: Primary data saved (53165 records). [2025-10-28T19:16:18.523199] [INFO ] [MAIN ] HMY: Full history saved. [2025-10-28T19:16:18.523327] [INFO ] [MAIN ] Update Progress: 1037/2366 symbols completed. HMY took 40.2s. Estimated remaining: 2h 54m 38s. Rate: 7.6 symbols/min [2025-10-28T19:16:18.908734] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-28T19:16:19.180274] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-06. [2025-10-28T19:16:19.450797] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-28T19:16:19.980288] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-10. [2025-10-28T19:16:20.416372] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-28T19:16:20.780318] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-08. [2025-10-28T19:16:21.369593] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-28T19:16:21.378890] [INFO ] [REMOTE ] HMC: Full fetch complete (68399 records). [2025-10-28T19:16:21.379056] [DEBUG] [VALIDATOR ] HMC: Validating primary data. [2025-10-28T19:16:21.607208] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-07. [2025-10-28T19:16:21.788196] [DEBUG] [VALIDATOR ] HMC: All expected trading days are present. [2025-10-28T19:16:21.788284] [DEBUG] [VALIDATOR ] HMC: Primary data validation passed. [2025-10-28T19:16:21.789212] [INFO ] [MAIN ] HMC: Fetched primary data is valid. [2025-10-28T19:16:21.789275] [DEBUG] [LOCAL ] HMC: Saving primary data. [2025-10-28T19:16:21.790761] [DEBUG] [LOCAL ] HMC: Trimmed 68399 records to 46011 (keeping 200 days of data) [2025-10-28T19:16:22.031482] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-28T19:16:22.102150] [DEBUG] [LOCAL ] HMC: Primary data saved (46011 records). [2025-10-28T19:16:22.102285] [INFO ] [MAIN ] HMC: Full history saved. [2025-10-28T19:16:22.102365] [INFO ] [MAIN ] Update Progress: 1038/2366 symbols completed. HMC took 47.9s. Estimated remaining: 2h 54m 24s. Rate: 7.6 symbols/min [2025-10-28T19:16:22.380302] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-09. [2025-10-28T19:16:23.018856] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-28T19:16:23.180299] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-08. [2025-10-28T19:16:23.454487] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-28T19:16:23.980319] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-10. [2025-10-28T19:16:24.372680] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-28T19:16:24.780241] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-09. [2025-10-28T19:16:25.130337] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-28T19:16:25.139579] [INFO ] [REMOTE ] HOMB: Full fetch complete (64448 records). [2025-10-28T19:16:25.139719] [DEBUG] [VALIDATOR ] HOMB: Validating primary data. [2025-10-28T19:16:25.524571] [DEBUG] [VALIDATOR ] HOMB: All expected trading days are present. [2025-10-28T19:16:25.524709] [DEBUG] [VALIDATOR ] HOMB: Primary data validation passed. [2025-10-28T19:16:25.525747] [INFO ] [MAIN ] HOMB: Fetched primary data is valid. [2025-10-28T19:16:25.525812] [DEBUG] [LOCAL ] HOMB: Saving primary data. [2025-10-28T19:16:25.527324] [DEBUG] [LOCAL ] HOMB: Trimmed 64448 records to 43531 (keeping 200 days of data) [2025-10-28T19:16:25.780359] [DEBUG] [LOCAL ] HOMB: Primary data saved (43531 records). [2025-10-28T19:16:25.780478] [INFO ] [MAIN ] HOMB: Full history saved. [2025-10-28T19:16:25.780552] [INFO ] [MAIN ] Update Progress: 1039/2366 symbols completed. HOMB took 22.3s. Estimated remaining: 2h 54m 11s. Rate: 7.6 symbols/min [2025-10-28T19:16:26.058375] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-28T19:16:26.069197] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-10. [2025-10-28T19:16:27.600578] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-28T19:16:27.610400] [INFO ] [REMOTE ] HOG: Full fetch complete (74209 records). [2025-10-28T19:16:27.610544] [DEBUG] [VALIDATOR ] HOG: Validating primary data. [2025-10-28T19:16:28.001409] [DEBUG] [VALIDATOR ] HOG: All expected trading days are present. [2025-10-28T19:16:28.001493] [DEBUG] [VALIDATOR ] HOG: Primary data validation passed. [2025-10-28T19:16:28.002521] [INFO ] [MAIN ] HOG: Fetched primary data is valid. [2025-10-28T19:16:28.002584] [DEBUG] [LOCAL ] HOG: Saving primary data. [2025-10-28T19:16:28.003935] [DEBUG] [LOCAL ] HOG: Trimmed 74209 records to 50482 (keeping 200 days of data) [2025-10-28T19:16:28.302281] [DEBUG] [LOCAL ] HOG: Primary data saved (50482 records). [2025-10-28T19:16:28.302422] [INFO ] [MAIN ] HOG: Full history saved. [2025-10-28T19:16:28.302501] [INFO ] [MAIN ] Update Progress: 1040/2366 symbols completed. HOG took 28.5s. Estimated remaining: 2h 53m 56s. Rate: 7.6 symbols/min [2025-10-28T19:16:28.952702] [INFO ] [MAIN ] HPE: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:16:28.981297] [INFO ] [MAIN ] HOUS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:16:28.990691] [INFO ] [MAIN ] HP: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:16:29.019680] [INFO ] [MAIN ] HOV: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:16:29.035746] [DEBUG] [LOCAL ] HOV: Loaded 13651 existing records from primary storage. [2025-10-28T19:16:29.036278] [INFO ] [MAIN ] HOV: Loaded 13651 existing records. [2025-10-28T19:16:29.253748] [DEBUG] [LOCAL ] HOUS: Loaded 45802 existing records from primary storage. [2025-10-28T19:16:29.272297] [INFO ] [MAIN ] HOUS: Loaded 45802 existing records. [2025-10-28T19:16:29.276053] [WARN ] [MAIN ] HOV: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:16:29.290268] [INFO ] [MAIN ] HOV: Wiping existing primary data before full refresh. [2025-10-28T19:16:29.302967] [INFO ] [LOCAL ] HOV: Starting deletion of primary data. [2025-10-28T19:16:29.325243] [DEBUG] [LOCAL ] HOV: Deleted primary data file. [2025-10-28T19:16:29.325363] [INFO ] [MAIN ] HOV: Starting full primary refresh. [2025-10-28T19:16:29.325182] [DEBUG] [LOCAL ] HPE: Loaded 53697 existing records from primary storage. [2025-10-28T19:16:29.380044] [DEBUG] [LOCAL ] HP: Loaded 51297 existing records from primary storage. [2025-10-28T19:16:29.413273] [INFO ] [MAIN ] HPE: Loaded 53697 existing records. [2025-10-28T19:16:29.418609] [INFO ] [MAIN ] HP: Loaded 51297 existing records. [2025-10-28T19:16:29.847199] [WARN ] [MAIN ] HOUS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:16:29.893386] [INFO ] [MAIN ] HOUS: Wiping existing primary data before full refresh. [2025-10-28T19:16:29.906292] [INFO ] [LOCAL ] HOUS: Starting deletion of primary data. [2025-10-28T19:16:29.993679] [DEBUG] [LOCAL ] HOUS: Deleted primary data file. [2025-10-28T19:16:30.096725] [INFO ] [MAIN ] HOUS: Starting full primary refresh. [2025-10-28T19:16:30.099779] [WARN ] [MAIN ] HP: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:16:30.147805] [WARN ] [MAIN ] HPE: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:16:30.162628] [INFO ] [MAIN ] HP: Wiping existing primary data before full refresh. [2025-10-28T19:16:30.167925] [INFO ] [LOCAL ] HP: Starting deletion of primary data. [2025-10-28T19:16:30.183740] [INFO ] [MAIN ] HPE: Wiping existing primary data before full refresh. [2025-10-28T19:16:30.178476] [DEBUG] [LOCAL ] HP: Deleted primary data file. [2025-10-28T19:16:30.201102] [INFO ] [LOCAL ] HPE: Starting deletion of primary data. [2025-10-28T19:16:30.230535] [DEBUG] [LOCAL ] HPE: Deleted primary data file. [2025-10-28T19:16:30.230742] [INFO ] [MAIN ] HPE: Starting full primary refresh. [2025-10-28T19:16:30.201212] [INFO ] [MAIN ] HP: Starting full primary refresh. [2025-10-28T19:16:30.565012] [INFO ] [REMOTE ] HOV: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:16:30.655915] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-01. [2025-10-28T19:16:31.265897] [INFO ] [REMOTE ] HOUS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:16:31.318433] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-01. [2025-10-28T19:16:31.408437] [INFO ] [REMOTE ] HPE: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:16:31.412610] [INFO ] [REMOTE ] HP: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:16:31.413123] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-01. [2025-10-28T19:16:31.413821] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-01. [2025-10-28T19:16:31.424495] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-28T19:16:31.427374] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-02. [2025-10-28T19:16:31.975860] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-28T19:16:31.978738] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-03. [2025-10-28T19:16:32.405704] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-28T19:16:32.414319] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-02. [2025-10-28T19:16:32.561526] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-28T19:16:32.571116] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-02. [2025-10-28T19:16:32.580063] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-28T19:16:32.780267] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-04. [2025-10-28T19:16:33.111568] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-10-28T19:16:33.359038] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-28T19:16:33.411390] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-28T19:16:33.580288] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-05. [2025-10-28T19:16:33.767441] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-28T19:16:34.102634] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-28T19:16:34.380293] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-03. [2025-10-28T19:16:35.180299] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-06. [2025-10-28T19:16:35.577778] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-28T19:16:35.810028] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-10-28T19:16:35.980263] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-04. [2025-10-28T19:16:36.780325] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-03. [2025-10-28T19:16:37.419574] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-28T19:16:37.580250] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-02. [2025-10-28T19:16:37.806360] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-28T19:16:38.380265] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-04. [2025-10-28T19:16:38.969392] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-28T19:16:39.180236] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-03. [2025-10-28T19:16:39.414211] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-28T19:16:39.980299] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-07. [2025-10-28T19:16:40.642884] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-28T19:16:40.676470] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-10-28T19:16:40.780273] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-08. [2025-10-28T19:16:41.364452] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-28T19:16:41.580284] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-09. [2025-10-28T19:16:42.178399] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-28T19:16:42.380244] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-05. [2025-10-28T19:16:43.180300] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-10. [2025-10-28T19:16:43.791527] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-10 (0.61 seconds). [2025-10-28T19:16:43.794104] [INFO ] [REMOTE ] HOV: Full fetch complete (18851 records). [2025-10-28T19:16:43.794173] [DEBUG] [VALIDATOR ] HOV: Validating primary data. [2025-10-28T19:16:43.980528] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-04. [2025-10-28T19:16:44.020623] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-28T19:16:44.219257] [DEBUG] [VALIDATOR ] HOV: All expected trading days are present. [2025-10-28T19:16:44.219333] [DEBUG] [VALIDATOR ] HOV: Primary data validation passed. [2025-10-28T19:16:44.219747] [INFO ] [MAIN ] HOV: Fetched primary data is valid. [2025-10-28T19:16:44.219807] [DEBUG] [LOCAL ] HOV: Saving primary data. [2025-10-28T19:16:44.220372] [DEBUG] [LOCAL ] HOV: Trimmed 18851 records to 13612 (keeping 200 days of data) [2025-10-28T19:16:44.301303] [DEBUG] [LOCAL ] HOV: Primary data saved (13612 records). [2025-10-28T19:16:44.301433] [INFO ] [MAIN ] HOV: Full history saved. [2025-10-28T19:16:44.301513] [INFO ] [MAIN ] Update Progress: 1041/2366 symbols completed. HOV took 16.0s. Estimated remaining: 2h 53m 59s. Rate: 7.6 symbols/min [2025-10-28T19:16:44.481004] [INFO ] [MAIN ] HPF: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:16:44.489371] [DEBUG] [LOCAL ] HPF: Loaded 7315 existing records from primary storage. [2025-10-28T19:16:44.489576] [INFO ] [MAIN ] HPF: Loaded 7315 existing records. [2025-10-28T19:16:44.679488] [WARN ] [MAIN ] HPF: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:16:44.679711] [INFO ] [MAIN ] HPF: Wiping existing primary data before full refresh. [2025-10-28T19:16:44.679767] [INFO ] [LOCAL ] HPF: Starting deletion of primary data. [2025-10-28T19:16:44.679998] [DEBUG] [LOCAL ] HPF: Deleted primary data file. [2025-10-28T19:16:44.680039] [INFO ] [MAIN ] HPF: Starting full primary refresh. [2025-10-28T19:16:44.785402] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-05. [2025-10-28T19:16:45.037910] [INFO ] [REMOTE ] HPF: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:16:45.585394] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-06. [2025-10-28T19:16:45.603492] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-10-28T19:16:45.956752] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-28T19:16:46.380275] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-05. [2025-10-28T19:16:46.907253] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-28T19:16:47.180273] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-01. [2025-10-28T19:16:47.644545] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-28T19:16:47.761089] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-28T19:16:47.980248] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-07. [2025-10-28T19:16:48.780258] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-06. [2025-10-28T19:16:49.256825] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-28T19:16:49.580263] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-02. [2025-10-28T19:16:49.975190] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-10-28T19:16:50.189935] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-28T19:16:50.380287] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-06. [2025-10-28T19:16:51.180327] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-03. [2025-10-28T19:16:51.554510] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-28T19:16:51.620359] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-10-28T19:16:51.980248] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-08. [2025-10-28T19:16:52.780266] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-07. [2025-10-28T19:16:53.254215] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-28T19:16:53.580262] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-04. [2025-10-28T19:16:53.783005] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-28T19:16:54.018176] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-10-28T19:16:54.380254] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-07. [2025-10-28T19:16:55.180302] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-05. [2025-10-28T19:16:55.640578] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-28T19:16:55.857243] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-28T19:16:55.980219] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-08. [2025-10-28T19:16:56.780230] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-06. [2025-10-28T19:16:57.261839] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-28T19:16:57.451420] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-28T19:16:57.580241] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-08. [2025-10-28T19:16:58.380240] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-09. [2025-10-28T19:16:58.573176] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-28T19:16:59.180251] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-07. [2025-10-28T19:16:59.657165] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-28T19:16:59.846547] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-28T19:16:59.980243] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-10. [2025-10-28T19:17:00.780260] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-08. [2025-10-28T19:17:01.265323] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-28T19:17:01.580248] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-09. [2025-10-28T19:17:01.682356] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-10 (1.70 seconds). [2025-10-28T19:17:01.693117] [INFO ] [REMOTE ] HPE: Full fetch complete (77876 records). [2025-10-28T19:17:01.693283] [DEBUG] [VALIDATOR ] HPE: Validating primary data. [2025-10-28T19:17:02.083683] [DEBUG] [VALIDATOR ] HPE: All expected trading days are present. [2025-10-28T19:17:02.083780] [DEBUG] [VALIDATOR ] HPE: Primary data validation passed. [2025-10-28T19:17:02.084781] [INFO ] [MAIN ] HPE: Fetched primary data is valid. [2025-10-28T19:17:02.084844] [DEBUG] [LOCAL ] HPE: Saving primary data. [2025-10-28T19:17:02.086325] [DEBUG] [LOCAL ] HPE: Trimmed 77876 records to 53697 (keeping 200 days of data) [2025-10-28T19:17:02.384318] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-09. [2025-10-28T19:17:02.411816] [DEBUG] [LOCAL ] HPE: Primary data saved (53697 records). [2025-10-28T19:17:02.411941] [INFO ] [MAIN ] HPE: Full history saved. [2025-10-28T19:17:02.412018] [INFO ] [MAIN ] Update Progress: 1042/2366 symbols completed. HPE took 34.1s. Estimated remaining: 2h 54m 4s. Rate: 7.6 symbols/min [2025-10-28T19:17:02.586620] [INFO ] [MAIN ] HPI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:17:02.599129] [DEBUG] [LOCAL ] HPI: Loaded 10526 existing records from primary storage. [2025-10-28T19:17:02.599352] [INFO ] [MAIN ] HPI: Loaded 10526 existing records. [2025-10-28T19:17:02.785956] [WARN ] [MAIN ] HPI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:17:02.786202] [INFO ] [MAIN ] HPI: Wiping existing primary data before full refresh. [2025-10-28T19:17:02.786299] [INFO ] [LOCAL ] HPI: Starting deletion of primary data. [2025-10-28T19:17:02.786547] [DEBUG] [LOCAL ] HPI: Deleted primary data file. [2025-10-28T19:17:02.786606] [INFO ] [MAIN ] HPI: Starting full primary refresh. [2025-10-28T19:17:03.014777] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-28T19:17:03.198873] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-10. [2025-10-28T19:17:03.175833] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-28T19:17:03.214363] [INFO ] [REMOTE ] HPI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:17:03.730862] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-10 (0.53 seconds). [2025-10-28T19:17:03.732601] [INFO ] [REMOTE ] HPF: Full fetch complete (10406 records). [2025-10-28T19:17:03.732701] [DEBUG] [VALIDATOR ] HPF: Validating primary data. [2025-10-28T19:17:03.985365] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-01. [2025-10-28T19:17:04.097128] [DEBUG] [VALIDATOR ] HPF: All expected trading days are present. [2025-10-28T19:17:04.097211] [DEBUG] [VALIDATOR ] HPF: Primary data validation passed. [2025-10-28T19:17:04.097481] [INFO ] [MAIN ] HPF: Fetched primary data is valid. [2025-10-28T19:17:04.097523] [DEBUG] [LOCAL ] HPF: Saving primary data. [2025-10-28T19:17:04.098037] [DEBUG] [LOCAL ] HPF: Trimmed 10406 records to 7291 (keeping 200 days of data) [2025-10-28T19:17:04.143599] [DEBUG] [LOCAL ] HPF: Primary data saved (7291 records). [2025-10-28T19:17:04.143769] [INFO ] [MAIN ] HPF: Full history saved. [2025-10-28T19:17:04.143897] [INFO ] [MAIN ] Update Progress: 1043/2366 symbols completed. HPF took 19.8s. Estimated remaining: 2h 53m 48s. Rate: 7.6 symbols/min [2025-10-28T19:17:04.318958] [INFO ] [MAIN ] HPP: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:17:04.367638] [DEBUG] [LOCAL ] HPP: Loaded 51188 existing records from primary storage. [2025-10-28T19:17:04.368053] [INFO ] [MAIN ] HPP: Loaded 51188 existing records. [2025-10-28T19:17:04.545157] [WARN ] [MAIN ] HPP: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:17:04.545360] [INFO ] [MAIN ] HPP: Wiping existing primary data before full refresh. [2025-10-28T19:17:04.545407] [INFO ] [LOCAL ] HPP: Starting deletion of primary data. [2025-10-28T19:17:04.545830] [DEBUG] [LOCAL ] HPP: Deleted primary data file. [2025-10-28T19:17:04.545888] [INFO ] [MAIN ] HPP: Starting full primary refresh. [2025-10-28T19:17:04.664379] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-28T19:17:04.785546] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-10. [2025-10-28T19:17:04.907638] [INFO ] [REMOTE ] HPP: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:17:05.580326] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-02. [2025-10-28T19:17:05.991801] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-10-28T19:17:06.103915] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-28T19:17:06.114463] [INFO ] [REMOTE ] HOUS: Full fetch complete (64832 records). [2025-10-28T19:17:06.114630] [DEBUG] [VALIDATOR ] HOUS: Validating primary data. [2025-10-28T19:17:06.385512] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-09. [2025-10-28T19:17:06.498694] [DEBUG] [VALIDATOR ] HOUS: All expected trading days are present. [2025-10-28T19:17:06.498788] [DEBUG] [VALIDATOR ] HOUS: Primary data validation passed. [2025-10-28T19:17:06.499693] [INFO ] [MAIN ] HOUS: Fetched primary data is valid. [2025-10-28T19:17:06.499754] [DEBUG] [LOCAL ] HOUS: Saving primary data. [2025-10-28T19:17:06.501170] [DEBUG] [LOCAL ] HOUS: Trimmed 64832 records to 45809 (keeping 200 days of data) [2025-10-28T19:17:06.753128] [DEBUG] [LOCAL ] HOUS: Primary data saved (45809 records). [2025-10-28T19:17:06.753261] [INFO ] [MAIN ] HOUS: Full history saved. [2025-10-28T19:17:06.754398] [INFO ] [MAIN ] Update Progress: 1044/2366 symbols completed. HOUS took 38.5s. Estimated remaining: 2h 53m 34s. Rate: 7.6 symbols/min [2025-10-28T19:17:06.922039] [INFO ] [MAIN ] HPQ: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:17:06.970770] [DEBUG] [LOCAL ] HPQ: Loaded 53669 existing records from primary storage. [2025-10-28T19:17:06.971056] [INFO ] [MAIN ] HPQ: Loaded 53669 existing records. [2025-10-28T19:17:07.146075] [WARN ] [MAIN ] HPQ: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:17:07.146339] [INFO ] [MAIN ] HPQ: Wiping existing primary data before full refresh. [2025-10-28T19:17:07.146390] [INFO ] [LOCAL ] HPQ: Starting deletion of primary data. [2025-10-28T19:17:07.146586] [DEBUG] [LOCAL ] HPQ: Deleted primary data file. [2025-10-28T19:17:07.146625] [INFO ] [MAIN ] HPQ: Starting full primary refresh. [2025-10-28T19:17:07.188069] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-03. [2025-10-28T19:17:07.500308] [INFO ] [REMOTE ] HPQ: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:17:07.714563] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-28T19:17:07.716469] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-28T19:17:07.980303] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-01. [2025-10-28T19:17:08.780262] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-01. [2025-10-28T19:17:09.199916] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-28T19:17:09.580251] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-02. [2025-10-28T19:17:09.930084] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-28T19:17:10.380314] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-02. [2025-10-28T19:17:10.606287] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-28T19:17:11.180252] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-03. [2025-10-28T19:17:11.642187] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-28T19:17:11.980261] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-04. [2025-10-28T19:17:12.330699] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-28T19:17:12.501415] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-28T19:17:12.780261] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-03. [2025-10-28T19:17:13.580258] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-05. [2025-10-28T19:17:14.077874] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-10-28T19:17:14.305961] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-10-28T19:17:14.380272] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-06. [2025-10-28T19:17:14.832836] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-28T19:17:15.180253] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-10. [2025-10-28T19:17:15.980259] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-04. [2025-10-28T19:17:16.635543] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-28T19:17:16.645885] [INFO ] [REMOTE ] HP: Full fetch complete (74145 records). [2025-10-28T19:17:16.646044] [DEBUG] [VALIDATOR ] HP: Validating primary data. [2025-10-28T19:17:16.785414] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-04. [2025-10-28T19:17:17.071583] [DEBUG] [VALIDATOR ] HP: All expected trading days are present. [2025-10-28T19:17:17.071768] [DEBUG] [VALIDATOR ] HP: Primary data validation passed. [2025-10-28T19:17:17.072888] [INFO ] [MAIN ] HP: Fetched primary data is valid. [2025-10-28T19:17:17.072966] [DEBUG] [LOCAL ] HP: Saving primary data. [2025-10-28T19:17:17.074576] [DEBUG] [LOCAL ] HP: Trimmed 74145 records to 51229 (keeping 200 days of data) [2025-10-28T19:17:17.198242] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-28T19:17:17.424853] [DEBUG] [LOCAL ] HP: Primary data saved (51229 records). [2025-10-28T19:17:17.424987] [INFO ] [MAIN ] HP: Full history saved. [2025-10-28T19:17:17.425064] [INFO ] [MAIN ] Update Progress: 1045/2366 symbols completed. HP took 49.1s. Estimated remaining: 2h 53m 29s. Rate: 7.6 symbols/min [2025-10-28T19:17:17.597049] [INFO ] [MAIN ] HPS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:17:17.585877] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-05. [2025-10-28T19:17:17.610518] [DEBUG] [LOCAL ] HPS: Loaded 10175 existing records from primary storage. [2025-10-28T19:17:17.610769] [INFO ] [MAIN ] HPS: Loaded 10175 existing records. [2025-10-28T19:17:17.792251] [WARN ] [MAIN ] HPS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:17:17.792484] [INFO ] [MAIN ] HPS: Wiping existing primary data before full refresh. [2025-10-28T19:17:17.792538] [INFO ] [LOCAL ] HPS: Starting deletion of primary data. [2025-10-28T19:17:17.792760] [DEBUG] [LOCAL ] HPS: Deleted primary data file. [2025-10-28T19:17:17.792818] [INFO ] [MAIN ] HPS: Starting full primary refresh. [2025-10-28T19:17:18.158866] [INFO ] [REMOTE ] HPS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:17:18.222980] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-28T19:17:18.380268] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-07. [2025-10-28T19:17:18.791408] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-28T19:17:18.808081] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-28T19:17:19.180295] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-05. [2025-10-28T19:17:19.980302] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-08. [2025-10-28T19:17:20.530619] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-28T19:17:20.565438] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-28T19:17:20.780270] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-01. [2025-10-28T19:17:21.325470] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-28T19:17:21.580323] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-02. [2025-10-28T19:17:22.107321] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-28T19:17:22.380249] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-03. [2025-10-28T19:17:22.867049] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-28T19:17:23.180245] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-06. [2025-10-28T19:17:23.980246] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-06. [2025-10-28T19:17:24.303262] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-28T19:17:24.780272] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-04. [2025-10-28T19:17:25.213578] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-28T19:17:25.279464] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-28T19:17:25.580314] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-07. [2025-10-28T19:17:26.380318] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-05. [2025-10-28T19:17:26.957795] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-28T19:17:26.958263] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-10-28T19:17:27.180304] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-09. [2025-10-28T19:17:27.865489] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-28T19:17:27.980325] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-06. [2025-10-28T19:17:28.500748] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-28T19:17:28.780296] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-08. [2025-10-28T19:17:29.580317] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-07. [2025-10-28T19:17:30.173872] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-28T19:17:30.239005] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-28T19:17:30.380223] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-09. [2025-10-28T19:17:31.180248] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-10. [2025-10-28T19:17:31.680268] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-28T19:17:31.812511] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-28T19:17:31.814946] [INFO ] [REMOTE ] HPI: Full fetch complete (13814 records). [2025-10-28T19:17:31.815023] [DEBUG] [VALIDATOR ] HPI: Validating primary data. [2025-10-28T19:17:31.987594] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-08. [2025-10-28T19:17:32.173784] [DEBUG] [VALIDATOR ] HPI: All expected trading days are present. [2025-10-28T19:17:32.173856] [DEBUG] [VALIDATOR ] HPI: Primary data validation passed. [2025-10-28T19:17:32.174164] [INFO ] [MAIN ] HPI: Fetched primary data is valid. [2025-10-28T19:17:32.174200] [DEBUG] [LOCAL ] HPI: Saving primary data. [2025-10-28T19:17:32.174680] [DEBUG] [LOCAL ] HPI: Trimmed 13814 records to 10492 (keeping 200 days of data) [2025-10-28T19:17:32.235617] [DEBUG] [LOCAL ] HPI: Primary data saved (10492 records). [2025-10-28T19:17:32.235749] [INFO ] [MAIN ] HPI: Full history saved. [2025-10-28T19:17:32.235829] [INFO ] [MAIN ] Update Progress: 1046/2366 symbols completed. HPI took 29.8s. Estimated remaining: 2h 53m 30s. Rate: 7.6 symbols/min [2025-10-28T19:17:32.402988] [INFO ] [MAIN ] HQH: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:17:32.429436] [DEBUG] [LOCAL ] HQH: Loaded 25547 existing records from primary storage. [2025-10-28T19:17:32.429681] [INFO ] [MAIN ] HQH: Loaded 25547 existing records. [2025-10-28T19:17:32.613901] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-28T19:17:32.618182] [WARN ] [MAIN ] HQH: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:17:32.620859] [INFO ] [MAIN ] HQH: Wiping existing primary data before full refresh. [2025-10-28T19:17:32.621169] [INFO ] [LOCAL ] HQH: Starting deletion of primary data. [2025-10-28T19:17:32.621471] [DEBUG] [LOCAL ] HQH: Deleted primary data file. [2025-10-28T19:17:32.621529] [INFO ] [MAIN ] HQH: Starting full primary refresh. [2025-10-28T19:17:32.790016] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-10. [2025-10-28T19:17:32.981892] [INFO ] [REMOTE ] HQH: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:17:33.514871] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-28T19:17:33.525609] [INFO ] [REMOTE ] HPQ: Full fetch complete (77842 records). [2025-10-28T19:17:33.525811] [DEBUG] [VALIDATOR ] HPQ: Validating primary data. [2025-10-28T19:17:33.588702] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-09. [2025-10-28T19:17:33.925609] [DEBUG] [VALIDATOR ] HPQ: All expected trading days are present. [2025-10-28T19:17:33.925723] [DEBUG] [VALIDATOR ] HPQ: Primary data validation passed. [2025-10-28T19:17:33.926814] [INFO ] [MAIN ] HPQ: Fetched primary data is valid. [2025-10-28T19:17:33.926881] [DEBUG] [LOCAL ] HPQ: Saving primary data. [2025-10-28T19:17:33.928408] [DEBUG] [LOCAL ] HPQ: Trimmed 77842 records to 53669 (keeping 200 days of data) [2025-10-28T19:17:34.111537] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-28T19:17:34.263754] [DEBUG] [LOCAL ] HPQ: Primary data saved (53669 records). [2025-10-28T19:17:34.263886] [INFO ] [MAIN ] HPQ: Full history saved. [2025-10-28T19:17:34.263960] [INFO ] [MAIN ] Update Progress: 1047/2366 symbols completed. HPQ took 27.5s. Estimated remaining: 2h 53m 15s. Rate: 7.6 symbols/min [2025-10-28T19:17:34.385402] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-10. [2025-10-28T19:17:34.433185] [INFO ] [MAIN ] HQL: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:17:34.450956] [DEBUG] [LOCAL ] HQL: Loaded 17143 existing records from primary storage. [2025-10-28T19:17:34.451180] [INFO ] [MAIN ] HQL: Loaded 17143 existing records. [2025-10-28T19:17:34.631719] [WARN ] [MAIN ] HQL: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:17:34.631947] [INFO ] [MAIN ] HQL: Wiping existing primary data before full refresh. [2025-10-28T19:17:34.632008] [INFO ] [LOCAL ] HQL: Starting deletion of primary data. [2025-10-28T19:17:34.632236] [DEBUG] [LOCAL ] HQL: Deleted primary data file. [2025-10-28T19:17:34.632283] [INFO ] [MAIN ] HQL: Starting full primary refresh. [2025-10-28T19:17:34.982978] [INFO ] [REMOTE ] HQL: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:17:35.039881] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-10 (0.65 seconds). [2025-10-28T19:17:35.042292] [INFO ] [REMOTE ] HPS: Full fetch complete (14949 records). [2025-10-28T19:17:35.042364] [DEBUG] [VALIDATOR ] HPS: Validating primary data. [2025-10-28T19:17:35.185358] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-01. [2025-10-28T19:17:35.433455] [DEBUG] [VALIDATOR ] HPS: All expected trading days are present. [2025-10-28T19:17:35.433529] [DEBUG] [VALIDATOR ] HPS: Primary data validation passed. [2025-10-28T19:17:35.433877] [INFO ] [MAIN ] HPS: Fetched primary data is valid. [2025-10-28T19:17:35.433936] [DEBUG] [LOCAL ] HPS: Saving primary data. [2025-10-28T19:17:35.434428] [DEBUG] [LOCAL ] HPS: Trimmed 14949 records to 10110 (keeping 200 days of data) [2025-10-28T19:17:35.492543] [DEBUG] [LOCAL ] HPS: Primary data saved (10110 records). [2025-10-28T19:17:35.492679] [INFO ] [MAIN ] HPS: Full history saved. [2025-10-28T19:17:35.492783] [INFO ] [MAIN ] Update Progress: 1048/2366 symbols completed. HPS took 18.1s. Estimated remaining: 2h 52m 59s. Rate: 7.6 symbols/min [2025-10-28T19:17:35.657442] [INFO ] [MAIN ] HR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:17:35.705149] [DEBUG] [LOCAL ] HR: Loaded 52096 existing records from primary storage. [2025-10-28T19:17:35.705432] [INFO ] [MAIN ] HR: Loaded 52096 existing records. [2025-10-28T19:17:35.879455] [WARN ] [MAIN ] HR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:17:35.879702] [INFO ] [MAIN ] HR: Wiping existing primary data before full refresh. [2025-10-28T19:17:35.879767] [INFO ] [LOCAL ] HR: Starting deletion of primary data. [2025-10-28T19:17:35.880178] [DEBUG] [LOCAL ] HR: Deleted primary data file. [2025-10-28T19:17:35.880233] [INFO ] [MAIN ] HR: Starting full primary refresh. [2025-10-28T19:17:35.980259] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-01. [2025-10-28T19:17:36.235360] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-28T19:17:36.256676] [INFO ] [REMOTE ] HR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:17:36.780245] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-01. [2025-10-28T19:17:36.827343] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-10-28T19:17:37.580310] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-07. [2025-10-28T19:17:37.954031] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-28T19:17:38.380296] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-02. [2025-10-28T19:17:38.901889] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-28T19:17:39.180294] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-08. [2025-10-28T19:17:39.511044] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-28T19:17:39.980251] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-02. [2025-10-28T19:17:40.315400] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-28T19:17:40.624271] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-28T19:17:40.780265] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-02. [2025-10-28T19:17:41.563680] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-28T19:17:41.580248] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-09. [2025-10-28T19:17:42.380299] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-03. [2025-10-28T19:17:42.948517] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-10-28T19:17:43.180362] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-10. [2025-10-28T19:17:43.691919] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-28T19:17:43.980330] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-04. [2025-10-28T19:17:44.478036] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-28T19:17:44.488600] [INFO ] [REMOTE ] HPP: Full fetch complete (73362 records). [2025-10-28T19:17:44.488827] [DEBUG] [VALIDATOR ] HPP: Validating primary data. [2025-10-28T19:17:44.785384] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-03. [2025-10-28T19:17:44.902009] [DEBUG] [VALIDATOR ] HPP: All expected trading days are present. [2025-10-28T19:17:44.902085] [DEBUG] [VALIDATOR ] HPP: Primary data validation passed. [2025-10-28T19:17:44.903104] [INFO ] [MAIN ] HPP: Fetched primary data is valid. [2025-10-28T19:17:44.903168] [DEBUG] [LOCAL ] HPP: Saving primary data. [2025-10-28T19:17:44.904615] [DEBUG] [LOCAL ] HPP: Trimmed 73362 records to 51198 (keeping 200 days of data) [2025-10-28T19:17:45.227590] [DEBUG] [LOCAL ] HPP: Primary data saved (51198 records). [2025-10-28T19:17:45.227760] [INFO ] [MAIN ] HPP: Full history saved. [2025-10-28T19:17:45.227875] [INFO ] [MAIN ] Update Progress: 1049/2366 symbols completed. HPP took 41.1s. Estimated remaining: 2h 52m 53s. Rate: 7.6 symbols/min [2025-10-28T19:17:45.405045] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-28T19:17:45.477173] [INFO ] [MAIN ] HRB: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:17:45.518839] [DEBUG] [LOCAL ] HRB: Loaded 48064 existing records from primary storage. [2025-10-28T19:17:45.519127] [INFO ] [MAIN ] HRB: Loaded 48064 existing records. [2025-10-28T19:17:45.582234] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-05. [2025-10-28T19:17:45.666513] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-28T19:17:45.725084] [WARN ] [MAIN ] HRB: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:17:45.725327] [INFO ] [MAIN ] HRB: Wiping existing primary data before full refresh. [2025-10-28T19:17:45.725374] [INFO ] [LOCAL ] HRB: Starting deletion of primary data. [2025-10-28T19:17:45.725752] [DEBUG] [LOCAL ] HRB: Deleted primary data file. [2025-10-28T19:17:45.725810] [INFO ] [MAIN ] HRB: Starting full primary refresh. [2025-10-28T19:17:46.071087] [INFO ] [REMOTE ] HRB: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:17:46.380243] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-04. [2025-10-28T19:17:46.833455] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-28T19:17:47.069220] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-28T19:17:47.180325] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-01. [2025-10-28T19:17:47.980301] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-05. [2025-10-28T19:17:48.444896] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-10-28T19:17:48.780287] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-02. [2025-10-28T19:17:48.848019] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-28T19:17:49.580252] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-06. [2025-10-28T19:17:49.924259] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-28T19:17:50.281252] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-28T19:17:50.380250] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-06. [2025-10-28T19:17:51.180259] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-03. [2025-10-28T19:17:51.808004] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-28T19:17:51.814783] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-28T19:17:51.980233] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-07. [2025-10-28T19:17:52.780245] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-04. [2025-10-28T19:17:53.242630] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-28T19:17:53.379068] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-10-28T19:17:53.580279] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-05. [2025-10-28T19:17:54.211059] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-28T19:17:54.380268] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-03. [2025-10-28T19:17:55.180253] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-07. [2025-10-28T19:17:55.651864] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-28T19:17:55.875071] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-28T19:17:55.980213] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-08. [2025-10-28T19:17:56.779761] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-28T19:17:56.785229] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-08. [2025-10-28T19:17:57.580250] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-06. [2025-10-28T19:17:57.986902] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-28T19:17:58.195356] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-28T19:17:58.380264] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-07. [2025-10-28T19:17:59.036088] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-28T19:17:59.180240] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-09. [2025-10-28T19:17:59.906133] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-28T19:17:59.980205] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-10. [2025-10-28T19:18:00.780252] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-08. [2025-10-28T19:18:01.024979] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-28T19:18:01.030531] [INFO ] [REMOTE ] HQH: Full fetch complete (36838 records). [2025-10-28T19:18:01.030613] [DEBUG] [VALIDATOR ] HQH: Validating primary data. [2025-10-28T19:18:01.443510] [DEBUG] [VALIDATOR ] HQH: All expected trading days are present. [2025-10-28T19:18:01.443578] [DEBUG] [VALIDATOR ] HQH: Primary data validation passed. [2025-10-28T19:18:01.444395] [INFO ] [MAIN ] HQH: Fetched primary data is valid. [2025-10-28T19:18:01.444460] [DEBUG] [LOCAL ] HQH: Saving primary data. [2025-10-28T19:18:01.445409] [DEBUG] [LOCAL ] HQH: Trimmed 36838 records to 25506 (keeping 200 days of data) [2025-10-28T19:18:01.585680] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-04. [2025-10-28T19:18:01.607635] [DEBUG] [LOCAL ] HQH: Primary data saved (25506 records). [2025-10-28T19:18:01.607780] [INFO ] [MAIN ] HQH: Full history saved. [2025-10-28T19:18:01.607859] [INFO ] [MAIN ] Update Progress: 1050/2366 symbols completed. HQH took 29.4s. Estimated remaining: 2h 52m 56s. Rate: 7.6 symbols/min [2025-10-28T19:18:01.760395] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-28T19:18:01.796024] [INFO ] [MAIN ] HRI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:18:01.829480] [DEBUG] [LOCAL ] HRI: Loaded 31983 existing records from primary storage. [2025-10-28T19:18:01.829759] [INFO ] [MAIN ] HRI: Loaded 31983 existing records. [2025-10-28T19:18:02.016461] [WARN ] [MAIN ] HRI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:18:02.016690] [INFO ] [MAIN ] HRI: Wiping existing primary data before full refresh. [2025-10-28T19:18:02.016752] [INFO ] [LOCAL ] HRI: Starting deletion of primary data. [2025-10-28T19:18:02.017027] [DEBUG] [LOCAL ] HRI: Deleted primary data file. [2025-10-28T19:18:02.017087] [INFO ] [MAIN ] HRI: Starting full primary refresh. [2025-10-28T19:18:02.386123] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-09. [2025-10-28T19:18:02.420256] [INFO ] [REMOTE ] HRI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:18:02.800570] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-28T19:18:03.035105] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-10-28T19:18:03.180238] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-01. [2025-10-28T19:18:03.980318] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-09. [2025-10-28T19:18:04.073936] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-28T19:18:04.780340] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-02. [2025-10-28T19:18:05.138130] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-28T19:18:05.571458] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-28T19:18:05.580203] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-03. [2025-10-28T19:18:06.380299] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-05. [2025-10-28T19:18:06.646804] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-28T19:18:07.180254] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-04. [2025-10-28T19:18:07.573418] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-28T19:18:07.980256] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-06. [2025-10-28T19:18:08.251081] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-28T19:18:08.780265] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-10. [2025-10-28T19:18:09.203778] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-28T19:18:09.580300] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-05. [2025-10-28T19:18:10.050620] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-28T19:18:10.061170] [INFO ] [REMOTE ] HR: Full fetch complete (75080 records). [2025-10-28T19:18:10.061286] [DEBUG] [VALIDATOR ] HR: Validating primary data. [2025-10-28T19:18:10.404170] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-07. [2025-10-28T19:18:10.453037] [DEBUG] [VALIDATOR ] HR: All expected trading days are present. [2025-10-28T19:18:10.454096] [DEBUG] [VALIDATOR ] HR: Primary data validation passed. [2025-10-28T19:18:10.455225] [INFO ] [MAIN ] HR: Fetched primary data is valid. [2025-10-28T19:18:10.455462] [DEBUG] [LOCAL ] HR: Saving primary data. [2025-10-28T19:18:10.457481] [DEBUG] [LOCAL ] HR: Trimmed 75080 records to 52094 (keeping 200 days of data) [2025-10-28T19:18:10.689798] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-28T19:18:10.805796] [DEBUG] [LOCAL ] HR: Primary data saved (52094 records). [2025-10-28T19:18:10.805959] [INFO ] [MAIN ] HR: Full history saved. [2025-10-28T19:18:10.806721] [INFO ] [MAIN ] Update Progress: 1051/2366 symbols completed. HR took 35.3s. Estimated remaining: 2h 52m 50s. Rate: 7.6 symbols/min [2025-10-28T19:18:10.972710] [INFO ] [MAIN ] HRL: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:18:11.024445] [DEBUG] [LOCAL ] HRL: Loaded 53115 existing records from primary storage. [2025-10-28T19:18:11.024780] [INFO ] [MAIN ] HRL: Loaded 53115 existing records. [2025-10-28T19:18:11.193816] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-10. [2025-10-28T19:18:11.198463] [WARN ] [MAIN ] HRL: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:18:11.199602] [INFO ] [MAIN ] HRL: Wiping existing primary data before full refresh. [2025-10-28T19:18:11.199680] [INFO ] [LOCAL ] HRL: Starting deletion of primary data. [2025-10-28T19:18:11.200158] [DEBUG] [LOCAL ] HRL: Deleted primary data file. [2025-10-28T19:18:11.200294] [INFO ] [MAIN ] HRL: Starting full primary refresh. [2025-10-28T19:18:11.559600] [INFO ] [REMOTE ] HRL: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:18:11.684314] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-28T19:18:11.980258] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-01. [2025-10-28T19:18:12.093528] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-10 (0.90 seconds). [2025-10-28T19:18:12.099067] [INFO ] [REMOTE ] HQL: Full fetch complete (25496 records). [2025-10-28T19:18:12.099163] [DEBUG] [VALIDATOR ] HQL: Validating primary data. [2025-10-28T19:18:12.472024] [DEBUG] [VALIDATOR ] HQL: All expected trading days are present. [2025-10-28T19:18:12.472101] [DEBUG] [VALIDATOR ] HQL: Primary data validation passed. [2025-10-28T19:18:12.472629] [INFO ] [MAIN ] HQL: Fetched primary data is valid. [2025-10-28T19:18:12.472705] [DEBUG] [LOCAL ] HQL: Saving primary data. [2025-10-28T19:18:12.473334] [DEBUG] [LOCAL ] HQL: Trimmed 25496 records to 17242 (keeping 200 days of data) [2025-10-28T19:18:12.572736] [DEBUG] [LOCAL ] HQL: Primary data saved (17242 records). [2025-10-28T19:18:12.572865] [INFO ] [MAIN ] HQL: Full history saved. [2025-10-28T19:18:12.572942] [INFO ] [MAIN ] Update Progress: 1052/2366 symbols completed. HQL took 38.3s. Estimated remaining: 2h 52m 34s. Rate: 7.6 symbols/min [2025-10-28T19:18:12.747960] [INFO ] [MAIN ] HRTG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:18:12.779684] [DEBUG] [LOCAL ] HRTG: Loaded 34356 existing records from primary storage. [2025-10-28T19:18:12.779948] [INFO ] [MAIN ] HRTG: Loaded 34356 existing records. [2025-10-28T19:18:12.790864] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-08. [2025-10-28T19:18:12.962484] [WARN ] [MAIN ] HRTG: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:18:12.962776] [INFO ] [MAIN ] HRTG: Wiping existing primary data before full refresh. [2025-10-28T19:18:12.962840] [INFO ] [LOCAL ] HRTG: Starting deletion of primary data. [2025-10-28T19:18:12.963229] [DEBUG] [LOCAL ] HRTG: Deleted primary data file. [2025-10-28T19:18:12.963290] [INFO ] [MAIN ] HRTG: Starting full primary refresh. [2025-10-28T19:18:13.330021] [INFO ] [REMOTE ] HRTG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:18:13.435618] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-10-28T19:18:13.580234] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-01. [2025-10-28T19:18:14.110791] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-28T19:18:14.231881] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-28T19:18:14.380287] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-06. [2025-10-28T19:18:15.180270] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-09. [2025-10-28T19:18:15.230407] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-28T19:18:15.980292] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-02. [2025-10-28T19:18:16.388247] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-28T19:18:16.780276] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-02. [2025-10-28T19:18:17.203370] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-10-28T19:18:17.283063] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-28T19:18:17.580280] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-10. [2025-10-28T19:18:18.380253] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-03. [2025-10-28T19:18:18.912134] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-10 (1.33 seconds). [2025-10-28T19:18:18.921621] [INFO ] [REMOTE ] HRB: Full fetch complete (69814 records). [2025-10-28T19:18:18.921820] [DEBUG] [VALIDATOR ] HRB: Validating primary data. [2025-10-28T19:18:19.188549] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-07. [2025-10-28T19:18:19.309233] [DEBUG] [VALIDATOR ] HRB: All expected trading days are present. [2025-10-28T19:18:19.309317] [DEBUG] [VALIDATOR ] HRB: Primary data validation passed. [2025-10-28T19:18:19.310248] [INFO ] [MAIN ] HRB: Fetched primary data is valid. [2025-10-28T19:18:19.310312] [DEBUG] [LOCAL ] HRB: Saving primary data. [2025-10-28T19:18:19.311795] [DEBUG] [LOCAL ] HRB: Trimmed 69814 records to 47981 (keeping 200 days of data) [2025-10-28T19:18:19.603702] [DEBUG] [LOCAL ] HRB: Primary data saved (47981 records). [2025-10-28T19:18:19.618407] [INFO ] [MAIN ] HRB: Full history saved. [2025-10-28T19:18:19.631575] [INFO ] [MAIN ] Update Progress: 1053/2366 symbols completed. HRB took 34.4s. Estimated remaining: 2h 52m 25s. Rate: 7.6 symbols/min [2025-10-28T19:18:19.669743] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-28T19:18:19.818753] [INFO ] [MAIN ] HSBC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:18:19.863989] [DEBUG] [LOCAL ] HSBC: Loaded 50955 existing records from primary storage. [2025-10-28T19:18:19.864270] [INFO ] [MAIN ] HSBC: Loaded 50955 existing records. [2025-10-28T19:18:19.985362] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-04. [2025-10-28T19:18:20.040404] [WARN ] [MAIN ] HSBC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:18:20.040666] [INFO ] [MAIN ] HSBC: Wiping existing primary data before full refresh. [2025-10-28T19:18:20.040727] [INFO ] [LOCAL ] HSBC: Starting deletion of primary data. [2025-10-28T19:18:20.041088] [DEBUG] [LOCAL ] HSBC: Deleted primary data file. [2025-10-28T19:18:20.041144] [INFO ] [MAIN ] HSBC: Starting full primary refresh. [2025-10-28T19:18:20.401160] [INFO ] [REMOTE ] HSBC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:18:20.425193] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-28T19:18:20.780271] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-01. [2025-10-28T19:18:21.506711] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-28T19:18:21.580244] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-05. [2025-10-28T19:18:22.172459] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-28T19:18:22.380260] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-02. [2025-10-28T19:18:23.178872] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-10-28T19:18:23.188903] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-08. [2025-10-28T19:18:23.986873] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-06. [2025-10-28T19:18:24.013590] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-10-28T19:18:24.075791] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-28T19:18:24.780336] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-03. [2025-10-28T19:18:25.224472] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-28T19:18:25.580219] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-07. [2025-10-28T19:18:26.389834] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-09. [2025-10-28T19:18:26.415488] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-10-28T19:18:26.865803] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-28T19:18:27.180270] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-04. [2025-10-28T19:18:27.469555] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-28T19:18:27.980335] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-08. [2025-10-28T19:18:28.642220] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-28T19:18:28.780230] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-05. [2025-10-28T19:18:29.269085] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-10-28T19:18:29.580298] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-09. [2025-10-28T19:18:30.337198] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-28T19:18:30.380336] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-10. [2025-10-28T19:18:31.180365] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-06. [2025-10-28T19:18:31.432495] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-10-28T19:18:31.531092] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-28T19:18:31.537332] [INFO ] [REMOTE ] HRI: Full fetch complete (46912 records). [2025-10-28T19:18:31.537422] [DEBUG] [VALIDATOR ] HRI: Validating primary data. [2025-10-28T19:18:31.921531] [DEBUG] [VALIDATOR ] HRI: All expected trading days are present. [2025-10-28T19:18:31.921612] [DEBUG] [VALIDATOR ] HRI: Primary data validation passed. [2025-10-28T19:18:31.922333] [INFO ] [MAIN ] HRI: Fetched primary data is valid. [2025-10-28T19:18:31.922390] [DEBUG] [LOCAL ] HRI: Saving primary data. [2025-10-28T19:18:31.923297] [DEBUG] [LOCAL ] HRI: Trimmed 46912 records to 32021 (keeping 200 days of data) [2025-10-28T19:18:31.986532] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-10. [2025-10-28T19:18:32.123474] [DEBUG] [LOCAL ] HRI: Primary data saved (32021 records). [2025-10-28T19:18:32.123591] [INFO ] [MAIN ] HRI: Full history saved. [2025-10-28T19:18:32.123684] [INFO ] [MAIN ] Update Progress: 1054/2366 symbols completed. HRI took 30.5s. Estimated remaining: 2h 52m 23s. Rate: 7.6 symbols/min [2025-10-28T19:18:32.292464] [INFO ] [MAIN ] HSHP: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:18:32.306947] [DEBUG] [LOCAL ] HSHP: Loaded 14105 existing records from primary storage. [2025-10-28T19:18:32.307226] [INFO ] [MAIN ] HSHP: Loaded 14105 existing records. [2025-10-28T19:18:32.486485] [WARN ] [MAIN ] HSHP: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:18:32.486761] [INFO ] [MAIN ] HSHP: Wiping existing primary data before full refresh. [2025-10-28T19:18:32.486944] [INFO ] [LOCAL ] HSHP: Starting deletion of primary data. [2025-10-28T19:18:32.487235] [DEBUG] [LOCAL ] HSHP: Deleted primary data file. [2025-10-28T19:18:32.487297] [INFO ] [MAIN ] HSHP: Starting full primary refresh. [2025-10-28T19:18:32.799371] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-10-28T19:18:32.797560] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-03. [2025-10-28T19:18:32.898000] [INFO ] [REMOTE ] HSHP: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:18:33.581085] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-01. [2025-10-28T19:18:33.580957] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-28T19:18:33.612771] [INFO ] [REMOTE ] HRL: Full fetch complete (77029 records). [2025-10-28T19:18:33.614102] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-28T19:18:33.621549] [DEBUG] [VALIDATOR ] HRL: Validating primary data. [2025-10-28T19:18:34.009143] [DEBUG] [VALIDATOR ] HRL: All expected trading days are present. [2025-10-28T19:18:34.009221] [DEBUG] [VALIDATOR ] HRL: Primary data validation passed. [2025-10-28T19:18:34.010197] [INFO ] [MAIN ] HRL: Fetched primary data is valid. [2025-10-28T19:18:34.010258] [DEBUG] [LOCAL ] HRL: Saving primary data. [2025-10-28T19:18:34.011697] [DEBUG] [LOCAL ] HRL: Trimmed 77029 records to 53113 (keeping 200 days of data) [2025-10-28T19:18:34.230042] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-28T19:18:34.345302] [DEBUG] [LOCAL ] HRL: Primary data saved (53113 records). [2025-10-28T19:18:34.345435] [INFO ] [MAIN ] HRL: Full history saved. [2025-10-28T19:18:34.346235] [INFO ] [MAIN ] Update Progress: 1055/2366 symbols completed. HRL took 23.5s. Estimated remaining: 2h 52m 8s. Rate: 7.6 symbols/min [2025-10-28T19:18:34.385349] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-02. [2025-10-28T19:18:34.515800] [INFO ] [MAIN ] HSY: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:18:34.564424] [DEBUG] [LOCAL ] HSY: Loaded 50292 existing records from primary storage. [2025-10-28T19:18:34.564726] [INFO ] [MAIN ] HSY: Loaded 50292 existing records. [2025-10-28T19:18:34.739598] [WARN ] [MAIN ] HSY: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:18:34.739815] [INFO ] [MAIN ] HSY: Wiping existing primary data before full refresh. [2025-10-28T19:18:34.739872] [INFO ] [LOCAL ] HSY: Starting deletion of primary data. [2025-10-28T19:18:34.740384] [DEBUG] [LOCAL ] HSY: Deleted primary data file. [2025-10-28T19:18:34.740424] [INFO ] [MAIN ] HSY: Starting full primary refresh. [2025-10-28T19:18:35.098764] [INFO ] [REMOTE ] HSY: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:18:35.109460] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-28T19:18:35.180227] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-03. [2025-10-28T19:18:35.943393] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-28T19:18:35.980242] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-04. [2025-10-28T19:18:36.667978] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-28T19:18:36.780286] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-04. [2025-10-28T19:18:37.580277] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-05. [2025-10-28T19:18:37.700042] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-28T19:18:38.189408] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-10-28T19:18:38.380263] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-05. [2025-10-28T19:18:39.180288] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-01. [2025-10-28T19:18:39.400373] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-28T19:18:39.980280] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-06. [2025-10-28T19:18:40.454441] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-28T19:18:40.619112] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-28T19:18:40.780287] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-02. [2025-10-28T19:18:41.580272] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-06. [2025-10-28T19:18:42.065893] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-28T19:18:42.380230] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-03. [2025-10-28T19:18:42.559993] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-28T19:18:43.180246] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-07. [2025-10-28T19:18:43.657255] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-28T19:18:43.980249] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-07. [2025-10-28T19:18:44.644813] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-10-28T19:18:44.677189] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-10-28T19:18:44.780233] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-08. [2025-10-28T19:18:45.580253] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-08. [2025-10-28T19:18:46.055181] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-28T19:18:46.073103] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-28T19:18:46.380306] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-04. [2025-10-28T19:18:47.180252] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-09. [2025-10-28T19:18:47.873243] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-28T19:18:47.937349] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-28T19:18:47.980225] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-10. [2025-10-28T19:18:48.728049] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-10 (0.75 seconds). [2025-10-28T19:18:48.730936] [INFO ] [REMOTE ] HSHP: Full fetch complete (22858 records). [2025-10-28T19:18:48.731036] [DEBUG] [VALIDATOR ] HSHP: Validating primary data. [2025-10-28T19:18:48.785448] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-05. [2025-10-28T19:18:49.095498] [DEBUG] [VALIDATOR ] HSHP: All expected trading days are present. [2025-10-28T19:18:49.095576] [DEBUG] [VALIDATOR ] HSHP: Primary data validation passed. [2025-10-28T19:18:49.096068] [INFO ] [MAIN ] HSHP: Fetched primary data is valid. [2025-10-28T19:18:49.096128] [DEBUG] [LOCAL ] HSHP: Saving primary data. [2025-10-28T19:18:49.096833] [DEBUG] [LOCAL ] HSHP: Trimmed 22858 records to 13903 (keeping 200 days of data) [2025-10-28T19:18:49.174761] [DEBUG] [LOCAL ] HSHP: Primary data saved (13903 records). [2025-10-28T19:18:49.174902] [INFO ] [MAIN ] HSHP: Full history saved. [2025-10-28T19:18:49.174979] [INFO ] [MAIN ] Update Progress: 1056/2366 symbols completed. HSHP took 17.1s. Estimated remaining: 2h 52m 9s. Rate: 7.6 symbols/min [2025-10-28T19:18:49.348612] [INFO ] [MAIN ] HTB: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:18:49.348812] [DEBUG] [LOCAL ] HTB: No existing data file found in primary storage. [2025-10-28T19:18:49.348855] [WARN ] [MAIN ] HTB: No existing data found, performing full refresh instead. [2025-10-28T19:18:49.348965] [INFO ] [MAIN ] HTB: Wiping existing primary data before full refresh. [2025-10-28T19:18:49.349006] [INFO ] [LOCAL ] HTB: Starting deletion of primary data. [2025-10-28T19:18:49.349048] [DEBUG] [LOCAL ] HTB: No primary data file found to delete. [2025-10-28T19:18:49.349080] [INFO ] [MAIN ] HTB: Starting full primary refresh. [2025-10-28T19:18:49.589231] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-07. [2025-10-28T19:18:49.714497] [INFO ] [REMOTE ] HTB: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:18:50.364182] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-10-28T19:18:50.380227] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-06. [2025-10-28T19:18:50.553788] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-28T19:18:51.180320] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-08. [2025-10-28T19:18:51.597703] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-28T19:18:51.980260] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-09. [2025-10-28T19:18:52.206390] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-28T19:18:52.780225] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-09. [2025-10-28T19:18:53.443354] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-10-28T19:18:53.580259] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-10. [2025-10-28T19:18:53.733993] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-28T19:18:54.380259] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-07. [2025-10-28T19:18:55.073078] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-28T19:18:55.083791] [INFO ] [REMOTE ] HSBC: Full fetch complete (74281 records). [2025-10-28T19:18:55.083961] [DEBUG] [VALIDATOR ] HSBC: Validating primary data. [2025-10-28T19:18:55.185380] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-10. [2025-10-28T19:18:55.472984] [DEBUG] [VALIDATOR ] HSBC: All expected trading days are present. [2025-10-28T19:18:55.473081] [DEBUG] [VALIDATOR ] HSBC: Primary data validation passed. [2025-10-28T19:18:55.474062] [INFO ] [MAIN ] HSBC: Fetched primary data is valid. [2025-10-28T19:18:55.474122] [DEBUG] [LOCAL ] HSBC: Saving primary data. [2025-10-28T19:18:55.475476] [DEBUG] [LOCAL ] HSBC: Trimmed 74281 records to 50952 (keeping 200 days of data) [2025-10-28T19:18:55.810921] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-10-28T19:18:55.830697] [DEBUG] [LOCAL ] HSBC: Primary data saved (50952 records). [2025-10-28T19:18:55.831159] [INFO ] [MAIN ] HSBC: Full history saved. [2025-10-28T19:18:55.831400] [INFO ] [MAIN ] Update Progress: 1057/2366 symbols completed. HSBC took 36.2s. Estimated remaining: 2h 51m 59s. Rate: 7.6 symbols/min [2025-10-28T19:18:55.998679] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-01. [2025-10-28T19:18:56.007935] [INFO ] [MAIN ] HTD: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:18:56.024091] [DEBUG] [LOCAL ] HTD: Loaded 14025 existing records from primary storage. [2025-10-28T19:18:56.024326] [INFO ] [MAIN ] HTD: Loaded 14025 existing records. [2025-10-28T19:18:56.205168] [WARN ] [MAIN ] HTD: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:18:56.205371] [INFO ] [MAIN ] HTD: Wiping existing primary data before full refresh. [2025-10-28T19:18:56.205420] [INFO ] [LOCAL ] HTD: Starting deletion of primary data. [2025-10-28T19:18:56.205611] [DEBUG] [LOCAL ] HTD: Deleted primary data file. [2025-10-28T19:18:56.205697] [INFO ] [MAIN ] HTD: Starting full primary refresh. [2025-10-28T19:18:56.270819] [DEBUG] [REMOTE ] HTB: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-28T19:18:56.294263] [WARN ] [REMOTE ] HTB: No data returned for month 2025-01 [2025-10-28T19:18:56.307845] [FATAL] [REMOTE ] HTB: API call failed - aborting fetch to avoid wasting further API calls [2025-10-28T19:18:56.308035] [FATAL] [MAIN ] HTB: Failed to fetch primary data. [2025-10-28T19:18:56.311587] [WARN ] [MAIN ] HTB: Deleting existing primary and derivative data due to fetch failure. [2025-10-28T19:18:56.312077] [INFO ] [LOCAL ] HTB: Starting deletion of primary data. [2025-10-28T19:18:56.317543] [DEBUG] [LOCAL ] HTB: No primary data file found to delete. [2025-10-28T19:18:56.328073] [INFO ] [LOCAL ] HTB: Starting deletion of derivative data. [2025-10-28T19:18:56.328279] [DEBUG] [LOCAL ] HTB: No derivative data file found to delete. [2025-10-28T19:18:56.357609] [INFO ] [MAIN ] Update Progress: 1058/2366 symbols completed. HTB took 7.2s. Estimated remaining: 2h 51m 42s. Rate: 7.6 symbols/min [2025-10-28T19:18:56.691600] [INFO ] [MAIN ] HTFC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:18:56.718767] [DEBUG] [LOCAL ] HTFC: No existing data file found in primary storage. [2025-10-28T19:18:56.788490] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-08. [2025-10-28T19:18:56.772831] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-28T19:18:56.792622] [WARN ] [MAIN ] HTFC: No existing data found, performing full refresh instead. [2025-10-28T19:18:56.792447] [INFO ] [REMOTE ] HTD: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:18:56.801043] [INFO ] [MAIN ] HTFC: Wiping existing primary data before full refresh. [2025-10-28T19:18:56.801317] [INFO ] [LOCAL ] HTFC: Starting deletion of primary data. [2025-10-28T19:18:56.801733] [DEBUG] [LOCAL ] HTFC: No primary data file found to delete. [2025-10-28T19:18:56.801971] [INFO ] [MAIN ] HTFC: Starting full primary refresh. [2025-10-28T19:18:56.814042] [INFO ] [REMOTE ] HRTG: Full fetch complete (44479 records). [2025-10-28T19:18:56.835626] [DEBUG] [VALIDATOR ] HRTG: Validating primary data. [2025-10-28T19:18:57.473036] [INFO ] [REMOTE ] HTFC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:18:57.559997] [DEBUG] [VALIDATOR ] HRTG: All expected trading days are present. [2025-10-28T19:18:57.560072] [DEBUG] [VALIDATOR ] HRTG: Primary data validation passed. [2025-10-28T19:18:57.560865] [INFO ] [MAIN ] HRTG: Fetched primary data is valid. [2025-10-28T19:18:57.560975] [DEBUG] [LOCAL ] HRTG: Saving primary data. [2025-10-28T19:18:57.561991] [DEBUG] [LOCAL ] HRTG: Trimmed 44479 records to 34248 (keeping 200 days of data) [2025-10-28T19:18:57.608871] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-01. [2025-10-28T19:18:57.759575] [DEBUG] [LOCAL ] HRTG: Primary data saved (34248 records). [2025-10-28T19:18:57.759728] [INFO ] [MAIN ] HRTG: Full history saved. [2025-10-28T19:18:57.759813] [INFO ] [MAIN ] Update Progress: 1059/2366 symbols completed. HRTG took 45.2s. Estimated remaining: 2h 51m 27s. Rate: 7.6 symbols/min [2025-10-28T19:18:57.939794] [INFO ] [MAIN ] HTGC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:18:57.982748] [DEBUG] [LOCAL ] HTGC: Loaded 47529 existing records from primary storage. [2025-10-28T19:18:57.983099] [INFO ] [MAIN ] HTGC: Loaded 47529 existing records. [2025-10-28T19:18:58.168004] [WARN ] [MAIN ] HTGC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:18:58.168333] [INFO ] [MAIN ] HTGC: Wiping existing primary data before full refresh. [2025-10-28T19:18:58.168466] [INFO ] [LOCAL ] HTGC: Starting deletion of primary data. [2025-10-28T19:18:58.177699] [DEBUG] [LOCAL ] HTGC: Deleted primary data file. [2025-10-28T19:18:58.177530] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-28T19:18:58.180718] [INFO ] [MAIN ] HTGC: Starting full primary refresh. [2025-10-28T19:18:58.385376] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-02. [2025-10-28T19:18:58.551849] [INFO ] [REMOTE ] HTGC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:18:58.593964] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-28T19:18:58.931144] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-28T19:18:59.180243] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-03. [2025-10-28T19:18:59.766287] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-28T19:18:59.980283] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-04. [2025-10-28T19:19:00.631301] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-28T19:19:00.780315] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-01. [2025-10-28T19:19:01.034838] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-01 (0.25 seconds). [2025-10-28T19:19:01.580305] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-01. [2025-10-28T19:19:02.380295] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-02. [2025-10-28T19:19:02.623802] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-02 (0.24 seconds). [2025-10-28T19:19:02.896550] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-28T19:19:03.180290] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-09. [2025-10-28T19:19:03.980322] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-02. [2025-10-28T19:19:04.461525] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-28T19:19:04.780313] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-10. [2025-10-28T19:19:05.157909] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-28T19:19:05.518268] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-28T19:19:05.528475] [INFO ] [REMOTE ] HSY: Full fetch complete (73542 records). [2025-10-28T19:19:05.528633] [DEBUG] [VALIDATOR ] HSY: Validating primary data. [2025-10-28T19:19:05.585476] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-05. [2025-10-28T19:19:05.925248] [DEBUG] [VALIDATOR ] HSY: All expected trading days are present. [2025-10-28T19:19:05.925329] [DEBUG] [VALIDATOR ] HSY: Primary data validation passed. [2025-10-28T19:19:05.926416] [INFO ] [MAIN ] HSY: Fetched primary data is valid. [2025-10-28T19:19:05.926478] [DEBUG] [LOCAL ] HSY: Saving primary data. [2025-10-28T19:19:05.927831] [DEBUG] [LOCAL ] HSY: Trimmed 73542 records to 50287 (keeping 200 days of data) [2025-10-28T19:19:06.240697] [DEBUG] [LOCAL ] HSY: Primary data saved (50287 records). [2025-10-28T19:19:06.240933] [INFO ] [MAIN ] HSY: Full history saved. [2025-10-28T19:19:06.241827] [INFO ] [MAIN ] Update Progress: 1060/2366 symbols completed. HSY took 31.9s. Estimated remaining: 2h 51m 20s. Rate: 7.6 symbols/min [2025-10-28T19:19:06.365220] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-10-28T19:19:06.383800] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-03. [2025-10-28T19:19:06.452748] [INFO ] [MAIN ] HTH: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:19:06.484838] [DEBUG] [LOCAL ] HTH: Loaded 32247 existing records from primary storage. [2025-10-28T19:19:06.485123] [INFO ] [MAIN ] HTH: Loaded 32247 existing records. [2025-10-28T19:19:06.662762] [WARN ] [MAIN ] HTH: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:19:06.662968] [INFO ] [MAIN ] HTH: Wiping existing primary data before full refresh. [2025-10-28T19:19:06.663017] [INFO ] [LOCAL ] HTH: Starting deletion of primary data. [2025-10-28T19:19:06.663257] [DEBUG] [LOCAL ] HTH: Deleted primary data file. [2025-10-28T19:19:06.663299] [INFO ] [MAIN ] HTH: Starting full primary refresh. [2025-10-28T19:19:06.730089] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-10-28T19:19:07.024028] [INFO ] [REMOTE ] HTH: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:19:07.180300] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-04. [2025-10-28T19:19:07.438777] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-04 (0.26 seconds). [2025-10-28T19:19:07.980253] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-01. [2025-10-28T19:19:08.672911] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-28T19:19:08.780296] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-05. [2025-10-28T19:19:09.008665] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-05 (0.23 seconds). [2025-10-28T19:19:09.580247] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-06. [2025-10-28T19:19:10.100244] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-10-28T19:19:10.380236] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-06. [2025-10-28T19:19:10.634421] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-06 (0.25 seconds). [2025-10-28T19:19:11.180295] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-02. [2025-10-28T19:19:11.980223] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-07. [2025-10-28T19:19:12.150555] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-28T19:19:12.160699] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-07 (0.18 seconds). [2025-10-28T19:19:12.780232] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-03. [2025-10-28T19:19:13.580256] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-03. [2025-10-28T19:19:13.998407] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-28T19:19:14.366507] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-10-28T19:19:14.380204] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-04. [2025-10-28T19:19:15.180224] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-08. [2025-10-28T19:19:15.249991] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-28T19:19:15.365116] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-08 (0.18 seconds). [2025-10-28T19:19:15.980308] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-09. [2025-10-28T19:19:16.204469] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-09 (0.22 seconds). [2025-10-28T19:19:16.780308] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-04. [2025-10-28T19:19:17.580263] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-07. [2025-10-28T19:19:18.062062] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-28T19:19:18.280713] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-28T19:19:18.380287] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-08. [2025-10-28T19:19:18.956456] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-28T19:19:19.180301] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-05. [2025-10-28T19:19:19.980222] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-05. [2025-10-28T19:19:20.660703] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-10-28T19:19:20.780251] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-10. [2025-10-28T19:19:20.988546] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-28T19:19:21.210262] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-10 (0.43 seconds). [2025-10-28T19:19:21.210922] [INFO ] [REMOTE ] HTFC: Full fetch complete (832 records). [2025-10-28T19:19:21.210987] [DEBUG] [VALIDATOR ] HTFC: Validating primary data. [2025-10-28T19:19:21.383525] [WARN ] [VALIDATOR ] HTFC: Validation failed - insufficient historical data. Have 183 unique days, need 200 days [2025-10-28T19:19:21.383724] [FATAL] [MAIN ] HTFC: Fetched primary data is invalid. Refusing to save it. [2025-10-28T19:19:21.383789] [WARN ] [MAIN ] HTFC: Deleting existing primary and derivative data due to validation failure. [2025-10-28T19:19:21.383856] [INFO ] [LOCAL ] HTFC: Starting deletion of primary data. [2025-10-28T19:19:21.383921] [DEBUG] [LOCAL ] HTFC: No primary data file found to delete. [2025-10-28T19:19:21.383956] [INFO ] [LOCAL ] HTFC: Starting deletion of derivative data. [2025-10-28T19:19:21.383994] [DEBUG] [LOCAL ] HTFC: No derivative data file found to delete. [2025-10-28T19:19:21.384047] [INFO ] [MAIN ] Update Progress: 1061/2366 symbols completed. HTFC took 25.0s. Estimated remaining: 2h 51m 21s. Rate: 7.6 symbols/min [2025-10-28T19:19:21.545875] [INFO ] [MAIN ] HUBB: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:19:21.579438] [DEBUG] [LOCAL ] HUBB: Loaded 35660 existing records from primary storage. [2025-10-28T19:19:21.579741] [INFO ] [MAIN ] HUBB: Loaded 35660 existing records. [2025-10-28T19:19:21.590418] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-06. [2025-10-28T19:19:21.763798] [WARN ] [MAIN ] HUBB: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:19:21.764033] [INFO ] [MAIN ] HUBB: Wiping existing primary data before full refresh. [2025-10-28T19:19:21.764083] [INFO ] [LOCAL ] HUBB: Starting deletion of primary data. [2025-10-28T19:19:21.764436] [DEBUG] [LOCAL ] HUBB: Deleted primary data file. [2025-10-28T19:19:21.764496] [INFO ] [MAIN ] HUBB: Starting full primary refresh. [2025-10-28T19:19:22.119324] [INFO ] [REMOTE ] HUBB: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:19:22.380271] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-01. [2025-10-28T19:19:22.815330] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-28T19:19:23.180305] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-06. [2025-10-28T19:19:23.474702] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-28T19:19:23.980229] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-02. [2025-10-28T19:19:24.114823] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-28T19:19:24.780287] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-09. [2025-10-28T19:19:25.147268] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-28T19:19:25.402385] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-10-28T19:19:25.580271] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-10. [2025-10-28T19:19:26.320890] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-28T19:19:26.324787] [INFO ] [REMOTE ] HTD: Full fetch complete (19526 records). [2025-10-28T19:19:26.324914] [DEBUG] [VALIDATOR ] HTD: Validating primary data. [2025-10-28T19:19:26.387884] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-07. [2025-10-28T19:19:26.700521] [DEBUG] [VALIDATOR ] HTD: All expected trading days are present. [2025-10-28T19:19:26.700598] [DEBUG] [VALIDATOR ] HTD: Primary data validation passed. [2025-10-28T19:19:26.701022] [INFO ] [MAIN ] HTD: Fetched primary data is valid. [2025-10-28T19:19:26.701083] [DEBUG] [LOCAL ] HTD: Saving primary data. [2025-10-28T19:19:26.701696] [DEBUG] [LOCAL ] HTD: Trimmed 19526 records to 14039 (keeping 200 days of data) [2025-10-28T19:19:26.785486] [DEBUG] [LOCAL ] HTD: Primary data saved (14039 records). [2025-10-28T19:19:26.785626] [INFO ] [MAIN ] HTD: Full history saved. [2025-10-28T19:19:26.785744] [INFO ] [MAIN ] Update Progress: 1062/2366 symbols completed. HTD took 31.0s. Estimated remaining: 2h 51m 10s. Rate: 7.6 symbols/min [2025-10-28T19:19:26.955190] [INFO ] [MAIN ] HUBS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:19:26.991822] [DEBUG] [LOCAL ] HUBS: Loaded 39652 existing records from primary storage. [2025-10-28T19:19:26.992112] [INFO ] [MAIN ] HUBS: Loaded 39652 existing records. [2025-10-28T19:19:27.170150] [WARN ] [MAIN ] HUBS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:19:27.170360] [INFO ] [MAIN ] HUBS: Wiping existing primary data before full refresh. [2025-10-28T19:19:27.170410] [INFO ] [LOCAL ] HUBS: Starting deletion of primary data. [2025-10-28T19:19:27.170670] [DEBUG] [LOCAL ] HUBS: Deleted primary data file. [2025-10-28T19:19:27.170746] [INFO ] [MAIN ] HUBS: Starting full primary refresh. [2025-10-28T19:19:27.185364] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-07. [2025-10-28T19:19:27.546705] [INFO ] [REMOTE ] HUBS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:19:27.642683] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-28T19:19:27.980248] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-03. [2025-10-28T19:19:28.202987] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-28T19:19:28.780282] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-08. [2025-10-28T19:19:29.309208] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-28T19:19:29.580273] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-04. [2025-10-28T19:19:29.944271] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-28T19:19:30.380315] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-09. [2025-10-28T19:19:30.830022] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-28T19:19:31.180313] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-01. [2025-10-28T19:19:31.617077] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-28T19:19:31.980326] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-10. [2025-10-28T19:19:32.183534] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-28T19:19:32.780334] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-05. [2025-10-28T19:19:33.362930] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-28T19:19:33.372747] [INFO ] [REMOTE ] HTGC: Full fetch complete (68857 records). [2025-10-28T19:19:33.372865] [DEBUG] [VALIDATOR ] HTGC: Validating primary data. [2025-10-28T19:19:33.585770] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-02. [2025-10-28T19:19:33.762736] [DEBUG] [VALIDATOR ] HTGC: All expected trading days are present. [2025-10-28T19:19:33.762971] [DEBUG] [VALIDATOR ] HTGC: Primary data validation passed. [2025-10-28T19:19:33.764041] [INFO ] [MAIN ] HTGC: Fetched primary data is valid. [2025-10-28T19:19:33.764119] [DEBUG] [LOCAL ] HTGC: Saving primary data. [2025-10-28T19:19:33.765693] [DEBUG] [LOCAL ] HTGC: Trimmed 68857 records to 47495 (keeping 200 days of data) [2025-10-28T19:19:34.011739] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-28T19:19:34.080179] [DEBUG] [LOCAL ] HTGC: Primary data saved (47495 records). [2025-10-28T19:19:34.080303] [INFO ] [MAIN ] HTGC: Full history saved. [2025-10-28T19:19:34.080399] [INFO ] [MAIN ] Update Progress: 1063/2366 symbols completed. HTGC took 36.3s. Estimated remaining: 2h 51m 1s. Rate: 7.6 symbols/min [2025-10-28T19:19:34.244921] [INFO ] [MAIN ] HUM: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:19:34.286819] [DEBUG] [LOCAL ] HUM: Loaded 49027 existing records from primary storage. [2025-10-28T19:19:34.287132] [INFO ] [MAIN ] HUM: Loaded 49027 existing records. [2025-10-28T19:19:34.384480] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-06. [2025-10-28T19:19:34.462384] [WARN ] [MAIN ] HUM: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:19:34.462580] [INFO ] [MAIN ] HUM: Wiping existing primary data before full refresh. [2025-10-28T19:19:34.462627] [INFO ] [LOCAL ] HUM: Starting deletion of primary data. [2025-10-28T19:19:34.463000] [DEBUG] [LOCAL ] HUM: Deleted primary data file. [2025-10-28T19:19:34.463057] [INFO ] [MAIN ] HUM: Starting full primary refresh. [2025-10-28T19:19:34.811146] [INFO ] [REMOTE ] HUM: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:19:34.869509] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-10-28T19:19:35.180268] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-01. [2025-10-28T19:19:35.355676] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-28T19:19:35.980320] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-07. [2025-10-28T19:19:36.423075] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-28T19:19:36.780289] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-03. [2025-10-28T19:19:37.038749] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-28T19:19:37.580255] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-08. [2025-10-28T19:19:37.994435] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-28T19:19:38.380323] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-08. [2025-10-28T19:19:38.754535] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-10-28T19:19:39.180334] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-09. [2025-10-28T19:19:39.321977] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-10-28T19:19:39.968633] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-28T19:19:39.980263] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-09. [2025-10-28T19:19:40.780266] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-10. [2025-10-28T19:19:40.911309] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-28T19:19:41.580224] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-10. [2025-10-28T19:19:41.649609] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-28T19:19:41.655598] [INFO ] [REMOTE ] HTH: Full fetch complete (46863 records). [2025-10-28T19:19:41.655731] [DEBUG] [VALIDATOR ] HTH: Validating primary data. [2025-10-28T19:19:42.052246] [DEBUG] [VALIDATOR ] HTH: All expected trading days are present. [2025-10-28T19:19:42.052341] [DEBUG] [VALIDATOR ] HTH: Primary data validation passed. [2025-10-28T19:19:42.053194] [INFO ] [MAIN ] HTH: Fetched primary data is valid. [2025-10-28T19:19:42.053258] [DEBUG] [LOCAL ] HTH: Saving primary data. [2025-10-28T19:19:42.054228] [DEBUG] [LOCAL ] HTH: Trimmed 46863 records to 32136 (keeping 200 days of data) [2025-10-28T19:19:42.243064] [DEBUG] [LOCAL ] HTH: Primary data saved (32136 records). [2025-10-28T19:19:42.243203] [INFO ] [MAIN ] HTH: Full history saved. [2025-10-28T19:19:42.243283] [INFO ] [MAIN ] Update Progress: 1064/2366 symbols completed. HTH took 36.0s. Estimated remaining: 2h 50m 54s. Rate: 7.6 symbols/min [2025-10-28T19:19:42.386459] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-02. [2025-10-28T19:19:42.418371] [INFO ] [MAIN ] HUN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:19:42.478155] [DEBUG] [LOCAL ] HUN: Loaded 53210 existing records from primary storage. [2025-10-28T19:19:42.478994] [INFO ] [MAIN ] HUN: Loaded 53210 existing records. [2025-10-28T19:19:42.665299] [WARN ] [MAIN ] HUN: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:19:42.665793] [INFO ] [MAIN ] HUN: Wiping existing primary data before full refresh. [2025-10-28T19:19:42.665869] [INFO ] [LOCAL ] HUN: Starting deletion of primary data. [2025-10-28T19:19:42.667163] [DEBUG] [LOCAL ] HUN: Deleted primary data file. [2025-10-28T19:19:42.667231] [INFO ] [MAIN ] HUN: Starting full primary refresh. [2025-10-28T19:19:42.791511] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-10 (1.21 seconds). [2025-10-28T19:19:42.817289] [INFO ] [REMOTE ] HUBB: Full fetch complete (54303 records). [2025-10-28T19:19:42.827715] [DEBUG] [VALIDATOR ] HUBB: Validating primary data. [2025-10-28T19:19:43.200117] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-04. [2025-10-28T19:19:43.312804] [INFO ] [REMOTE ] HUN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:19:43.474390] [DEBUG] [VALIDATOR ] HUBB: All expected trading days are present. [2025-10-28T19:19:43.474477] [DEBUG] [VALIDATOR ] HUBB: Primary data validation passed. [2025-10-28T19:19:43.475361] [INFO ] [MAIN ] HUBB: Fetched primary data is valid. [2025-10-28T19:19:43.475425] [DEBUG] [LOCAL ] HUBB: Saving primary data. [2025-10-28T19:19:43.476598] [DEBUG] [LOCAL ] HUBB: Trimmed 54303 records to 35648 (keeping 200 days of data) [2025-10-28T19:19:43.702808] [DEBUG] [LOCAL ] HUBB: Primary data saved (35648 records). [2025-10-28T19:19:43.702979] [INFO ] [MAIN ] HUBB: Full history saved. [2025-10-28T19:19:43.703135] [INFO ] [MAIN ] Update Progress: 1065/2366 symbols completed. HUBB took 22.3s. Estimated remaining: 2h 50m 38s. Rate: 7.6 symbols/min [2025-10-28T19:19:43.836966] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-10-28T19:19:43.915285] [INFO ] [MAIN ] HUYA: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:19:43.953066] [DEBUG] [LOCAL ] HUYA: Loaded 43516 existing records from primary storage. [2025-10-28T19:19:43.953411] [INFO ] [MAIN ] HUYA: Loaded 43516 existing records. [2025-10-28T19:19:43.985344] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-01. [2025-10-28T19:19:44.138449] [WARN ] [MAIN ] HUYA: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:19:44.138678] [INFO ] [MAIN ] HUYA: Wiping existing primary data before full refresh. [2025-10-28T19:19:44.138737] [INFO ] [LOCAL ] HUYA: Starting deletion of primary data. [2025-10-28T19:19:44.138929] [DEBUG] [LOCAL ] HUYA: Deleted primary data file. [2025-10-28T19:19:44.138970] [INFO ] [MAIN ] HUYA: Starting full primary refresh. [2025-10-28T19:19:44.504484] [INFO ] [REMOTE ] HUYA: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:19:44.569107] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-28T19:19:44.780249] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-03. [2025-10-28T19:19:45.195842] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-28T19:19:45.580261] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-05. [2025-10-28T19:19:46.137356] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-10-28T19:19:46.380270] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-04. [2025-10-28T19:19:46.929490] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-28T19:19:47.180223] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-02. [2025-10-28T19:19:47.754357] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-28T19:19:47.980296] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-01. [2025-10-28T19:19:48.385520] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-28T19:19:48.780285] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-03. [2025-10-28T19:19:49.203292] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-28T19:19:49.580298] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-02. [2025-10-28T19:19:50.380224] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-05. [2025-10-28T19:19:50.573152] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-28T19:19:50.614864] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-10-28T19:19:51.180246] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-06. [2025-10-28T19:19:51.787997] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-28T19:19:51.980228] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-06. [2025-10-28T19:19:52.239792] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-28T19:19:52.780261] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-03. [2025-10-28T19:19:53.274817] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-28T19:19:53.580242] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-07. [2025-10-28T19:19:53.964393] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-10-28T19:19:54.380299] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-04. [2025-10-28T19:19:54.998379] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-28T19:19:55.180241] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-08. [2025-10-28T19:19:55.480539] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-28T19:19:55.980295] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-04. [2025-10-28T19:19:56.481570] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-10-28T19:19:56.780270] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-09. [2025-10-28T19:19:57.210911] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-28T19:19:57.580243] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-05. [2025-10-28T19:19:58.168028] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-28T19:19:58.380289] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-07. [2025-10-28T19:19:58.865039] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-28T19:19:59.180295] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-10. [2025-10-28T19:19:59.474367] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-28T19:19:59.980290] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-08. [2025-10-28T19:20:00.717941] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-28T19:20:00.727794] [INFO ] [REMOTE ] HUM: Full fetch complete (71063 records). [2025-10-28T19:20:00.727931] [DEBUG] [VALIDATOR ] HUM: Validating primary data. [2025-10-28T19:20:00.790205] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-05. [2025-10-28T19:20:01.132422] [DEBUG] [VALIDATOR ] HUM: All expected trading days are present. [2025-10-28T19:20:01.132623] [DEBUG] [VALIDATOR ] HUM: Primary data validation passed. [2025-10-28T19:20:01.133750] [INFO ] [MAIN ] HUM: Fetched primary data is valid. [2025-10-28T19:20:01.133829] [DEBUG] [LOCAL ] HUM: Saving primary data. [2025-10-28T19:20:01.135722] [DEBUG] [LOCAL ] HUM: Trimmed 71063 records to 48986 (keeping 200 days of data) [2025-10-28T19:20:01.379639] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-28T19:20:01.480459] [DEBUG] [LOCAL ] HUM: Primary data saved (48986 records). [2025-10-28T19:20:01.480600] [INFO ] [MAIN ] HUM: Full history saved. [2025-10-28T19:20:01.481799] [INFO ] [MAIN ] Update Progress: 1066/2366 symbols completed. HUM took 27.4s. Estimated remaining: 2h 50m 42s. Rate: 7.6 symbols/min [2025-10-28T19:20:01.585392] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-09. [2025-10-28T19:20:01.656541] [INFO ] [MAIN ] HVT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:20:01.672963] [DEBUG] [LOCAL ] HVT: Loaded 14524 existing records from primary storage. [2025-10-28T19:20:01.673184] [INFO ] [MAIN ] HVT: Loaded 14524 existing records. [2025-10-28T19:20:01.853937] [WARN ] [MAIN ] HVT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:20:01.854152] [INFO ] [MAIN ] HVT: Wiping existing primary data before full refresh. [2025-10-28T19:20:01.854198] [INFO ] [LOCAL ] HVT: Starting deletion of primary data. [2025-10-28T19:20:01.854365] [DEBUG] [LOCAL ] HVT: Deleted primary data file. [2025-10-28T19:20:01.854403] [INFO ] [MAIN ] HVT: Starting full primary refresh. [2025-10-28T19:20:02.279270] [INFO ] [REMOTE ] HVT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:20:02.282102] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-28T19:20:02.380306] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-06. [2025-10-28T19:20:02.788027] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-28T19:20:03.180307] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-06. [2025-10-28T19:20:03.373026] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-28T19:20:03.980224] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-07. [2025-10-28T19:20:04.305581] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-10-28T19:20:04.780302] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-01. [2025-10-28T19:20:05.254866] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-28T19:20:05.472492] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-28T19:20:05.580249] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-10. [2025-10-28T19:20:06.380269] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-07. [2025-10-28T19:20:07.180224] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-02. [2025-10-28T19:20:07.388200] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-28T19:20:07.396760] [INFO ] [REMOTE ] HUBS: Full fetch complete (57117 records). [2025-10-28T19:20:07.396893] [DEBUG] [VALIDATOR ] HUBS: Validating primary data. [2025-10-28T19:20:07.792241] [DEBUG] [VALIDATOR ] HUBS: All expected trading days are present. [2025-10-28T19:20:07.792457] [DEBUG] [VALIDATOR ] HUBS: Primary data validation passed. [2025-10-28T19:20:07.793615] [INFO ] [MAIN ] HUBS: Fetched primary data is valid. [2025-10-28T19:20:07.793732] [DEBUG] [LOCAL ] HUBS: Saving primary data. [2025-10-28T19:20:07.795333] [DEBUG] [LOCAL ] HUBS: Trimmed 57117 records to 39593 (keeping 200 days of data) [2025-10-28T19:20:07.917957] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-10-28T19:20:08.022918] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-28T19:20:08.023004] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-08. [2025-10-28T19:20:08.098960] [DEBUG] [LOCAL ] HUBS: Primary data saved (39593 records). [2025-10-28T19:20:08.099097] [INFO ] [MAIN ] HUBS: Full history saved. [2025-10-28T19:20:08.099176] [INFO ] [MAIN ] Update Progress: 1067/2366 symbols completed. HUBS took 41.3s. Estimated remaining: 2h 50m 33s. Rate: 7.6 symbols/min [2025-10-28T19:20:08.275311] [INFO ] [MAIN ] HWM: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:20:08.324888] [DEBUG] [LOCAL ] HWM: Loaded 52655 existing records from primary storage. [2025-10-28T19:20:08.325204] [INFO ] [MAIN ] HWM: Loaded 52655 existing records. [2025-10-28T19:20:08.510602] [WARN ] [MAIN ] HWM: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:20:08.510846] [INFO ] [MAIN ] HWM: Wiping existing primary data before full refresh. [2025-10-28T19:20:08.510927] [INFO ] [LOCAL ] HWM: Starting deletion of primary data. [2025-10-28T19:20:08.511853] [DEBUG] [LOCAL ] HWM: Deleted primary data file. [2025-10-28T19:20:08.511913] [INFO ] [MAIN ] HWM: Starting full primary refresh. [2025-10-28T19:20:08.785523] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-08. [2025-10-28T19:20:08.885853] [INFO ] [REMOTE ] HWM: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:20:09.526521] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-28T19:20:09.580258] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-01. [2025-10-28T19:20:09.981440] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-28T19:20:10.380307] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-09. [2025-10-28T19:20:11.180226] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-03. [2025-10-28T19:20:11.501822] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-28T19:20:11.716169] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-28T19:20:11.885540] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-28T19:20:11.980226] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-10. [2025-10-28T19:20:12.780263] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-09. [2025-10-28T19:20:13.580226] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-04. [2025-10-28T19:20:13.638733] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-10 (1.66 seconds). [2025-10-28T19:20:13.650006] [INFO ] [REMOTE ] HUN: Full fetch complete (77037 records). [2025-10-28T19:20:13.650151] [DEBUG] [VALIDATOR ] HUN: Validating primary data. [2025-10-28T19:20:14.070090] [DEBUG] [VALIDATOR ] HUN: All expected trading days are present. [2025-10-28T19:20:14.070326] [DEBUG] [VALIDATOR ] HUN: Primary data validation passed. [2025-10-28T19:20:14.071715] [INFO ] [MAIN ] HUN: Fetched primary data is valid. [2025-10-28T19:20:14.072998] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-28T19:20:14.073088] [DEBUG] [LOCAL ] HUN: Saving primary data. [2025-10-28T19:20:14.083519] [DEBUG] [LOCAL ] HUN: Trimmed 77037 records to 53207 (keeping 200 days of data) [2025-10-28T19:20:14.380517] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-10. [2025-10-28T19:20:14.401614] [DEBUG] [LOCAL ] HUN: Primary data saved (53207 records). [2025-10-28T19:20:14.402087] [INFO ] [MAIN ] HUN: Full history saved. [2025-10-28T19:20:14.413836] [INFO ] [MAIN ] Update Progress: 1068/2366 symbols completed. HUN took 32.2s. Estimated remaining: 2h 50m 23s. Rate: 7.6 symbols/min [2025-10-28T19:20:14.480963] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-28T19:20:14.597567] [INFO ] [MAIN ] HXL: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:20:14.641887] [DEBUG] [LOCAL ] HXL: Loaded 45823 existing records from primary storage. [2025-10-28T19:20:14.642199] [INFO ] [MAIN ] HXL: Loaded 45823 existing records. [2025-10-28T19:20:14.847183] [WARN ] [MAIN ] HXL: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:20:14.847416] [INFO ] [MAIN ] HXL: Wiping existing primary data before full refresh. [2025-10-28T19:20:14.847498] [INFO ] [LOCAL ] HXL: Starting deletion of primary data. [2025-10-28T19:20:14.847713] [DEBUG] [LOCAL ] HXL: Deleted primary data file. [2025-10-28T19:20:14.847769] [INFO ] [MAIN ] HXL: Starting full primary refresh. [2025-10-28T19:20:15.182358] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-05. [2025-10-28T19:20:15.206036] [INFO ] [REMOTE ] HXL: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:20:15.716328] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-28T19:20:15.726406] [INFO ] [REMOTE ] HUYA: Full fetch complete (64076 records). [2025-10-28T19:20:15.736573] [DEBUG] [VALIDATOR ] HUYA: Validating primary data. [2025-10-28T19:20:15.737490] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-28T19:20:15.985538] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-02. [2025-10-28T19:20:16.152525] [DEBUG] [VALIDATOR ] HUYA: All expected trading days are present. [2025-10-28T19:20:16.152605] [DEBUG] [VALIDATOR ] HUYA: Primary data validation passed. [2025-10-28T19:20:16.153500] [INFO ] [MAIN ] HUYA: Fetched primary data is valid. [2025-10-28T19:20:16.153562] [DEBUG] [LOCAL ] HUYA: Saving primary data. [2025-10-28T19:20:16.154775] [DEBUG] [LOCAL ] HUYA: Trimmed 64076 records to 43540 (keeping 200 days of data) [2025-10-28T19:20:16.394627] [DEBUG] [LOCAL ] HUYA: Primary data saved (43540 records). [2025-10-28T19:20:16.394771] [INFO ] [MAIN ] HUYA: Full history saved. [2025-10-28T19:20:16.394849] [INFO ] [MAIN ] Update Progress: 1069/2366 symbols completed. HUYA took 32.7s. Estimated remaining: 2h 50m 8s. Rate: 7.6 symbols/min [2025-10-28T19:20:16.561532] [INFO ] [MAIN ] HY: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:20:16.571121] [DEBUG] [LOCAL ] HY: Loaded 9594 existing records from primary storage. [2025-10-28T19:20:16.571315] [INFO ] [MAIN ] HY: Loaded 9594 existing records. [2025-10-28T19:20:16.750942] [WARN ] [MAIN ] HY: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:20:16.751149] [INFO ] [MAIN ] HY: Wiping existing primary data before full refresh. [2025-10-28T19:20:16.751197] [INFO ] [LOCAL ] HY: Starting deletion of primary data. [2025-10-28T19:20:16.751453] [DEBUG] [LOCAL ] HY: Deleted primary data file. [2025-10-28T19:20:16.751493] [INFO ] [MAIN ] HY: Starting full primary refresh. [2025-10-28T19:20:16.785559] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-01. [2025-10-28T19:20:17.124113] [INFO ] [REMOTE ] HY: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:20:17.423339] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-28T19:20:17.580263] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-06. [2025-10-28T19:20:17.905302] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-28T19:20:18.260875] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-28T19:20:18.380240] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-03. [2025-10-28T19:20:19.180287] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-01. [2025-10-28T19:20:19.757396] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-28T19:20:19.758337] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-28T19:20:19.980333] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-04. [2025-10-28T19:20:20.780309] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-02. [2025-10-28T19:20:21.436633] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-28T19:20:21.515258] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-28T19:20:21.580214] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-03. [2025-10-28T19:20:22.141579] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-10-28T19:20:22.380264] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-07. [2025-10-28T19:20:22.977338] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-28T19:20:23.180307] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-02. [2025-10-28T19:20:23.980259] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-05. [2025-10-28T19:20:24.285152] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-28T19:20:24.780268] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-08. [2025-10-28T19:20:25.395069] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-10-28T19:20:25.418411] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-28T19:20:25.580310] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-09. [2025-10-28T19:20:26.162978] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-10-28T19:20:26.380258] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-03. [2025-10-28T19:20:27.180259] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-04. [2025-10-28T19:20:27.520515] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-28T19:20:27.765859] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-28T19:20:27.980286] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-05. [2025-10-28T19:20:28.494056] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-28T19:20:28.780259] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-10. [2025-10-28T19:20:29.580243] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-04. [2025-10-28T19:20:29.616921] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-28T19:20:29.620053] [INFO ] [REMOTE ] HVT: Full fetch complete (22896 records). [2025-10-28T19:20:29.620154] [DEBUG] [VALIDATOR ] HVT: Validating primary data. [2025-10-28T19:20:29.986796] [DEBUG] [VALIDATOR ] HVT: All expected trading days are present. [2025-10-28T19:20:29.986887] [DEBUG] [VALIDATOR ] HVT: Primary data validation passed. [2025-10-28T19:20:29.987394] [INFO ] [MAIN ] HVT: Fetched primary data is valid. [2025-10-28T19:20:29.987454] [DEBUG] [LOCAL ] HVT: Saving primary data. [2025-10-28T19:20:29.988231] [DEBUG] [LOCAL ] HVT: Trimmed 22896 records to 14478 (keeping 200 days of data) [2025-10-28T19:20:30.074192] [DEBUG] [LOCAL ] HVT: Primary data saved (14478 records). [2025-10-28T19:20:30.074328] [INFO ] [MAIN ] HVT: Full history saved. [2025-10-28T19:20:30.074404] [INFO ] [MAIN ] Update Progress: 1070/2366 symbols completed. HVT took 28.6s. Estimated remaining: 2h 50m 7s. Rate: 7.6 symbols/min [2025-10-28T19:20:30.242532] [INFO ] [MAIN ] HYAC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:20:30.242740] [DEBUG] [LOCAL ] HYAC: No existing data file found in primary storage. [2025-10-28T19:20:30.242785] [WARN ] [MAIN ] HYAC: No existing data found, performing full refresh instead. [2025-10-28T19:20:30.242896] [INFO ] [MAIN ] HYAC: Wiping existing primary data before full refresh. [2025-10-28T19:20:30.242936] [INFO ] [LOCAL ] HYAC: Starting deletion of primary data. [2025-10-28T19:20:30.242989] [DEBUG] [LOCAL ] HYAC: No primary data file found to delete. [2025-10-28T19:20:30.243053] [INFO ] [MAIN ] HYAC: Starting full primary refresh. [2025-10-28T19:20:30.389021] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-06. [2025-10-28T19:20:30.616549] [INFO ] [REMOTE ] HYAC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:20:30.782248] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-28T19:20:30.918832] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-10-28T19:20:31.180226] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-01. [2025-10-28T19:20:31.396262] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-01 (0.22 seconds). [2025-10-28T19:20:31.980292] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-05. [2025-10-28T19:20:32.780280] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-06. [2025-10-28T19:20:33.164800] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-28T19:20:33.580249] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-07. [2025-10-28T19:20:34.047932] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-28T19:20:34.065344] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-10-28T19:20:34.380256] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-07. [2025-10-28T19:20:35.180246] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-08. [2025-10-28T19:20:35.698013] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-28T19:20:35.985434] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-06. [2025-10-28T19:20:36.002533] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-10-28T19:20:36.780253] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-08. [2025-10-28T19:20:37.215060] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-28T19:20:37.580256] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-07. [2025-10-28T19:20:38.222366] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-28T19:20:38.380252] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-09. [2025-10-28T19:20:38.724496] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-28T19:20:39.180321] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-08. [2025-10-28T19:20:39.816899] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-28T19:20:39.980233] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-09. [2025-10-28T19:20:40.257684] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-28T19:20:40.504756] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-28T19:20:40.780251] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-02. [2025-10-28T19:20:41.018616] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-02 (0.24 seconds). [2025-10-28T19:20:41.580228] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-09. [2025-10-28T19:20:42.380245] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-10. [2025-10-28T19:20:42.647085] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-28T19:20:43.180247] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-03. [2025-10-28T19:20:43.354578] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-03 (0.17 seconds). [2025-10-28T19:20:43.980221] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-10. [2025-10-28T19:20:44.049192] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-10 (1.67 seconds). [2025-10-28T19:20:44.059612] [INFO ] [REMOTE ] HWM: Full fetch complete (76600 records). [2025-10-28T19:20:44.059800] [DEBUG] [VALIDATOR ] HWM: Validating primary data. [2025-10-28T19:20:44.443456] [DEBUG] [VALIDATOR ] HWM: All expected trading days are present. [2025-10-28T19:20:44.443543] [DEBUG] [VALIDATOR ] HWM: Primary data validation passed. [2025-10-28T19:20:44.444606] [INFO ] [MAIN ] HWM: Fetched primary data is valid. [2025-10-28T19:20:44.444695] [DEBUG] [LOCAL ] HWM: Saving primary data. [2025-10-28T19:20:44.446165] [DEBUG] [LOCAL ] HWM: Trimmed 76600 records to 52640 (keeping 200 days of data) [2025-10-28T19:20:44.679219] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-28T19:20:44.683529] [INFO ] [REMOTE ] HY: Full fetch complete (14740 records). [2025-10-28T19:20:44.684111] [DEBUG] [VALIDATOR ] HY: Validating primary data. [2025-10-28T19:20:44.785324] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-10. [2025-10-28T19:20:45.163227] [DEBUG] [VALIDATOR ] HY: All expected trading days are present. [2025-10-28T19:20:45.167670] [DEBUG] [VALIDATOR ] HY: Primary data validation passed. [2025-10-28T19:20:45.168018] [INFO ] [MAIN ] HY: Fetched primary data is valid. [2025-10-28T19:20:45.168089] [DEBUG] [LOCAL ] HY: Saving primary data. [2025-10-28T19:20:45.174416] [DEBUG] [LOCAL ] HWM: Primary data saved (52640 records). [2025-10-28T19:20:45.174743] [DEBUG] [LOCAL ] HY: Trimmed 14740 records to 9548 (keeping 200 days of data) [2025-10-28T19:20:45.174831] [INFO ] [MAIN ] HWM: Full history saved. [2025-10-28T19:20:45.175161] [INFO ] [MAIN ] Update Progress: 1071/2366 symbols completed. HWM took 37.1s. Estimated remaining: 2h 50m 8s. Rate: 7.6 symbols/min [2025-10-28T19:20:45.361806] [DEBUG] [LOCAL ] HY: Primary data saved (9548 records). [2025-10-28T19:20:45.375600] [INFO ] [MAIN ] HY: Full history saved. [2025-10-28T19:20:45.382956] [INFO ] [MAIN ] Update Progress: 1072/2366 symbols completed. HY took 29.0s. Estimated remaining: 2h 49m 51s. Rate: 7.6 symbols/min [2025-10-28T19:20:45.481829] [INFO ] [MAIN ] HYBX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:20:45.497582] [DEBUG] [LOCAL ] HYBX: No existing data file found in primary storage. [2025-10-28T19:20:45.505681] [WARN ] [MAIN ] HYBX: No existing data found, performing full refresh instead. [2025-10-28T19:20:45.508041] [INFO ] [MAIN ] HYBX: Wiping existing primary data before full refresh. [2025-10-28T19:20:45.508134] [INFO ] [LOCAL ] HYBX: Starting deletion of primary data. [2025-10-28T19:20:45.508201] [DEBUG] [LOCAL ] HYBX: No primary data file found to delete. [2025-10-28T19:20:45.508505] [INFO ] [MAIN ] HYBX: Starting full primary refresh. [2025-10-28T19:20:45.585699] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-04. [2025-10-28T19:20:45.648144] [INFO ] [MAIN ] HYI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:20:45.761507] [DEBUG] [LOCAL ] HYI: Loaded 9485 existing records from primary storage. [2025-10-28T19:20:45.779769] [INFO ] [MAIN ] HYI: Loaded 9485 existing records. [2025-10-28T19:20:45.930834] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-10-28T19:20:46.154757] [WARN ] [MAIN ] HYI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:20:46.178248] [INFO ] [REMOTE ] HYBX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:20:46.178702] [INFO ] [MAIN ] HYI: Wiping existing primary data before full refresh. [2025-10-28T19:20:46.178849] [INFO ] [LOCAL ] HYI: Starting deletion of primary data. [2025-10-28T19:20:46.179705] [DEBUG] [LOCAL ] HYI: Deleted primary data file. [2025-10-28T19:20:46.179838] [INFO ] [MAIN ] HYI: Starting full primary refresh. [2025-10-28T19:20:46.387631] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-05. [2025-10-28T19:20:46.465737] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-10 (1.68 seconds). [2025-10-28T19:20:46.513764] [INFO ] [REMOTE ] HXL: Full fetch complete (66764 records). [2025-10-28T19:20:46.524231] [DEBUG] [VALIDATOR ] HXL: Validating primary data. [2025-10-28T19:20:46.668443] [INFO ] [REMOTE ] HYI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:20:46.719210] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-10-28T19:20:46.977910] [DEBUG] [VALIDATOR ] HXL: All expected trading days are present. [2025-10-28T19:20:46.977996] [DEBUG] [VALIDATOR ] HXL: Primary data validation passed. [2025-10-28T19:20:46.978931] [INFO ] [MAIN ] HXL: Fetched primary data is valid. [2025-10-28T19:20:46.978994] [DEBUG] [LOCAL ] HXL: Saving primary data. [2025-10-28T19:20:46.980372] [DEBUG] [LOCAL ] HXL: Trimmed 66764 records to 45798 (keeping 200 days of data) [2025-10-28T19:20:47.184349] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-01. [2025-10-28T19:20:47.250805] [DEBUG] [LOCAL ] HXL: Primary data saved (45798 records). [2025-10-28T19:20:47.251032] [INFO ] [MAIN ] HXL: Full history saved. [2025-10-28T19:20:47.251119] [INFO ] [MAIN ] Update Progress: 1073/2366 symbols completed. HXL took 32.8s. Estimated remaining: 2h 49m 36s. Rate: 7.6 symbols/min [2025-10-28T19:20:47.419292] [INFO ] [MAIN ] HYT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:20:47.447966] [DEBUG] [LOCAL ] HYT: Loaded 33156 existing records from primary storage. [2025-10-28T19:20:47.448225] [INFO ] [MAIN ] HYT: Loaded 33156 existing records. [2025-10-28T19:20:47.626246] [WARN ] [MAIN ] HYT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:20:47.626599] [INFO ] [MAIN ] HYT: Wiping existing primary data before full refresh. [2025-10-28T19:20:47.626690] [INFO ] [LOCAL ] HYT: Starting deletion of primary data. [2025-10-28T19:20:47.627342] [DEBUG] [LOCAL ] HYT: Deleted primary data file. [2025-10-28T19:20:47.627399] [INFO ] [MAIN ] HYT: Starting full primary refresh. [2025-10-28T19:20:47.737811] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-28T19:20:47.985612] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-01. [2025-10-28T19:20:47.990393] [INFO ] [REMOTE ] HYT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:20:48.255931] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-01 (0.27 seconds). [2025-10-28T19:20:48.780247] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-02. [2025-10-28T19:20:48.945850] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-02 (0.17 seconds). [2025-10-28T19:20:49.580293] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-03. [2025-10-28T19:20:49.806673] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-03 (0.23 seconds). [2025-10-28T19:20:50.380337] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-06. [2025-10-28T19:20:50.643881] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-06 (0.26 seconds). [2025-10-28T19:20:51.180277] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-01. [2025-10-28T19:20:51.980235] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-07. [2025-10-28T19:20:52.067844] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-28T19:20:52.281092] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-07 (0.30 seconds). [2025-10-28T19:20:52.780250] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-08. [2025-10-28T19:20:52.956975] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-08 (0.18 seconds). [2025-10-28T19:20:53.580260] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-09. [2025-10-28T19:20:53.745795] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-09 (0.17 seconds). [2025-10-28T19:20:54.380266] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-02. [2025-10-28T19:20:55.180301] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-10. [2025-10-28T19:20:55.268637] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-28T19:20:55.671706] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-28T19:20:55.672515] [INFO ] [REMOTE ] HYAC: Full fetch complete (907 records). [2025-10-28T19:20:55.672581] [DEBUG] [VALIDATOR ] HYAC: Validating primary data. [2025-10-28T19:20:55.869321] [WARN ] [VALIDATOR ] HYAC: Validation failed - insufficient historical data. Have 165 unique days, need 200 days [2025-10-28T19:20:55.869534] [FATAL] [MAIN ] HYAC: Fetched primary data is invalid. Refusing to save it. [2025-10-28T19:20:55.869619] [WARN ] [MAIN ] HYAC: Deleting existing primary and derivative data due to validation failure. [2025-10-28T19:20:55.869733] [INFO ] [LOCAL ] HYAC: Starting deletion of primary data. [2025-10-28T19:20:55.869809] [DEBUG] [LOCAL ] HYAC: No primary data file found to delete. [2025-10-28T19:20:55.869846] [INFO ] [LOCAL ] HYAC: Starting deletion of derivative data. [2025-10-28T19:20:55.869886] [DEBUG] [LOCAL ] HYAC: No derivative data file found to delete. [2025-10-28T19:20:55.869945] [INFO ] [MAIN ] Update Progress: 1074/2366 symbols completed. HYAC took 25.8s. Estimated remaining: 2h 49m 29s. Rate: 7.6 symbols/min [2025-10-28T19:20:55.983672] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-04. [2025-10-28T19:20:56.054855] [INFO ] [MAIN ] HYTR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:20:56.059442] [DEBUG] [LOCAL ] HYTR: Loaded 3094 existing records from primary storage. [2025-10-28T19:20:56.059607] [INFO ] [MAIN ] HYTR: Loaded 3094 existing records. [2025-10-28T19:20:56.249156] [WARN ] [MAIN ] HYTR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:20:56.252232] [INFO ] [MAIN ] HYTR: Wiping existing primary data before full refresh. [2025-10-28T19:20:56.252089] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-04 (0.27 seconds). [2025-10-28T19:20:56.253437] [INFO ] [LOCAL ] HYTR: Starting deletion of primary data. [2025-10-28T19:20:56.253687] [DEBUG] [LOCAL ] HYTR: Deleted primary data file. [2025-10-28T19:20:56.253745] [INFO ] [MAIN ] HYTR: Starting full primary refresh. [2025-10-28T19:20:56.609402] [INFO ] [REMOTE ] HYTR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:20:56.780207] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-05. [2025-10-28T19:20:57.041195] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-05 (0.26 seconds). [2025-10-28T19:20:57.580324] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-01. [2025-10-28T19:20:57.897106] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-01 (0.32 seconds). [2025-10-28T19:20:58.380221] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-03. [2025-10-28T19:20:59.180279] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-02. [2025-10-28T19:20:59.459211] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-28T19:20:59.505143] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-10-28T19:20:59.980275] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-02. [2025-10-28T19:21:00.464681] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-28T19:21:00.780257] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-04. [2025-10-28T19:21:01.580264] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-03. [2025-10-28T19:21:01.796637] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-28T19:21:02.059973] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-28T19:21:02.380258] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-03. [2025-10-28T19:21:02.740967] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-10-28T19:21:03.180270] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-05. [2025-10-28T19:21:03.980253] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-06. [2025-10-28T19:21:04.046317] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-28T19:21:04.194573] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-06 (0.21 seconds). [2025-10-28T19:21:04.780282] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-04. [2025-10-28T19:21:05.301295] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-28T19:21:05.580287] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-04. [2025-10-28T19:21:05.946140] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-10-28T19:21:06.380268] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-07. [2025-10-28T19:21:06.635048] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-07 (0.25 seconds). [2025-10-28T19:21:07.180250] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-05. [2025-10-28T19:21:07.512406] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-10-28T19:21:07.980261] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-06. [2025-10-28T19:21:08.780257] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-06. [2025-10-28T19:21:08.970960] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-28T19:21:09.100922] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-10-28T19:21:09.580239] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-07. [2025-10-28T19:21:10.380232] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-07. [2025-10-28T19:21:10.533565] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-28T19:21:10.714077] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-10-28T19:21:11.180344] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-08. [2025-10-28T19:21:11.980355] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-05. [2025-10-28T19:21:12.267550] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-28T19:21:12.443883] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-10-28T19:21:12.780281] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-06. [2025-10-28T19:21:13.222868] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-28T19:21:13.580238] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-08. [2025-10-28T19:21:13.802829] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-08 (0.22 seconds). [2025-10-28T19:21:14.380323] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-07. [2025-10-28T19:21:14.858611] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-28T19:21:15.180247] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-09. [2025-10-28T19:21:15.384533] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-09 (0.20 seconds). [2025-10-28T19:21:15.980298] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-09. [2025-10-28T19:21:16.780293] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-08. [2025-10-28T19:21:16.938017] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-28T19:21:17.107404] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-10-28T19:21:17.580246] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-09. [2025-10-28T19:21:17.893896] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-09 (0.31 seconds). [2025-10-28T19:21:18.380296] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-10. [2025-10-28T19:21:18.738913] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-10 (0.36 seconds). [2025-10-28T19:21:18.739634] [INFO ] [REMOTE ] HYBX: Full fetch complete (702 records). [2025-10-28T19:21:18.739738] [DEBUG] [VALIDATOR ] HYBX: Validating primary data. [2025-10-28T19:21:18.994473] [WARN ] [VALIDATOR ] HYBX: Validation failed - insufficient historical data. Have 179 unique days, need 200 days [2025-10-28T19:21:18.994682] [FATAL] [MAIN ] HYBX: Fetched primary data is invalid. Refusing to save it. [2025-10-28T19:21:18.994753] [WARN ] [MAIN ] HYBX: Deleting existing primary and derivative data due to validation failure. [2025-10-28T19:21:18.994846] [INFO ] [LOCAL ] HYBX: Starting deletion of primary data. [2025-10-28T19:21:18.994932] [DEBUG] [LOCAL ] HYBX: No primary data file found to delete. [2025-10-28T19:21:18.994970] [INFO ] [LOCAL ] HYBX: Starting deletion of derivative data. [2025-10-28T19:21:18.995010] [DEBUG] [LOCAL ] HYBX: No derivative data file found to delete. [2025-10-28T19:21:18.995104] [INFO ] [MAIN ] Update Progress: 1075/2366 symbols completed. HYBX took 33.8s. Estimated remaining: 2h 49m 39s. Rate: 7.6 symbols/min [2025-10-28T19:21:19.189436] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-10. [2025-10-28T19:21:19.192747] [INFO ] [MAIN ] HZO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:21:19.220540] [DEBUG] [LOCAL ] HZO: Loaded 28097 existing records from primary storage. [2025-10-28T19:21:19.220820] [INFO ] [MAIN ] HZO: Loaded 28097 existing records. [2025-10-28T19:21:19.398001] [WARN ] [MAIN ] HZO: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:21:19.398206] [INFO ] [MAIN ] HZO: Wiping existing primary data before full refresh. [2025-10-28T19:21:19.398273] [INFO ] [LOCAL ] HZO: Starting deletion of primary data. [2025-10-28T19:21:19.398922] [DEBUG] [LOCAL ] HZO: Deleted primary data file. [2025-10-28T19:21:19.398979] [INFO ] [MAIN ] HZO: Starting full primary refresh. [2025-10-28T19:21:19.758470] [INFO ] [REMOTE ] HZO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:21:19.980264] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-10. [2025-10-28T19:21:20.378339] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-28T19:21:20.386539] [INFO ] [REMOTE ] HYT: Full fetch complete (47863 records). [2025-10-28T19:21:20.386794] [DEBUG] [VALIDATOR ] HYT: Validating primary data. [2025-10-28T19:21:20.770059] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-28T19:21:20.780703] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-08. [2025-10-28T19:21:20.789962] [INFO ] [REMOTE ] HYTR: Full fetch complete (4702 records). [2025-10-28T19:21:20.809807] [DEBUG] [VALIDATOR ] HYTR: Validating primary data. [2025-10-28T19:21:20.875720] [DEBUG] [VALIDATOR ] HYT: All expected trading days are present. [2025-10-28T19:21:20.904860] [DEBUG] [VALIDATOR ] HYT: Primary data validation passed. [2025-10-28T19:21:20.938111] [INFO ] [MAIN ] HYT: Fetched primary data is valid. [2025-10-28T19:21:20.941323] [DEBUG] [LOCAL ] HYT: Saving primary data. [2025-10-28T19:21:21.041497] [DEBUG] [LOCAL ] HYT: Trimmed 47863 records to 33000 (keeping 200 days of data) [2025-10-28T19:21:21.328020] [DEBUG] [VALIDATOR ] HYTR: All expected trading days are present. [2025-10-28T19:21:21.328889] [DEBUG] [VALIDATOR ] HYTR: Primary data validation passed. [2025-10-28T19:21:21.340186] [INFO ] [MAIN ] HYTR: Fetched primary data is valid. [2025-10-28T19:21:21.342283] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-28T19:21:21.342373] [DEBUG] [LOCAL ] HYTR: Saving primary data. [2025-10-28T19:21:21.366025] [DEBUG] [LOCAL ] HYTR: Trimmed 4702 records to 3090 (keeping 200 days of data) [2025-10-28T19:21:21.459564] [DEBUG] [LOCAL ] HYTR: Primary data saved (3090 records). [2025-10-28T19:21:21.463056] [INFO ] [MAIN ] HYTR: Full history saved. [2025-10-28T19:21:21.464735] [INFO ] [MAIN ] Update Progress: 1076/2366 symbols completed. HYTR took 25.6s. Estimated remaining: 2h 49m 25s. Rate: 7.6 symbols/min [2025-10-28T19:21:21.554673] [DEBUG] [LOCAL ] HYT: Primary data saved (33000 records). [2025-10-28T19:21:21.566687] [INFO ] [MAIN ] HYT: Full history saved. [2025-10-28T19:21:21.571933] [INFO ] [MAIN ] Update Progress: 1077/2366 symbols completed. HYT took 34.3s. Estimated remaining: 2h 49m 8s. Rate: 7.6 symbols/min [2025-10-28T19:21:21.585079] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-01. [2025-10-28T19:21:21.674302] [INFO ] [MAIN ] IAE: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:21:21.681916] [DEBUG] [LOCAL ] IAE: Loaded 6415 existing records from primary storage. [2025-10-28T19:21:21.682085] [INFO ] [MAIN ] IAE: Loaded 6415 existing records. [2025-10-28T19:21:21.869207] [WARN ] [MAIN ] IAE: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:21:21.869425] [INFO ] [MAIN ] IAE: Wiping existing primary data before full refresh. [2025-10-28T19:21:21.869475] [INFO ] [LOCAL ] IAE: Starting deletion of primary data. [2025-10-28T19:21:21.869732] [DEBUG] [LOCAL ] IAE: Deleted primary data file. [2025-10-28T19:21:21.869791] [INFO ] [MAIN ] IAE: Starting full primary refresh. [2025-10-28T19:21:22.242421] [INFO ] [REMOTE ] IAE: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:21:22.386553] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-09. [2025-10-28T19:21:22.388546] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-28T19:21:22.780152] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-10-28T19:21:23.180301] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-10. [2025-10-28T19:21:23.953747] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-28T19:21:23.956582] [INFO ] [REMOTE ] HYI: Full fetch complete (14057 records). [2025-10-28T19:21:23.956688] [DEBUG] [VALIDATOR ] HYI: Validating primary data. [2025-10-28T19:21:23.986718] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-02. [2025-10-28T19:21:24.315184] [DEBUG] [VALIDATOR ] HYI: All expected trading days are present. [2025-10-28T19:21:24.315278] [DEBUG] [VALIDATOR ] HYI: Primary data validation passed. [2025-10-28T19:21:24.315619] [INFO ] [MAIN ] HYI: Fetched primary data is valid. [2025-10-28T19:21:24.315699] [DEBUG] [LOCAL ] HYI: Saving primary data. [2025-10-28T19:21:24.316195] [DEBUG] [LOCAL ] HYI: Trimmed 14057 records to 9430 (keeping 200 days of data) [2025-10-28T19:21:24.373183] [DEBUG] [LOCAL ] HYI: Primary data saved (9430 records). [2025-10-28T19:21:24.373310] [INFO ] [MAIN ] HYI: Full history saved. [2025-10-28T19:21:24.373387] [INFO ] [MAIN ] Update Progress: 1078/2366 symbols completed. HYI took 39.0s. Estimated remaining: 2h 48m 54s. Rate: 7.6 symbols/min [2025-10-28T19:21:24.787406] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-01. [2025-10-28T19:21:24.789414] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-28T19:21:25.228270] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-10-28T19:21:25.580242] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-02. [2025-10-28T19:21:25.984896] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-28T19:21:26.380259] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-03. [2025-10-28T19:21:26.778036] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-10-28T19:21:27.180250] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-03. [2025-10-28T19:21:27.980228] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-04. [2025-10-28T19:21:28.058143] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-28T19:21:28.348309] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-10-28T19:21:28.780312] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-05. [2025-10-28T19:21:29.166055] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-10-28T19:21:29.580283] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-06. [2025-10-28T19:21:29.990686] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-10-28T19:21:30.380284] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-04. [2025-10-28T19:21:31.180370] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-07. [2025-10-28T19:21:31.256789] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-10-28T19:21:31.644073] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-10-28T19:21:31.980317] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-05. [2025-10-28T19:21:32.780228] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-08. [2025-10-28T19:21:32.873102] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-28T19:21:33.178212] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-10-28T19:21:33.580245] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-09. [2025-10-28T19:21:34.042926] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-10-28T19:21:34.380294] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-10. [2025-10-28T19:21:35.055797] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-28T19:21:35.058104] [INFO ] [REMOTE ] IAE: Full fetch complete (9183 records). [2025-10-28T19:21:35.058174] [DEBUG] [VALIDATOR ] IAE: Validating primary data. [2025-10-28T19:21:35.185444] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-06. [2025-10-28T19:21:35.416948] [DEBUG] [VALIDATOR ] IAE: All expected trading days are present. [2025-10-28T19:21:35.417023] [DEBUG] [VALIDATOR ] IAE: Primary data validation passed. [2025-10-28T19:21:35.417233] [INFO ] [MAIN ] IAE: Fetched primary data is valid. [2025-10-28T19:21:35.417270] [DEBUG] [LOCAL ] IAE: Saving primary data. [2025-10-28T19:21:35.417679] [DEBUG] [LOCAL ] IAE: Trimmed 9183 records to 6432 (keeping 200 days of data) [2025-10-28T19:21:35.452864] [DEBUG] [LOCAL ] IAE: Primary data saved (6432 records). [2025-10-28T19:21:35.452948] [INFO ] [MAIN ] IAE: Full history saved. [2025-10-28T19:21:35.453020] [INFO ] [MAIN ] Update Progress: 1079/2366 symbols completed. IAE took 14.0s. Estimated remaining: 2h 48m 50s. Rate: 7.6 symbols/min [2025-10-28T19:21:36.177742] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-28T19:21:36.183734] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-07. [2025-10-28T19:21:36.949008] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-28T19:21:36.955611] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-08. [2025-10-28T19:21:37.731394] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-28T19:21:37.740176] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-09. [2025-10-28T19:21:38.565464] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-28T19:21:38.571526] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-10. [2025-10-28T19:21:39.437840] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-28T19:21:39.443298] [INFO ] [REMOTE ] HZO: Full fetch complete (41331 records). [2025-10-28T19:21:39.443458] [DEBUG] [VALIDATOR ] HZO: Validating primary data. [2025-10-28T19:21:39.835472] [DEBUG] [VALIDATOR ] HZO: All expected trading days are present. [2025-10-28T19:21:39.835563] [DEBUG] [VALIDATOR ] HZO: Primary data validation passed. [2025-10-28T19:21:39.836408] [INFO ] [MAIN ] HZO: Fetched primary data is valid. [2025-10-28T19:21:39.836472] [DEBUG] [LOCAL ] HZO: Saving primary data. [2025-10-28T19:21:39.837526] [DEBUG] [LOCAL ] HZO: Trimmed 41331 records to 28055 (keeping 200 days of data) [2025-10-28T19:21:39.995723] [DEBUG] [LOCAL ] HZO: Primary data saved (28055 records). [2025-10-28T19:21:39.995856] [INFO ] [MAIN ] HZO: Full history saved. [2025-10-28T19:21:39.995932] [INFO ] [MAIN ] Update Progress: 1080/2366 symbols completed. HZO took 21.0s. Estimated remaining: 2h 48m 38s. Rate: 7.6 symbols/min [2025-10-28T19:21:40.641401] [INFO ] [MAIN ] IAG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:21:40.707806] [INFO ] [MAIN ] IBN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:21:40.701451] [INFO ] [MAIN ] IBM: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:21:40.704554] [INFO ] [MAIN ] IBP: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:21:40.783615] [DEBUG] [LOCAL ] IBP: Loaded 28251 existing records from primary storage. [2025-10-28T19:21:40.797279] [INFO ] [MAIN ] IBP: Loaded 28251 existing records. [2025-10-28T19:21:40.799855] [DEBUG] [LOCAL ] IBM: Loaded 53628 existing records from primary storage. [2025-10-28T19:21:40.844723] [INFO ] [MAIN ] IBM: Loaded 53628 existing records. [2025-10-28T19:21:40.856745] [DEBUG] [LOCAL ] IAG: Loaded 53492 existing records from primary storage. [2025-10-28T19:21:40.896146] [INFO ] [MAIN ] IAG: Loaded 53492 existing records. [2025-10-28T19:21:41.017851] [DEBUG] [LOCAL ] IBN: Loaded 52799 existing records from primary storage. [2025-10-28T19:21:41.104940] [INFO ] [MAIN ] IBN: Loaded 52799 existing records. [2025-10-28T19:21:41.364855] [WARN ] [MAIN ] IBP: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:21:41.530219] [INFO ] [MAIN ] IBP: Wiping existing primary data before full refresh. [2025-10-28T19:21:41.542316] [INFO ] [LOCAL ] IBP: Starting deletion of primary data. [2025-10-28T19:21:41.533814] [WARN ] [MAIN ] IAG: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:21:41.618625] [INFO ] [MAIN ] IAG: Wiping existing primary data before full refresh. [2025-10-28T19:21:41.622014] [INFO ] [LOCAL ] IAG: Starting deletion of primary data. [2025-10-28T19:21:41.621883] [WARN ] [MAIN ] IBN: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:21:41.625140] [DEBUG] [LOCAL ] IBP: Deleted primary data file. [2025-10-28T19:21:41.625102] [DEBUG] [LOCAL ] IAG: Deleted primary data file. [2025-10-28T19:21:41.624979] [WARN ] [MAIN ] IBM: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:21:41.625562] [INFO ] [MAIN ] IBN: Wiping existing primary data before full refresh. [2025-10-28T19:21:41.625633] [INFO ] [MAIN ] IBP: Starting full primary refresh. [2025-10-28T19:21:41.625748] [INFO ] [MAIN ] IAG: Starting full primary refresh. [2025-10-28T19:21:41.642568] [INFO ] [LOCAL ] IBN: Starting deletion of primary data. [2025-10-28T19:21:41.626098] [INFO ] [MAIN ] IBM: Wiping existing primary data before full refresh. [2025-10-28T19:21:41.747489] [DEBUG] [LOCAL ] IBN: Deleted primary data file. [2025-10-28T19:21:41.723839] [INFO ] [LOCAL ] IBM: Starting deletion of primary data. [2025-10-28T19:21:41.784133] [INFO ] [MAIN ] IBN: Starting full primary refresh. [2025-10-28T19:21:41.832744] [DEBUG] [LOCAL ] IBM: Deleted primary data file. [2025-10-28T19:21:41.951226] [INFO ] [MAIN ] IBM: Starting full primary refresh. [2025-10-28T19:21:42.941492] [INFO ] [REMOTE ] IBP: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:21:42.994744] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-01. [2025-10-28T19:21:43.019254] [INFO ] [REMOTE ] IAG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:21:43.085992] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-01. [2025-10-28T19:21:43.140429] [INFO ] [REMOTE ] IBM: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:21:43.140899] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-01. [2025-10-28T19:21:43.136793] [INFO ] [REMOTE ] IBN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:21:43.141963] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-01. [2025-10-28T19:21:43.839211] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-28T19:21:43.844232] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-02. [2025-10-28T19:21:44.285663] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-28T19:21:44.296076] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-02. [2025-10-28T19:21:44.465154] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-28T19:21:44.475704] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-02. [2025-10-28T19:21:44.586840] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-28T19:21:44.625633] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-28T19:21:44.780241] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-02. [2025-10-28T19:21:45.543057] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-28T19:21:45.580233] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-03. [2025-10-28T19:21:45.636556] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-28T19:21:46.170792] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-28T19:21:46.380242] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-03. [2025-10-28T19:21:46.819859] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-28T19:21:47.180301] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-04. [2025-10-28T19:21:47.828002] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-28T19:21:47.980240] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-04. [2025-10-28T19:21:48.482748] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-28T19:21:48.780231] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-03. [2025-10-28T19:21:49.580207] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-05. [2025-10-28T19:21:49.652743] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-10-28T19:21:50.208170] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-10-28T19:21:50.380248] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-03. [2025-10-28T19:21:50.867346] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-28T19:21:51.180325] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-04. [2025-10-28T19:21:51.285626] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-28T19:21:51.980325] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-06. [2025-10-28T19:21:52.640003] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-28T19:21:52.780260] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-05. [2025-10-28T19:21:53.265998] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-28T19:21:53.580263] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-07. [2025-10-28T19:21:54.122540] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-28T19:21:54.380305] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-04. [2025-10-28T19:21:54.818770] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-28T19:21:55.105414] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-10-28T19:21:55.180245] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-05. [2025-10-28T19:21:55.980249] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-06. [2025-10-28T19:21:56.021568] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-28T19:21:56.780327] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-05. [2025-10-28T19:21:57.304585] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-28T19:21:57.580319] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-07. [2025-10-28T19:21:58.335622] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-10-28T19:21:58.380248] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-06. [2025-10-28T19:21:58.900870] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-10-28T19:21:59.180317] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-08. [2025-10-28T19:21:59.900929] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-10-28T19:21:59.980247] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-06. [2025-10-28T19:22:00.458832] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-28T19:22:00.779586] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-28T19:22:00.785321] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-07. [2025-10-28T19:22:01.580315] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-09. [2025-10-28T19:22:02.380241] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-07. [2025-10-28T19:22:02.521226] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-10-28T19:22:02.939741] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-28T19:22:03.180233] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-10. [2025-10-28T19:22:03.310921] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-28T19:22:03.980261] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-08. [2025-10-28T19:22:04.780222] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-08. [2025-10-28T19:22:04.922917] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-10 (1.74 seconds). [2025-10-28T19:22:04.934618] [INFO ] [REMOTE ] IAG: Full fetch complete (77529 records). [2025-10-28T19:22:04.934816] [DEBUG] [VALIDATOR ] IAG: Validating primary data. [2025-10-28T19:22:05.252070] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-28T19:22:05.456777] [DEBUG] [VALIDATOR ] IAG: All expected trading days are present. [2025-10-28T19:22:05.456875] [DEBUG] [VALIDATOR ] IAG: Primary data validation passed. [2025-10-28T19:22:05.457984] [INFO ] [MAIN ] IAG: Fetched primary data is valid. [2025-10-28T19:22:05.458051] [DEBUG] [LOCAL ] IAG: Saving primary data. [2025-10-28T19:22:05.459734] [DEBUG] [LOCAL ] IAG: Trimmed 77529 records to 53492 (keeping 200 days of data) [2025-10-28T19:22:05.582266] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-08. [2025-10-28T19:22:05.890275] [DEBUG] [LOCAL ] IAG: Primary data saved (53492 records). [2025-10-28T19:22:05.890458] [INFO ] [MAIN ] IAG: Full history saved. [2025-10-28T19:22:05.891668] [INFO ] [MAIN ] Update Progress: 1081/2366 symbols completed. IAG took 25.9s. Estimated remaining: 2h 48m 51s. Rate: 7.6 symbols/min [2025-10-28T19:22:06.077482] [INFO ] [MAIN ] IBTA: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:22:06.116309] [DEBUG] [LOCAL ] IBTA: Loaded 35583 existing records from primary storage. [2025-10-28T19:22:06.116733] [INFO ] [MAIN ] IBTA: Loaded 35583 existing records. [2025-10-28T19:22:06.306122] [WARN ] [MAIN ] IBTA: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:22:06.306354] [INFO ] [MAIN ] IBTA: Wiping existing primary data before full refresh. [2025-10-28T19:22:06.306402] [INFO ] [LOCAL ] IBTA: Starting deletion of primary data. [2025-10-28T19:22:06.306803] [DEBUG] [LOCAL ] IBTA: Deleted primary data file. [2025-10-28T19:22:06.306862] [INFO ] [MAIN ] IBTA: Starting full primary refresh. [2025-10-28T19:22:06.385360] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-09. [2025-10-28T19:22:06.675144] [INFO ] [REMOTE ] IBTA: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:22:06.710039] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-10-28T19:22:06.852713] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-28T19:22:07.180297] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-09. [2025-10-28T19:22:07.308749] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-28T19:22:07.980254] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-10. [2025-10-28T19:22:08.562012] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-10-28T19:22:08.780256] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-09. [2025-10-28T19:22:09.022510] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-28T19:22:09.028825] [INFO ] [REMOTE ] IBP: Full fetch complete (41122 records). [2025-10-28T19:22:09.029018] [DEBUG] [VALIDATOR ] IBP: Validating primary data. [2025-10-28T19:22:09.427140] [DEBUG] [VALIDATOR ] IBP: All expected trading days are present. [2025-10-28T19:22:09.427245] [DEBUG] [VALIDATOR ] IBP: Primary data validation passed. [2025-10-28T19:22:09.428536] [INFO ] [MAIN ] IBP: Fetched primary data is valid. [2025-10-28T19:22:09.428602] [DEBUG] [LOCAL ] IBP: Saving primary data. [2025-10-28T19:22:09.430040] [DEBUG] [LOCAL ] IBP: Trimmed 41122 records to 28152 (keeping 200 days of data) [2025-10-28T19:22:09.584290] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-10. [2025-10-28T19:22:09.619775] [DEBUG] [LOCAL ] IBP: Primary data saved (28152 records). [2025-10-28T19:22:09.620362] [INFO ] [MAIN ] IBP: Full history saved. [2025-10-28T19:22:09.620496] [INFO ] [MAIN ] Update Progress: 1082/2366 symbols completed. IBP took 29.6s. Estimated remaining: 2h 48m 38s. Rate: 7.6 symbols/min [2025-10-28T19:22:09.829681] [INFO ] [MAIN ] ICE: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:22:09.887665] [DEBUG] [LOCAL ] ICE: Loaded 53009 existing records from primary storage. [2025-10-28T19:22:09.888112] [INFO ] [MAIN ] ICE: Loaded 53009 existing records. [2025-10-28T19:22:10.071894] [WARN ] [MAIN ] ICE: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:22:10.072205] [INFO ] [MAIN ] ICE: Wiping existing primary data before full refresh. [2025-10-28T19:22:10.072257] [INFO ] [LOCAL ] ICE: Starting deletion of primary data. [2025-10-28T19:22:10.072682] [DEBUG] [LOCAL ] ICE: Deleted primary data file. [2025-10-28T19:22:10.072744] [INFO ] [MAIN ] ICE: Starting full primary refresh. [2025-10-28T19:22:10.385817] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-01. [2025-10-28T19:22:10.459969] [INFO ] [REMOTE ] ICE: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:22:10.608737] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-10-28T19:22:11.161242] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-28T19:22:11.172120] [INFO ] [REMOTE ] IBN: Full fetch complete (76656 records). [2025-10-28T19:22:11.172247] [DEBUG] [VALIDATOR ] IBN: Validating primary data. [2025-10-28T19:22:11.186234] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-01. [2025-10-28T19:22:11.486424] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-28T19:22:11.663896] [DEBUG] [VALIDATOR ] IBN: All expected trading days are present. [2025-10-28T19:22:11.664006] [DEBUG] [VALIDATOR ] IBN: Primary data validation passed. [2025-10-28T19:22:11.665185] [INFO ] [MAIN ] IBN: Fetched primary data is valid. [2025-10-28T19:22:11.665251] [DEBUG] [LOCAL ] IBN: Saving primary data. [2025-10-28T19:22:11.667228] [DEBUG] [LOCAL ] IBN: Trimmed 76656 records to 52793 (keeping 200 days of data) [2025-10-28T19:22:11.994704] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-10. [2025-10-28T19:22:12.020130] [DEBUG] [LOCAL ] IBN: Primary data saved (52793 records). [2025-10-28T19:22:12.020274] [INFO ] [MAIN ] IBN: Full history saved. [2025-10-28T19:22:12.020357] [INFO ] [MAIN ] Update Progress: 1083/2366 symbols completed. IBN took 32.0s. Estimated remaining: 2h 48m 24s. Rate: 7.6 symbols/min [2025-10-28T19:22:12.223094] [INFO ] [MAIN ] ICL: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:22:12.260601] [DEBUG] [LOCAL ] ICL: Loaded 37737 existing records from primary storage. [2025-10-28T19:22:12.260962] [INFO ] [MAIN ] ICL: Loaded 37737 existing records. [2025-10-28T19:22:12.472928] [WARN ] [MAIN ] ICL: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:22:12.473370] [INFO ] [MAIN ] ICL: Wiping existing primary data before full refresh. [2025-10-28T19:22:12.473495] [INFO ] [LOCAL ] ICL: Starting deletion of primary data. [2025-10-28T19:22:12.473988] [DEBUG] [LOCAL ] ICL: Deleted primary data file. [2025-10-28T19:22:12.474137] [INFO ] [MAIN ] ICL: Starting full primary refresh. [2025-10-28T19:22:12.782770] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-02. [2025-10-28T19:22:12.830432] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-10-28T19:22:12.924908] [INFO ] [REMOTE ] ICL: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:22:13.580310] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-01. [2025-10-28T19:22:13.659910] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-28T19:22:14.040445] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-10 (2.05 seconds). [2025-10-28T19:22:14.051483] [INFO ] [REMOTE ] IBM: Full fetch complete (77744 records). [2025-10-28T19:22:14.051683] [DEBUG] [VALIDATOR ] IBM: Validating primary data. [2025-10-28T19:22:14.390087] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-03. [2025-10-28T19:22:14.452563] [DEBUG] [VALIDATOR ] IBM: All expected trading days are present. [2025-10-28T19:22:14.452700] [DEBUG] [VALIDATOR ] IBM: Primary data validation passed. [2025-10-28T19:22:14.453890] [INFO ] [MAIN ] IBM: Fetched primary data is valid. [2025-10-28T19:22:14.453969] [DEBUG] [LOCAL ] IBM: Saving primary data. [2025-10-28T19:22:14.455440] [DEBUG] [LOCAL ] IBM: Trimmed 77744 records to 53628 (keeping 200 days of data) [2025-10-28T19:22:14.692552] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-28T19:22:14.819376] [DEBUG] [LOCAL ] IBM: Primary data saved (53628 records). [2025-10-28T19:22:14.819515] [INFO ] [MAIN ] IBM: Full history saved. [2025-10-28T19:22:14.819878] [INFO ] [MAIN ] Update Progress: 1084/2366 symbols completed. IBM took 34.8s. Estimated remaining: 2h 48m 10s. Rate: 7.6 symbols/min [2025-10-28T19:22:14.986874] [INFO ] [MAIN ] IDA: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:22:15.023051] [DEBUG] [LOCAL ] IDA: Loaded 32500 existing records from primary storage. [2025-10-28T19:22:15.023307] [INFO ] [MAIN ] IDA: Loaded 32500 existing records. [2025-10-28T19:22:15.195155] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-02. [2025-10-28T19:22:15.199786] [WARN ] [MAIN ] IDA: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:22:15.200611] [INFO ] [MAIN ] IDA: Wiping existing primary data before full refresh. [2025-10-28T19:22:15.200689] [INFO ] [LOCAL ] IDA: Starting deletion of primary data. [2025-10-28T19:22:15.200964] [DEBUG] [LOCAL ] IDA: Deleted primary data file. [2025-10-28T19:22:15.201021] [INFO ] [MAIN ] IDA: Starting full primary refresh. [2025-10-28T19:22:15.555478] [INFO ] [REMOTE ] IDA: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:22:15.616520] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-28T19:22:15.980322] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-02. [2025-10-28T19:22:16.150902] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-28T19:22:16.780292] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-03. [2025-10-28T19:22:17.222957] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-28T19:22:17.580309] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-03. [2025-10-28T19:22:17.965577] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-28T19:22:18.380423] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-04. [2025-10-28T19:22:18.922415] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-28T19:22:19.180286] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-04. [2025-10-28T19:22:19.465271] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-28T19:22:19.980254] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-04. [2025-10-28T19:22:20.336528] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-28T19:22:20.780279] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-01. [2025-10-28T19:22:21.399352] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-28T19:22:21.580246] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-05. [2025-10-28T19:22:21.727507] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-10-28T19:22:22.380287] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-05. [2025-10-28T19:22:22.806875] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-28T19:22:23.180239] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-02. [2025-10-28T19:22:23.335877] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-10-28T19:22:23.985424] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-05. [2025-10-28T19:22:24.000793] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-28T19:22:24.780226] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-06. [2025-10-28T19:22:24.853816] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-10-28T19:22:25.580314] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-03. [2025-10-28T19:22:25.977958] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-28T19:22:26.380248] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-06. [2025-10-28T19:22:26.382618] [DEBUG] [REMOTE ] IDA: Error fetching primary data for 2025-03: ("Connection broken: ConnectionResetError(104, 'Connection reset by peer')", ConnectionResetError(104, 'Connection reset by peer')) [2025-10-28T19:22:26.382723] [WARN ] [REMOTE ] IDA: No data returned for month 2025-03 [2025-10-28T19:22:26.382808] [FATAL] [REMOTE ] IDA: API call failed - aborting fetch to avoid wasting further API calls [2025-10-28T19:22:26.382875] [FATAL] [MAIN ] IDA: Failed to fetch primary data. [2025-10-28T19:22:26.382946] [WARN ] [MAIN ] IDA: Deleting existing primary and derivative data due to fetch failure. [2025-10-28T19:22:26.383028] [INFO ] [LOCAL ] IDA: Starting deletion of primary data. [2025-10-28T19:22:26.383106] [DEBUG] [LOCAL ] IDA: No primary data file found to delete. [2025-10-28T19:22:26.383154] [INFO ] [LOCAL ] IDA: Starting deletion of derivative data. [2025-10-28T19:22:26.384297] [DEBUG] [LOCAL ] IDA: Deleted derivative data file. [2025-10-28T19:22:26.384375] [INFO ] [MAIN ] Update Progress: 1085/2366 symbols completed. IDA took 11.6s. Estimated remaining: 2h 48m 7s. Rate: 7.6 symbols/min [2025-10-28T19:22:26.563680] [INFO ] [MAIN ] IDE: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:22:26.575227] [DEBUG] [LOCAL ] IDE: Loaded 9081 existing records from primary storage. [2025-10-28T19:22:26.575446] [INFO ] [MAIN ] IDE: Loaded 9081 existing records. [2025-10-28T19:22:26.753174] [WARN ] [MAIN ] IDE: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:22:26.753382] [INFO ] [MAIN ] IDE: Wiping existing primary data before full refresh. [2025-10-28T19:22:26.753460] [INFO ] [LOCAL ] IDE: Starting deletion of primary data. [2025-10-28T19:22:26.753593] [DEBUG] [LOCAL ] IDE: Deleted primary data file. [2025-10-28T19:22:26.753631] [INFO ] [MAIN ] IDE: Starting full primary refresh. [2025-10-28T19:22:27.127591] [INFO ] [REMOTE ] IDE: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:22:27.180267] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-01. [2025-10-28T19:22:27.488966] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-28T19:22:27.636492] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-28T19:22:27.980305] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-02. [2025-10-28T19:22:28.424330] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-28T19:22:28.780319] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-06. [2025-10-28T19:22:29.549556] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-10-28T19:22:29.580252] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-07. [2025-10-28T19:22:30.380260] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-07. [2025-10-28T19:22:30.927578] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-28T19:22:31.180245] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-08. [2025-10-28T19:22:31.307287] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-10-28T19:22:31.980243] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-08. [2025-10-28T19:22:32.517246] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-28T19:22:32.780234] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-09. [2025-10-28T19:22:32.894968] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-28T19:22:33.580268] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-07. [2025-10-28T19:22:34.088969] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-28T19:22:34.380243] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-03. [2025-10-28T19:22:34.441692] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-28T19:22:34.758220] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-10-28T19:22:35.180237] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-08. [2025-10-28T19:22:35.980266] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-04. [2025-10-28T19:22:36.380466] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-28T19:22:36.499151] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-28T19:22:36.780273] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-09. [2025-10-28T19:22:37.580289] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-05. [2025-10-28T19:22:37.859126] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-28T19:22:38.070157] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-28T19:22:38.380332] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-06. [2025-10-28T19:22:38.892735] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-10-28T19:22:39.180289] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-07. [2025-10-28T19:22:39.716112] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-10-28T19:22:39.980244] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-08. [2025-10-28T19:22:40.490731] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-28T19:22:40.780252] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-10. [2025-10-28T19:22:41.580250] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-10. [2025-10-28T19:22:41.934952] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-28T19:22:41.946095] [INFO ] [REMOTE ] IBTA: Full fetch complete (51094 records). [2025-10-28T19:22:41.946322] [DEBUG] [VALIDATOR ] IBTA: Validating primary data. [2025-10-28T19:22:42.359435] [DEBUG] [VALIDATOR ] IBTA: All expected trading days are present. [2025-10-28T19:22:42.359531] [DEBUG] [VALIDATOR ] IBTA: Primary data validation passed. [2025-10-28T19:22:42.360327] [INFO ] [MAIN ] IBTA: Fetched primary data is valid. [2025-10-28T19:22:42.360392] [DEBUG] [LOCAL ] IBTA: Saving primary data. [2025-10-28T19:22:42.361544] [DEBUG] [LOCAL ] IBTA: Trimmed 51094 records to 35416 (keeping 200 days of data) [2025-10-28T19:22:42.411346] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-09. [2025-10-28T19:22:42.575550] [DEBUG] [LOCAL ] IBTA: Primary data saved (35416 records). [2025-10-28T19:22:42.575715] [INFO ] [MAIN ] IBTA: Full history saved. [2025-10-28T19:22:42.575806] [INFO ] [MAIN ] Update Progress: 1086/2366 symbols completed. IBTA took 36.7s. Estimated remaining: 2h 48m 9s. Rate: 7.6 symbols/min [2025-10-28T19:22:42.756240] [INFO ] [MAIN ] IDT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:22:42.775609] [DEBUG] [LOCAL ] IDT: Loaded 18504 existing records from primary storage. [2025-10-28T19:22:42.775888] [INFO ] [MAIN ] IDT: Loaded 18504 existing records. [2025-10-28T19:22:43.035449] [WARN ] [MAIN ] IDT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:22:43.035982] [INFO ] [MAIN ] IDT: Wiping existing primary data before full refresh. [2025-10-28T19:22:43.036185] [INFO ] [LOCAL ] IDT: Starting deletion of primary data. [2025-10-28T19:22:43.036445] [DEBUG] [LOCAL ] IDT: Deleted primary data file. [2025-10-28T19:22:43.036604] [INFO ] [MAIN ] IDT: Starting full primary refresh. [2025-10-28T19:22:43.185229] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-09. [2025-10-28T19:22:43.381426] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-10 (1.80 seconds). [2025-10-28T19:22:43.458166] [INFO ] [REMOTE ] ICE: Full fetch complete (77024 records). [2025-10-28T19:22:43.457589] [INFO ] [REMOTE ] IDT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:22:43.458892] [DEBUG] [VALIDATOR ] ICE: Validating primary data. [2025-10-28T19:22:43.561172] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-28T19:22:43.819013] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-28T19:22:43.911316] [DEBUG] [VALIDATOR ] ICE: All expected trading days are present. [2025-10-28T19:22:43.911410] [DEBUG] [VALIDATOR ] ICE: Primary data validation passed. [2025-10-28T19:22:43.912816] [INFO ] [MAIN ] ICE: Fetched primary data is valid. [2025-10-28T19:22:43.912897] [DEBUG] [LOCAL ] ICE: Saving primary data. [2025-10-28T19:22:43.915143] [DEBUG] [LOCAL ] ICE: Trimmed 77024 records to 53007 (keeping 200 days of data) [2025-10-28T19:22:44.004000] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-01. [2025-10-28T19:22:44.241890] [DEBUG] [LOCAL ] ICE: Primary data saved (53007 records). [2025-10-28T19:22:44.242019] [INFO ] [MAIN ] ICE: Full history saved. [2025-10-28T19:22:44.242412] [INFO ] [MAIN ] Update Progress: 1087/2366 symbols completed. ICE took 34.6s. Estimated remaining: 2h 47m 53s. Rate: 7.6 symbols/min [2025-10-28T19:22:44.412568] [INFO ] [MAIN ] IEX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:22:44.453382] [DEBUG] [LOCAL ] IEX: Loaded 37995 existing records from primary storage. [2025-10-28T19:22:44.453667] [INFO ] [MAIN ] IEX: Loaded 37995 existing records. [2025-10-28T19:22:44.654997] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-28T19:22:44.654688] [WARN ] [MAIN ] IEX: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:22:44.657954] [INFO ] [MAIN ] IEX: Wiping existing primary data before full refresh. [2025-10-28T19:22:44.658016] [INFO ] [LOCAL ] IEX: Starting deletion of primary data. [2025-10-28T19:22:44.658480] [DEBUG] [LOCAL ] IEX: Deleted primary data file. [2025-10-28T19:22:44.658540] [INFO ] [MAIN ] IEX: Starting full primary refresh. [2025-10-28T19:22:44.785386] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-10. [2025-10-28T19:22:45.036451] [INFO ] [REMOTE ] IEX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:22:45.580263] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-10. [2025-10-28T19:22:46.037767] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-10 (1.25 seconds). [2025-10-28T19:22:46.047168] [INFO ] [REMOTE ] ICL: Full fetch complete (55601 records). [2025-10-28T19:22:46.047344] [DEBUG] [VALIDATOR ] ICL: Validating primary data. [2025-10-28T19:22:46.356210] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-28T19:22:46.375263] [INFO ] [REMOTE ] IDE: Full fetch complete (12797 records). [2025-10-28T19:22:46.404402] [DEBUG] [VALIDATOR ] IDE: Validating primary data. [2025-10-28T19:22:46.385693] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-02. [2025-10-28T19:22:46.529543] [DEBUG] [VALIDATOR ] ICL: All expected trading days are present. [2025-10-28T19:22:46.546022] [DEBUG] [VALIDATOR ] ICL: Primary data validation passed. [2025-10-28T19:22:46.565202] [INFO ] [MAIN ] ICL: Fetched primary data is valid. [2025-10-28T19:22:46.567446] [DEBUG] [LOCAL ] ICL: Saving primary data. [2025-10-28T19:22:46.618793] [DEBUG] [LOCAL ] ICL: Trimmed 55601 records to 37606 (keeping 200 days of data) [2025-10-28T19:22:46.947773] [DEBUG] [VALIDATOR ] IDE: All expected trading days are present. [2025-10-28T19:22:46.950024] [DEBUG] [VALIDATOR ] IDE: Primary data validation passed. [2025-10-28T19:22:46.958556] [INFO ] [MAIN ] IDE: Fetched primary data is valid. [2025-10-28T19:22:46.958787] [DEBUG] [LOCAL ] IDE: Saving primary data. [2025-10-28T19:22:47.003440] [DEBUG] [LOCAL ] IDE: Trimmed 12797 records to 9108 (keeping 200 days of data) [2025-10-28T19:22:47.043446] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-28T19:22:47.120708] [DEBUG] [LOCAL ] ICL: Primary data saved (37606 records). [2025-10-28T19:22:47.126438] [DEBUG] [LOCAL ] IDE: Primary data saved (9108 records). [2025-10-28T19:22:47.126638] [INFO ] [MAIN ] IDE: Full history saved. [2025-10-28T19:22:47.126768] [INFO ] [MAIN ] ICL: Full history saved. [2025-10-28T19:22:47.126890] [INFO ] [MAIN ] Update Progress: 1088/2366 symbols completed. ICL took 35.1s. Estimated remaining: 2h 47m 40s. Rate: 7.6 symbols/min [2025-10-28T19:22:47.138265] [INFO ] [MAIN ] Update Progress: 1089/2366 symbols completed. IDE took 20.8s. Estimated remaining: 2h 47m 23s. Rate: 7.6 symbols/min [2025-10-28T19:22:47.200994] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-03. [2025-10-28T19:22:47.432908] [INFO ] [MAIN ] IFF: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:22:47.487385] [INFO ] [MAIN ] IFN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:22:47.506201] [DEBUG] [LOCAL ] IFN: Loaded 18180 existing records from primary storage. [2025-10-28T19:22:47.506454] [INFO ] [MAIN ] IFN: Loaded 18180 existing records. [2025-10-28T19:22:47.714892] [WARN ] [MAIN ] IFN: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:22:47.730265] [INFO ] [MAIN ] IFN: Wiping existing primary data before full refresh. [2025-10-28T19:22:47.730361] [INFO ] [LOCAL ] IFN: Starting deletion of primary data. [2025-10-28T19:22:47.731781] [DEBUG] [LOCAL ] IFN: Deleted primary data file. [2025-10-28T19:22:47.731867] [INFO ] [MAIN ] IFN: Starting full primary refresh. [2025-10-28T19:22:47.731995] [DEBUG] [LOCAL ] IFF: Loaded 51193 existing records from primary storage. [2025-10-28T19:22:47.801824] [INFO ] [MAIN ] IFF: Loaded 51193 existing records. [2025-10-28T19:22:47.994449] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-01. [2025-10-28T19:22:48.184137] [WARN ] [MAIN ] IFF: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:22:48.208157] [INFO ] [MAIN ] IFF: Wiping existing primary data before full refresh. [2025-10-28T19:22:48.232793] [INFO ] [LOCAL ] IFF: Starting deletion of primary data. [2025-10-28T19:22:48.241424] [DEBUG] [LOCAL ] IFF: Deleted primary data file. [2025-10-28T19:22:48.247262] [INFO ] [MAIN ] IFF: Starting full primary refresh. [2025-10-28T19:22:48.285438] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-28T19:22:48.367581] [INFO ] [REMOTE ] IFN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:22:48.693042] [INFO ] [REMOTE ] IFF: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:22:48.780220] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-04. [2025-10-28T19:22:49.112104] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-28T19:22:49.326668] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-28T19:22:49.580259] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-01. [2025-10-28T19:22:50.354826] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-28T19:22:50.380211] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-05. [2025-10-28T19:22:51.050132] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-28T19:22:51.180238] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-02. [2025-10-28T19:22:51.832422] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-28T19:22:51.980253] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-02. [2025-10-28T19:22:52.780219] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-01. [2025-10-28T19:22:52.839994] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-28T19:22:53.580248] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-06. [2025-10-28T19:22:54.189213] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-28T19:22:54.225408] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-28T19:22:54.380265] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-03. [2025-10-28T19:22:55.180244] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-03. [2025-10-28T19:22:55.492633] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-28T19:22:55.856069] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-28T19:22:55.980270] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-04. [2025-10-28T19:22:56.780266] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-04. [2025-10-28T19:22:57.175361] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-28T19:22:57.524108] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-28T19:22:57.580283] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-02. [2025-10-28T19:22:58.380281] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-05. [2025-10-28T19:22:58.720398] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-28T19:22:59.180268] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-07. [2025-10-28T19:22:59.980325] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-03. [2025-10-28T19:23:00.780360] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-05. [2025-10-28T19:23:04.256080] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-05 (5.88 seconds). [2025-10-28T19:23:04.260980] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-06. [2025-10-28T19:23:04.760416] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-07 (5.58 seconds). [2025-10-28T19:23:04.765024] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-08. [2025-10-28T19:23:05.539999] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-05 (4.76 seconds). [2025-10-28T19:23:05.548227] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-06. [2025-10-28T19:23:05.729110] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-03 (5.75 seconds). [2025-10-28T19:23:05.739802] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-04. [2025-10-28T19:23:06.012421] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-10-28T19:23:06.017584] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-07. [2025-10-28T19:23:06.345577] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-10-28T19:23:06.349684] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-09. [2025-10-28T19:23:06.744743] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-28T19:23:06.749879] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-08. [2025-10-28T19:23:07.097033] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-28T19:23:07.181812] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-10. [2025-10-28T19:23:07.184882] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-28T19:23:07.387344] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-10-28T19:23:07.488211] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-10-28T19:23:07.980231] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-09. [2025-10-28T19:23:08.012107] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-28T19:23:08.016804] [INFO ] [REMOTE ] IDT: Full fetch complete (24243 records). [2025-10-28T19:23:08.016884] [DEBUG] [VALIDATOR ] IDT: Validating primary data. [2025-10-28T19:23:08.396258] [DEBUG] [VALIDATOR ] IDT: All expected trading days are present. [2025-10-28T19:23:08.396347] [DEBUG] [VALIDATOR ] IDT: Primary data validation passed. [2025-10-28T19:23:08.396947] [INFO ] [MAIN ] IDT: Fetched primary data is valid. [2025-10-28T19:23:08.397010] [DEBUG] [LOCAL ] IDT: Saving primary data. [2025-10-28T19:23:08.397750] [DEBUG] [LOCAL ] IDT: Trimmed 24243 records to 18480 (keeping 200 days of data) [2025-10-28T19:23:08.519014] [DEBUG] [LOCAL ] IDT: Primary data saved (18480 records). [2025-10-28T19:23:08.519165] [INFO ] [MAIN ] IDT: Full history saved. [2025-10-28T19:23:08.519254] [INFO ] [MAIN ] Update Progress: 1090/2366 symbols completed. IDT took 25.9s. Estimated remaining: 2h 47m 31s. Rate: 7.6 symbols/min [2025-10-28T19:23:08.693958] [INFO ] [MAIN ] IFS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:23:08.706053] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-10-28T19:23:08.731514] [DEBUG] [LOCAL ] IFS: Loaded 21676 existing records from primary storage. [2025-10-28T19:23:08.731873] [INFO ] [MAIN ] IFS: Loaded 21676 existing records. [2025-10-28T19:23:08.786473] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-05. [2025-10-28T19:23:08.914293] [WARN ] [MAIN ] IFS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:23:08.914518] [INFO ] [MAIN ] IFS: Wiping existing primary data before full refresh. [2025-10-28T19:23:08.914563] [INFO ] [LOCAL ] IFS: Starting deletion of primary data. [2025-10-28T19:23:08.914819] [DEBUG] [LOCAL ] IFS: Deleted primary data file. [2025-10-28T19:23:08.914876] [INFO ] [MAIN ] IFS: Starting full primary refresh. [2025-10-28T19:23:09.260034] [INFO ] [REMOTE ] IFS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:23:09.580258] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-07. [2025-10-28T19:23:10.060205] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-10-28T19:23:10.380258] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-06. [2025-10-28T19:23:10.641013] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-28T19:23:11.180242] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-01. [2025-10-28T19:23:11.701346] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-28T19:23:11.856394] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-28T19:23:11.980276] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-02. [2025-10-28T19:23:12.754355] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-28T19:23:12.780232] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-03. [2025-10-28T19:23:13.580318] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-07. [2025-10-28T19:23:13.692835] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-28T19:23:14.380333] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-10. [2025-10-28T19:23:14.946741] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-28T19:23:15.180252] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-08. [2025-10-28T19:23:15.237126] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-10 (0.86 seconds). [2025-10-28T19:23:15.241375] [INFO ] [REMOTE ] IFN: Full fetch complete (28013 records). [2025-10-28T19:23:15.241505] [DEBUG] [VALIDATOR ] IFN: Validating primary data. [2025-10-28T19:23:15.625598] [DEBUG] [VALIDATOR ] IFN: All expected trading days are present. [2025-10-28T19:23:15.625703] [DEBUG] [VALIDATOR ] IFN: Primary data validation passed. [2025-10-28T19:23:15.626362] [INFO ] [MAIN ] IFN: Fetched primary data is valid. [2025-10-28T19:23:15.626425] [DEBUG] [LOCAL ] IFN: Saving primary data. [2025-10-28T19:23:15.627254] [DEBUG] [LOCAL ] IFN: Trimmed 28013 records to 18129 (keeping 200 days of data) [2025-10-28T19:23:15.735906] [DEBUG] [LOCAL ] IFN: Primary data saved (18129 records). [2025-10-28T19:23:15.736047] [INFO ] [MAIN ] IFN: Full history saved. [2025-10-28T19:23:15.736149] [INFO ] [MAIN ] Update Progress: 1091/2366 symbols completed. IFN took 28.5s. Estimated remaining: 2h 47m 22s. Rate: 7.6 symbols/min [2025-10-28T19:23:15.901790] [INFO ] [MAIN ] IGA: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:23:15.913138] [DEBUG] [LOCAL ] IGA: Loaded 9709 existing records from primary storage. [2025-10-28T19:23:15.913333] [INFO ] [MAIN ] IGA: Loaded 9709 existing records. [2025-10-28T19:23:15.980682] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-04. [2025-10-28T19:23:16.097699] [WARN ] [MAIN ] IGA: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:23:16.097917] [INFO ] [MAIN ] IGA: Wiping existing primary data before full refresh. [2025-10-28T19:23:16.097968] [INFO ] [LOCAL ] IGA: Starting deletion of primary data. [2025-10-28T19:23:16.098116] [DEBUG] [LOCAL ] IGA: Deleted primary data file. [2025-10-28T19:23:16.098157] [INFO ] [MAIN ] IGA: Starting full primary refresh. [2025-10-28T19:23:16.487771] [INFO ] [REMOTE ] IGA: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:23:16.785880] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-08. [2025-10-28T19:23:16.808547] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-10-28T19:23:16.875351] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-10-28T19:23:17.580326] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-05. [2025-10-28T19:23:17.908458] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-28T19:23:18.380219] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-09. [2025-10-28T19:23:18.503517] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-10-28T19:23:19.180239] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-06. [2025-10-28T19:23:19.404227] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-28T19:23:19.985164] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-10. [2025-10-28T19:23:19.987323] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-28T19:23:20.780268] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-01. [2025-10-28T19:23:21.268347] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-28T19:23:21.275888] [INFO ] [REMOTE ] IEX: Full fetch complete (53903 records). [2025-10-28T19:23:21.275987] [DEBUG] [VALIDATOR ] IEX: Validating primary data. [2025-10-28T19:23:21.393751] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-10-28T19:23:21.585470] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-02. [2025-10-28T19:23:21.712150] [DEBUG] [VALIDATOR ] IEX: All expected trading days are present. [2025-10-28T19:23:21.712221] [DEBUG] [VALIDATOR ] IEX: Primary data validation passed. [2025-10-28T19:23:21.713032] [INFO ] [MAIN ] IEX: Fetched primary data is valid. [2025-10-28T19:23:21.713094] [DEBUG] [LOCAL ] IEX: Saving primary data. [2025-10-28T19:23:21.714207] [DEBUG] [LOCAL ] IEX: Trimmed 53903 records to 37974 (keeping 200 days of data) [2025-10-28T19:23:21.955072] [DEBUG] [LOCAL ] IEX: Primary data saved (37974 records). [2025-10-28T19:23:21.955247] [INFO ] [MAIN ] IEX: Full history saved. [2025-10-28T19:23:21.955785] [INFO ] [MAIN ] Update Progress: 1092/2366 symbols completed. IEX took 37.7s. Estimated remaining: 2h 47m 12s. Rate: 7.6 symbols/min [2025-10-28T19:23:22.143594] [INFO ] [MAIN ] IGD: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:23:22.150324] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-10-28T19:23:22.169257] [DEBUG] [LOCAL ] IGD: Loaded 19075 existing records from primary storage. [2025-10-28T19:23:22.169499] [INFO ] [MAIN ] IGD: Loaded 19075 existing records. [2025-10-28T19:23:22.340390] [WARN ] [MAIN ] IGD: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:23:22.340600] [INFO ] [MAIN ] IGD: Wiping existing primary data before full refresh. [2025-10-28T19:23:22.340669] [INFO ] [LOCAL ] IGD: Starting deletion of primary data. [2025-10-28T19:23:22.340890] [DEBUG] [LOCAL ] IGD: Deleted primary data file. [2025-10-28T19:23:22.340931] [INFO ] [MAIN ] IGD: Starting full primary refresh. [2025-10-28T19:23:22.385526] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-07. [2025-10-28T19:23:22.693582] [INFO ] [REMOTE ] IGD: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:23:23.122754] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-10-28T19:23:23.180215] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-08. [2025-10-28T19:23:23.953319] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-10-28T19:23:23.980208] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-09. [2025-10-28T19:23:24.722298] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-10-28T19:23:24.780249] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-09. [2025-10-28T19:23:25.580259] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-03. [2025-10-28T19:23:26.062423] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-28T19:23:26.230617] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-10-28T19:23:26.380219] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-10. [2025-10-28T19:23:27.180264] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-10. [2025-10-28T19:23:27.854514] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-28T19:23:27.865778] [INFO ] [REMOTE ] IFF: Full fetch complete (73809 records). [2025-10-28T19:23:27.865925] [DEBUG] [VALIDATOR ] IFF: Validating primary data. [2025-10-28T19:23:27.981892] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-04. [2025-10-28T19:23:28.146928] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-28T19:23:28.178518] [INFO ] [REMOTE ] IFS: Full fetch complete (32302 records). [2025-10-28T19:23:28.188924] [DEBUG] [VALIDATOR ] IFS: Validating primary data. [2025-10-28T19:23:28.447535] [DEBUG] [VALIDATOR ] IFF: All expected trading days are present. [2025-10-28T19:23:28.448251] [DEBUG] [VALIDATOR ] IFF: Primary data validation passed. [2025-10-28T19:23:28.513497] [INFO ] [MAIN ] IFF: Fetched primary data is valid. [2025-10-28T19:23:28.538051] [DEBUG] [LOCAL ] IFF: Saving primary data. [2025-10-28T19:23:28.588473] [DEBUG] [LOCAL ] IFF: Trimmed 73809 records to 51191 (keeping 200 days of data) [2025-10-28T19:23:28.776809] [DEBUG] [VALIDATOR ] IFS: All expected trading days are present. [2025-10-28T19:23:28.779530] [DEBUG] [VALIDATOR ] IFS: Primary data validation passed. [2025-10-28T19:23:28.779966] [INFO ] [MAIN ] IFS: Fetched primary data is valid. [2025-10-28T19:23:28.780067] [DEBUG] [LOCAL ] IFS: Saving primary data. [2025-10-28T19:23:28.784290] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-01. [2025-10-28T19:23:28.796276] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-28T19:23:28.797873] [DEBUG] [LOCAL ] IFS: Trimmed 32302 records to 21632 (keeping 200 days of data) [2025-10-28T19:23:29.054236] [DEBUG] [LOCAL ] IFS: Primary data saved (21632 records). [2025-10-28T19:23:29.062689] [INFO ] [MAIN ] IFS: Full history saved. [2025-10-28T19:23:29.063268] [INFO ] [MAIN ] Update Progress: 1093/2366 symbols completed. IFS took 20.5s. Estimated remaining: 2h 47m 3s. Rate: 7.6 symbols/min [2025-10-28T19:23:29.258191] [DEBUG] [LOCAL ] IFF: Primary data saved (51191 records). [2025-10-28T19:23:29.276153] [INFO ] [MAIN ] IFF: Full history saved. [2025-10-28T19:23:29.289286] [INFO ] [MAIN ] Update Progress: 1094/2366 symbols completed. IFF took 42.2s. Estimated remaining: 2h 46m 47s. Rate: 7.6 symbols/min [2025-10-28T19:23:29.322982] [INFO ] [MAIN ] IGI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:23:29.420984] [DEBUG] [LOCAL ] IGI: Loaded 4108 existing records from primary storage. [2025-10-28T19:23:29.436733] [INFO ] [MAIN ] IGI: Loaded 4108 existing records. [2025-10-28T19:23:29.561855] [INFO ] [MAIN ] IGR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:23:29.593434] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-05. [2025-10-28T19:23:29.680819] [WARN ] [MAIN ] IGI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:23:29.681341] [INFO ] [MAIN ] IGI: Wiping existing primary data before full refresh. [2025-10-28T19:23:29.681432] [INFO ] [LOCAL ] IGI: Starting deletion of primary data. [2025-10-28T19:23:29.681756] [DEBUG] [LOCAL ] IGI: Deleted primary data file. [2025-10-28T19:23:29.682022] [INFO ] [MAIN ] IGI: Starting full primary refresh. [2025-10-28T19:23:29.835431] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-28T19:23:29.836614] [DEBUG] [LOCAL ] IGR: Loaded 30163 existing records from primary storage. [2025-10-28T19:23:29.880273] [INFO ] [MAIN ] IGR: Loaded 30163 existing records. [2025-10-28T19:23:30.254607] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-28T19:23:30.254022] [WARN ] [MAIN ] IGR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:23:30.297749] [INFO ] [MAIN ] IGR: Wiping existing primary data before full refresh. [2025-10-28T19:23:30.308323] [INFO ] [LOCAL ] IGR: Starting deletion of primary data. [2025-10-28T19:23:30.317177] [DEBUG] [LOCAL ] IGR: Deleted primary data file. [2025-10-28T19:23:30.317367] [INFO ] [MAIN ] IGR: Starting full primary refresh. [2025-10-28T19:23:30.385505] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-02. [2025-10-28T19:23:30.406796] [INFO ] [REMOTE ] IGI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:23:30.703247] [INFO ] [REMOTE ] IGR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:23:31.180276] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-01. [2025-10-28T19:23:31.214451] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-28T19:23:31.572219] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-10-28T19:23:31.980258] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-03. [2025-10-28T19:23:32.780230] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-02. [2025-10-28T19:23:32.921129] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-28T19:23:33.183186] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-28T19:23:33.580250] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-06. [2025-10-28T19:23:34.030668] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-28T19:23:34.380298] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-01. [2025-10-28T19:23:35.180242] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-07. [2025-10-28T19:23:35.468798] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-10-28T19:23:35.980223] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-04. [2025-10-28T19:23:36.727092] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-28T19:23:36.780239] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-03. [2025-10-28T19:23:36.859141] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-10-28T19:23:37.228227] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-10-28T19:23:37.580264] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-05. [2025-10-28T19:23:38.212726] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-28T19:23:38.380279] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-06. [2025-10-28T19:23:39.180239] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-08. [2025-10-28T19:23:39.221577] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-28T19:23:39.661232] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-10-28T19:23:39.980367] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-09. [2025-10-28T19:23:40.508318] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-28T19:23:40.780260] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-02. [2025-10-28T19:23:41.580239] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-07. [2025-10-28T19:23:41.782591] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-28T19:23:42.380249] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-04. [2025-10-28T19:23:42.449797] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-28T19:23:42.684885] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-04 (0.30 seconds). [2025-10-28T19:23:43.180250] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-05. [2025-10-28T19:23:43.505172] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-10-28T19:23:43.980246] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-06. [2025-10-28T19:23:44.413719] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-10-28T19:23:44.780256] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-03. [2025-10-28T19:23:45.580288] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-10. [2025-10-28T19:23:45.753139] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-28T19:23:46.269574] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-28T19:23:46.272386] [INFO ] [REMOTE ] IGA: Full fetch complete (14247 records). [2025-10-28T19:23:46.272478] [DEBUG] [VALIDATOR ] IGA: Validating primary data. [2025-10-28T19:23:46.385370] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-04. [2025-10-28T19:23:46.630331] [DEBUG] [VALIDATOR ] IGA: All expected trading days are present. [2025-10-28T19:23:46.630407] [DEBUG] [VALIDATOR ] IGA: Primary data validation passed. [2025-10-28T19:23:46.630761] [INFO ] [MAIN ] IGA: Fetched primary data is valid. [2025-10-28T19:23:46.630822] [DEBUG] [LOCAL ] IGA: Saving primary data. [2025-10-28T19:23:46.631322] [DEBUG] [LOCAL ] IGA: Trimmed 14247 records to 9667 (keeping 200 days of data) [2025-10-28T19:23:46.688050] [DEBUG] [LOCAL ] IGA: Primary data saved (9667 records). [2025-10-28T19:23:46.688193] [INFO ] [MAIN ] IGA: Full history saved. [2025-10-28T19:23:46.688320] [INFO ] [MAIN ] Update Progress: 1095/2366 symbols completed. IGA took 31.0s. Estimated remaining: 2h 46m 50s. Rate: 7.6 symbols/min [2025-10-28T19:23:46.862115] [INFO ] [MAIN ] IH: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:23:46.867253] [DEBUG] [LOCAL ] IH: Loaded 2674 existing records from primary storage. [2025-10-28T19:23:46.867410] [INFO ] [MAIN ] IH: Loaded 2674 existing records. [2025-10-28T19:23:47.042945] [WARN ] [MAIN ] IH: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:23:47.043187] [INFO ] [MAIN ] IH: Wiping existing primary data before full refresh. [2025-10-28T19:23:47.043238] [INFO ] [LOCAL ] IH: Starting deletion of primary data. [2025-10-28T19:23:47.043397] [DEBUG] [LOCAL ] IH: Deleted primary data file. [2025-10-28T19:23:47.043454] [INFO ] [MAIN ] IH: Starting full primary refresh. [2025-10-28T19:23:47.185378] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-08. [2025-10-28T19:23:47.410625] [INFO ] [REMOTE ] IH: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:23:47.499024] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-28T19:23:47.980320] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-01. [2025-10-28T19:23:48.351282] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-10-28T19:23:48.780249] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-07. [2025-10-28T19:23:49.159520] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-10-28T19:23:49.287668] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-10-28T19:23:49.580242] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-08. [2025-10-28T19:23:49.988304] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-10-28T19:23:50.380317] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-05. [2025-10-28T19:23:51.180314] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-09. [2025-10-28T19:23:51.222629] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-28T19:23:51.783016] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-10-28T19:23:51.980258] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-10. [2025-10-28T19:23:52.780275] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-02. [2025-10-28T19:23:52.819334] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-28T19:23:52.824464] [INFO ] [REMOTE ] IGD: Full fetch complete (30081 records). [2025-10-28T19:23:52.824571] [DEBUG] [VALIDATOR ] IGD: Validating primary data. [2025-10-28T19:23:53.217701] [DEBUG] [VALIDATOR ] IGD: All expected trading days are present. [2025-10-28T19:23:53.217875] [DEBUG] [VALIDATOR ] IGD: Primary data validation passed. [2025-10-28T19:23:53.218961] [INFO ] [MAIN ] IGD: Fetched primary data is valid. [2025-10-28T19:23:53.219031] [DEBUG] [LOCAL ] IGD: Saving primary data. [2025-10-28T19:23:53.220396] [DEBUG] [LOCAL ] IGD: Trimmed 30081 records to 19113 (keeping 200 days of data) [2025-10-28T19:23:53.309358] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-28T19:23:53.349123] [DEBUG] [LOCAL ] IGD: Primary data saved (19113 records). [2025-10-28T19:23:53.349336] [INFO ] [MAIN ] IGD: Full history saved. [2025-10-28T19:23:53.349441] [INFO ] [MAIN ] Update Progress: 1096/2366 symbols completed. IGD took 31.4s. Estimated remaining: 2h 46m 41s. Rate: 7.6 symbols/min [2025-10-28T19:23:53.537056] [INFO ] [MAIN ] IHD: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:23:53.547714] [DEBUG] [LOCAL ] IHD: Loaded 7348 existing records from primary storage. [2025-10-28T19:23:53.548061] [INFO ] [MAIN ] IHD: Loaded 7348 existing records. [2025-10-28T19:23:53.585472] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-06. [2025-10-28T19:23:53.740081] [WARN ] [MAIN ] IHD: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:23:53.740285] [INFO ] [MAIN ] IHD: Wiping existing primary data before full refresh. [2025-10-28T19:23:53.740330] [INFO ] [LOCAL ] IHD: Starting deletion of primary data. [2025-10-28T19:23:53.740512] [DEBUG] [LOCAL ] IHD: Deleted primary data file. [2025-10-28T19:23:53.740569] [INFO ] [MAIN ] IHD: Starting full primary refresh. [2025-10-28T19:23:54.087763] [INFO ] [REMOTE ] IHD: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:23:54.380256] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-03. [2025-10-28T19:23:54.443305] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-28T19:23:54.777190] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-10-28T19:23:55.180268] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-04. [2025-10-28T19:23:55.552088] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-10-28T19:23:55.980285] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-01. [2025-10-28T19:23:56.534587] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-10-28T19:23:56.780252] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-02. [2025-10-28T19:23:57.309385] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-28T19:23:57.580247] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-03. [2025-10-28T19:23:58.062025] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-10-28T19:23:58.380308] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-09. [2025-10-28T19:23:58.751986] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-10-28T19:23:59.180249] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-05. [2025-10-28T19:23:59.464508] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-05 (0.28 seconds). [2025-10-28T19:23:59.980260] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-07. [2025-10-28T19:24:00.780343] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-04. [2025-10-28T19:24:01.525553] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-28T19:24:01.580306] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-05. [2025-10-28T19:24:01.780207] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-10-28T19:24:02.212841] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-28T19:24:02.380278] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-10. [2025-10-28T19:24:03.180234] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-06. [2025-10-28T19:24:03.273408] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-28T19:24:03.275178] [INFO ] [REMOTE ] IGI: Full fetch complete (5570 records). [2025-10-28T19:24:03.275248] [DEBUG] [VALIDATOR ] IGI: Validating primary data. [2025-10-28T19:24:03.539069] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-10-28T19:24:03.650179] [DEBUG] [VALIDATOR ] IGI: All expected trading days are present. [2025-10-28T19:24:03.650263] [DEBUG] [VALIDATOR ] IGI: Primary data validation passed. [2025-10-28T19:24:03.650426] [INFO ] [MAIN ] IGI: Fetched primary data is valid. [2025-10-28T19:24:03.650464] [DEBUG] [LOCAL ] IGI: Saving primary data. [2025-10-28T19:24:03.650875] [DEBUG] [LOCAL ] IGI: Trimmed 5570 records to 4082 (keeping 200 days of data) [2025-10-28T19:24:03.677907] [DEBUG] [LOCAL ] IGI: Primary data saved (4082 records). [2025-10-28T19:24:03.678060] [INFO ] [MAIN ] IGI: Full history saved. [2025-10-28T19:24:03.678155] [INFO ] [MAIN ] Update Progress: 1097/2366 symbols completed. IGI took 34.6s. Estimated remaining: 2h 46m 35s. Rate: 7.6 symbols/min [2025-10-28T19:24:03.856173] [INFO ] [MAIN ] IHG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:24:03.881732] [DEBUG] [LOCAL ] IHG: Loaded 23569 existing records from primary storage. [2025-10-28T19:24:03.882008] [INFO ] [MAIN ] IHG: Loaded 23569 existing records. [2025-10-28T19:24:03.985529] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-07. [2025-10-28T19:24:04.093904] [WARN ] [MAIN ] IHG: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:24:04.094210] [INFO ] [MAIN ] IHG: Wiping existing primary data before full refresh. [2025-10-28T19:24:04.094264] [INFO ] [LOCAL ] IHG: Starting deletion of primary data. [2025-10-28T19:24:04.094721] [DEBUG] [LOCAL ] IHG: Deleted primary data file. [2025-10-28T19:24:04.094783] [INFO ] [MAIN ] IHG: Starting full primary refresh. [2025-10-28T19:24:04.437154] [INFO ] [REMOTE ] IHG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:24:04.567212] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-28T19:24:04.780262] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-08. [2025-10-28T19:24:05.580266] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-06. [2025-10-28T19:24:06.380284] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-08. [2025-10-28T19:24:06.403911] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-28T19:24:06.427220] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-28T19:24:06.771585] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-10-28T19:24:07.180238] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-01. [2025-10-28T19:24:07.797593] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-28T19:24:07.980285] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-02. [2025-10-28T19:24:08.734513] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-28T19:24:08.780291] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-07. [2025-10-28T19:24:09.357496] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-28T19:24:09.580296] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-08. [2025-10-28T19:24:09.964871] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-10-28T19:24:10.380300] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-09. [2025-10-28T19:24:11.022520] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-28T19:24:11.180255] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-09. [2025-10-28T19:24:11.527414] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-10-28T19:24:11.980259] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-10. [2025-10-28T19:24:12.477981] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-10 (0.50 seconds). [2025-10-28T19:24:12.479123] [INFO ] [REMOTE ] IH: Full fetch complete (5061 records). [2025-10-28T19:24:12.479190] [DEBUG] [VALIDATOR ] IH: Validating primary data. [2025-10-28T19:24:12.785497] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-03. [2025-10-28T19:24:12.854038] [DEBUG] [VALIDATOR ] IH: All expected trading days are present. [2025-10-28T19:24:12.854116] [DEBUG] [VALIDATOR ] IH: Primary data validation passed. [2025-10-28T19:24:12.854291] [INFO ] [MAIN ] IH: Fetched primary data is valid. [2025-10-28T19:24:12.854350] [DEBUG] [LOCAL ] IH: Saving primary data. [2025-10-28T19:24:12.854740] [DEBUG] [LOCAL ] IH: Trimmed 5061 records to 2664 (keeping 200 days of data) [2025-10-28T19:24:12.870134] [DEBUG] [LOCAL ] IH: Primary data saved (2664 records). [2025-10-28T19:24:12.870199] [INFO ] [MAIN ] IH: Full history saved. [2025-10-28T19:24:12.870268] [INFO ] [MAIN ] Update Progress: 1098/2366 symbols completed. IH took 26.2s. Estimated remaining: 2h 46m 29s. Rate: 7.6 symbols/min [2025-10-28T19:24:13.043965] [INFO ] [MAIN ] IHS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:24:13.077955] [DEBUG] [LOCAL ] IHS: Loaded 36888 existing records from primary storage. [2025-10-28T19:24:13.078220] [INFO ] [MAIN ] IHS: Loaded 36888 existing records. [2025-10-28T19:24:13.252337] [WARN ] [MAIN ] IHS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:24:13.252526] [INFO ] [MAIN ] IHS: Wiping existing primary data before full refresh. [2025-10-28T19:24:13.252570] [INFO ] [LOCAL ] IHS: Starting deletion of primary data. [2025-10-28T19:24:13.252883] [DEBUG] [LOCAL ] IHS: Deleted primary data file. [2025-10-28T19:24:13.252938] [INFO ] [MAIN ] IHS: Starting full primary refresh. [2025-10-28T19:24:13.581537] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-09. [2025-10-28T19:24:13.610288] [INFO ] [REMOTE ] IHS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:24:13.710705] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-28T19:24:14.380279] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-04. [2025-10-28T19:24:14.589281] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-28T19:24:15.180315] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-10. [2025-10-28T19:24:15.456368] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-28T19:24:15.840137] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-28T19:24:15.842573] [INFO ] [REMOTE ] IHD: Full fetch complete (11687 records). [2025-10-28T19:24:15.842682] [DEBUG] [VALIDATOR ] IHD: Validating primary data. [2025-10-28T19:24:15.985453] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-10. [2025-10-28T19:24:16.206363] [DEBUG] [VALIDATOR ] IHD: All expected trading days are present. [2025-10-28T19:24:16.206439] [DEBUG] [VALIDATOR ] IHD: Primary data validation passed. [2025-10-28T19:24:16.206781] [INFO ] [MAIN ] IHD: Fetched primary data is valid. [2025-10-28T19:24:16.206854] [DEBUG] [LOCAL ] IHD: Saving primary data. [2025-10-28T19:24:16.207277] [DEBUG] [LOCAL ] IHD: Trimmed 11687 records to 7342 (keeping 200 days of data) [2025-10-28T19:24:16.249751] [DEBUG] [LOCAL ] IHD: Primary data saved (7342 records). [2025-10-28T19:24:16.249883] [INFO ] [MAIN ] IHD: Full history saved. [2025-10-28T19:24:16.249963] [INFO ] [MAIN ] Update Progress: 1099/2366 symbols completed. IHD took 22.9s. Estimated remaining: 2h 46m 16s. Rate: 7.6 symbols/min [2025-10-28T19:24:16.419316] [INFO ] [MAIN ] IIF: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:24:16.426487] [DEBUG] [LOCAL ] IIF: Loaded 5028 existing records from primary storage. [2025-10-28T19:24:16.426735] [INFO ] [MAIN ] IIF: Loaded 5028 existing records. [2025-10-28T19:24:16.599885] [WARN ] [MAIN ] IIF: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:24:16.600085] [INFO ] [MAIN ] IIF: Wiping existing primary data before full refresh. [2025-10-28T19:24:16.600131] [INFO ] [LOCAL ] IIF: Starting deletion of primary data. [2025-10-28T19:24:16.600281] [DEBUG] [LOCAL ] IIF: Deleted primary data file. [2025-10-28T19:24:16.600336] [INFO ] [MAIN ] IIF: Starting full primary refresh. [2025-10-28T19:24:16.789325] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-01. [2025-10-28T19:24:16.970833] [INFO ] [REMOTE ] IIF: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:24:17.127162] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-28T19:24:17.133962] [INFO ] [REMOTE ] IGR: Full fetch complete (44470 records). [2025-10-28T19:24:17.134091] [DEBUG] [VALIDATOR ] IGR: Validating primary data. [2025-10-28T19:24:17.568549] [DEBUG] [VALIDATOR ] IGR: All expected trading days are present. [2025-10-28T19:24:17.569369] [DEBUG] [VALIDATOR ] IGR: Primary data validation passed. [2025-10-28T19:24:17.570273] [INFO ] [MAIN ] IGR: Fetched primary data is valid. [2025-10-28T19:24:17.570352] [DEBUG] [LOCAL ] IGR: Saving primary data. [2025-10-28T19:24:17.571446] [DEBUG] [LOCAL ] IGR: Trimmed 44470 records to 30039 (keeping 200 days of data) [2025-10-28T19:24:17.623856] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-05. [2025-10-28T19:24:17.763729] [DEBUG] [LOCAL ] IGR: Primary data saved (30039 records). [2025-10-28T19:24:17.778066] [INFO ] [MAIN ] IGR: Full history saved. [2025-10-28T19:24:17.778891] [INFO ] [MAIN ] Update Progress: 1100/2366 symbols completed. IGR took 48.5s. Estimated remaining: 2h 46m 1s. Rate: 7.6 symbols/min [2025-10-28T19:24:17.779472] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-10-28T19:24:17.978516] [INFO ] [MAIN ] IIIN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:24:17.994861] [DEBUG] [LOCAL ] IIIN: Loaded 16087 existing records from primary storage. [2025-10-28T19:24:17.995111] [INFO ] [MAIN ] IIIN: Loaded 16087 existing records. [2025-10-28T19:24:18.168172] [WARN ] [MAIN ] IIIN: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:24:18.168372] [INFO ] [MAIN ] IIIN: Wiping existing primary data before full refresh. [2025-10-28T19:24:18.168419] [INFO ] [LOCAL ] IIIN: Starting deletion of primary data. [2025-10-28T19:24:18.168602] [DEBUG] [LOCAL ] IIIN: Deleted primary data file. [2025-10-28T19:24:18.168673] [INFO ] [MAIN ] IIIN: Starting full primary refresh. [2025-10-28T19:24:18.384379] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-02. [2025-10-28T19:24:18.544061] [INFO ] [REMOTE ] IIIN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:24:18.560680] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-28T19:24:19.180228] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-01. [2025-10-28T19:24:19.329167] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-28T19:24:19.800139] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-10-28T19:24:19.980259] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-03. [2025-10-28T19:24:20.780298] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-01. [2025-10-28T19:24:21.087260] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-28T19:24:21.354725] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-28T19:24:21.580303] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-04. [2025-10-28T19:24:22.380233] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-02. [2025-10-28T19:24:22.520892] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-28T19:24:22.823029] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-10-28T19:24:23.180304] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-03. [2025-10-28T19:24:23.567787] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-10-28T19:24:23.980351] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-05. [2025-10-28T19:24:24.780320] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-04. [2025-10-28T19:24:25.284520] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-10-28T19:24:25.580243] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-02. [2025-10-28T19:24:25.616856] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-10-28T19:24:26.262875] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-28T19:24:26.380309] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-06. [2025-10-28T19:24:27.114672] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-10-28T19:24:27.180249] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-07. [2025-10-28T19:24:27.980277] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-03. [2025-10-28T19:24:28.013934] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-28T19:24:28.785189] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-05. [2025-10-28T19:24:28.791549] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-10-28T19:24:29.201602] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-10-28T19:24:29.580309] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-06. [2025-10-28T19:24:29.924375] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-10-28T19:24:30.380349] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-06. [2025-10-28T19:24:31.180243] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-08. [2025-10-28T19:24:31.530168] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-10-28T19:24:31.939722] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-28T19:24:31.980321] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-07. [2025-10-28T19:24:32.543337] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-10-28T19:24:32.780324] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-07. [2025-10-28T19:24:33.580293] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-08. [2025-10-28T19:24:33.787058] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-28T19:24:34.037434] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-10-28T19:24:34.380248] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-08. [2025-10-28T19:24:35.180238] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-09. [2025-10-28T19:24:35.420518] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-28T19:24:35.980285] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-09. [2025-10-28T19:24:36.522110] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-28T19:24:36.780236] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-04. [2025-10-28T19:24:36.979515] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-28T19:24:37.585003] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-09. [2025-10-28T19:24:37.589071] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-10-28T19:24:37.965400] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-10-28T19:24:38.380260] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-10. [2025-10-28T19:24:38.801057] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-28T19:24:38.802220] [INFO ] [REMOTE ] IIF: Full fetch complete (8728 records). [2025-10-28T19:24:38.802287] [DEBUG] [VALIDATOR ] IIF: Validating primary data. [2025-10-28T19:24:39.171537] [DEBUG] [VALIDATOR ] IIF: All expected trading days are present. [2025-10-28T19:24:39.171620] [DEBUG] [VALIDATOR ] IIF: Primary data validation passed. [2025-10-28T19:24:39.171912] [INFO ] [MAIN ] IIF: Fetched primary data is valid. [2025-10-28T19:24:39.171973] [DEBUG] [LOCAL ] IIF: Saving primary data. [2025-10-28T19:24:39.172420] [DEBUG] [LOCAL ] IIF: Trimmed 8728 records to 4964 (keeping 200 days of data) [2025-10-28T19:24:39.184277] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-05. [2025-10-28T19:24:39.202467] [DEBUG] [LOCAL ] IIF: Primary data saved (4964 records). [2025-10-28T19:24:39.202541] [INFO ] [MAIN ] IIF: Full history saved. [2025-10-28T19:24:39.202613] [INFO ] [MAIN ] Update Progress: 1101/2366 symbols completed. IIF took 23.0s. Estimated remaining: 2h 46m 9s. Rate: 7.6 symbols/min [2025-10-28T19:24:39.371419] [INFO ] [MAIN ] IIM: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:24:39.387978] [DEBUG] [LOCAL ] IIM: Loaded 15363 existing records from primary storage. [2025-10-28T19:24:39.388196] [INFO ] [MAIN ] IIM: Loaded 15363 existing records. [2025-10-28T19:24:39.563784] [WARN ] [MAIN ] IIM: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:24:39.564006] [INFO ] [MAIN ] IIM: Wiping existing primary data before full refresh. [2025-10-28T19:24:39.564054] [INFO ] [LOCAL ] IIM: Starting deletion of primary data. [2025-10-28T19:24:39.564326] [DEBUG] [LOCAL ] IIM: Deleted primary data file. [2025-10-28T19:24:39.564394] [INFO ] [MAIN ] IIM: Starting full primary refresh. [2025-10-28T19:24:39.921982] [INFO ] [REMOTE ] IIM: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:24:39.980224] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-10. [2025-10-28T19:24:40.033118] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-28T19:24:40.780252] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-01. [2025-10-28T19:24:41.029988] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-28T19:24:41.035008] [INFO ] [REMOTE ] IHG: Full fetch complete (34605 records). [2025-10-28T19:24:41.035122] [DEBUG] [VALIDATOR ] IHG: Validating primary data. [2025-10-28T19:24:41.407910] [DEBUG] [VALIDATOR ] IHG: All expected trading days are present. [2025-10-28T19:24:41.408047] [DEBUG] [VALIDATOR ] IHG: Primary data validation passed. [2025-10-28T19:24:41.408875] [INFO ] [MAIN ] IHG: Fetched primary data is valid. [2025-10-28T19:24:41.408944] [DEBUG] [LOCAL ] IHG: Saving primary data. [2025-10-28T19:24:41.410072] [DEBUG] [LOCAL ] IHG: Trimmed 34605 records to 23472 (keeping 200 days of data) [2025-10-28T19:24:41.520302] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-10-28T19:24:41.572993] [DEBUG] [LOCAL ] IHG: Primary data saved (23472 records). [2025-10-28T19:24:41.573113] [INFO ] [MAIN ] IHG: Full history saved. [2025-10-28T19:24:41.573189] [INFO ] [MAIN ] Update Progress: 1102/2366 symbols completed. IHG took 37.9s. Estimated remaining: 2h 45m 54s. Rate: 7.6 symbols/min [2025-10-28T19:24:41.585377] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-02. [2025-10-28T19:24:41.748017] [INFO ] [MAIN ] IIPR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:24:41.777238] [DEBUG] [LOCAL ] IIPR: Loaded 28414 existing records from primary storage. [2025-10-28T19:24:41.777480] [INFO ] [MAIN ] IIPR: Loaded 28414 existing records. [2025-10-28T19:24:41.961603] [WARN ] [MAIN ] IIPR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:24:41.961782] [INFO ] [MAIN ] IIPR: Wiping existing primary data before full refresh. [2025-10-28T19:24:41.961827] [INFO ] [LOCAL ] IIPR: Starting deletion of primary data. [2025-10-28T19:24:41.962218] [DEBUG] [LOCAL ] IIPR: Deleted primary data file. [2025-10-28T19:24:41.962276] [INFO ] [MAIN ] IIPR: Starting full primary refresh. [2025-10-28T19:24:42.313124] [INFO ] [REMOTE ] IIPR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:24:42.380217] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-10. [2025-10-28T19:24:42.643411] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-28T19:24:43.180274] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-06. [2025-10-28T19:24:43.419465] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-10 (1.04 seconds). [2025-10-28T19:24:43.425783] [INFO ] [REMOTE ] IHS: Full fetch complete (51473 records). [2025-10-28T19:24:43.425923] [DEBUG] [VALIDATOR ] IHS: Validating primary data. [2025-10-28T19:24:43.796259] [DEBUG] [VALIDATOR ] IHS: All expected trading days are present. [2025-10-28T19:24:43.796335] [DEBUG] [VALIDATOR ] IHS: Primary data validation passed. [2025-10-28T19:24:43.797119] [INFO ] [MAIN ] IHS: Fetched primary data is valid. [2025-10-28T19:24:43.797179] [DEBUG] [LOCAL ] IHS: Saving primary data. [2025-10-28T19:24:43.798302] [DEBUG] [LOCAL ] IHS: Trimmed 51473 records to 36825 (keeping 200 days of data) [2025-10-28T19:24:43.896938] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-28T19:24:43.983553] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-07. [2025-10-28T19:24:44.011947] [DEBUG] [LOCAL ] IHS: Primary data saved (36825 records). [2025-10-28T19:24:44.012065] [INFO ] [MAIN ] IHS: Full history saved. [2025-10-28T19:24:44.012140] [INFO ] [MAIN ] Update Progress: 1103/2366 symbols completed. IHS took 31.1s. Estimated remaining: 2h 45m 40s. Rate: 7.6 symbols/min [2025-10-28T19:24:44.181831] [INFO ] [MAIN ] IMAX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:24:44.220492] [DEBUG] [LOCAL ] IMAX: Loaded 43361 existing records from primary storage. [2025-10-28T19:24:44.220816] [INFO ] [MAIN ] IMAX: Loaded 43361 existing records. [2025-10-28T19:24:44.399048] [WARN ] [MAIN ] IMAX: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:24:44.399240] [INFO ] [MAIN ] IMAX: Wiping existing primary data before full refresh. [2025-10-28T19:24:44.399289] [INFO ] [LOCAL ] IMAX: Starting deletion of primary data. [2025-10-28T19:24:44.399731] [DEBUG] [LOCAL ] IMAX: Deleted primary data file. [2025-10-28T19:24:44.399789] [INFO ] [MAIN ] IMAX: Starting full primary refresh. [2025-10-28T19:24:44.764498] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-28T19:24:44.763991] [INFO ] [REMOTE ] IMAX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:24:44.780204] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-01. [2025-10-28T19:24:45.580220] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-03. [2025-10-28T19:24:45.693286] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-28T19:24:46.312877] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-28T19:24:46.380204] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-04. [2025-10-28T19:24:47.150002] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-28T19:24:47.180247] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-05. [2025-10-28T19:24:47.735477] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-28T19:24:47.980232] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-06. [2025-10-28T19:24:48.639676] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-10-28T19:24:48.780256] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-07. [2025-10-28T19:24:49.310909] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-10-28T19:24:49.580228] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-01. [2025-10-28T19:24:50.380307] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-08. [2025-10-28T19:24:50.688673] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-28T19:24:51.050094] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-28T19:24:51.180261] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-09. [2025-10-28T19:24:51.931586] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-28T19:24:51.980221] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-10. [2025-10-28T19:24:52.754355] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-28T19:24:52.757869] [INFO ] [REMOTE ] IIM: Full fetch complete (24597 records). [2025-10-28T19:24:52.757945] [DEBUG] [VALIDATOR ] IIM: Validating primary data. [2025-10-28T19:24:52.790445] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-02. [2025-10-28T19:24:53.168738] [DEBUG] [VALIDATOR ] IIM: All expected trading days are present. [2025-10-28T19:24:53.168837] [DEBUG] [VALIDATOR ] IIM: Primary data validation passed. [2025-10-28T19:24:53.169581] [INFO ] [MAIN ] IIM: Fetched primary data is valid. [2025-10-28T19:24:53.169669] [DEBUG] [LOCAL ] IIM: Saving primary data. [2025-10-28T19:24:53.170631] [DEBUG] [LOCAL ] IIM: Trimmed 24597 records to 15240 (keeping 200 days of data) [2025-10-28T19:24:53.309263] [DEBUG] [LOCAL ] IIM: Primary data saved (15240 records). [2025-10-28T19:24:53.309445] [INFO ] [MAIN ] IIM: Full history saved. [2025-10-28T19:24:53.309588] [INFO ] [MAIN ] Update Progress: 1104/2366 symbols completed. IIM took 14.1s. Estimated remaining: 2h 45m 34s. Rate: 7.6 symbols/min [2025-10-28T19:24:53.555890] [INFO ] [MAIN ] INFA: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:24:53.588240] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-08. [2025-10-28T19:24:53.616860] [DEBUG] [LOCAL ] INFA: Loaded 48355 existing records from primary storage. [2025-10-28T19:24:53.617253] [INFO ] [MAIN ] INFA: Loaded 48355 existing records. [2025-10-28T19:24:53.866564] [WARN ] [MAIN ] INFA: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:24:53.866978] [INFO ] [MAIN ] INFA: Wiping existing primary data before full refresh. [2025-10-28T19:24:53.867069] [INFO ] [LOCAL ] INFA: Starting deletion of primary data. [2025-10-28T19:24:53.867688] [DEBUG] [LOCAL ] INFA: Deleted primary data file. [2025-10-28T19:24:53.867862] [INFO ] [MAIN ] INFA: Starting full primary refresh. [2025-10-28T19:24:54.018593] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-10-28T19:24:54.294757] [INFO ] [REMOTE ] INFA: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:24:54.337918] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-28T19:24:54.380256] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-01. [2025-10-28T19:24:55.180252] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-02. [2025-10-28T19:24:55.886911] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-10-28T19:24:55.980217] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-02. [2025-10-28T19:24:56.197387] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-28T19:24:56.780267] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-09. [2025-10-28T19:24:57.166746] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-28T19:24:57.294480] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-28T19:24:57.580257] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-03. [2025-10-28T19:24:58.380247] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-03. [2025-10-28T19:24:59.020903] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-28T19:24:59.180272] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-03. [2025-10-28T19:24:59.443608] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-28T19:24:59.980313] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-10. [2025-10-28T19:25:00.665503] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-10-28T19:25:00.780273] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-04. [2025-10-28T19:25:00.999063] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-10 (1.02 seconds). [2025-10-28T19:25:01.004447] [INFO ] [REMOTE ] IIIN: Full fetch complete (24950 records). [2025-10-28T19:25:01.004555] [DEBUG] [VALIDATOR ] IIIN: Validating primary data. [2025-10-28T19:25:01.374890] [DEBUG] [VALIDATOR ] IIIN: All expected trading days are present. [2025-10-28T19:25:01.374975] [DEBUG] [VALIDATOR ] IIIN: Primary data validation passed. [2025-10-28T19:25:01.375495] [INFO ] [MAIN ] IIIN: Fetched primary data is valid. [2025-10-28T19:25:01.375534] [DEBUG] [LOCAL ] IIIN: Saving primary data. [2025-10-28T19:25:01.376427] [DEBUG] [LOCAL ] IIIN: Trimmed 24950 records to 15939 (keeping 200 days of data) [2025-10-28T19:25:01.484035] [DEBUG] [LOCAL ] IIIN: Primary data saved (15939 records). [2025-10-28T19:25:01.484184] [INFO ] [MAIN ] IIIN: Full history saved. [2025-10-28T19:25:01.484264] [INFO ] [MAIN ] Update Progress: 1105/2366 symbols completed. IIIN took 43.7s. Estimated remaining: 2h 45m 27s. Rate: 7.6 symbols/min [2025-10-28T19:25:01.585496] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-04. [2025-10-28T19:25:01.700279] [INFO ] [MAIN ] INFY: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:25:01.760571] [DEBUG] [LOCAL ] INFY: Loaded 53595 existing records from primary storage. [2025-10-28T19:25:01.760984] [INFO ] [MAIN ] INFY: Loaded 53595 existing records. [2025-10-28T19:25:01.953441] [WARN ] [MAIN ] INFY: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:25:01.953717] [INFO ] [MAIN ] INFY: Wiping existing primary data before full refresh. [2025-10-28T19:25:01.953796] [INFO ] [LOCAL ] INFY: Starting deletion of primary data. [2025-10-28T19:25:01.954558] [DEBUG] [LOCAL ] INFY: Deleted primary data file. [2025-10-28T19:25:01.954627] [INFO ] [MAIN ] INFY: Starting full primary refresh. [2025-10-28T19:25:02.365872] [INFO ] [REMOTE ] INFY: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:25:02.380242] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-01. [2025-10-28T19:25:02.820175] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-10-28T19:25:03.180213] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-05. [2025-10-28T19:25:03.240223] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-10-28T19:25:03.819358] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-28T19:25:03.980248] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-02. [2025-10-28T19:25:04.364357] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-28T19:25:04.780336] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-04. [2025-10-28T19:25:05.401836] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-28T19:25:05.580244] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-03. [2025-10-28T19:25:05.919538] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-10-28T19:25:06.380318] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-06. [2025-10-28T19:25:06.928124] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-28T19:25:07.180266] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-04. [2025-10-28T19:25:07.490781] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-28T19:25:07.980276] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-07. [2025-10-28T19:25:08.582715] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-10-28T19:25:08.780337] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-05. [2025-10-28T19:25:09.580257] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-05. [2025-10-28T19:25:09.617322] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-10-28T19:25:10.184529] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-10-28T19:25:10.380274] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-06. [2025-10-28T19:25:10.659138] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-10-28T19:25:11.180249] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-06. [2025-10-28T19:25:11.652601] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-28T19:25:11.980276] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-05. [2025-10-28T19:25:12.171897] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-28T19:25:12.780286] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-07. [2025-10-28T19:25:13.110488] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-10-28T19:25:13.580281] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-07. [2025-10-28T19:25:13.934605] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-28T19:25:14.380267] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-06. [2025-10-28T19:25:15.180299] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-08. [2025-10-28T19:25:15.226520] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-28T19:25:15.326919] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-10-28T19:25:15.980298] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-07. [2025-10-28T19:25:16.550244] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-28T19:25:16.780230] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-09. [2025-10-28T19:25:16.882511] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-28T19:25:17.580270] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-08. [2025-10-28T19:25:17.925148] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-28T19:25:18.380256] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-10. [2025-10-28T19:25:18.921036] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-28T19:25:19.180273] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-08. [2025-10-28T19:25:19.950622] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-28T19:25:19.959272] [INFO ] [REMOTE ] INFA: Full fetch complete (70633 records). [2025-10-28T19:25:19.959449] [DEBUG] [VALIDATOR ] INFA: Validating primary data. [2025-10-28T19:25:19.991948] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-09. [2025-10-28T19:25:20.373544] [DEBUG] [VALIDATOR ] INFA: All expected trading days are present. [2025-10-28T19:25:20.373695] [DEBUG] [VALIDATOR ] INFA: Primary data validation passed. [2025-10-28T19:25:20.374823] [INFO ] [MAIN ] INFA: Fetched primary data is valid. [2025-10-28T19:25:20.374988] [DEBUG] [LOCAL ] INFA: Saving primary data. [2025-10-28T19:25:20.376818] [DEBUG] [LOCAL ] INFA: Trimmed 70633 records to 48282 (keeping 200 days of data) [2025-10-28T19:25:20.517121] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-28T19:25:20.735769] [DEBUG] [LOCAL ] INFA: Primary data saved (48282 records). [2025-10-28T19:25:20.735945] [INFO ] [MAIN ] INFA: Full history saved. [2025-10-28T19:25:20.736066] [INFO ] [MAIN ] Update Progress: 1106/2366 symbols completed. INFA took 27.4s. Estimated remaining: 2h 45m 32s. Rate: 7.6 symbols/min [2025-10-28T19:25:20.789237] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-08. [2025-10-28T19:25:20.931607] [INFO ] [MAIN ] ING: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:25:20.978364] [DEBUG] [LOCAL ] ING: Loaded 50616 existing records from primary storage. [2025-10-28T19:25:20.978685] [INFO ] [MAIN ] ING: Loaded 50616 existing records. [2025-10-28T19:25:21.154632] [WARN ] [MAIN ] ING: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:25:21.154882] [INFO ] [MAIN ] ING: Wiping existing primary data before full refresh. [2025-10-28T19:25:21.154929] [INFO ] [LOCAL ] ING: Starting deletion of primary data. [2025-10-28T19:25:21.155188] [DEBUG] [LOCAL ] ING: Deleted primary data file. [2025-10-28T19:25:21.155233] [INFO ] [MAIN ] ING: Starting full primary refresh. [2025-10-28T19:25:21.526056] [INFO ] [REMOTE ] ING: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:25:21.540470] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-28T19:25:21.580210] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-10. [2025-10-28T19:25:21.780505] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-10-28T19:25:22.380307] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-09. [2025-10-28T19:25:23.180254] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-09. [2025-10-28T19:25:23.220676] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-10 (1.64 seconds). [2025-10-28T19:25:23.232085] [INFO ] [REMOTE ] INFY: Full fetch complete (77750 records). [2025-10-28T19:25:23.232256] [DEBUG] [VALIDATOR ] INFY: Validating primary data. [2025-10-28T19:25:23.653540] [DEBUG] [VALIDATOR ] INFY: All expected trading days are present. [2025-10-28T19:25:23.653719] [DEBUG] [VALIDATOR ] INFY: Primary data validation passed. [2025-10-28T19:25:23.654937] [INFO ] [MAIN ] INFY: Fetched primary data is valid. [2025-10-28T19:25:23.655041] [DEBUG] [LOCAL ] INFY: Saving primary data. [2025-10-28T19:25:23.674457] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-10-28T19:25:23.681256] [DEBUG] [LOCAL ] INFY: Trimmed 77750 records to 53594 (keeping 200 days of data) [2025-10-28T19:25:23.983254] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-01. [2025-10-28T19:25:24.010473] [DEBUG] [LOCAL ] INFY: Primary data saved (53594 records). [2025-10-28T19:25:24.010618] [INFO ] [MAIN ] INFY: Full history saved. [2025-10-28T19:25:24.010765] [INFO ] [MAIN ] Update Progress: 1107/2366 symbols completed. INFY took 22.5s. Estimated remaining: 2h 45m 18s. Rate: 7.6 symbols/min [2025-10-28T19:25:24.187372] [INFO ] [MAIN ] INGM: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:25:24.213497] [DEBUG] [LOCAL ] INGM: Loaded 27728 existing records from primary storage. [2025-10-28T19:25:24.213758] [INFO ] [MAIN ] INGM: Loaded 27728 existing records. [2025-10-28T19:25:24.346705] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-28T19:25:24.427125] [WARN ] [MAIN ] INGM: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:25:24.427304] [INFO ] [MAIN ] INGM: Wiping existing primary data before full refresh. [2025-10-28T19:25:24.427361] [INFO ] [LOCAL ] INGM: Starting deletion of primary data. [2025-10-28T19:25:24.427531] [DEBUG] [LOCAL ] INGM: Deleted primary data file. [2025-10-28T19:25:24.427567] [INFO ] [MAIN ] INGM: Starting full primary refresh. [2025-10-28T19:25:24.768852] [INFO ] [REMOTE ] INGM: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:25:24.780207] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-01. [2025-10-28T19:25:25.206806] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-10-28T19:25:25.580217] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-02. [2025-10-28T19:25:26.156227] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-28T19:25:26.380297] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-02. [2025-10-28T19:25:26.742467] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-28T19:25:27.180283] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-10. [2025-10-28T19:25:27.269492] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-28T19:25:27.980262] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-03. [2025-10-28T19:25:28.403189] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-28T19:25:28.412560] [INFO ] [REMOTE ] IMAX: Full fetch complete (61392 records). [2025-10-28T19:25:28.412703] [DEBUG] [VALIDATOR ] IMAX: Validating primary data. [2025-10-28T19:25:28.790027] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-03. [2025-10-28T19:25:28.793463] [DEBUG] [VALIDATOR ] IMAX: All expected trading days are present. [2025-10-28T19:25:28.794754] [DEBUG] [VALIDATOR ] IMAX: Primary data validation passed. [2025-10-28T19:25:28.795751] [INFO ] [MAIN ] IMAX: Fetched primary data is valid. [2025-10-28T19:25:28.795929] [DEBUG] [LOCAL ] IMAX: Saving primary data. [2025-10-28T19:25:28.797193] [DEBUG] [LOCAL ] IMAX: Trimmed 61392 records to 43353 (keeping 200 days of data) [2025-10-28T19:25:29.044132] [DEBUG] [LOCAL ] IMAX: Primary data saved (43353 records). [2025-10-28T19:25:29.044280] [INFO ] [MAIN ] IMAX: Full history saved. [2025-10-28T19:25:29.044394] [INFO ] [MAIN ] Update Progress: 1108/2366 symbols completed. IMAX took 45.0s. Estimated remaining: 2h 45m 7s. Rate: 7.6 symbols/min [2025-10-28T19:25:29.214528] [INFO ] [MAIN ] INGR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:25:29.246931] [DEBUG] [LOCAL ] INGR: Loaded 33584 existing records from primary storage. [2025-10-28T19:25:29.247216] [INFO ] [MAIN ] INGR: Loaded 33584 existing records. [2025-10-28T19:25:29.422343] [WARN ] [MAIN ] INGR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:25:29.422562] [INFO ] [MAIN ] INGR: Wiping existing primary data before full refresh. [2025-10-28T19:25:29.422620] [INFO ] [LOCAL ] INGR: Starting deletion of primary data. [2025-10-28T19:25:29.422909] [DEBUG] [LOCAL ] INGR: Deleted primary data file. [2025-10-28T19:25:29.422966] [INFO ] [MAIN ] INGR: Starting full primary refresh. [2025-10-28T19:25:29.588772] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-10. [2025-10-28T19:25:29.631053] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-10-28T19:25:29.807081] [INFO ] [REMOTE ] INGR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:25:30.161003] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-28T19:25:30.380292] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-04. [2025-10-28T19:25:31.162188] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-10 (1.57 seconds). [2025-10-28T19:25:31.169520] [INFO ] [REMOTE ] IIPR: Full fetch complete (43416 records). [2025-10-28T19:25:31.169767] [DEBUG] [VALIDATOR ] IIPR: Validating primary data. [2025-10-28T19:25:31.185684] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-01. [2025-10-28T19:25:31.604822] [DEBUG] [VALIDATOR ] IIPR: All expected trading days are present. [2025-10-28T19:25:31.615782] [DEBUG] [VALIDATOR ] IIPR: Primary data validation passed. [2025-10-28T19:25:31.620801] [INFO ] [MAIN ] IIPR: Fetched primary data is valid. [2025-10-28T19:25:31.621637] [DEBUG] [LOCAL ] IIPR: Saving primary data. [2025-10-28T19:25:31.623988] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-28T19:25:31.633422] [DEBUG] [LOCAL ] IIPR: Trimmed 43416 records to 28323 (keeping 200 days of data) [2025-10-28T19:25:31.833387] [DEBUG] [LOCAL ] IIPR: Primary data saved (28323 records). [2025-10-28T19:25:31.833584] [INFO ] [MAIN ] IIPR: Full history saved. [2025-10-28T19:25:31.833734] [INFO ] [MAIN ] Update Progress: 1109/2366 symbols completed. IIPR took 50.3s. Estimated remaining: 2h 44m 54s. Rate: 7.6 symbols/min [2025-10-28T19:25:31.989351] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-05. [2025-10-28T19:25:32.024158] [INFO ] [MAIN ] INN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:25:32.068456] [DEBUG] [LOCAL ] INN: Loaded 41159 existing records from primary storage. [2025-10-28T19:25:32.068887] [INFO ] [MAIN ] INN: Loaded 41159 existing records. [2025-10-28T19:25:32.271140] [WARN ] [MAIN ] INN: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:25:32.271817] [INFO ] [MAIN ] INN: Wiping existing primary data before full refresh. [2025-10-28T19:25:32.271957] [INFO ] [LOCAL ] INN: Starting deletion of primary data. [2025-10-28T19:25:32.272614] [DEBUG] [LOCAL ] INN: Deleted primary data file. [2025-10-28T19:25:32.272746] [INFO ] [MAIN ] INN: Starting full primary refresh. [2025-10-28T19:25:32.458832] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-28T19:25:32.692017] [INFO ] [REMOTE ] INN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:25:32.780245] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-01. [2025-10-28T19:25:32.880705] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-28T19:25:33.580345] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-02. [2025-10-28T19:25:33.691145] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-28T19:25:34.380222] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-06. [2025-10-28T19:25:34.585928] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-28T19:25:35.115608] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-10-28T19:25:35.180268] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-04. [2025-10-28T19:25:35.980308] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-07. [2025-10-28T19:25:36.508566] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-28T19:25:36.780267] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-05. [2025-10-28T19:25:36.848693] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-10-28T19:25:37.580256] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-02. [2025-10-28T19:25:38.162396] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-10-28T19:25:38.380237] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-08. [2025-10-28T19:25:38.447390] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-28T19:25:39.180310] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-03. [2025-10-28T19:25:39.846352] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-10-28T19:25:39.980243] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-09. [2025-10-28T19:25:40.785629] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-03. [2025-10-28T19:25:40.805071] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-28T19:25:41.294704] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-10-28T19:25:41.580307] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-06. [2025-10-28T19:25:41.825974] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-28T19:25:42.380254] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-04. [2025-10-28T19:25:43.180217] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-10. [2025-10-28T19:25:43.498947] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-28T19:25:43.713939] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-10-28T19:25:43.980229] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-07. [2025-10-28T19:25:44.039477] [DEBUG] [REMOTE ] ING: Error fetching primary data for 2025-07: 'API call returned an empty response.' [2025-10-28T19:25:44.039828] [WARN ] [REMOTE ] ING: No data returned for month 2025-07 [2025-10-28T19:25:44.039915] [FATAL] [REMOTE ] ING: API call failed - aborting fetch to avoid wasting further API calls [2025-10-28T19:25:44.039996] [FATAL] [MAIN ] ING: Failed to fetch primary data. [2025-10-28T19:25:44.040056] [WARN ] [MAIN ] ING: Deleting existing primary and derivative data due to fetch failure. [2025-10-28T19:25:44.040144] [INFO ] [LOCAL ] ING: Starting deletion of primary data. [2025-10-28T19:25:44.040206] [DEBUG] [LOCAL ] ING: No primary data file found to delete. [2025-10-28T19:25:44.040241] [INFO ] [LOCAL ] ING: Starting deletion of derivative data. [2025-10-28T19:25:44.040417] [DEBUG] [LOCAL ] ING: Deleted derivative data file. [2025-10-28T19:25:44.040499] [INFO ] [MAIN ] Update Progress: 1110/2366 symbols completed. ING took 23.3s. Estimated remaining: 2h 44m 51s. Rate: 7.6 symbols/min [2025-10-28T19:25:44.223694] [INFO ] [MAIN ] INR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:25:44.223933] [DEBUG] [LOCAL ] INR: No existing data file found in primary storage. [2025-10-28T19:25:44.224032] [WARN ] [MAIN ] INR: No existing data found, performing full refresh instead. [2025-10-28T19:25:44.224198] [INFO ] [MAIN ] INR: Wiping existing primary data before full refresh. [2025-10-28T19:25:44.224366] [INFO ] [LOCAL ] INR: Starting deletion of primary data. [2025-10-28T19:25:44.224563] [DEBUG] [LOCAL ] INR: No primary data file found to delete. [2025-10-28T19:25:44.224680] [INFO ] [MAIN ] INR: Starting full primary refresh. [2025-10-28T19:25:44.310143] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-28T19:25:44.349242] [INFO ] [REMOTE ] INGM: Full fetch complete (41656 records). [2025-10-28T19:25:44.360238] [DEBUG] [VALIDATOR ] INGM: Validating primary data. [2025-10-28T19:25:44.789510] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-05. [2025-10-28T19:25:44.909934] [INFO ] [REMOTE ] INR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:25:44.996742] [DEBUG] [VALIDATOR ] INGM: All expected trading days are present. [2025-10-28T19:25:44.996838] [DEBUG] [VALIDATOR ] INGM: Primary data validation passed. [2025-10-28T19:25:44.997546] [INFO ] [MAIN ] INGM: Fetched primary data is valid. [2025-10-28T19:25:44.997585] [DEBUG] [LOCAL ] INGM: Saving primary data. [2025-10-28T19:25:44.998608] [DEBUG] [LOCAL ] INGM: Trimmed 41656 records to 27588 (keeping 200 days of data) [2025-10-28T19:25:45.161559] [DEBUG] [LOCAL ] INGM: Primary data saved (27588 records). [2025-10-28T19:25:45.161711] [INFO ] [MAIN ] INGM: Full history saved. [2025-10-28T19:25:45.161800] [INFO ] [MAIN ] Update Progress: 1111/2366 symbols completed. INGM took 21.2s. Estimated remaining: 2h 44m 35s. Rate: 7.6 symbols/min [2025-10-28T19:25:45.329530] [INFO ] [MAIN ] INSP: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:25:45.365057] [DEBUG] [LOCAL ] INSP: Loaded 38599 existing records from primary storage. [2025-10-28T19:25:45.365361] [INFO ] [MAIN ] INSP: Loaded 38599 existing records. [2025-10-28T19:25:45.560481] [WARN ] [MAIN ] INSP: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:25:45.560735] [INFO ] [MAIN ] INSP: Wiping existing primary data before full refresh. [2025-10-28T19:25:45.560794] [INFO ] [LOCAL ] INSP: Starting deletion of primary data. [2025-10-28T19:25:45.561064] [DEBUG] [LOCAL ] INSP: Deleted primary data file. [2025-10-28T19:25:45.561123] [INFO ] [MAIN ] INSP: Starting full primary refresh. [2025-10-28T19:25:45.592457] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-01. [2025-10-28T19:25:45.938889] [INFO ] [REMOTE ] INSP: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:25:45.941512] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-10-28T19:25:45.967633] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-28T19:25:46.380288] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-06. [2025-10-28T19:25:47.180285] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-04. [2025-10-28T19:25:47.980267] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-01. [2025-10-28T19:25:48.117505] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-28T19:25:48.780275] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-02. [2025-10-28T19:25:48.939316] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-28T19:25:49.239284] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-06 (2.86 seconds). [2025-10-28T19:25:49.580276] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-02. [2025-10-28T19:25:49.709069] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-10-28T19:25:50.380272] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-03. [2025-10-28T19:25:50.622618] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-28T19:25:51.180229] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-03. [2025-10-28T19:25:51.290742] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-28T19:25:51.980288] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-07. [2025-10-28T19:25:52.099275] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-28T19:25:52.780240] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-04. [2025-10-28T19:25:52.992267] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-10-28T19:25:53.580249] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-04. [2025-10-28T19:25:53.792789] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-28T19:25:54.324895] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-28T19:25:54.380219] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-05. [2025-10-28T19:25:55.020041] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-28T19:25:55.180452] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-05. [2025-10-28T19:25:55.980246] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-08. [2025-10-28T19:25:56.152308] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-28T19:25:56.780310] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-06. [2025-10-28T19:25:57.437345] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-28T19:25:57.580258] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-06. [2025-10-28T19:25:57.704966] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-28T19:25:58.380280] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-05. [2025-10-28T19:25:58.452673] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-28T19:25:59.180266] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-07. [2025-10-28T19:25:59.985158] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-07. [2025-10-28T19:25:59.987401] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-28T19:26:00.780332] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-09. [2025-10-28T19:26:00.860307] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-05 (2.48 seconds). [2025-10-28T19:26:00.880469] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-28T19:26:01.580291] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-06. [2025-10-28T19:26:01.718993] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-28T19:26:02.380258] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-08. [2025-10-28T19:26:03.180254] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-08. [2025-10-28T19:26:03.385111] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-28T19:26:03.950337] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-06 (2.37 seconds). [2025-10-28T19:26:03.980226] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-07. [2025-10-28T19:26:04.780235] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-10. [2025-10-28T19:26:05.025382] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-10-28T19:26:05.071801] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-10-28T19:26:05.580320] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-09. [2025-10-28T19:26:06.019371] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-28T19:26:06.028854] [INFO ] [REMOTE ] INN: Full fetch complete (57602 records). [2025-10-28T19:26:06.029086] [DEBUG] [VALIDATOR ] INN: Validating primary data. [2025-10-28T19:26:06.388093] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-09. [2025-10-28T19:26:06.463805] [DEBUG] [VALIDATOR ] INN: All expected trading days are present. [2025-10-28T19:26:06.466439] [DEBUG] [VALIDATOR ] INN: Primary data validation passed. [2025-10-28T19:26:06.467971] [INFO ] [MAIN ] INN: Fetched primary data is valid. [2025-10-28T19:26:06.468768] [DEBUG] [LOCAL ] INN: Saving primary data. [2025-10-28T19:26:06.468688] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-28T19:26:06.477305] [DEBUG] [LOCAL ] INN: Trimmed 57602 records to 41032 (keeping 200 days of data) [2025-10-28T19:26:06.707158] [DEBUG] [LOCAL ] INN: Primary data saved (41032 records). [2025-10-28T19:26:06.707285] [INFO ] [MAIN ] INN: Full history saved. [2025-10-28T19:26:06.708007] [INFO ] [MAIN ] Update Progress: 1112/2366 symbols completed. INN took 34.9s. Estimated remaining: 2h 44m 43s. Rate: 7.6 symbols/min [2025-10-28T19:26:06.885723] [INFO ] [MAIN ] INSW: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:26:06.923799] [DEBUG] [LOCAL ] INSW: Loaded 38828 existing records from primary storage. [2025-10-28T19:26:06.924078] [INFO ] [MAIN ] INSW: Loaded 38828 existing records. [2025-10-28T19:26:07.108806] [WARN ] [MAIN ] INSW: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:26:07.109001] [INFO ] [MAIN ] INSW: Wiping existing primary data before full refresh. [2025-10-28T19:26:07.109047] [INFO ] [LOCAL ] INSW: Starting deletion of primary data. [2025-10-28T19:26:07.109301] [DEBUG] [LOCAL ] INSW: Deleted primary data file. [2025-10-28T19:26:07.109405] [INFO ] [MAIN ] INSW: Starting full primary refresh. [2025-10-28T19:26:07.185714] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-10. [2025-10-28T19:26:07.483640] [INFO ] [REMOTE ] INSW: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:26:07.594432] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-28T19:26:07.980296] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-10. [2025-10-28T19:26:08.346962] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-28T19:26:08.353425] [INFO ] [REMOTE ] INR: Full fetch complete (38052 records). [2025-10-28T19:26:08.353574] [DEBUG] [VALIDATOR ] INR: Validating primary data. [2025-10-28T19:26:08.567371] [WARN ] [VALIDATOR ] INR: Validation failed - insufficient historical data. Have 187 unique days, need 200 days [2025-10-28T19:26:08.568074] [FATAL] [MAIN ] INR: Fetched primary data is invalid. Refusing to save it. [2025-10-28T19:26:08.568156] [WARN ] [MAIN ] INR: Deleting existing primary and derivative data due to validation failure. [2025-10-28T19:26:08.568236] [INFO ] [LOCAL ] INR: Starting deletion of primary data. [2025-10-28T19:26:08.568320] [DEBUG] [LOCAL ] INR: No primary data file found to delete. [2025-10-28T19:26:08.568359] [INFO ] [LOCAL ] INR: Starting deletion of derivative data. [2025-10-28T19:26:08.568399] [DEBUG] [LOCAL ] INR: No derivative data file found to delete. [2025-10-28T19:26:08.568511] [INFO ] [MAIN ] Update Progress: 1113/2366 symbols completed. INR took 24.5s. Estimated remaining: 2h 44m 28s. Rate: 7.6 symbols/min [2025-10-28T19:26:08.774905] [INFO ] [MAIN ] INVH: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:26:08.780282] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-08. [2025-10-28T19:26:08.842425] [DEBUG] [LOCAL ] INVH: Loaded 53185 existing records from primary storage. [2025-10-28T19:26:08.842939] [INFO ] [MAIN ] INVH: Loaded 53185 existing records. [2025-10-28T19:26:09.043557] [WARN ] [MAIN ] INVH: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:26:09.044709] [INFO ] [MAIN ] INVH: Wiping existing primary data before full refresh. [2025-10-28T19:26:09.044775] [INFO ] [LOCAL ] INVH: Starting deletion of primary data. [2025-10-28T19:26:09.045133] [DEBUG] [LOCAL ] INVH: Deleted primary data file. [2025-10-28T19:26:09.045196] [INFO ] [MAIN ] INVH: Starting full primary refresh. [2025-10-28T19:26:09.397492] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-28T19:26:09.446002] [INFO ] [REMOTE ] INGR: Full fetch complete (50814 records). [2025-10-28T19:26:09.463192] [DEBUG] [VALIDATOR ] INGR: Validating primary data. [2025-10-28T19:26:09.469253] [INFO ] [REMOTE ] INVH: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:26:09.585423] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-01. [2025-10-28T19:26:09.886784] [DEBUG] [VALIDATOR ] INGR: All expected trading days are present. [2025-10-28T19:26:09.886879] [DEBUG] [VALIDATOR ] INGR: Primary data validation passed. [2025-10-28T19:26:09.887867] [INFO ] [MAIN ] INGR: Fetched primary data is valid. [2025-10-28T19:26:09.887931] [DEBUG] [LOCAL ] INGR: Saving primary data. [2025-10-28T19:26:09.889108] [DEBUG] [LOCAL ] INGR: Trimmed 50814 records to 33548 (keeping 200 days of data) [2025-10-28T19:26:10.107638] [DEBUG] [LOCAL ] INGR: Primary data saved (33548 records). [2025-10-28T19:26:10.107816] [INFO ] [MAIN ] INGR: Full history saved. [2025-10-28T19:26:10.107901] [INFO ] [MAIN ] Update Progress: 1114/2366 symbols completed. INGR took 41.1s. Estimated remaining: 2h 44m 13s. Rate: 7.6 symbols/min [2025-10-28T19:26:10.279573] [INFO ] [MAIN ] INVX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:26:10.310463] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-28T19:26:10.341002] [DEBUG] [LOCAL ] INVX: Loaded 28642 existing records from primary storage. [2025-10-28T19:26:10.341259] [INFO ] [MAIN ] INVX: Loaded 28642 existing records. [2025-10-28T19:26:10.385492] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-01. [2025-10-28T19:26:10.516990] [WARN ] [MAIN ] INVX: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:26:10.517224] [INFO ] [MAIN ] INVX: Wiping existing primary data before full refresh. [2025-10-28T19:26:10.517271] [INFO ] [LOCAL ] INVX: Starting deletion of primary data. [2025-10-28T19:26:10.517452] [DEBUG] [LOCAL ] INVX: Deleted primary data file. [2025-10-28T19:26:10.517492] [INFO ] [MAIN ] INVX: Starting full primary refresh. [2025-10-28T19:26:10.866847] [INFO ] [REMOTE ] INVX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:26:10.899624] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-28T19:26:11.180303] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-01. [2025-10-28T19:26:11.652307] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-10-28T19:26:11.972538] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-28T19:26:11.980171] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-02. [2025-10-28T19:26:12.780241] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-02. [2025-10-28T19:26:12.806333] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-10-28T19:26:13.580271] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-09. [2025-10-28T19:26:13.908931] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-28T19:26:14.380240] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-02. [2025-10-28T19:26:14.651413] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-28T19:26:15.180258] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-03. [2025-10-28T19:26:15.484334] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-28T19:26:15.980217] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-03. [2025-10-28T19:26:16.011133] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-28T19:26:16.780262] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-03. [2025-10-28T19:26:17.264452] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-10-28T19:26:17.580244] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-04. [2025-10-28T19:26:17.707950] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-10-28T19:26:18.380277] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-04. [2025-10-28T19:26:19.180268] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-10. [2025-10-28T19:26:19.400226] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-28T19:26:19.980264] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-05. [2025-10-28T19:26:20.554713] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-10 (1.37 seconds). [2025-10-28T19:26:20.564096] [INFO ] [REMOTE ] INSP: Full fetch complete (53958 records). [2025-10-28T19:26:20.564237] [DEBUG] [VALIDATOR ] INSP: Validating primary data. [2025-10-28T19:26:20.793895] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-04. [2025-10-28T19:26:21.014681] [DEBUG] [VALIDATOR ] INSP: All expected trading days are present. [2025-10-28T19:26:21.021604] [DEBUG] [VALIDATOR ] INSP: Primary data validation passed. [2025-10-28T19:26:21.033100] [INFO ] [MAIN ] INSP: Fetched primary data is valid. [2025-10-28T19:26:21.033219] [DEBUG] [LOCAL ] INSP: Saving primary data. [2025-10-28T19:26:21.035441] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-28T19:26:21.043237] [DEBUG] [LOCAL ] INSP: Trimmed 53958 records to 38628 (keeping 200 days of data) [2025-10-28T19:26:21.284252] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-04 (3.70 seconds). [2025-10-28T19:26:21.311050] [DEBUG] [LOCAL ] INSP: Primary data saved (38628 records). [2025-10-28T19:26:21.311198] [INFO ] [MAIN ] INSP: Full history saved. [2025-10-28T19:26:21.311283] [INFO ] [MAIN ] Update Progress: 1115/2366 symbols completed. INSP took 36.1s. Estimated remaining: 2h 44m 9s. Rate: 7.6 symbols/min [2025-10-28T19:26:21.496313] [INFO ] [MAIN ] IONQ: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:26:21.548903] [DEBUG] [LOCAL ] IONQ: Loaded 53788 existing records from primary storage. [2025-10-28T19:26:21.549269] [INFO ] [MAIN ] IONQ: Loaded 53788 existing records. [2025-10-28T19:26:21.585439] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-06. [2025-10-28T19:26:21.744123] [WARN ] [MAIN ] IONQ: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:26:21.744355] [INFO ] [MAIN ] IONQ: Wiping existing primary data before full refresh. [2025-10-28T19:26:21.744426] [INFO ] [LOCAL ] IONQ: Starting deletion of primary data. [2025-10-28T19:26:21.745316] [DEBUG] [LOCAL ] IONQ: Deleted primary data file. [2025-10-28T19:26:21.745375] [INFO ] [MAIN ] IONQ: Starting full primary refresh. [2025-10-28T19:26:22.105202] [INFO ] [REMOTE ] IONQ: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:26:22.137293] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-28T19:26:22.380255] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-05. [2025-10-28T19:26:22.463001] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-28T19:26:23.180261] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-05. [2025-10-28T19:26:23.980231] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-01. [2025-10-28T19:26:24.367399] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-28T19:26:24.780244] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-06. [2025-10-28T19:26:25.580253] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-07. [2025-10-28T19:26:26.090816] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-05 (3.71 seconds). [2025-10-28T19:26:26.136171] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-01 (2.16 seconds). [2025-10-28T19:26:26.380213] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-02. [2025-10-28T19:26:26.581497] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-28T19:26:27.180265] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-06. [2025-10-28T19:26:27.954836] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-06 (3.17 seconds). [2025-10-28T19:26:27.980211] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-07. [2025-10-28T19:26:28.780227] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-08. [2025-10-28T19:26:29.255719] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-10-28T19:26:29.580268] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-08. [2025-10-28T19:26:30.866981] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-06 (3.69 seconds). [2025-10-28T19:26:30.875285] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-07. [2025-10-28T19:26:30.966794] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-28T19:26:31.180233] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-09. [2025-10-28T19:26:31.842694] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-10-28T19:26:31.980259] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-08. [2025-10-28T19:26:32.526568] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-28T19:26:32.780314] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-10. [2025-10-28T19:26:33.078155] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-28T19:26:33.195255] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-02 (6.82 seconds). [2025-10-28T19:26:33.580260] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-03. [2025-10-28T19:26:34.380263] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-09. [2025-10-28T19:26:34.693499] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-08 (5.91 seconds). [2025-10-28T19:26:35.180285] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-09. [2025-10-28T19:26:35.995162] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-28T19:26:36.001194] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-10. [2025-10-28T19:26:36.135637] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-10 (3.36 seconds). [2025-10-28T19:26:36.146626] [INFO ] [REMOTE ] INVH: Full fetch complete (76987 records). [2025-10-28T19:26:36.146803] [DEBUG] [VALIDATOR ] INVH: Validating primary data. [2025-10-28T19:26:36.535267] [DEBUG] [VALIDATOR ] INVH: All expected trading days are present. [2025-10-28T19:26:36.535352] [DEBUG] [VALIDATOR ] INVH: Primary data validation passed. [2025-10-28T19:26:36.536435] [INFO ] [MAIN ] INVH: Fetched primary data is valid. [2025-10-28T19:26:36.536496] [DEBUG] [LOCAL ] INVH: Saving primary data. [2025-10-28T19:26:36.537889] [DEBUG] [LOCAL ] INVH: Trimmed 76987 records to 53180 (keeping 200 days of data) [2025-10-28T19:26:36.868533] [DEBUG] [LOCAL ] INVH: Primary data saved (53180 records). [2025-10-28T19:26:36.868766] [INFO ] [MAIN ] INVH: Full history saved. [2025-10-28T19:26:36.868859] [INFO ] [MAIN ] Update Progress: 1116/2366 symbols completed. INVH took 28.3s. Estimated remaining: 2h 44m 10s. Rate: 7.6 symbols/min [2025-10-28T19:26:37.056976] [INFO ] [MAIN ] IOT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:26:37.058408] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-28T19:26:37.064850] [INFO ] [REMOTE ] INVX: Full fetch complete (42464 records). [2025-10-28T19:26:37.065026] [DEBUG] [VALIDATOR ] INVX: Validating primary data. [2025-10-28T19:26:37.439128] [DEBUG] [LOCAL ] IOT: Loaded 53443 existing records from primary storage. [2025-10-28T19:26:37.458195] [INFO ] [MAIN ] IOT: Loaded 53443 existing records. [2025-10-28T19:26:37.558871] [DEBUG] [VALIDATOR ] INVX: All expected trading days are present. [2025-10-28T19:26:37.569935] [DEBUG] [VALIDATOR ] INVX: Primary data validation passed. [2025-10-28T19:26:37.571086] [INFO ] [MAIN ] INVX: Fetched primary data is valid. [2025-10-28T19:26:37.582060] [DEBUG] [LOCAL ] INVX: Saving primary data. [2025-10-28T19:26:37.623279] [DEBUG] [LOCAL ] INVX: Trimmed 42464 records to 28510 (keeping 200 days of data) [2025-10-28T19:26:37.740903] [WARN ] [MAIN ] IOT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:26:37.750606] [INFO ] [MAIN ] IOT: Wiping existing primary data before full refresh. [2025-10-28T19:26:37.776999] [INFO ] [LOCAL ] IOT: Starting deletion of primary data. [2025-10-28T19:26:37.803252] [DEBUG] [LOCAL ] IOT: Deleted primary data file. [2025-10-28T19:26:37.806895] [INFO ] [MAIN ] IOT: Starting full primary refresh. [2025-10-28T19:26:37.974223] [DEBUG] [LOCAL ] INVX: Primary data saved (28510 records). [2025-10-28T19:26:37.988707] [INFO ] [MAIN ] INVX: Full history saved. [2025-10-28T19:26:37.988953] [INFO ] [MAIN ] Update Progress: 1117/2366 symbols completed. INVX took 27.9s. Estimated remaining: 2h 43m 54s. Rate: 7.6 symbols/min [2025-10-28T19:26:38.221159] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-09 (3.84 seconds). [2025-10-28T19:26:38.257007] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-10. [2025-10-28T19:26:38.326228] [INFO ] [REMOTE ] IOT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:26:38.326783] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-01. [2025-10-28T19:26:39.395009] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-10 (1.14 seconds). [2025-10-28T19:26:39.402752] [INFO ] [REMOTE ] INSW: Full fetch complete (59008 records). [2025-10-28T19:26:39.402876] [DEBUG] [VALIDATOR ] INSW: Validating primary data. [2025-10-28T19:26:39.810303] [DEBUG] [VALIDATOR ] INSW: All expected trading days are present. [2025-10-28T19:26:39.810415] [DEBUG] [VALIDATOR ] INSW: Primary data validation passed. [2025-10-28T19:26:39.811476] [INFO ] [MAIN ] INSW: Fetched primary data is valid. [2025-10-28T19:26:39.811560] [DEBUG] [LOCAL ] INSW: Saving primary data. [2025-10-28T19:26:39.844296] [DEBUG] [LOCAL ] INSW: Trimmed 59008 records to 38711 (keeping 200 days of data) [2025-10-28T19:26:39.847241] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-28T19:26:39.908913] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-02. [2025-10-28T19:26:40.092242] [DEBUG] [LOCAL ] INSW: Primary data saved (38711 records). [2025-10-28T19:26:40.092452] [INFO ] [MAIN ] INSW: Full history saved. [2025-10-28T19:26:40.093099] [INFO ] [MAIN ] Update Progress: 1118/2366 symbols completed. INSW took 33.4s. Estimated remaining: 2h 43m 40s. Rate: 7.6 symbols/min [2025-10-28T19:26:41.296728] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-28T19:26:41.307566] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-03. [2025-10-28T19:26:42.458056] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-03 (8.88 seconds). [2025-10-28T19:26:42.469226] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-04. [2025-10-28T19:26:42.653248] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-28T19:26:42.664343] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-04. [2025-10-28T19:26:44.155004] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-10-28T19:26:44.166176] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-05. [2025-10-28T19:26:45.491712] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-28T19:26:45.504828] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-06. [2025-10-28T19:26:46.931046] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-10-28T19:26:46.942208] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-07. [2025-10-28T19:26:47.179006] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-04 (4.71 seconds). [2025-10-28T19:26:47.191049] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-05. [2025-10-28T19:26:48.395429] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-10-28T19:26:48.415091] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-08. [2025-10-28T19:26:49.268716] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-10-28T19:26:49.287046] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-06. [2025-10-28T19:26:49.868349] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-28T19:26:49.882586] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-09. [2025-10-28T19:26:51.189571] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-10-28T19:26:51.201575] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-07. [2025-10-28T19:26:51.295748] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-28T19:26:51.307577] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-10. [2025-10-28T19:26:53.014053] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-10 (1.71 seconds). [2025-10-28T19:26:53.025071] [INFO ] [REMOTE ] IOT: Full fetch complete (77517 records). [2025-10-28T19:26:53.025234] [DEBUG] [VALIDATOR ] IOT: Validating primary data. [2025-10-28T19:26:53.425621] [DEBUG] [VALIDATOR ] IOT: All expected trading days are present. [2025-10-28T19:26:53.425740] [DEBUG] [VALIDATOR ] IOT: Primary data validation passed. [2025-10-28T19:26:53.426821] [INFO ] [MAIN ] IOT: Fetched primary data is valid. [2025-10-28T19:26:53.426886] [DEBUG] [LOCAL ] IOT: Saving primary data. [2025-10-28T19:26:53.428287] [DEBUG] [LOCAL ] IOT: Trimmed 77517 records to 53440 (keeping 200 days of data) [2025-10-28T19:26:53.735923] [DEBUG] [LOCAL ] IOT: Primary data saved (53440 records). [2025-10-28T19:26:53.736045] [INFO ] [MAIN ] IOT: Full history saved. [2025-10-28T19:26:53.736155] [INFO ] [MAIN ] Update Progress: 1119/2366 symbols completed. IOT took 16.9s. Estimated remaining: 2h 43m 39s. Rate: 7.6 symbols/min [2025-10-28T19:26:55.953586] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-07 (4.75 seconds). [2025-10-28T19:26:55.965314] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-08. [2025-10-28T19:26:58.250062] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-08 (2.28 seconds). [2025-10-28T19:26:58.261408] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-09. [2025-10-28T19:27:00.302406] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-28T19:27:00.313933] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-10. [2025-10-28T19:27:02.584112] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-10 (2.27 seconds). [2025-10-28T19:27:02.595228] [INFO ] [REMOTE ] IONQ: Full fetch complete (77968 records). [2025-10-28T19:27:02.595388] [DEBUG] [VALIDATOR ] IONQ: Validating primary data. [2025-10-28T19:27:03.003476] [DEBUG] [VALIDATOR ] IONQ: All expected trading days are present. [2025-10-28T19:27:03.003564] [DEBUG] [VALIDATOR ] IONQ: Primary data validation passed. [2025-10-28T19:27:03.004609] [INFO ] [MAIN ] IONQ: Fetched primary data is valid. [2025-10-28T19:27:03.004704] [DEBUG] [LOCAL ] IONQ: Saving primary data. [2025-10-28T19:27:03.006352] [DEBUG] [LOCAL ] IONQ: Trimmed 77968 records to 53788 (keeping 200 days of data) [2025-10-28T19:27:03.320733] [DEBUG] [LOCAL ] IONQ: Primary data saved (53788 records). [2025-10-28T19:27:03.320857] [INFO ] [MAIN ] IONQ: Full history saved. [2025-10-28T19:27:03.320933] [INFO ] [MAIN ] Update Progress: 1120/2366 symbols completed. IONQ took 42.0s. Estimated remaining: 2h 43m 33s. Rate: 7.6 symbols/min [2025-10-28T19:27:03.882554] [INFO ] [MAIN ] IPG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:27:03.956285] [INFO ] [MAIN ] IQI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:27:04.027281] [INFO ] [MAIN ] IP: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:27:04.045749] [INFO ] [MAIN ] IPI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:27:04.058617] [DEBUG] [LOCAL ] IQI: Loaded 17496 existing records from primary storage. [2025-10-28T19:27:04.058951] [INFO ] [MAIN ] IQI: Loaded 17496 existing records. [2025-10-28T19:27:04.222088] [DEBUG] [LOCAL ] IPI: Loaded 21303 existing records from primary storage. [2025-10-28T19:27:04.266679] [INFO ] [MAIN ] IPI: Loaded 21303 existing records. [2025-10-28T19:27:04.286192] [WARN ] [MAIN ] IQI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:27:04.347489] [INFO ] [MAIN ] IQI: Wiping existing primary data before full refresh. [2025-10-28T19:27:04.377085] [DEBUG] [LOCAL ] IP: Loaded 53297 existing records from primary storage. [2025-10-28T19:27:04.424603] [DEBUG] [LOCAL ] IPG: Loaded 53328 existing records from primary storage. [2025-10-28T19:27:04.393694] [INFO ] [LOCAL ] IQI: Starting deletion of primary data. [2025-10-28T19:27:04.455574] [INFO ] [MAIN ] IPG: Loaded 53328 existing records. [2025-10-28T19:27:04.430244] [INFO ] [MAIN ] IP: Loaded 53297 existing records. [2025-10-28T19:27:04.526542] [DEBUG] [LOCAL ] IQI: Deleted primary data file. [2025-10-28T19:27:04.676749] [INFO ] [MAIN ] IQI: Starting full primary refresh. [2025-10-28T19:27:04.732273] [WARN ] [MAIN ] IPI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:27:04.758917] [INFO ] [MAIN ] IPI: Wiping existing primary data before full refresh. [2025-10-28T19:27:04.759546] [INFO ] [LOCAL ] IPI: Starting deletion of primary data. [2025-10-28T19:27:04.816690] [DEBUG] [LOCAL ] IPI: Deleted primary data file. [2025-10-28T19:27:04.847028] [INFO ] [MAIN ] IPI: Starting full primary refresh. [2025-10-28T19:27:05.019750] [WARN ] [MAIN ] IP: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:27:05.067731] [WARN ] [MAIN ] IPG: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:27:05.082302] [INFO ] [MAIN ] IPG: Wiping existing primary data before full refresh. [2025-10-28T19:27:05.086826] [INFO ] [MAIN ] IP: Wiping existing primary data before full refresh. [2025-10-28T19:27:05.128333] [INFO ] [LOCAL ] IP: Starting deletion of primary data. [2025-10-28T19:27:05.123143] [INFO ] [LOCAL ] IPG: Starting deletion of primary data. [2025-10-28T19:27:05.201561] [DEBUG] [LOCAL ] IPG: Deleted primary data file. [2025-10-28T19:27:05.173521] [DEBUG] [LOCAL ] IP: Deleted primary data file. [2025-10-28T19:27:05.216400] [INFO ] [MAIN ] IP: Starting full primary refresh. [2025-10-28T19:27:05.215955] [INFO ] [MAIN ] IPG: Starting full primary refresh. [2025-10-28T19:27:05.985514] [INFO ] [REMOTE ] IQI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:27:06.030782] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-01. [2025-10-28T19:27:06.311062] [INFO ] [REMOTE ] IPI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:27:06.355724] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-01. [2025-10-28T19:27:06.442357] [INFO ] [REMOTE ] IPG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:27:06.454949] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-01. [2025-10-28T19:27:06.480203] [INFO ] [REMOTE ] IP: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:27:06.480606] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-01. [2025-10-28T19:27:07.120039] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-10-28T19:27:07.123850] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-02. [2025-10-28T19:27:07.400144] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-28T19:27:07.404319] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-02. [2025-10-28T19:27:07.815115] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-28T19:27:07.825745] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-02. [2025-10-28T19:27:08.171560] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-28T19:27:08.177000] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-03. [2025-10-28T19:27:08.517050] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-28T19:27:08.521715] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-03. [2025-10-28T19:27:08.855499] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-28T19:27:08.859444] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-04. [2025-10-28T19:27:09.618942] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-28T19:27:09.624198] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-05. [2025-10-28T19:27:09.994945] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-01 (3.54 seconds). [2025-10-28T19:27:10.005361] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-02. [2025-10-28T19:27:10.216164] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-10-28T19:27:10.220400] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-06. [2025-10-28T19:27:10.822464] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-10-28T19:27:10.826506] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-07. [2025-10-28T19:27:11.130817] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-02 (3.31 seconds). [2025-10-28T19:27:11.140835] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-03. [2025-10-28T19:27:11.225693] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-03 (2.70 seconds). [2025-10-28T19:27:11.231363] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-04. [2025-10-28T19:27:11.259086] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-28T19:27:11.269452] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-03. [2025-10-28T19:27:11.559419] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-28T19:27:11.563782] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-08. [2025-10-28T19:27:11.991447] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-10-28T19:27:11.996918] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-05. [2025-10-28T19:27:12.343362] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-28T19:27:12.348747] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-09. [2025-10-28T19:27:12.518743] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-28T19:27:12.530514] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-04. [2025-10-28T19:27:12.571907] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-28T19:27:12.584679] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-04. [2025-10-28T19:27:13.736860] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-28T19:27:13.741469] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-10. [2025-10-28T19:27:13.792318] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-28T19:27:13.804782] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-05. [2025-10-28T19:27:13.888700] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-28T19:27:13.901178] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-05. [2025-10-28T19:27:14.356919] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-05 (2.36 seconds). [2025-10-28T19:27:14.363050] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-06. [2025-10-28T19:27:14.462346] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-28T19:27:14.465774] [INFO ] [REMOTE ] IQI: Full fetch complete (26042 records). [2025-10-28T19:27:14.465858] [DEBUG] [VALIDATOR ] IQI: Validating primary data. [2025-10-28T19:27:14.850299] [DEBUG] [VALIDATOR ] IQI: All expected trading days are present. [2025-10-28T19:27:14.850377] [DEBUG] [VALIDATOR ] IQI: Primary data validation passed. [2025-10-28T19:27:14.850927] [INFO ] [MAIN ] IQI: Fetched primary data is valid. [2025-10-28T19:27:14.850987] [DEBUG] [LOCAL ] IQI: Saving primary data. [2025-10-28T19:27:14.851606] [DEBUG] [LOCAL ] IQI: Trimmed 26042 records to 17371 (keeping 200 days of data) [2025-10-28T19:27:14.954920] [DEBUG] [LOCAL ] IQI: Primary data saved (17371 records). [2025-10-28T19:27:14.955164] [INFO ] [MAIN ] IQI: Full history saved. [2025-10-28T19:27:14.955340] [INFO ] [MAIN ] Update Progress: 1121/2366 symbols completed. IQI took 11.6s. Estimated remaining: 2h 43m 29s. Rate: 7.6 symbols/min [2025-10-28T19:27:15.129055] [INFO ] [MAIN ] IQV: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:27:15.142599] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-10-28T19:27:15.174813] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-07. [2025-10-28T19:27:15.178717] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-28T19:27:15.191139] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-06. [2025-10-28T19:27:15.225196] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-28T19:27:15.248639] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-06. [2025-10-28T19:27:15.270201] [DEBUG] [LOCAL ] IQV: Loaded 49937 existing records from primary storage. [2025-10-28T19:27:15.270482] [INFO ] [MAIN ] IQV: Loaded 49937 existing records. [2025-10-28T19:27:15.443423] [WARN ] [MAIN ] IQV: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:27:15.443624] [INFO ] [MAIN ] IQV: Wiping existing primary data before full refresh. [2025-10-28T19:27:15.443700] [INFO ] [LOCAL ] IQV: Starting deletion of primary data. [2025-10-28T19:27:15.444061] [DEBUG] [LOCAL ] IQV: Deleted primary data file. [2025-10-28T19:27:15.444102] [INFO ] [MAIN ] IQV: Starting full primary refresh. [2025-10-28T19:27:15.792698] [INFO ] [REMOTE ] IQV: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:27:15.792996] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-01. [2025-10-28T19:27:15.945503] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-28T19:27:15.949985] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-08. [2025-10-28T19:27:16.297140] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-28T19:27:16.308195] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-07. [2025-10-28T19:27:17.640729] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-28T19:27:17.652487] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-08. [2025-10-28T19:27:17.703008] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-10-28T19:27:17.707543] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-09. [2025-10-28T19:27:18.470513] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-10-28T19:27:18.475543] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-10. [2025-10-28T19:27:18.668433] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-06 (3.42 seconds). [2025-10-28T19:27:18.874361] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-28T19:27:19.180245] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-09. [2025-10-28T19:27:19.327717] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-28T19:27:19.333076] [INFO ] [REMOTE ] IPI: Full fetch complete (30440 records). [2025-10-28T19:27:19.333218] [DEBUG] [VALIDATOR ] IPI: Validating primary data. [2025-10-28T19:27:19.725318] [DEBUG] [VALIDATOR ] IPI: All expected trading days are present. [2025-10-28T19:27:19.725433] [DEBUG] [VALIDATOR ] IPI: Primary data validation passed. [2025-10-28T19:27:19.726512] [INFO ] [MAIN ] IPI: Fetched primary data is valid. [2025-10-28T19:27:19.726582] [DEBUG] [LOCAL ] IPI: Saving primary data. [2025-10-28T19:27:19.727859] [DEBUG] [LOCAL ] IPI: Trimmed 30440 records to 21264 (keeping 200 days of data) [2025-10-28T19:27:19.862261] [DEBUG] [LOCAL ] IPI: Primary data saved (21264 records). [2025-10-28T19:27:19.862430] [INFO ] [MAIN ] IPI: Full history saved. [2025-10-28T19:27:19.862529] [INFO ] [MAIN ] Update Progress: 1122/2366 symbols completed. IPI took 16.5s. Estimated remaining: 2h 43m 18s. Rate: 7.6 symbols/min [2025-10-28T19:27:19.985399] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-07. [2025-10-28T19:27:20.049855] [INFO ] [MAIN ] IR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:27:20.102502] [DEBUG] [LOCAL ] IR: Loaded 52720 existing records from primary storage. [2025-10-28T19:27:20.102997] [INFO ] [MAIN ] IR: Loaded 52720 existing records. [2025-10-28T19:27:20.293752] [WARN ] [MAIN ] IR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:27:20.294108] [INFO ] [MAIN ] IR: Wiping existing primary data before full refresh. [2025-10-28T19:27:20.294160] [INFO ] [LOCAL ] IR: Starting deletion of primary data. [2025-10-28T19:27:20.294559] [DEBUG] [LOCAL ] IR: Deleted primary data file. [2025-10-28T19:27:20.294629] [INFO ] [MAIN ] IR: Starting full primary refresh. [2025-10-28T19:27:20.675525] [INFO ] [REMOTE ] IR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:27:20.780367] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-01. [2025-10-28T19:27:21.203972] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-01 (5.41 seconds). [2025-10-28T19:27:21.369033] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-10-28T19:27:21.580330] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-02. [2025-10-28T19:27:21.938061] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-28T19:27:22.380277] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-02. [2025-10-28T19:27:22.574817] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-28T19:27:23.190800] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-03. [2025-10-28T19:27:23.197748] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-09 (4.02 seconds). [2025-10-28T19:27:23.381600] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-10-28T19:27:23.980279] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-08. [2025-10-28T19:27:24.377864] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-28T19:27:24.780295] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-04. [2025-10-28T19:27:25.195959] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-28T19:27:25.580281] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-10. [2025-10-28T19:27:26.035670] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-28T19:27:26.380287] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-09. [2025-10-28T19:27:27.032451] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-28T19:27:27.044619] [INFO ] [REMOTE ] IPG: Full fetch complete (77442 records). [2025-10-28T19:27:27.044850] [DEBUG] [VALIDATOR ] IPG: Validating primary data. [2025-10-28T19:27:27.193411] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-05. [2025-10-28T19:27:27.467909] [DEBUG] [VALIDATOR ] IPG: All expected trading days are present. [2025-10-28T19:27:27.468013] [DEBUG] [VALIDATOR ] IPG: Primary data validation passed. [2025-10-28T19:27:27.469191] [INFO ] [MAIN ] IPG: Fetched primary data is valid. [2025-10-28T19:27:27.469256] [DEBUG] [LOCAL ] IPG: Saving primary data. [2025-10-28T19:27:27.470955] [DEBUG] [LOCAL ] IPG: Trimmed 77442 records to 53327 (keeping 200 days of data) [2025-10-28T19:27:27.835017] [DEBUG] [LOCAL ] IPG: Primary data saved (53327 records). [2025-10-28T19:27:27.838344] [INFO ] [MAIN ] IPG: Full history saved. [2025-10-28T19:27:27.838475] [INFO ] [MAIN ] Update Progress: 1123/2366 symbols completed. IPG took 24.5s. Estimated remaining: 2h 43m 10s. Rate: 7.6 symbols/min [2025-10-28T19:27:27.883883] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-28T19:27:27.985442] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-10. [2025-10-28T19:27:28.050101] [INFO ] [MAIN ] IRM: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:27:28.101722] [DEBUG] [LOCAL ] IRM: Loaded 48673 existing records from primary storage. [2025-10-28T19:27:28.102047] [INFO ] [MAIN ] IRM: Loaded 48673 existing records. [2025-10-28T19:27:28.300495] [WARN ] [MAIN ] IRM: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:27:28.300857] [INFO ] [MAIN ] IRM: Wiping existing primary data before full refresh. [2025-10-28T19:27:28.300919] [INFO ] [LOCAL ] IRM: Starting deletion of primary data. [2025-10-28T19:27:28.301377] [DEBUG] [LOCAL ] IRM: Deleted primary data file. [2025-10-28T19:27:28.301450] [INFO ] [MAIN ] IRM: Starting full primary refresh. [2025-10-28T19:27:28.659157] [INFO ] [REMOTE ] IRM: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:27:28.691875] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-10-28T19:27:28.780268] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-01. [2025-10-28T19:27:29.581686] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-03. [2025-10-28T19:27:29.584426] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-10 (1.60 seconds). [2025-10-28T19:27:29.595807] [INFO ] [REMOTE ] IP: Full fetch complete (77423 records). [2025-10-28T19:27:29.595914] [DEBUG] [VALIDATOR ] IP: Validating primary data. [2025-10-28T19:27:29.991410] [DEBUG] [VALIDATOR ] IP: All expected trading days are present. [2025-10-28T19:27:29.991528] [DEBUG] [VALIDATOR ] IP: Primary data validation passed. [2025-10-28T19:27:29.992773] [INFO ] [MAIN ] IP: Fetched primary data is valid. [2025-10-28T19:27:29.992912] [DEBUG] [LOCAL ] IP: Saving primary data. [2025-10-28T19:27:29.994951] [DEBUG] [LOCAL ] IP: Trimmed 77423 records to 53297 (keeping 200 days of data) [2025-10-28T19:27:30.259768] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-10-28T19:27:30.358797] [DEBUG] [LOCAL ] IP: Primary data saved (53297 records). [2025-10-28T19:27:30.358965] [INFO ] [MAIN ] IP: Full history saved. [2025-10-28T19:27:30.359311] [INFO ] [MAIN ] Update Progress: 1124/2366 symbols completed. IP took 27.0s. Estimated remaining: 2h 42m 56s. Rate: 7.6 symbols/min [2025-10-28T19:27:30.388220] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-02. [2025-10-28T19:27:30.527248] [INFO ] [MAIN ] IRS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:27:30.550805] [DEBUG] [LOCAL ] IRS: Loaded 23461 existing records from primary storage. [2025-10-28T19:27:30.551049] [INFO ] [MAIN ] IRS: Loaded 23461 existing records. [2025-10-28T19:27:30.727889] [WARN ] [MAIN ] IRS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:27:30.728334] [INFO ] [MAIN ] IRS: Wiping existing primary data before full refresh. [2025-10-28T19:27:30.728520] [INFO ] [LOCAL ] IRS: Starting deletion of primary data. [2025-10-28T19:27:30.728955] [DEBUG] [LOCAL ] IRS: Deleted primary data file. [2025-10-28T19:27:30.729061] [INFO ] [MAIN ] IRS: Starting full primary refresh. [2025-10-28T19:27:31.164419] [INFO ] [REMOTE ] IRS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:27:31.173412] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-10-28T19:27:31.187207] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-06. [2025-10-28T19:27:31.980215] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-04. [2025-10-28T19:27:32.364171] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-28T19:27:32.780241] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-01. [2025-10-28T19:27:33.186381] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-28T19:27:33.570448] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-10-28T19:27:33.580196] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-02. [2025-10-28T19:27:34.219331] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-28T19:27:34.380311] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-03. [2025-10-28T19:27:34.654778] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-02 (4.27 seconds). [2025-10-28T19:27:35.099551] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-28T19:27:35.180250] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-07. [2025-10-28T19:27:35.980297] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-04. [2025-10-28T19:27:36.507128] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-10-28T19:27:36.760081] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-28T19:27:36.780289] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-05. [2025-10-28T19:27:37.504714] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-28T19:27:37.580276] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-06. [2025-10-28T19:27:38.253077] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-28T19:27:38.380262] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-03. [2025-10-28T19:27:39.180304] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-05. [2025-10-28T19:27:39.980263] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-08. [2025-10-28T19:27:40.780286] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-07. [2025-10-28T19:27:41.198809] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-28T19:27:41.580286] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-09. [2025-10-28T19:27:42.313159] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-28T19:27:42.380214] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-08. [2025-10-28T19:27:42.759275] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-28T19:27:42.906240] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-03 (4.53 seconds). [2025-10-28T19:27:43.177087] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-28T19:27:43.181866] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-10. [2025-10-28T19:27:43.763271] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-28T19:27:43.774590] [INFO ] [REMOTE ] IQV: Full fetch complete (72677 records). [2025-10-28T19:27:43.774850] [DEBUG] [VALIDATOR ] IQV: Validating primary data. [2025-10-28T19:27:43.985859] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-04. [2025-10-28T19:27:44.196515] [DEBUG] [VALIDATOR ] IQV: All expected trading days are present. [2025-10-28T19:27:44.196632] [DEBUG] [VALIDATOR ] IQV: Primary data validation passed. [2025-10-28T19:27:44.198276] [INFO ] [MAIN ] IQV: Fetched primary data is valid. [2025-10-28T19:27:44.198353] [DEBUG] [LOCAL ] IQV: Saving primary data. [2025-10-28T19:27:44.200497] [DEBUG] [LOCAL ] IQV: Trimmed 72677 records to 49919 (keeping 200 days of data) [2025-10-28T19:27:44.535019] [DEBUG] [LOCAL ] IQV: Primary data saved (49919 records). [2025-10-28T19:27:44.535288] [INFO ] [MAIN ] IQV: Full history saved. [2025-10-28T19:27:44.535461] [INFO ] [MAIN ] Update Progress: 1125/2366 symbols completed. IQV took 29.6s. Estimated remaining: 2h 42m 55s. Rate: 7.6 symbols/min [2025-10-28T19:27:44.742021] [INFO ] [MAIN ] IRT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:27:44.791167] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-09. [2025-10-28T19:27:44.795108] [DEBUG] [LOCAL ] IRT: Loaded 50309 existing records from primary storage. [2025-10-28T19:27:44.795637] [INFO ] [MAIN ] IRT: Loaded 50309 existing records. [2025-10-28T19:27:44.991307] [WARN ] [MAIN ] IRT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:27:44.991604] [INFO ] [MAIN ] IRT: Wiping existing primary data before full refresh. [2025-10-28T19:27:44.991694] [INFO ] [LOCAL ] IRT: Starting deletion of primary data. [2025-10-28T19:27:44.992303] [DEBUG] [LOCAL ] IRT: Deleted primary data file. [2025-10-28T19:27:44.992382] [INFO ] [MAIN ] IRT: Starting full primary refresh. [2025-10-28T19:27:45.382734] [INFO ] [REMOTE ] IRT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:27:45.440195] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-10-28T19:27:45.580237] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-05. [2025-10-28T19:27:45.754599] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-10-28T19:27:46.380248] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-10. [2025-10-28T19:27:46.778736] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-28T19:27:47.001746] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-05 (7.82 seconds). [2025-10-28T19:27:47.180247] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-06. [2025-10-28T19:27:47.531783] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-28T19:27:47.538736] [INFO ] [REMOTE ] IRS: Full fetch complete (32766 records). [2025-10-28T19:27:47.538975] [DEBUG] [VALIDATOR ] IRS: Validating primary data. [2025-10-28T19:27:47.922625] [DEBUG] [VALIDATOR ] IRS: All expected trading days are present. [2025-10-28T19:27:47.922748] [DEBUG] [VALIDATOR ] IRS: Primary data validation passed. [2025-10-28T19:27:47.923409] [INFO ] [MAIN ] IRS: Fetched primary data is valid. [2025-10-28T19:27:47.923450] [DEBUG] [LOCAL ] IRS: Saving primary data. [2025-10-28T19:27:47.924217] [DEBUG] [LOCAL ] IRS: Trimmed 32766 records to 23690 (keeping 200 days of data) [2025-10-28T19:27:48.005727] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-06. [2025-10-28T19:27:48.061772] [DEBUG] [LOCAL ] IRS: Primary data saved (23690 records). [2025-10-28T19:27:48.061967] [INFO ] [MAIN ] IRS: Full history saved. [2025-10-28T19:27:48.062066] [INFO ] [MAIN ] Update Progress: 1126/2366 symbols completed. IRS took 17.7s. Estimated remaining: 2h 42m 43s. Rate: 7.6 symbols/min [2025-10-28T19:27:48.232968] [INFO ] [MAIN ] ISD: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:27:48.249545] [DEBUG] [LOCAL ] ISD: Loaded 15420 existing records from primary storage. [2025-10-28T19:27:48.249945] [INFO ] [MAIN ] ISD: Loaded 15420 existing records. [2025-10-28T19:27:48.427970] [WARN ] [MAIN ] ISD: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:27:48.428340] [INFO ] [MAIN ] ISD: Wiping existing primary data before full refresh. [2025-10-28T19:27:48.428401] [INFO ] [LOCAL ] ISD: Starting deletion of primary data. [2025-10-28T19:27:48.428796] [DEBUG] [LOCAL ] ISD: Deleted primary data file. [2025-10-28T19:27:48.428930] [INFO ] [MAIN ] ISD: Starting full primary refresh. [2025-10-28T19:27:48.638238] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-10-28T19:27:48.791455] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-07. [2025-10-28T19:27:48.831821] [INFO ] [REMOTE ] ISD: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:27:49.580316] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-01. [2025-10-28T19:27:50.207332] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-28T19:27:50.380272] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-08. [2025-10-28T19:27:50.764411] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-28T19:27:51.180279] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-01. [2025-10-28T19:27:51.485383] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-10-28T19:27:51.980241] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-02. [2025-10-28T19:27:52.482881] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-06 (4.48 seconds). [2025-10-28T19:27:52.780293] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-07. [2025-10-28T19:27:53.054830] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-28T19:27:53.580244] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-03. [2025-10-28T19:27:53.980688] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-28T19:27:54.169130] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-01 (2.99 seconds). [2025-10-28T19:27:54.380306] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-02. [2025-10-28T19:27:55.180314] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-08. [2025-10-28T19:27:55.554525] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-28T19:27:55.980270] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-09. [2025-10-28T19:27:56.404671] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-28T19:27:56.780247] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-09. [2025-10-28T19:27:57.041092] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-03 (3.46 seconds). [2025-10-28T19:27:57.332956] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-28T19:27:57.580256] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-10. [2025-10-28T19:27:57.978285] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-10-28T19:27:58.380306] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-03. [2025-10-28T19:27:58.963791] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-28T19:27:58.974566] [INFO ] [REMOTE ] IR: Full fetch complete (76479 records). [2025-10-28T19:27:58.974746] [DEBUG] [VALIDATOR ] IR: Validating primary data. [2025-10-28T19:27:59.113604] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-28T19:27:59.180676] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-04. [2025-10-28T19:27:59.402296] [DEBUG] [VALIDATOR ] IR: All expected trading days are present. [2025-10-28T19:27:59.402389] [DEBUG] [VALIDATOR ] IR: Primary data validation passed. [2025-10-28T19:27:59.403422] [INFO ] [MAIN ] IR: Fetched primary data is valid. [2025-10-28T19:27:59.403488] [DEBUG] [LOCAL ] IR: Saving primary data. [2025-10-28T19:27:59.404972] [DEBUG] [LOCAL ] IR: Trimmed 76479 records to 52717 (keeping 200 days of data) [2025-10-28T19:27:59.725439] [DEBUG] [LOCAL ] IR: Primary data saved (52717 records). [2025-10-28T19:27:59.725599] [INFO ] [MAIN ] IR: Full history saved. [2025-10-28T19:27:59.725736] [INFO ] [MAIN ] Update Progress: 1127/2366 symbols completed. IR took 39.9s. Estimated remaining: 2h 42m 39s. Rate: 7.6 symbols/min [2025-10-28T19:27:59.904674] [INFO ] [MAIN ] IT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:27:59.949341] [DEBUG] [LOCAL ] IT: Loaded 42087 existing records from primary storage. [2025-10-28T19:27:59.956197] [INFO ] [MAIN ] IT: Loaded 42087 existing records. [2025-10-28T19:27:59.956064] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-28T19:27:59.985325] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-04. [2025-10-28T19:28:00.154581] [WARN ] [MAIN ] IT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:28:00.154847] [INFO ] [MAIN ] IT: Wiping existing primary data before full refresh. [2025-10-28T19:28:00.154896] [INFO ] [LOCAL ] IT: Starting deletion of primary data. [2025-10-28T19:28:00.155210] [DEBUG] [LOCAL ] IT: Deleted primary data file. [2025-10-28T19:28:00.155270] [INFO ] [MAIN ] IT: Starting full primary refresh. [2025-10-28T19:28:00.521421] [INFO ] [REMOTE ] IT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:28:00.780265] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-01. [2025-10-28T19:28:01.294901] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-28T19:28:01.580256] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-05. [2025-10-28T19:28:01.744847] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-28T19:28:02.380288] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-02. [2025-10-28T19:28:02.718232] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-28T19:28:03.180256] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-10. [2025-10-28T19:28:03.328283] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-10-28T19:28:03.980261] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-05. [2025-10-28T19:28:04.607825] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-10-28T19:28:04.780275] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-06. [2025-10-28T19:28:05.391813] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-10-28T19:28:05.580278] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-03. [2025-10-28T19:28:06.380303] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-07. [2025-10-28T19:28:06.632455] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-28T19:28:07.180322] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-06. [2025-10-28T19:28:07.980338] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-04. [2025-10-28T19:28:08.260842] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-10 (5.08 seconds). [2025-10-28T19:28:08.271509] [INFO ] [REMOTE ] IRM: Full fetch complete (71845 records). [2025-10-28T19:28:08.271699] [DEBUG] [VALIDATOR ] IRM: Validating primary data. [2025-10-28T19:28:08.661705] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-10-28T19:28:08.793793] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-07. [2025-10-28T19:28:08.818637] [DEBUG] [VALIDATOR ] IRM: All expected trading days are present. [2025-10-28T19:28:08.818817] [DEBUG] [VALIDATOR ] IRM: Primary data validation passed. [2025-10-28T19:28:08.820345] [INFO ] [MAIN ] IRM: Fetched primary data is valid. [2025-10-28T19:28:08.820550] [DEBUG] [LOCAL ] IRM: Saving primary data. [2025-10-28T19:28:08.822826] [DEBUG] [LOCAL ] IRM: Trimmed 71845 records to 48597 (keeping 200 days of data) [2025-10-28T19:28:09.136865] [DEBUG] [LOCAL ] IRM: Primary data saved (48597 records). [2025-10-28T19:28:09.137015] [INFO ] [MAIN ] IRM: Full history saved. [2025-10-28T19:28:09.137716] [INFO ] [MAIN ] Update Progress: 1128/2366 symbols completed. IRM took 41.3s. Estimated remaining: 2h 42m 33s. Rate: 7.6 symbols/min [2025-10-28T19:28:09.311549] [INFO ] [MAIN ] ITGR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:28:09.338083] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-10-28T19:28:09.384801] [DEBUG] [LOCAL ] ITGR: Loaded 31163 existing records from primary storage. [2025-10-28T19:28:09.385187] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-07 (3.00 seconds). [2025-10-28T19:28:09.388723] [INFO ] [MAIN ] ITGR: Loaded 31163 existing records. [2025-10-28T19:28:09.563680] [WARN ] [MAIN ] ITGR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:28:09.563879] [INFO ] [MAIN ] ITGR: Wiping existing primary data before full refresh. [2025-10-28T19:28:09.563926] [INFO ] [LOCAL ] ITGR: Starting deletion of primary data. [2025-10-28T19:28:09.564346] [DEBUG] [LOCAL ] ITGR: Deleted primary data file. [2025-10-28T19:28:09.564407] [INFO ] [MAIN ] ITGR: Starting full primary refresh. [2025-10-28T19:28:09.585492] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-05. [2025-10-28T19:28:09.910485] [INFO ] [REMOTE ] ITGR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:28:10.141096] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-28T19:28:10.380322] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-08. [2025-10-28T19:28:11.180233] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-01. [2025-10-28T19:28:11.647360] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-28T19:28:11.881021] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-28T19:28:11.980213] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-02. [2025-10-28T19:28:12.780263] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-08. [2025-10-28T19:28:13.413696] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-10-28T19:28:13.580242] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-09. [2025-10-28T19:28:14.380338] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-09. [2025-10-28T19:28:14.410279] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-05 (4.82 seconds). [2025-10-28T19:28:14.439116] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-02 (2.46 seconds). [2025-10-28T19:28:14.743118] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-28T19:28:15.180328] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-03. [2025-10-28T19:28:15.971677] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-28T19:28:15.980203] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-10. [2025-10-28T19:28:16.124866] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-28T19:28:16.638271] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-10 (0.66 seconds). [2025-10-28T19:28:16.642183] [INFO ] [REMOTE ] ISD: Full fetch complete (23958 records). [2025-10-28T19:28:16.642254] [DEBUG] [VALIDATOR ] ISD: Validating primary data. [2025-10-28T19:28:16.785359] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-06. [2025-10-28T19:28:17.012610] [DEBUG] [VALIDATOR ] ISD: All expected trading days are present. [2025-10-28T19:28:17.012726] [DEBUG] [VALIDATOR ] ISD: Primary data validation passed. [2025-10-28T19:28:17.013281] [INFO ] [MAIN ] ISD: Fetched primary data is valid. [2025-10-28T19:28:17.013363] [DEBUG] [LOCAL ] ISD: Saving primary data. [2025-10-28T19:28:17.014029] [DEBUG] [LOCAL ] ISD: Trimmed 23958 records to 15340 (keeping 200 days of data) [2025-10-28T19:28:17.106007] [DEBUG] [LOCAL ] ISD: Primary data saved (15340 records). [2025-10-28T19:28:17.106174] [INFO ] [MAIN ] ISD: Full history saved. [2025-10-28T19:28:17.106260] [INFO ] [MAIN ] Update Progress: 1129/2366 symbols completed. ISD took 29.0s. Estimated remaining: 2h 42m 25s. Rate: 7.6 symbols/min [2025-10-28T19:28:17.300314] [INFO ] [MAIN ] ITT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:28:17.333015] [DEBUG] [LOCAL ] ITT: Loaded 31974 existing records from primary storage. [2025-10-28T19:28:17.333292] [INFO ] [MAIN ] ITT: Loaded 31974 existing records. [2025-10-28T19:28:17.509277] [WARN ] [MAIN ] ITT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:28:17.509556] [INFO ] [MAIN ] ITT: Wiping existing primary data before full refresh. [2025-10-28T19:28:17.509605] [INFO ] [LOCAL ] ITT: Starting deletion of primary data. [2025-10-28T19:28:17.509845] [DEBUG] [LOCAL ] ITT: Deleted primary data file. [2025-10-28T19:28:17.509902] [INFO ] [MAIN ] ITT: Starting full primary refresh. [2025-10-28T19:28:17.585506] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-10. [2025-10-28T19:28:17.863783] [INFO ] [REMOTE ] ITT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:28:17.890676] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-28T19:28:18.380289] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-07. [2025-10-28T19:28:19.180240] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-04. [2025-10-28T19:28:19.528306] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-28T19:28:19.980255] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-08. [2025-10-28T19:28:20.257845] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-28T19:28:20.780316] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-05. [2025-10-28T19:28:21.238775] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-10-28T19:28:21.580314] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-09. [2025-10-28T19:28:21.792558] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-28T19:28:22.380292] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-01. [2025-10-28T19:28:22.880561] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-28T19:28:23.180251] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-10. [2025-10-28T19:28:23.980260] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-06. [2025-10-28T19:28:24.761447] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-28T19:28:24.770810] [INFO ] [REMOTE ] IT: Full fetch complete (58196 records). [2025-10-28T19:28:24.770924] [DEBUG] [VALIDATOR ] IT: Validating primary data. [2025-10-28T19:28:25.022589] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-10 (7.44 seconds). [2025-10-28T19:28:25.093039] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-28T19:28:25.131038] [INFO ] [REMOTE ] IRT: Full fetch complete (72816 records). [2025-10-28T19:28:25.140105] [DEBUG] [VALIDATOR ] IRT: Validating primary data. [2025-10-28T19:28:25.140885] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-07. [2025-10-28T19:28:25.357130] [DEBUG] [VALIDATOR ] IT: All expected trading days are present. [2025-10-28T19:28:25.362367] [DEBUG] [VALIDATOR ] IT: Primary data validation passed. [2025-10-28T19:28:25.368409] [INFO ] [MAIN ] IT: Fetched primary data is valid. [2025-10-28T19:28:25.380818] [DEBUG] [LOCAL ] IT: Saving primary data. [2025-10-28T19:28:25.435687] [DEBUG] [LOCAL ] IT: Trimmed 58196 records to 42098 (keeping 200 days of data) [2025-10-28T19:28:25.823878] [DEBUG] [VALIDATOR ] IRT: All expected trading days are present. [2025-10-28T19:28:25.824268] [DEBUG] [VALIDATOR ] IRT: Primary data validation passed. [2025-10-28T19:28:25.825324] [INFO ] [MAIN ] IRT: Fetched primary data is valid. [2025-10-28T19:28:25.825491] [DEBUG] [LOCAL ] IRT: Saving primary data. [2025-10-28T19:28:25.876474] [DEBUG] [LOCAL ] IRT: Trimmed 72816 records to 50290 (keeping 200 days of data) [2025-10-28T19:28:25.970509] [DEBUG] [LOCAL ] IT: Primary data saved (42098 records). [2025-10-28T19:28:25.971105] [INFO ] [MAIN ] IT: Full history saved. [2025-10-28T19:28:25.971249] [INFO ] [MAIN ] Update Progress: 1130/2366 symbols completed. IT took 26.2s. Estimated remaining: 2h 42m 18s. Rate: 7.6 symbols/min [2025-10-28T19:28:26.201775] [INFO ] [MAIN ] ITUB: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:28:26.328186] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-28T19:28:26.343602] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-08. [2025-10-28T19:28:26.455225] [DEBUG] [LOCAL ] ITUB: Loaded 53305 existing records from primary storage. [2025-10-28T19:28:26.463532] [INFO ] [MAIN ] ITUB: Loaded 53305 existing records. [2025-10-28T19:28:26.573104] [DEBUG] [LOCAL ] IRT: Primary data saved (50290 records). [2025-10-28T19:28:26.573506] [INFO ] [MAIN ] IRT: Full history saved. [2025-10-28T19:28:26.573618] [INFO ] [MAIN ] Update Progress: 1131/2366 symbols completed. IRT took 42.0s. Estimated remaining: 2h 42m 2s. Rate: 7.6 symbols/min [2025-10-28T19:28:26.752520] [WARN ] [MAIN ] ITUB: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:28:26.768543] [INFO ] [MAIN ] ITUB: Wiping existing primary data before full refresh. [2025-10-28T19:28:26.773771] [INFO ] [LOCAL ] ITUB: Starting deletion of primary data. [2025-10-28T19:28:26.821590] [INFO ] [MAIN ] ITW: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:28:26.818470] [DEBUG] [LOCAL ] ITUB: Deleted primary data file. [2025-10-28T19:28:26.822330] [INFO ] [MAIN ] ITUB: Starting full primary refresh. [2025-10-28T19:28:27.206544] [DEBUG] [LOCAL ] ITW: Loaded 45560 existing records from primary storage. [2025-10-28T19:28:27.264805] [INFO ] [REMOTE ] ITUB: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:28:27.265227] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-01. [2025-10-28T19:28:27.258773] [INFO ] [MAIN ] ITW: Loaded 45560 existing records. [2025-10-28T19:28:27.384792] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-28T19:28:27.404127] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-09. [2025-10-28T19:28:27.488257] [WARN ] [MAIN ] ITW: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:28:27.488587] [INFO ] [MAIN ] ITW: Wiping existing primary data before full refresh. [2025-10-28T19:28:27.488639] [INFO ] [LOCAL ] ITW: Starting deletion of primary data. [2025-10-28T19:28:27.489310] [DEBUG] [LOCAL ] ITW: Deleted primary data file. [2025-10-28T19:28:27.489374] [INFO ] [MAIN ] ITW: Starting full primary refresh. [2025-10-28T19:28:27.884271] [INFO ] [REMOTE ] ITW: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:28:27.980321] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-01. [2025-10-28T19:28:28.321083] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-28T19:28:28.494938] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-28T19:28:28.780313] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-02. [2025-10-28T19:28:29.159382] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-28T19:28:29.580303] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-10. [2025-10-28T19:28:30.165597] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-10-28T19:28:30.287543] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-01 (7.91 seconds). [2025-10-28T19:28:30.380276] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-02. [2025-10-28T19:28:30.731678] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-28T19:28:30.740506] [INFO ] [REMOTE ] ITGR: Full fetch complete (44226 records). [2025-10-28T19:28:30.740750] [DEBUG] [VALIDATOR ] ITGR: Validating primary data. [2025-10-28T19:28:31.155259] [DEBUG] [VALIDATOR ] ITGR: All expected trading days are present. [2025-10-28T19:28:31.155344] [DEBUG] [VALIDATOR ] ITGR: Primary data validation passed. [2025-10-28T19:28:31.156266] [INFO ] [MAIN ] ITGR: Fetched primary data is valid. [2025-10-28T19:28:31.156328] [DEBUG] [LOCAL ] ITGR: Saving primary data. [2025-10-28T19:28:31.157414] [DEBUG] [LOCAL ] ITGR: Trimmed 44226 records to 31198 (keeping 200 days of data) [2025-10-28T19:28:31.210619] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-02. [2025-10-28T19:28:31.348345] [DEBUG] [LOCAL ] ITGR: Primary data saved (31198 records). [2025-10-28T19:28:31.348470] [INFO ] [MAIN ] ITGR: Full history saved. [2025-10-28T19:28:31.348555] [INFO ] [MAIN ] Update Progress: 1132/2366 symbols completed. ITGR took 22.2s. Estimated remaining: 2h 41m 51s. Rate: 7.6 symbols/min [2025-10-28T19:28:31.518277] [INFO ] [MAIN ] IVR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:28:31.560700] [DEBUG] [LOCAL ] IVR: Loaded 47696 existing records from primary storage. [2025-10-28T19:28:31.561059] [INFO ] [MAIN ] IVR: Loaded 47696 existing records. [2025-10-28T19:28:31.741791] [WARN ] [MAIN ] IVR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:28:31.742065] [INFO ] [MAIN ] IVR: Wiping existing primary data before full refresh. [2025-10-28T19:28:31.742143] [INFO ] [LOCAL ] IVR: Starting deletion of primary data. [2025-10-28T19:28:31.742608] [DEBUG] [LOCAL ] IVR: Deleted primary data file. [2025-10-28T19:28:31.742709] [INFO ] [MAIN ] IVR: Starting full primary refresh. [2025-10-28T19:28:31.983270] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-03. [2025-10-28T19:28:32.035961] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-10-28T19:28:32.168747] [INFO ] [REMOTE ] IVR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:28:32.229987] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-28T19:28:32.780257] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-03. [2025-10-28T19:28:33.356459] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-10-28T19:28:33.580246] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-01. [2025-10-28T19:28:34.130624] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-28T19:28:34.380273] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-04. [2025-10-28T19:28:34.686496] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-28T19:28:35.180247] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-04. [2025-10-28T19:28:35.751987] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-10-28T19:28:35.980251] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-02. [2025-10-28T19:28:36.645369] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-28T19:28:36.780252] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-05. [2025-10-28T19:28:37.580256] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-03. [2025-10-28T19:28:38.380264] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-05. [2025-10-28T19:28:38.631169] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-28T19:28:39.180302] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-04. [2025-10-28T19:28:41.352488] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-02 (5.37 seconds). [2025-10-28T19:28:41.361513] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-03. [2025-10-28T19:28:42.820898] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-28T19:28:42.831085] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-04. [2025-10-28T19:28:43.993465] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-04 (4.81 seconds). [2025-10-28T19:28:44.004841] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-05. [2025-10-28T19:28:44.172543] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-28T19:28:44.183099] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-05. [2025-10-28T19:28:44.744096] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-05 (6.36 seconds). [2025-10-28T19:28:44.755297] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-06. [2025-10-28T19:28:44.977796] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-10-28T19:28:44.989357] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-06. [2025-10-28T19:28:45.399963] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-28T19:28:45.410234] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-06. [2025-10-28T19:28:45.586482] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-05 (8.81 seconds). [2025-10-28T19:28:45.596443] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-06. [2025-10-28T19:28:45.993595] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-28T19:28:46.060485] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-28T19:28:46.380267] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-07. [2025-10-28T19:28:46.701498] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-28T19:28:47.180249] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-07. [2025-10-28T19:28:47.690624] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-28T19:28:47.980269] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-07. [2025-10-28T19:28:48.366012] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-28T19:28:48.780274] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-08. [2025-10-28T19:28:49.580266] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-08. [2025-10-28T19:28:50.089289] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-28T19:28:50.183806] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-06 (4.77 seconds). [2025-10-28T19:28:50.380273] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-07. [2025-10-28T19:28:50.877485] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-07 (2.90 seconds). [2025-10-28T19:28:51.180265] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-09. [2025-10-28T19:28:51.914720] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-28T19:28:51.980221] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-08. [2025-10-28T19:28:52.458415] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-28T19:28:52.780223] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-08. [2025-10-28T19:28:53.127746] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-28T19:28:53.580262] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-09. [2025-10-28T19:28:53.616449] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-10-28T19:28:54.380216] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-09. [2025-10-28T19:28:54.893697] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-28T19:28:55.180231] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-10. [2025-10-28T19:28:55.277674] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-10-28T19:28:55.980238] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-10. [2025-10-28T19:28:56.399048] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-08 (6.82 seconds). [2025-10-28T19:28:56.655471] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-10 (1.48 seconds). [2025-10-28T19:28:56.665378] [INFO ] [REMOTE ] IVR: Full fetch complete (68999 records). [2025-10-28T19:28:56.665528] [DEBUG] [VALIDATOR ] IVR: Validating primary data. [2025-10-28T19:28:56.785439] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-10. [2025-10-28T19:28:57.047947] [DEBUG] [VALIDATOR ] IVR: All expected trading days are present. [2025-10-28T19:28:57.048046] [DEBUG] [VALIDATOR ] IVR: Primary data validation passed. [2025-10-28T19:28:57.049008] [INFO ] [MAIN ] IVR: Fetched primary data is valid. [2025-10-28T19:28:57.049209] [DEBUG] [LOCAL ] IVR: Saving primary data. [2025-10-28T19:28:57.050538] [DEBUG] [LOCAL ] IVR: Trimmed 68999 records to 47650 (keeping 200 days of data) [2025-10-28T19:28:57.273421] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-28T19:28:57.297280] [INFO ] [REMOTE ] ITT: Full fetch complete (47659 records). [2025-10-28T19:28:57.301099] [DEBUG] [VALIDATOR ] ITT: Validating primary data. [2025-10-28T19:28:57.534869] [DEBUG] [LOCAL ] IVR: Primary data saved (47650 records). [2025-10-28T19:28:57.548197] [INFO ] [MAIN ] IVR: Full history saved. [2025-10-28T19:28:57.554109] [INFO ] [MAIN ] Update Progress: 1133/2366 symbols completed. IVR took 26.2s. Estimated remaining: 2h 42m 3s. Rate: 7.6 symbols/min [2025-10-28T19:28:57.594245] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-09. [2025-10-28T19:28:57.896371] [INFO ] [MAIN ] IVT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:28:57.911630] [DEBUG] [VALIDATOR ] ITT: All expected trading days are present. [2025-10-28T19:28:57.911718] [DEBUG] [VALIDATOR ] ITT: Primary data validation passed. [2025-10-28T19:28:57.912488] [INFO ] [MAIN ] ITT: Fetched primary data is valid. [2025-10-28T19:28:57.912526] [DEBUG] [LOCAL ] ITT: Saving primary data. [2025-10-28T19:28:57.913610] [DEBUG] [LOCAL ] ITT: Trimmed 47659 records to 31933 (keeping 200 days of data) [2025-10-28T19:28:58.091581] [DEBUG] [LOCAL ] IVT: Loaded 31135 existing records from primary storage. [2025-10-28T19:28:58.107743] [INFO ] [MAIN ] IVT: Loaded 31135 existing records. [2025-10-28T19:28:58.172782] [DEBUG] [LOCAL ] ITT: Primary data saved (31933 records). [2025-10-28T19:28:58.184375] [INFO ] [MAIN ] ITT: Full history saved. [2025-10-28T19:28:58.198178] [INFO ] [MAIN ] Update Progress: 1134/2366 symbols completed. ITT took 41.1s. Estimated remaining: 2h 41m 47s. Rate: 7.6 symbols/min [2025-10-28T19:28:58.415490] [WARN ] [MAIN ] IVT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:28:58.431170] [INFO ] [MAIN ] IVT: Wiping existing primary data before full refresh. [2025-10-28T19:28:58.436568] [INFO ] [LOCAL ] IVT: Starting deletion of primary data. [2025-10-28T19:28:58.482568] [DEBUG] [LOCAL ] IVT: Deleted primary data file. [2025-10-28T19:28:58.482526] [INFO ] [MAIN ] IVZ: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:28:58.482802] [INFO ] [MAIN ] IVT: Starting full primary refresh. [2025-10-28T19:28:58.807245] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-10 (2.02 seconds). [2025-10-28T19:28:58.888396] [INFO ] [REMOTE ] ITUB: Full fetch complete (77303 records). [2025-10-28T19:28:58.925610] [INFO ] [REMOTE ] IVT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:28:58.926079] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-01. [2025-10-28T19:28:58.922484] [DEBUG] [VALIDATOR ] ITUB: Validating primary data. [2025-10-28T19:28:58.928210] [DEBUG] [LOCAL ] IVZ: Loaded 53128 existing records from primary storage. [2025-10-28T19:28:58.940006] [INFO ] [MAIN ] IVZ: Loaded 53128 existing records. [2025-10-28T19:28:59.312413] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-28T19:28:59.324519] [WARN ] [MAIN ] IVZ: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:28:59.345808] [INFO ] [MAIN ] IVZ: Wiping existing primary data before full refresh. [2025-10-28T19:28:59.354293] [INFO ] [LOCAL ] IVZ: Starting deletion of primary data. [2025-10-28T19:28:59.368049] [DEBUG] [LOCAL ] IVZ: Deleted primary data file. [2025-10-28T19:28:59.388103] [INFO ] [MAIN ] IVZ: Starting full primary refresh. [2025-10-28T19:28:59.400403] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-10. [2025-10-28T19:28:59.763987] [DEBUG] [VALIDATOR ] ITUB: All expected trading days are present. [2025-10-28T19:28:59.774183] [DEBUG] [VALIDATOR ] ITUB: Primary data validation passed. [2025-10-28T19:28:59.829049] [INFO ] [MAIN ] ITUB: Fetched primary data is valid. [2025-10-28T19:28:59.834517] [DEBUG] [LOCAL ] ITUB: Saving primary data. [2025-10-28T19:28:59.924432] [INFO ] [REMOTE ] IVZ: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:28:59.925797] [DEBUG] [LOCAL ] ITUB: Trimmed 77303 records to 53301 (keeping 200 days of data) [2025-10-28T19:28:59.989962] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-01. [2025-10-28T19:29:00.001477] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-10-28T19:29:00.267630] [DEBUG] [LOCAL ] ITUB: Primary data saved (53301 records). [2025-10-28T19:29:00.267801] [INFO ] [MAIN ] ITUB: Full history saved. [2025-10-28T19:29:00.267883] [INFO ] [MAIN ] Update Progress: 1135/2366 symbols completed. ITUB took 34.3s. Estimated remaining: 2h 41m 33s. Rate: 7.6 symbols/min [2025-10-28T19:29:00.437875] [INFO ] [MAIN ] IX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:29:00.459490] [DEBUG] [LOCAL ] IX: Loaded 21695 existing records from primary storage. [2025-10-28T19:29:00.459823] [INFO ] [MAIN ] IX: Loaded 21695 existing records. [2025-10-28T19:29:00.638995] [WARN ] [MAIN ] IX: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:29:00.639260] [INFO ] [MAIN ] IX: Wiping existing primary data before full refresh. [2025-10-28T19:29:00.639309] [INFO ] [LOCAL ] IX: Starting deletion of primary data. [2025-10-28T19:29:00.639575] [DEBUG] [LOCAL ] IX: Deleted primary data file. [2025-10-28T19:29:00.639617] [INFO ] [MAIN ] IX: Starting full primary refresh. [2025-10-28T19:29:00.784408] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-02. [2025-10-28T19:29:01.024267] [INFO ] [REMOTE ] IX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:29:01.050539] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-10 (1.65 seconds). [2025-10-28T19:29:01.059928] [INFO ] [REMOTE ] ITW: Full fetch complete (66952 records). [2025-10-28T19:29:01.060053] [DEBUG] [VALIDATOR ] ITW: Validating primary data. [2025-10-28T19:29:01.434321] [DEBUG] [VALIDATOR ] ITW: All expected trading days are present. [2025-10-28T19:29:01.434395] [DEBUG] [VALIDATOR ] ITW: Primary data validation passed. [2025-10-28T19:29:01.435282] [INFO ] [MAIN ] ITW: Fetched primary data is valid. [2025-10-28T19:29:01.435344] [DEBUG] [LOCAL ] ITW: Saving primary data. [2025-10-28T19:29:01.436602] [DEBUG] [LOCAL ] ITW: Trimmed 66952 records to 45547 (keeping 200 days of data) [2025-10-28T19:29:01.612615] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-01. [2025-10-28T19:29:01.736141] [DEBUG] [LOCAL ] ITW: Primary data saved (45547 records). [2025-10-28T19:29:01.736463] [INFO ] [MAIN ] ITW: Full history saved. [2025-10-28T19:29:01.736586] [INFO ] [MAIN ] Update Progress: 1136/2366 symbols completed. ITW took 35.2s. Estimated remaining: 2h 41m 18s. Rate: 7.6 symbols/min [2025-10-28T19:29:01.952889] [INFO ] [MAIN ] J: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:29:01.978998] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-10-28T19:29:02.026558] [DEBUG] [LOCAL ] J: Loaded 40512 existing records from primary storage. [2025-10-28T19:29:02.026929] [INFO ] [MAIN ] J: Loaded 40512 existing records. [2025-10-28T19:29:02.201452] [WARN ] [MAIN ] J: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:29:02.201684] [INFO ] [MAIN ] J: Wiping existing primary data before full refresh. [2025-10-28T19:29:02.201742] [INFO ] [LOCAL ] J: Starting deletion of primary data. [2025-10-28T19:29:02.202040] [DEBUG] [LOCAL ] J: Deleted primary data file. [2025-10-28T19:29:02.202098] [INFO ] [MAIN ] J: Starting full primary refresh. [2025-10-28T19:29:02.314764] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-28T19:29:02.387922] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-02. [2025-10-28T19:29:02.590971] [INFO ] [REMOTE ] J: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:29:02.934198] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-28T19:29:03.180238] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-03. [2025-10-28T19:29:03.636884] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-02 (2.85 seconds). [2025-10-28T19:29:03.980253] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-03. [2025-10-28T19:29:04.786719] [INFO ] [REMOTE ] J: Fetching primary data for 2025-01. [2025-10-28T19:29:04.804337] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-10-28T19:29:05.431739] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-03 (2.25 seconds). [2025-10-28T19:29:05.580276] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-04. [2025-10-28T19:29:06.380281] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-04. [2025-10-28T19:29:06.545207] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-28T19:29:07.180279] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-05. [2025-10-28T19:29:07.207224] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-28T19:29:07.980225] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-02. [2025-10-28T19:29:08.155844] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-28T19:29:08.780249] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-06. [2025-10-28T19:29:08.976323] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-01 (4.19 seconds). [2025-10-28T19:29:09.112050] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-28T19:29:09.427928] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-10-28T19:29:09.580292] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-07. [2025-10-28T19:29:10.380282] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-03. [2025-10-28T19:29:10.499927] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-28T19:29:11.180301] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-08. [2025-10-28T19:29:11.641401] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-28T19:29:11.980240] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-04. [2025-10-28T19:29:12.065927] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-10-28T19:29:12.780317] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-05. [2025-10-28T19:29:13.580243] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-09. [2025-10-28T19:29:14.380232] [INFO ] [REMOTE ] J: Fetching primary data for 2025-02. [2025-10-28T19:29:14.469106] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-10-28T19:29:15.180312] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-10. [2025-10-28T19:29:16.373502] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-28T19:29:16.382242] [INFO ] [REMOTE ] IVT: Full fetch complete (45577 records). [2025-10-28T19:29:16.382411] [DEBUG] [VALIDATOR ] IVT: Validating primary data. [2025-10-28T19:29:16.750017] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-04 (4.77 seconds). [2025-10-28T19:29:16.822180] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-05. [2025-10-28T19:29:16.856846] [DEBUG] [VALIDATOR ] IVT: All expected trading days are present. [2025-10-28T19:29:16.856939] [DEBUG] [VALIDATOR ] IVT: Primary data validation passed. [2025-10-28T19:29:16.857707] [INFO ] [MAIN ] IVT: Fetched primary data is valid. [2025-10-28T19:29:16.857768] [DEBUG] [LOCAL ] IVT: Saving primary data. [2025-10-28T19:29:16.858717] [DEBUG] [LOCAL ] IVT: Trimmed 45577 records to 31153 (keeping 200 days of data) [2025-10-28T19:29:17.046725] [DEBUG] [LOCAL ] IVT: Primary data saved (31153 records). [2025-10-28T19:29:17.046857] [INFO ] [MAIN ] IVT: Full history saved. [2025-10-28T19:29:17.046936] [INFO ] [MAIN ] Update Progress: 1137/2366 symbols completed. IVT took 19.5s. Estimated remaining: 2h 41m 19s. Rate: 7.6 symbols/min [2025-10-28T19:29:17.216971] [INFO ] [MAIN ] JBGS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:29:17.256282] [DEBUG] [LOCAL ] JBGS: Loaded 41297 existing records from primary storage. [2025-10-28T19:29:17.256580] [INFO ] [MAIN ] JBGS: Loaded 41297 existing records. [2025-10-28T19:29:17.439769] [WARN ] [MAIN ] JBGS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:29:17.439979] [INFO ] [MAIN ] JBGS: Wiping existing primary data before full refresh. [2025-10-28T19:29:17.440025] [INFO ] [LOCAL ] JBGS: Starting deletion of primary data. [2025-10-28T19:29:17.440235] [DEBUG] [LOCAL ] JBGS: Deleted primary data file. [2025-10-28T19:29:17.440277] [INFO ] [MAIN ] JBGS: Starting full primary refresh. [2025-10-28T19:29:17.784592] [INFO ] [REMOTE ] JBGS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:29:17.784906] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-01. [2025-10-28T19:29:18.667621] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-02 (4.29 seconds). [2025-10-28T19:29:18.677243] [INFO ] [REMOTE ] J: Fetching primary data for 2025-03. [2025-10-28T19:29:18.677974] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-05 (5.90 seconds). [2025-10-28T19:29:18.685497] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-06. [2025-10-28T19:29:18.719848] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-10-28T19:29:19.180312] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-02. [2025-10-28T19:29:19.378988] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-28T19:29:19.782613] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-28T19:29:19.980262] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-07. [2025-10-28T19:29:20.025248] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-10-28T19:29:20.788121] [INFO ] [REMOTE ] J: Fetching primary data for 2025-04. [2025-10-28T19:29:20.790775] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-10-28T19:29:21.580264] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-03. [2025-10-28T19:29:21.816061] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-05 (4.99 seconds). [2025-10-28T19:29:22.090374] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-28T19:29:22.380209] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-06. [2025-10-28T19:29:22.563734] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-10-28T19:29:23.180258] [INFO ] [REMOTE ] J: Fetching primary data for 2025-05. [2025-10-28T19:29:23.595552] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-28T19:29:23.980302] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-08. [2025-10-28T19:29:24.318978] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-28T19:29:24.717213] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-28T19:29:24.780237] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-09. [2025-10-28T19:29:25.461605] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-10-28T19:29:25.580244] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-07. [2025-10-28T19:29:26.380273] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-04. [2025-10-28T19:29:27.180250] [INFO ] [REMOTE ] J: Fetching primary data for 2025-06. [2025-10-28T19:29:27.980265] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-10. [2025-10-28T19:29:28.702106] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-28T19:29:28.706520] [INFO ] [REMOTE ] IX: Full fetch complete (29055 records). [2025-10-28T19:29:28.706610] [DEBUG] [VALIDATOR ] IX: Validating primary data. [2025-10-28T19:29:29.095289] [DEBUG] [VALIDATOR ] IX: All expected trading days are present. [2025-10-28T19:29:29.095373] [DEBUG] [VALIDATOR ] IX: Primary data validation passed. [2025-10-28T19:29:29.096097] [INFO ] [MAIN ] IX: Fetched primary data is valid. [2025-10-28T19:29:29.096161] [DEBUG] [LOCAL ] IX: Saving primary data. [2025-10-28T19:29:29.097015] [DEBUG] [LOCAL ] IX: Trimmed 29055 records to 21585 (keeping 200 days of data) [2025-10-28T19:29:29.222595] [DEBUG] [LOCAL ] IX: Primary data saved (21585 records). [2025-10-28T19:29:29.222742] [INFO ] [MAIN ] IX: Full history saved. [2025-10-28T19:29:29.222826] [INFO ] [MAIN ] Update Progress: 1138/2366 symbols completed. IX took 29.0s. Estimated remaining: 2h 41m 15s. Rate: 7.6 symbols/min [2025-10-28T19:29:29.394569] [INFO ] [MAIN ] JBI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:29:29.431719] [DEBUG] [LOCAL ] JBI: Loaded 42114 existing records from primary storage. [2025-10-28T19:29:29.431999] [INFO ] [MAIN ] JBI: Loaded 42114 existing records. [2025-10-28T19:29:29.608775] [WARN ] [MAIN ] JBI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:29:29.609076] [INFO ] [MAIN ] JBI: Wiping existing primary data before full refresh. [2025-10-28T19:29:29.609148] [INFO ] [LOCAL ] JBI: Starting deletion of primary data. [2025-10-28T19:29:29.609488] [DEBUG] [LOCAL ] JBI: Deleted primary data file. [2025-10-28T19:29:29.609552] [INFO ] [MAIN ] JBI: Starting full primary refresh. [2025-10-28T19:29:29.961718] [INFO ] [REMOTE ] JBI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:29:29.962089] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-01. [2025-10-28T19:29:32.156084] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-07 (6.58 seconds). [2025-10-28T19:29:32.167511] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-08. [2025-10-28T19:29:32.470665] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-04 (6.09 seconds). [2025-10-28T19:29:32.480331] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-05. [2025-10-28T19:29:33.763030] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-10-28T19:29:33.774476] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-09. [2025-10-28T19:29:34.073632] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-10-28T19:29:34.083975] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-06. [2025-10-28T19:29:34.864320] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-06 (7.68 seconds). [2025-10-28T19:29:34.872777] [INFO ] [REMOTE ] J: Fetching primary data for 2025-07. [2025-10-28T19:29:36.111600] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-28T19:29:36.120216] [INFO ] [REMOTE ] J: Fetching primary data for 2025-08. [2025-10-28T19:29:36.843283] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-01 (6.88 seconds). [2025-10-28T19:29:36.852558] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-02. [2025-10-28T19:29:37.318286] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-28T19:29:37.327245] [INFO ] [REMOTE ] J: Fetching primary data for 2025-09. [2025-10-28T19:29:37.969522] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-10-28T19:29:37.978663] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-03. [2025-10-28T19:29:38.509286] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-28T19:29:38.518276] [INFO ] [REMOTE ] J: Fetching primary data for 2025-10. [2025-10-28T19:29:38.662255] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-06 (4.58 seconds). [2025-10-28T19:29:38.671604] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-07. [2025-10-28T19:29:38.901870] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-28T19:29:38.912208] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-04. [2025-10-28T19:29:39.815292] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-10 (1.30 seconds). [2025-10-28T19:29:39.825815] [INFO ] [REMOTE ] J: Full fetch complete (60017 records). [2025-10-28T19:29:39.826110] [DEBUG] [VALIDATOR ] J: Validating primary data. [2025-10-28T19:29:39.897403] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-28T19:29:40.001377] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-08. [2025-10-28T19:29:40.297166] [DEBUG] [VALIDATOR ] J: All expected trading days are present. [2025-10-28T19:29:40.297266] [DEBUG] [VALIDATOR ] J: Primary data validation passed. [2025-10-28T19:29:40.298399] [INFO ] [MAIN ] J: Fetched primary data is valid. [2025-10-28T19:29:40.298479] [DEBUG] [LOCAL ] J: Saving primary data. [2025-10-28T19:29:40.324182] [DEBUG] [LOCAL ] J: Trimmed 60017 records to 40501 (keeping 200 days of data) [2025-10-28T19:29:40.326064] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-28T19:29:40.340143] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-05. [2025-10-28T19:29:40.585177] [DEBUG] [LOCAL ] J: Primary data saved (40501 records). [2025-10-28T19:29:40.585311] [INFO ] [MAIN ] J: Full history saved. [2025-10-28T19:29:40.586501] [INFO ] [MAIN ] Update Progress: 1139/2366 symbols completed. J took 38.8s. Estimated remaining: 2h 41m 11s. Rate: 7.6 symbols/min [2025-10-28T19:29:40.758371] [INFO ] [MAIN ] JBL: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:29:40.789859] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-09 (7.02 seconds). [2025-10-28T19:29:40.802062] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-10. [2025-10-28T19:29:40.841767] [DEBUG] [LOCAL ] JBL: Loaded 48193 existing records from primary storage. [2025-10-28T19:29:40.842052] [INFO ] [MAIN ] JBL: Loaded 48193 existing records. [2025-10-28T19:29:41.020404] [WARN ] [MAIN ] JBL: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:29:41.020736] [INFO ] [MAIN ] JBL: Wiping existing primary data before full refresh. [2025-10-28T19:29:41.020806] [INFO ] [LOCAL ] JBL: Starting deletion of primary data. [2025-10-28T19:29:41.021055] [DEBUG] [LOCAL ] JBL: Deleted primary data file. [2025-10-28T19:29:41.021178] [INFO ] [MAIN ] JBL: Starting full primary refresh. [2025-10-28T19:29:41.218298] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-28T19:29:41.423125] [INFO ] [REMOTE ] JBL: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:29:41.449437] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-28T19:29:41.580238] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-09. [2025-10-28T19:29:42.327065] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-28T19:29:42.337694] [INFO ] [REMOTE ] IVZ: Full fetch complete (77073 records). [2025-10-28T19:29:42.337803] [DEBUG] [VALIDATOR ] IVZ: Validating primary data. [2025-10-28T19:29:42.385428] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-06. [2025-10-28T19:29:42.742971] [DEBUG] [VALIDATOR ] IVZ: All expected trading days are present. [2025-10-28T19:29:42.743150] [DEBUG] [VALIDATOR ] IVZ: Primary data validation passed. [2025-10-28T19:29:42.744199] [INFO ] [MAIN ] IVZ: Fetched primary data is valid. [2025-10-28T19:29:42.744370] [DEBUG] [LOCAL ] IVZ: Saving primary data. [2025-10-28T19:29:42.745992] [DEBUG] [LOCAL ] IVZ: Trimmed 77073 records to 53126 (keeping 200 days of data) [2025-10-28T19:29:42.898070] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-10-28T19:29:43.100912] [DEBUG] [LOCAL ] IVZ: Primary data saved (53126 records). [2025-10-28T19:29:43.101037] [INFO ] [MAIN ] IVZ: Full history saved. [2025-10-28T19:29:43.101114] [INFO ] [MAIN ] Update Progress: 1140/2366 symbols completed. IVZ took 44.9s. Estimated remaining: 2h 40m 58s. Rate: 7.6 symbols/min [2025-10-28T19:29:43.185598] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-10. [2025-10-28T19:29:43.274437] [INFO ] [MAIN ] JBND: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:29:43.301947] [DEBUG] [LOCAL ] JBND: Loaded 27459 existing records from primary storage. [2025-10-28T19:29:43.302214] [INFO ] [MAIN ] JBND: Loaded 27459 existing records. [2025-10-28T19:29:43.486081] [WARN ] [MAIN ] JBND: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:29:43.486399] [INFO ] [MAIN ] JBND: Wiping existing primary data before full refresh. [2025-10-28T19:29:43.486510] [INFO ] [LOCAL ] JBND: Starting deletion of primary data. [2025-10-28T19:29:43.486908] [DEBUG] [LOCAL ] JBND: Deleted primary data file. [2025-10-28T19:29:43.487075] [INFO ] [MAIN ] JBND: Starting full primary refresh. [2025-10-28T19:29:43.614762] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-28T19:29:43.878374] [INFO ] [REMOTE ] JBND: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:29:43.980253] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-01. [2025-10-28T19:29:44.245362] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-28T19:29:44.252964] [INFO ] [REMOTE ] JBGS: Full fetch complete (59085 records). [2025-10-28T19:29:44.253118] [DEBUG] [VALIDATOR ] JBGS: Validating primary data. [2025-10-28T19:29:44.639417] [DEBUG] [VALIDATOR ] JBGS: All expected trading days are present. [2025-10-28T19:29:44.639613] [DEBUG] [VALIDATOR ] JBGS: Primary data validation passed. [2025-10-28T19:29:44.640534] [INFO ] [MAIN ] JBGS: Fetched primary data is valid. [2025-10-28T19:29:44.640613] [DEBUG] [LOCAL ] JBGS: Saving primary data. [2025-10-28T19:29:44.651911] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-28T19:29:44.656555] [DEBUG] [LOCAL ] JBGS: Trimmed 59085 records to 41208 (keeping 200 days of data) [2025-10-28T19:29:44.780278] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-07. [2025-10-28T19:29:44.901719] [DEBUG] [LOCAL ] JBGS: Primary data saved (41208 records). [2025-10-28T19:29:44.901846] [INFO ] [MAIN ] JBGS: Full history saved. [2025-10-28T19:29:44.902592] [INFO ] [MAIN ] Update Progress: 1141/2366 symbols completed. JBGS took 27.9s. Estimated remaining: 2h 40m 43s. Rate: 7.6 symbols/min [2025-10-28T19:29:45.070394] [INFO ] [MAIN ] JBS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:29:45.070571] [DEBUG] [LOCAL ] JBS: No existing data file found in primary storage. [2025-10-28T19:29:45.070607] [WARN ] [MAIN ] JBS: No existing data found, performing full refresh instead. [2025-10-28T19:29:45.070755] [INFO ] [MAIN ] JBS: Wiping existing primary data before full refresh. [2025-10-28T19:29:45.070798] [INFO ] [LOCAL ] JBS: Starting deletion of primary data. [2025-10-28T19:29:45.070846] [DEBUG] [LOCAL ] JBS: No primary data file found to delete. [2025-10-28T19:29:45.070879] [INFO ] [MAIN ] JBS: Starting full primary refresh. [2025-10-28T19:29:45.419468] [INFO ] [REMOTE ] JBS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:29:45.580285] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-02. [2025-10-28T19:29:45.914910] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-28T19:29:46.200193] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-10-28T19:29:46.380311] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-03. [2025-10-28T19:29:47.180218] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-01. [2025-10-28T19:29:47.323698] [DEBUG] [REMOTE ] JBS: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-28T19:29:47.324014] [WARN ] [REMOTE ] JBS: No data returned for month 2025-01 [2025-10-28T19:29:47.324102] [FATAL] [REMOTE ] JBS: API call failed - aborting fetch to avoid wasting further API calls [2025-10-28T19:29:47.324148] [FATAL] [MAIN ] JBS: Failed to fetch primary data. [2025-10-28T19:29:47.324181] [WARN ] [MAIN ] JBS: Deleting existing primary and derivative data due to fetch failure. [2025-10-28T19:29:47.324218] [INFO ] [LOCAL ] JBS: Starting deletion of primary data. [2025-10-28T19:29:47.324272] [DEBUG] [LOCAL ] JBS: No primary data file found to delete. [2025-10-28T19:29:47.324308] [INFO ] [LOCAL ] JBS: Starting deletion of derivative data. [2025-10-28T19:29:47.324346] [DEBUG] [LOCAL ] JBS: No derivative data file found to delete. [2025-10-28T19:29:47.324394] [INFO ] [MAIN ] Update Progress: 1142/2366 symbols completed. JBS took 2.4s. Estimated remaining: 2h 40m 29s. Rate: 7.6 symbols/min [2025-10-28T19:29:47.491804] [INFO ] [MAIN ] JBTM: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:29:47.527400] [DEBUG] [LOCAL ] JBTM: Loaded 33232 existing records from primary storage. [2025-10-28T19:29:47.527689] [INFO ] [MAIN ] JBTM: Loaded 33232 existing records. [2025-10-28T19:29:47.707928] [WARN ] [MAIN ] JBTM: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:29:47.708159] [INFO ] [MAIN ] JBTM: Wiping existing primary data before full refresh. [2025-10-28T19:29:47.708206] [INFO ] [LOCAL ] JBTM: Starting deletion of primary data. [2025-10-28T19:29:47.708754] [DEBUG] [LOCAL ] JBTM: Deleted primary data file. [2025-10-28T19:29:47.708813] [INFO ] [MAIN ] JBTM: Starting full primary refresh. [2025-10-28T19:29:47.982878] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-01. [2025-10-28T19:29:48.088249] [INFO ] [REMOTE ] JBTM: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:29:48.780282] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-08. [2025-10-28T19:29:49.174153] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-03 (2.79 seconds). [2025-10-28T19:29:49.375006] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-10-28T19:29:49.580240] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-02. [2025-10-28T19:29:49.825920] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-28T19:29:50.380298] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-04. [2025-10-28T19:29:50.872764] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-10-28T19:29:51.180235] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-01. [2025-10-28T19:29:51.227554] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-28T19:29:51.980234] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-03. [2025-10-28T19:29:52.780244] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-05. [2025-10-28T19:29:53.421709] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-28T19:29:53.580248] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-09. [2025-10-28T19:29:53.603712] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-10-28T19:29:54.092583] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-01 (2.91 seconds). [2025-10-28T19:29:54.380219] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-02. [2025-10-28T19:29:54.457484] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-10-28T19:29:55.180225] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-10. [2025-10-28T19:29:55.980249] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-04. [2025-10-28T19:29:56.296410] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-10 (1.12 seconds). [2025-10-28T19:29:56.304510] [INFO ] [REMOTE ] JBI: Full fetch complete (63167 records). [2025-10-28T19:29:56.304639] [DEBUG] [VALIDATOR ] JBI: Validating primary data. [2025-10-28T19:29:56.688736] [DEBUG] [VALIDATOR ] JBI: All expected trading days are present. [2025-10-28T19:29:56.688821] [DEBUG] [VALIDATOR ] JBI: Primary data validation passed. [2025-10-28T19:29:56.689817] [INFO ] [MAIN ] JBI: Fetched primary data is valid. [2025-10-28T19:29:56.689879] [DEBUG] [LOCAL ] JBI: Saving primary data. [2025-10-28T19:29:56.691204] [DEBUG] [LOCAL ] JBI: Trimmed 63167 records to 42038 (keeping 200 days of data) [2025-10-28T19:29:56.787937] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-06. [2025-10-28T19:29:56.928633] [DEBUG] [LOCAL ] JBI: Primary data saved (42038 records). [2025-10-28T19:29:56.928787] [INFO ] [MAIN ] JBI: Full history saved. [2025-10-28T19:29:56.928866] [INFO ] [MAIN ] Update Progress: 1143/2366 symbols completed. JBI took 27.7s. Estimated remaining: 2h 40m 23s. Rate: 7.6 symbols/min [2025-10-28T19:29:57.097599] [INFO ] [MAIN ] JCE: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:29:57.105563] [DEBUG] [LOCAL ] JCE: Loaded 7116 existing records from primary storage. [2025-10-28T19:29:57.105774] [INFO ] [MAIN ] JCE: Loaded 7116 existing records. [2025-10-28T19:29:57.235557] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-02 (2.86 seconds). [2025-10-28T19:29:57.316922] [WARN ] [MAIN ] JCE: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:29:57.317232] [INFO ] [MAIN ] JCE: Wiping existing primary data before full refresh. [2025-10-28T19:29:57.317410] [INFO ] [LOCAL ] JCE: Starting deletion of primary data. [2025-10-28T19:29:57.317781] [DEBUG] [LOCAL ] JCE: Deleted primary data file. [2025-10-28T19:29:57.317841] [INFO ] [MAIN ] JCE: Starting full primary refresh. [2025-10-28T19:29:57.591520] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-03. [2025-10-28T19:29:57.681903] [INFO ] [REMOTE ] JCE: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:29:57.709037] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-10-28T19:29:58.380257] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-01. [2025-10-28T19:29:58.485369] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-28T19:29:58.801227] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-10-28T19:29:59.180253] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-04. [2025-10-28T19:29:59.553636] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-06 (2.77 seconds). [2025-10-28T19:29:59.980315] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-05. [2025-10-28T19:30:00.025531] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-10-28T19:30:00.780255] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-07. [2025-10-28T19:30:01.541094] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-28T19:30:01.580204] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-02. [2025-10-28T19:30:01.946372] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-10-28T19:30:02.380333] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-03. [2025-10-28T19:30:02.805829] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-28T19:30:03.180242] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-05. [2025-10-28T19:30:03.976630] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-05 (4.00 seconds). [2025-10-28T19:30:03.985626] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-04. [2025-10-28T19:30:04.112432] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-28T19:30:04.543555] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-10-28T19:30:04.780271] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-08. [2025-10-28T19:30:05.580282] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-06. [2025-10-28T19:30:05.683774] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-10-28T19:30:06.380255] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-09. [2025-10-28T19:30:06.534672] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-10-28T19:30:07.180272] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-05. [2025-10-28T19:30:07.376692] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-28T19:30:07.566584] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-10-28T19:30:07.980287] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-07. [2025-10-28T19:30:08.780288] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-06. [2025-10-28T19:30:09.009013] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-28T19:30:09.580238] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-10. [2025-10-28T19:30:09.667513] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-10-28T19:30:10.380386] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-08. [2025-10-28T19:30:10.690486] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-28T19:30:10.697697] [INFO ] [REMOTE ] JBND: Full fetch complete (36697 records). [2025-10-28T19:30:10.697777] [DEBUG] [VALIDATOR ] JBND: Validating primary data. [2025-10-28T19:30:11.070530] [DEBUG] [VALIDATOR ] JBND: All expected trading days are present. [2025-10-28T19:30:11.070605] [DEBUG] [VALIDATOR ] JBND: Primary data validation passed. [2025-10-28T19:30:11.071288] [INFO ] [MAIN ] JBND: Fetched primary data is valid. [2025-10-28T19:30:11.071347] [DEBUG] [LOCAL ] JBND: Saving primary data. [2025-10-28T19:30:11.072138] [DEBUG] [LOCAL ] JBND: Trimmed 36697 records to 27536 (keeping 200 days of data) [2025-10-28T19:30:11.183698] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-07. [2025-10-28T19:30:11.236854] [DEBUG] [LOCAL ] JBND: Primary data saved (27536 records). [2025-10-28T19:30:11.237004] [INFO ] [MAIN ] JBND: Full history saved. [2025-10-28T19:30:11.237243] [INFO ] [MAIN ] Update Progress: 1144/2366 symbols completed. JBND took 28.1s. Estimated remaining: 2h 40m 22s. Rate: 7.6 symbols/min [2025-10-28T19:30:11.410149] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-28T19:30:11.434764] [INFO ] [MAIN ] JCI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:30:11.488119] [DEBUG] [LOCAL ] JCI: Loaded 53513 existing records from primary storage. [2025-10-28T19:30:11.488473] [INFO ] [MAIN ] JCI: Loaded 53513 existing records. [2025-10-28T19:30:11.660900] [WARN ] [MAIN ] JCI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:30:11.661113] [INFO ] [MAIN ] JCI: Wiping existing primary data before full refresh. [2025-10-28T19:30:11.661159] [INFO ] [LOCAL ] JCI: Starting deletion of primary data. [2025-10-28T19:30:11.661792] [DEBUG] [LOCAL ] JCI: Deleted primary data file. [2025-10-28T19:30:11.661849] [INFO ] [MAIN ] JCI: Starting full primary refresh. [2025-10-28T19:30:11.982525] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-09. [2025-10-28T19:30:12.012046] [INFO ] [REMOTE ] JCI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:30:12.248998] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-10-28T19:30:12.780299] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-06. [2025-10-28T19:30:13.580325] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-01. [2025-10-28T19:30:13.956278] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-28T19:30:14.380233] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-07. [2025-10-28T19:30:14.432394] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-09 (2.45 seconds). [2025-10-28T19:30:15.180333] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-08. [2025-10-28T19:30:15.634699] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-28T19:30:15.796193] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-28T19:30:15.980291] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-10. [2025-10-28T19:30:16.758350] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-01 (3.18 seconds). [2025-10-28T19:30:16.780228] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-02. [2025-10-28T19:30:17.580346] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-08. [2025-10-28T19:30:17.965042] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-28T19:30:18.380266] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-03. [2025-10-28T19:30:18.861564] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-28T19:30:19.180276] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-09. [2025-10-28T19:30:19.466193] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-10 (3.49 seconds). [2025-10-28T19:30:19.474747] [INFO ] [REMOTE ] JBTM: Full fetch complete (46913 records). [2025-10-28T19:30:19.474967] [DEBUG] [VALIDATOR ] JBTM: Validating primary data. [2025-10-28T19:30:19.813545] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-10-28T19:30:19.913155] [DEBUG] [VALIDATOR ] JBTM: All expected trading days are present. [2025-10-28T19:30:19.913407] [DEBUG] [VALIDATOR ] JBTM: Primary data validation passed. [2025-10-28T19:30:19.914920] [INFO ] [MAIN ] JBTM: Fetched primary data is valid. [2025-10-28T19:30:19.915001] [DEBUG] [LOCAL ] JBTM: Saving primary data. [2025-10-28T19:30:19.946912] [DEBUG] [LOCAL ] JBTM: Trimmed 46913 records to 33118 (keeping 200 days of data) [2025-10-28T19:30:19.948341] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-10-28T19:30:20.016577] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-04. [2025-10-28T19:30:20.191324] [DEBUG] [LOCAL ] JBTM: Primary data saved (33118 records). [2025-10-28T19:30:20.191509] [INFO ] [MAIN ] JBTM: Full history saved. [2025-10-28T19:30:20.191607] [INFO ] [MAIN ] Update Progress: 1145/2366 symbols completed. JBTM took 32.9s. Estimated remaining: 2h 40m 16s. Rate: 7.6 symbols/min [2025-10-28T19:30:20.368547] [INFO ] [MAIN ] JEF: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:30:20.419193] [DEBUG] [LOCAL ] JEF: Loaded 50159 existing records from primary storage. [2025-10-28T19:30:20.419595] [INFO ] [MAIN ] JEF: Loaded 50159 existing records. [2025-10-28T19:30:20.596369] [WARN ] [MAIN ] JEF: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:30:20.596683] [INFO ] [MAIN ] JEF: Wiping existing primary data before full refresh. [2025-10-28T19:30:20.596749] [INFO ] [LOCAL ] JEF: Starting deletion of primary data. [2025-10-28T19:30:20.597426] [DEBUG] [LOCAL ] JEF: Deleted primary data file. [2025-10-28T19:30:20.597488] [INFO ] [MAIN ] JEF: Starting full primary refresh. [2025-10-28T19:30:20.787540] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-09. [2025-10-28T19:30:20.966392] [INFO ] [REMOTE ] JEF: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:30:21.588933] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-10. [2025-10-28T19:30:21.594425] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-28T19:30:22.123694] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-10-28T19:30:22.270118] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-10 (0.68 seconds). [2025-10-28T19:30:22.272629] [INFO ] [REMOTE ] JCE: Full fetch complete (9591 records). [2025-10-28T19:30:22.272731] [DEBUG] [VALIDATOR ] JCE: Validating primary data. [2025-10-28T19:30:22.385421] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-05. [2025-10-28T19:30:22.658909] [DEBUG] [VALIDATOR ] JCE: All expected trading days are present. [2025-10-28T19:30:22.658997] [DEBUG] [VALIDATOR ] JCE: Primary data validation passed. [2025-10-28T19:30:22.659252] [INFO ] [MAIN ] JCE: Fetched primary data is valid. [2025-10-28T19:30:22.659295] [DEBUG] [LOCAL ] JCE: Saving primary data. [2025-10-28T19:30:22.659889] [DEBUG] [LOCAL ] JCE: Trimmed 9591 records to 7103 (keeping 200 days of data) [2025-10-28T19:30:22.707125] [DEBUG] [LOCAL ] JCE: Primary data saved (7103 records). [2025-10-28T19:30:22.707244] [INFO ] [MAIN ] JCE: Full history saved. [2025-10-28T19:30:22.707319] [INFO ] [MAIN ] Update Progress: 1146/2366 symbols completed. JCE took 25.8s. Estimated remaining: 2h 40m 2s. Rate: 7.6 symbols/min [2025-10-28T19:30:22.871133] [INFO ] [MAIN ] JELD: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:30:22.908700] [DEBUG] [LOCAL ] JELD: Loaded 45579 existing records from primary storage. [2025-10-28T19:30:22.908974] [INFO ] [MAIN ] JELD: Loaded 45579 existing records. [2025-10-28T19:30:23.083547] [WARN ] [MAIN ] JELD: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:30:23.083765] [INFO ] [MAIN ] JELD: Wiping existing primary data before full refresh. [2025-10-28T19:30:23.083812] [INFO ] [LOCAL ] JELD: Starting deletion of primary data. [2025-10-28T19:30:23.084535] [DEBUG] [LOCAL ] JELD: Deleted primary data file. [2025-10-28T19:30:23.084591] [INFO ] [MAIN ] JELD: Starting full primary refresh. [2025-10-28T19:30:23.183068] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-10. [2025-10-28T19:30:23.431138] [INFO ] [REMOTE ] JELD: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:30:23.742555] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-28T19:30:23.980235] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-01. [2025-10-28T19:30:24.780261] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-01. [2025-10-28T19:30:25.592349] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-06. [2025-10-28T19:30:25.821762] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-28T19:30:26.380303] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-02. [2025-10-28T19:30:27.324250] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-10-28T19:30:27.333364] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-03. [2025-10-28T19:30:28.479370] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-10-28T19:30:28.490044] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-04. [2025-10-28T19:30:29.649934] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-28T19:30:29.660421] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-05. [2025-10-28T19:30:29.729553] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-10 (6.55 seconds). [2025-10-28T19:30:29.740486] [INFO ] [REMOTE ] JBL: Full fetch complete (70535 records). [2025-10-28T19:30:29.740698] [DEBUG] [VALIDATOR ] JBL: Validating primary data. [2025-10-28T19:30:30.155552] [DEBUG] [VALIDATOR ] JBL: All expected trading days are present. [2025-10-28T19:30:30.155627] [DEBUG] [VALIDATOR ] JBL: Primary data validation passed. [2025-10-28T19:30:30.156740] [INFO ] [MAIN ] JBL: Fetched primary data is valid. [2025-10-28T19:30:30.156816] [DEBUG] [LOCAL ] JBL: Saving primary data. [2025-10-28T19:30:30.158169] [DEBUG] [LOCAL ] JBL: Trimmed 70535 records to 48163 (keeping 200 days of data) [2025-10-28T19:30:30.449717] [DEBUG] [LOCAL ] JBL: Primary data saved (48163 records). [2025-10-28T19:30:30.449824] [INFO ] [MAIN ] JBL: Full history saved. [2025-10-28T19:30:30.450537] [INFO ] [MAIN ] Update Progress: 1147/2366 symbols completed. JBL took 49.9s. Estimated remaining: 2h 39m 54s. Rate: 7.6 symbols/min [2025-10-28T19:30:30.620731] [INFO ] [MAIN ] JFR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:30:30.650965] [DEBUG] [LOCAL ] JFR: Loaded 30827 existing records from primary storage. [2025-10-28T19:30:30.651216] [INFO ] [MAIN ] JFR: Loaded 30827 existing records. [2025-10-28T19:30:30.839229] [WARN ] [MAIN ] JFR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:30:30.839835] [INFO ] [MAIN ] JFR: Wiping existing primary data before full refresh. [2025-10-28T19:30:30.839991] [INFO ] [LOCAL ] JFR: Starting deletion of primary data. [2025-10-28T19:30:30.840631] [DEBUG] [LOCAL ] JFR: Deleted primary data file. [2025-10-28T19:30:30.840761] [INFO ] [MAIN ] JFR: Starting full primary refresh. [2025-10-28T19:30:31.054233] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-28T19:30:31.148945] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-06. [2025-10-28T19:30:31.247510] [INFO ] [REMOTE ] JFR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:30:31.247884] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-01. [2025-10-28T19:30:32.212493] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-28T19:30:32.251944] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-28T19:30:32.249960] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-07. [2025-10-28T19:30:32.260798] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-02. [2025-10-28T19:30:33.401019] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-28T19:30:33.411019] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-08. [2025-10-28T19:30:34.626666] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-28T19:30:34.636709] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-09. [2025-10-28T19:30:35.686753] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-28T19:30:35.696593] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-10. [2025-10-28T19:30:35.978139] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-01 (12.00 seconds). [2025-10-28T19:30:35.988444] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-02. [2025-10-28T19:30:36.927434] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-10 (1.23 seconds). [2025-10-28T19:30:36.936553] [INFO ] [REMOTE ] JELD: Full fetch complete (64533 records). [2025-10-28T19:30:36.936761] [DEBUG] [VALIDATOR ] JELD: Validating primary data. [2025-10-28T19:30:37.337931] [DEBUG] [VALIDATOR ] JELD: All expected trading days are present. [2025-10-28T19:30:37.338037] [DEBUG] [VALIDATOR ] JELD: Primary data validation passed. [2025-10-28T19:30:37.339144] [INFO ] [MAIN ] JELD: Fetched primary data is valid. [2025-10-28T19:30:37.339253] [DEBUG] [LOCAL ] JELD: Saving primary data. [2025-10-28T19:30:37.340902] [DEBUG] [LOCAL ] JELD: Trimmed 64533 records to 45524 (keeping 200 days of data) [2025-10-28T19:30:37.524369] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-28T19:30:37.575724] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-03. [2025-10-28T19:30:37.635878] [DEBUG] [LOCAL ] JELD: Primary data saved (45524 records). [2025-10-28T19:30:37.636030] [INFO ] [MAIN ] JELD: Full history saved. [2025-10-28T19:30:37.636130] [INFO ] [MAIN ] Update Progress: 1148/2366 symbols completed. JELD took 14.9s. Estimated remaining: 2h 39m 46s. Rate: 7.6 symbols/min [2025-10-28T19:30:37.808768] [INFO ] [MAIN ] JGH: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:30:37.821056] [DEBUG] [LOCAL ] JGH: Loaded 12378 existing records from primary storage. [2025-10-28T19:30:37.821309] [INFO ] [MAIN ] JGH: Loaded 12378 existing records. [2025-10-28T19:30:38.003404] [WARN ] [MAIN ] JGH: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:30:38.003629] [INFO ] [MAIN ] JGH: Wiping existing primary data before full refresh. [2025-10-28T19:30:38.003723] [INFO ] [LOCAL ] JGH: Starting deletion of primary data. [2025-10-28T19:30:38.004086] [DEBUG] [LOCAL ] JGH: Deleted primary data file. [2025-10-28T19:30:38.004147] [INFO ] [MAIN ] JGH: Starting full primary refresh. [2025-10-28T19:30:38.368995] [INFO ] [REMOTE ] JGH: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:30:38.369273] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-01. [2025-10-28T19:30:38.911377] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-28T19:30:38.913437] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-28T19:30:38.916302] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-02. [2025-10-28T19:30:38.928172] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-04. [2025-10-28T19:30:39.350714] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-28T19:30:39.352333] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-06 (13.76 seconds). [2025-10-28T19:30:39.355057] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-03. [2025-10-28T19:30:39.907899] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-10-28T19:30:39.980203] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-04. [2025-10-28T19:30:40.143193] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-10-28T19:30:40.500313] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-28T19:30:40.780254] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-07. [2025-10-28T19:30:41.580238] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-05. [2025-10-28T19:30:42.116753] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-10-28T19:30:42.380229] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-05. [2025-10-28T19:30:42.447405] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-02 (10.19 seconds). [2025-10-28T19:30:43.180289] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-08. [2025-10-28T19:30:43.307229] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-28T19:30:43.980261] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-03. [2025-10-28T19:30:44.780224] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-06. [2025-10-28T19:30:45.061736] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-28T19:30:45.260618] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-28T19:30:45.580274] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-04. [2025-10-28T19:30:45.894958] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-05 (4.31 seconds). [2025-10-28T19:30:46.380369] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-06. [2025-10-28T19:30:47.180327] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-07. [2025-10-28T19:30:47.725145] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-28T19:30:47.756756] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-10-28T19:30:47.980271] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-07. [2025-10-28T19:30:48.780275] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-08. [2025-10-28T19:30:49.206638] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-28T19:30:49.351406] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-28T19:30:49.580260] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-08. [2025-10-28T19:30:49.809719] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-08 (6.63 seconds). [2025-10-28T19:30:50.380298] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-09. [2025-10-28T19:30:50.927061] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-28T19:30:50.959066] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-10-28T19:30:51.180209] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-10. [2025-10-28T19:30:51.980272] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-09. [2025-10-28T19:30:52.068540] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-10 (0.89 seconds). [2025-10-28T19:30:52.073123] [INFO ] [REMOTE ] JGH: Full fetch complete (16464 records). [2025-10-28T19:30:52.073199] [DEBUG] [VALIDATOR ] JGH: Validating primary data. [2025-10-28T19:30:52.444095] [DEBUG] [VALIDATOR ] JGH: All expected trading days are present. [2025-10-28T19:30:52.444166] [DEBUG] [VALIDATOR ] JGH: Primary data validation passed. [2025-10-28T19:30:52.444519] [INFO ] [MAIN ] JGH: Fetched primary data is valid. [2025-10-28T19:30:52.444557] [DEBUG] [LOCAL ] JGH: Saving primary data. [2025-10-28T19:30:52.445073] [DEBUG] [LOCAL ] JGH: Trimmed 16464 records to 12300 (keeping 200 days of data) [2025-10-28T19:30:52.517183] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-04 (6.94 seconds). [2025-10-28T19:30:52.544438] [DEBUG] [LOCAL ] JGH: Primary data saved (12300 records). [2025-10-28T19:30:52.544544] [INFO ] [MAIN ] JGH: Full history saved. [2025-10-28T19:30:52.544619] [INFO ] [MAIN ] Update Progress: 1149/2366 symbols completed. JGH took 14.9s. Estimated remaining: 2h 39m 45s. Rate: 7.6 symbols/min [2025-10-28T19:30:52.718973] [INFO ] [MAIN ] JHG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:30:52.758037] [DEBUG] [LOCAL ] JHG: Loaded 47426 existing records from primary storage. [2025-10-28T19:30:52.758310] [INFO ] [MAIN ] JHG: Loaded 47426 existing records. [2025-10-28T19:30:52.788684] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-09. [2025-10-28T19:30:52.936992] [WARN ] [MAIN ] JHG: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:30:52.937198] [INFO ] [MAIN ] JHG: Wiping existing primary data before full refresh. [2025-10-28T19:30:52.937242] [INFO ] [LOCAL ] JHG: Starting deletion of primary data. [2025-10-28T19:30:52.938061] [DEBUG] [LOCAL ] JHG: Deleted primary data file. [2025-10-28T19:30:52.938118] [INFO ] [MAIN ] JHG: Starting full primary refresh. [2025-10-28T19:30:53.299079] [INFO ] [REMOTE ] JHG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:30:53.328974] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-10-28T19:30:53.580250] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-01. [2025-10-28T19:30:54.122348] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-28T19:30:54.380279] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-05. [2025-10-28T19:30:54.615518] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-10-28T19:30:55.180249] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-02. [2025-10-28T19:30:55.242988] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-28T19:30:55.980302] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-10. [2025-10-28T19:30:56.313252] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-28T19:30:56.780312] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-03. [2025-10-28T19:30:57.426211] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-10 (1.45 seconds). [2025-10-28T19:30:57.438456] [INFO ] [REMOTE ] JCI: Full fetch complete (77650 records). [2025-10-28T19:30:57.438759] [DEBUG] [VALIDATOR ] JCI: Validating primary data. [2025-10-28T19:30:57.588382] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-10. [2025-10-28T19:30:57.842528] [DEBUG] [VALIDATOR ] JCI: All expected trading days are present. [2025-10-28T19:30:57.842752] [DEBUG] [VALIDATOR ] JCI: Primary data validation passed. [2025-10-28T19:30:57.843954] [INFO ] [MAIN ] JCI: Fetched primary data is valid. [2025-10-28T19:30:57.844021] [DEBUG] [LOCAL ] JCI: Saving primary data. [2025-10-28T19:30:57.845491] [DEBUG] [LOCAL ] JCI: Trimmed 77650 records to 53505 (keeping 200 days of data) [2025-10-28T19:30:58.094408] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-10-28T19:30:58.219985] [DEBUG] [LOCAL ] JCI: Primary data saved (53505 records). [2025-10-28T19:30:58.220124] [INFO ] [MAIN ] JCI: Full history saved. [2025-10-28T19:30:58.220202] [INFO ] [MAIN ] Update Progress: 1150/2366 symbols completed. JCI took 47.0s. Estimated remaining: 2h 39m 35s. Rate: 7.6 symbols/min [2025-10-28T19:30:58.387222] [INFO ] [MAIN ] JHI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:30:58.385446] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-04. [2025-10-28T19:30:58.393770] [DEBUG] [LOCAL ] JHI: Loaded 4048 existing records from primary storage. [2025-10-28T19:30:58.393938] [INFO ] [MAIN ] JHI: Loaded 4048 existing records. [2025-10-28T19:30:58.568244] [WARN ] [MAIN ] JHI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:30:58.568485] [INFO ] [MAIN ] JHI: Wiping existing primary data before full refresh. [2025-10-28T19:30:58.568534] [INFO ] [LOCAL ] JHI: Starting deletion of primary data. [2025-10-28T19:30:58.568740] [DEBUG] [LOCAL ] JHI: Deleted primary data file. [2025-10-28T19:30:58.568799] [INFO ] [MAIN ] JHI: Starting full primary refresh. [2025-10-28T19:30:58.915983] [INFO ] [REMOTE ] JHI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:30:59.028338] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-28T19:30:59.038971] [INFO ] [REMOTE ] JEF: Full fetch complete (73295 records). [2025-10-28T19:30:59.039109] [DEBUG] [VALIDATOR ] JEF: Validating primary data. [2025-10-28T19:30:59.185515] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-01. [2025-10-28T19:30:59.455278] [DEBUG] [VALIDATOR ] JEF: All expected trading days are present. [2025-10-28T19:30:59.455360] [DEBUG] [VALIDATOR ] JEF: Primary data validation passed. [2025-10-28T19:30:59.456377] [INFO ] [MAIN ] JEF: Fetched primary data is valid. [2025-10-28T19:30:59.456447] [DEBUG] [LOCAL ] JEF: Saving primary data. [2025-10-28T19:30:59.457834] [DEBUG] [LOCAL ] JEF: Trimmed 73295 records to 50140 (keeping 200 days of data) [2025-10-28T19:30:59.672827] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-10-28T19:30:59.790583] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-28T19:30:59.813223] [DEBUG] [LOCAL ] JEF: Primary data saved (50140 records). [2025-10-28T19:30:59.813350] [INFO ] [MAIN ] JEF: Full history saved. [2025-10-28T19:30:59.814132] [INFO ] [MAIN ] Update Progress: 1151/2366 symbols completed. JEF took 39.6s. Estimated remaining: 2h 39m 20s. Rate: 7.6 symbols/min [2025-10-28T19:30:59.980750] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-05. [2025-10-28T19:30:59.980673] [INFO ] [MAIN ] JHS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:30:59.989477] [DEBUG] [LOCAL ] JHS: Loaded 2985 existing records from primary storage. [2025-10-28T19:30:59.989736] [INFO ] [MAIN ] JHS: Loaded 2985 existing records. [2025-10-28T19:31:00.165817] [WARN ] [MAIN ] JHS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:31:00.166111] [INFO ] [MAIN ] JHS: Wiping existing primary data before full refresh. [2025-10-28T19:31:00.166163] [INFO ] [LOCAL ] JHS: Starting deletion of primary data. [2025-10-28T19:31:00.166327] [DEBUG] [LOCAL ] JHS: Deleted primary data file. [2025-10-28T19:31:00.166366] [INFO ] [MAIN ] JHS: Starting full primary refresh. [2025-10-28T19:31:00.510638] [INFO ] [REMOTE ] JHS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:31:00.780278] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-01. [2025-10-28T19:31:01.154543] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-10-28T19:31:01.403749] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-10-28T19:31:01.580253] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-06. [2025-10-28T19:31:02.380243] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-02. [2025-10-28T19:31:02.583799] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-28T19:31:02.721824] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-10-28T19:31:03.180257] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-07. [2025-10-28T19:31:03.980222] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-03. [2025-10-28T19:31:04.128746] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-10-28T19:31:04.569568] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-28T19:31:04.780299] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-04. [2025-10-28T19:31:05.169749] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-10-28T19:31:05.580290] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-05. [2025-10-28T19:31:06.380316] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-02. [2025-10-28T19:31:06.526922] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-10-28T19:31:06.827160] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-28T19:31:07.180300] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-06. [2025-10-28T19:31:07.980252] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-08. [2025-10-28T19:31:08.247712] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-28T19:31:08.780243] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-07. [2025-10-28T19:31:09.580253] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-03. [2025-10-28T19:31:09.990242] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-28T19:31:10.380313] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-08. [2025-10-28T19:31:10.650831] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-08 (2.67 seconds). [2025-10-28T19:31:10.779709] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-28T19:31:11.180269] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-04. [2025-10-28T19:31:11.549889] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-10-28T19:31:11.579167] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-10-28T19:31:11.980257] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-09. [2025-10-28T19:31:12.780340] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-05. [2025-10-28T19:31:13.083156] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-05 (0.30 seconds). [2025-10-28T19:31:13.580237] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-09. [2025-10-28T19:31:14.380319] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-06. [2025-10-28T19:31:14.503190] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-28T19:31:14.759127] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-10-28T19:31:15.180245] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-10. [2025-10-28T19:31:15.980266] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-07. [2025-10-28T19:31:16.469010] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-28T19:31:16.476547] [INFO ] [REMOTE ] JFR: Full fetch complete (48539 records). [2025-10-28T19:31:16.476722] [DEBUG] [VALIDATOR ] JFR: Validating primary data. [2025-10-28T19:31:16.785381] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-06. [2025-10-28T19:31:16.867724] [DEBUG] [VALIDATOR ] JFR: All expected trading days are present. [2025-10-28T19:31:16.867802] [DEBUG] [VALIDATOR ] JFR: Primary data validation passed. [2025-10-28T19:31:16.868581] [INFO ] [MAIN ] JFR: Fetched primary data is valid. [2025-10-28T19:31:16.868620] [DEBUG] [LOCAL ] JFR: Saving primary data. [2025-10-28T19:31:16.869545] [DEBUG] [LOCAL ] JFR: Trimmed 48539 records to 30734 (keeping 200 days of data) [2025-10-28T19:31:17.044068] [DEBUG] [LOCAL ] JFR: Primary data saved (30734 records). [2025-10-28T19:31:17.044190] [INFO ] [MAIN ] JFR: Full history saved. [2025-10-28T19:31:17.044269] [INFO ] [MAIN ] Update Progress: 1152/2366 symbols completed. JFR took 46.6s. Estimated remaining: 2h 39m 22s. Rate: 7.6 symbols/min [2025-10-28T19:31:17.220140] [INFO ] [MAIN ] JHX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:31:17.220723] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-28T19:31:17.269608] [DEBUG] [LOCAL ] JHX: Loaded 53186 existing records from primary storage. [2025-10-28T19:31:17.269921] [INFO ] [MAIN ] JHX: Loaded 53186 existing records. [2025-10-28T19:31:17.449085] [WARN ] [MAIN ] JHX: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:31:17.449309] [INFO ] [MAIN ] JHX: Wiping existing primary data before full refresh. [2025-10-28T19:31:17.449366] [INFO ] [LOCAL ] JHX: Starting deletion of primary data. [2025-10-28T19:31:17.449910] [DEBUG] [LOCAL ] JHX: Deleted primary data file. [2025-10-28T19:31:17.449968] [INFO ] [MAIN ] JHX: Starting full primary refresh. [2025-10-28T19:31:17.595060] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-07. [2025-10-28T19:31:17.824819] [INFO ] [REMOTE ] JHX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:31:18.021718] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-10-28T19:31:18.274054] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-09 (6.29 seconds). [2025-10-28T19:31:18.380239] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-10. [2025-10-28T19:31:18.669027] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-07 (2.69 seconds). [2025-10-28T19:31:19.180274] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-08. [2025-10-28T19:31:19.517799] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-10-28T19:31:19.980263] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-09. [2025-10-28T19:31:20.342549] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-10-28T19:31:20.780298] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-10. [2025-10-28T19:31:21.481541] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-28T19:31:21.483637] [INFO ] [REMOTE ] JHI: Full fetch complete (5807 records). [2025-10-28T19:31:21.483748] [DEBUG] [VALIDATOR ] JHI: Validating primary data. [2025-10-28T19:31:21.585348] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-01. [2025-10-28T19:31:21.869681] [DEBUG] [VALIDATOR ] JHI: All expected trading days are present. [2025-10-28T19:31:21.869771] [DEBUG] [VALIDATOR ] JHI: Primary data validation passed. [2025-10-28T19:31:21.869960] [INFO ] [MAIN ] JHI: Fetched primary data is valid. [2025-10-28T19:31:21.870049] [DEBUG] [LOCAL ] JHI: Saving primary data. [2025-10-28T19:31:21.870424] [DEBUG] [LOCAL ] JHI: Trimmed 5807 records to 4056 (keeping 200 days of data) [2025-10-28T19:31:21.894426] [DEBUG] [LOCAL ] JHI: Primary data saved (4056 records). [2025-10-28T19:31:21.894523] [INFO ] [MAIN ] JHI: Full history saved. [2025-10-28T19:31:21.894600] [INFO ] [MAIN ] Update Progress: 1153/2366 symbols completed. JHI took 23.7s. Estimated remaining: 2h 39m 11s. Rate: 7.6 symbols/min [2025-10-28T19:31:22.064909] [INFO ] [MAIN ] JILL: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:31:22.081481] [DEBUG] [LOCAL ] JILL: Loaded 15011 existing records from primary storage. [2025-10-28T19:31:22.081775] [INFO ] [MAIN ] JILL: Loaded 15011 existing records. [2025-10-28T19:31:22.263975] [WARN ] [MAIN ] JILL: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:31:22.264160] [INFO ] [MAIN ] JILL: Wiping existing primary data before full refresh. [2025-10-28T19:31:22.264206] [INFO ] [LOCAL ] JILL: Starting deletion of primary data. [2025-10-28T19:31:22.264386] [DEBUG] [LOCAL ] JILL: Deleted primary data file. [2025-10-28T19:31:22.264427] [INFO ] [MAIN ] JILL: Starting full primary refresh. [2025-10-28T19:31:22.385407] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-08. [2025-10-28T19:31:22.631696] [INFO ] [REMOTE ] JILL: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:31:22.909315] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-28T19:31:23.055401] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-28T19:31:23.180250] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-01. [2025-10-28T19:31:23.524107] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-10 (5.14 seconds). [2025-10-28T19:31:23.533931] [INFO ] [REMOTE ] JHG: Full fetch complete (68828 records). [2025-10-28T19:31:23.534094] [DEBUG] [VALIDATOR ] JHG: Validating primary data. [2025-10-28T19:31:23.852154] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-28T19:31:23.950726] [DEBUG] [VALIDATOR ] JHG: All expected trading days are present. [2025-10-28T19:31:23.950802] [DEBUG] [VALIDATOR ] JHG: Primary data validation passed. [2025-10-28T19:31:23.951744] [INFO ] [MAIN ] JHG: Fetched primary data is valid. [2025-10-28T19:31:23.951803] [DEBUG] [LOCAL ] JHG: Saving primary data. [2025-10-28T19:31:23.953053] [DEBUG] [LOCAL ] JHG: Trimmed 68828 records to 47435 (keeping 200 days of data) [2025-10-28T19:31:24.004557] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-02. [2025-10-28T19:31:24.234533] [DEBUG] [LOCAL ] JHG: Primary data saved (47435 records). [2025-10-28T19:31:24.234679] [INFO ] [MAIN ] JHG: Full history saved. [2025-10-28T19:31:24.234787] [INFO ] [MAIN ] Update Progress: 1154/2366 symbols completed. JHG took 31.7s. Estimated remaining: 2h 38m 58s. Rate: 7.6 symbols/min [2025-10-28T19:31:24.407661] [INFO ] [MAIN ] JKS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:31:24.443887] [DEBUG] [LOCAL ] JKS: Loaded 38863 existing records from primary storage. [2025-10-28T19:31:24.444173] [INFO ] [MAIN ] JKS: Loaded 38863 existing records. [2025-10-28T19:31:24.627769] [WARN ] [MAIN ] JKS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:31:24.628060] [INFO ] [MAIN ] JKS: Wiping existing primary data before full refresh. [2025-10-28T19:31:24.628133] [INFO ] [LOCAL ] JKS: Starting deletion of primary data. [2025-10-28T19:31:24.634927] [DEBUG] [LOCAL ] JKS: Deleted primary data file. [2025-10-28T19:31:24.635021] [INFO ] [MAIN ] JKS: Starting full primary refresh. [2025-10-28T19:31:24.640930] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-10-28T19:31:24.789049] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-03. [2025-10-28T19:31:24.993470] [INFO ] [REMOTE ] JKS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:31:25.580280] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-01. [2025-10-28T19:31:25.593055] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-10-28T19:31:26.380263] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-09. [2025-10-28T19:31:26.688850] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-28T19:31:26.932195] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-10-28T19:31:27.180304] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-04. [2025-10-28T19:31:27.827887] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-10-28T19:31:27.980300] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-10. [2025-10-28T19:31:28.318014] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-10 (0.34 seconds). [2025-10-28T19:31:28.319237] [INFO ] [REMOTE ] JHS: Full fetch complete (4581 records). [2025-10-28T19:31:28.319304] [DEBUG] [VALIDATOR ] JHS: Validating primary data. [2025-10-28T19:31:28.674742] [DEBUG] [VALIDATOR ] JHS: All expected trading days are present. [2025-10-28T19:31:28.674830] [DEBUG] [VALIDATOR ] JHS: Primary data validation passed. [2025-10-28T19:31:28.675007] [INFO ] [MAIN ] JHS: Fetched primary data is valid. [2025-10-28T19:31:28.675068] [DEBUG] [LOCAL ] JHS: Saving primary data. [2025-10-28T19:31:28.675414] [DEBUG] [LOCAL ] JHS: Trimmed 4581 records to 2960 (keeping 200 days of data) [2025-10-28T19:31:28.692772] [DEBUG] [LOCAL ] JHS: Primary data saved (2960 records). [2025-10-28T19:31:28.692841] [INFO ] [MAIN ] JHS: Full history saved. [2025-10-28T19:31:28.692907] [INFO ] [MAIN ] Update Progress: 1155/2366 symbols completed. JHS took 28.9s. Estimated remaining: 2h 38m 46s. Rate: 7.6 symbols/min [2025-10-28T19:31:28.788028] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-02. [2025-10-28T19:31:28.861334] [INFO ] [MAIN ] JLL: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:31:28.893316] [DEBUG] [LOCAL ] JLL: Loaded 31094 existing records from primary storage. [2025-10-28T19:31:28.893560] [INFO ] [MAIN ] JLL: Loaded 31094 existing records. [2025-10-28T19:31:29.067449] [WARN ] [MAIN ] JLL: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:31:29.067724] [INFO ] [MAIN ] JLL: Wiping existing primary data before full refresh. [2025-10-28T19:31:29.067785] [INFO ] [LOCAL ] JLL: Starting deletion of primary data. [2025-10-28T19:31:29.068153] [DEBUG] [LOCAL ] JLL: Deleted primary data file. [2025-10-28T19:31:29.068211] [INFO ] [MAIN ] JLL: Starting full primary refresh. [2025-10-28T19:31:29.415900] [INFO ] [REMOTE ] JLL: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:31:29.580221] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-02. [2025-10-28T19:31:30.133124] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-10-28T19:31:30.380236] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-05. [2025-10-28T19:31:31.180215] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-01. [2025-10-28T19:31:31.980215] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-03. [2025-10-28T19:31:32.020679] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-28T19:31:32.716406] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-02 (3.93 seconds). [2025-10-28T19:31:32.780228] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-03. [2025-10-28T19:31:32.821721] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-10-28T19:31:33.580258] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-02. [2025-10-28T19:31:33.867802] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-28T19:31:33.918489] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-05 (3.54 seconds). [2025-10-28T19:31:34.380218] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-06. [2025-10-28T19:31:34.564725] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-28T19:31:35.075879] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-28T19:31:35.180211] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-07. [2025-10-28T19:31:35.848853] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-28T19:31:35.980239] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-08. [2025-10-28T19:31:36.577811] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-28T19:31:36.780248] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-09. [2025-10-28T19:31:37.419376] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-28T19:31:37.580239] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-10. [2025-10-28T19:31:38.351101] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-28T19:31:38.354029] [INFO ] [REMOTE ] JILL: Full fetch complete (22259 records). [2025-10-28T19:31:38.354104] [DEBUG] [VALIDATOR ] JILL: Validating primary data. [2025-10-28T19:31:38.385292] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-04. [2025-10-28T19:31:38.715730] [DEBUG] [VALIDATOR ] JILL: All expected trading days are present. [2025-10-28T19:31:38.716386] [DEBUG] [VALIDATOR ] JILL: Primary data validation passed. [2025-10-28T19:31:38.716905] [INFO ] [MAIN ] JILL: Fetched primary data is valid. [2025-10-28T19:31:38.716965] [DEBUG] [LOCAL ] JILL: Saving primary data. [2025-10-28T19:31:38.717565] [DEBUG] [LOCAL ] JILL: Trimmed 22259 records to 14956 (keeping 200 days of data) [2025-10-28T19:31:38.805940] [DEBUG] [LOCAL ] JILL: Primary data saved (14956 records). [2025-10-28T19:31:38.806107] [INFO ] [MAIN ] JILL: Full history saved. [2025-10-28T19:31:38.806190] [INFO ] [MAIN ] Update Progress: 1156/2366 symbols completed. JILL took 16.9s. Estimated remaining: 2h 38m 41s. Rate: 7.6 symbols/min [2025-10-28T19:31:38.973803] [INFO ] [MAIN ] JLS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:31:38.980411] [DEBUG] [LOCAL ] JLS: Loaded 3941 existing records from primary storage. [2025-10-28T19:31:38.980564] [INFO ] [MAIN ] JLS: Loaded 3941 existing records. [2025-10-28T19:31:39.152236] [WARN ] [MAIN ] JLS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:31:39.152462] [INFO ] [MAIN ] JLS: Wiping existing primary data before full refresh. [2025-10-28T19:31:39.152510] [INFO ] [LOCAL ] JLS: Starting deletion of primary data. [2025-10-28T19:31:39.152905] [DEBUG] [LOCAL ] JLS: Deleted primary data file. [2025-10-28T19:31:39.152962] [INFO ] [MAIN ] JLS: Starting full primary refresh. [2025-10-28T19:31:39.185394] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-04. [2025-10-28T19:31:39.515055] [INFO ] [REMOTE ] JLS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:31:39.628445] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-10-28T19:31:39.980269] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-03. [2025-10-28T19:31:40.522582] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-28T19:31:40.748706] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-10-28T19:31:40.780307] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-01. [2025-10-28T19:31:41.169533] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-10-28T19:31:41.580278] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-04. [2025-10-28T19:31:42.380242] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-05. [2025-10-28T19:31:42.775134] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-28T19:31:43.180252] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-05. [2025-10-28T19:31:43.438417] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-28T19:31:43.980309] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-02. [2025-10-28T19:31:44.235451] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-28T19:31:44.356541] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-10-28T19:31:44.780315] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-03. [2025-10-28T19:31:45.418016] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-10-28T19:31:45.580280] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-05. [2025-10-28T19:31:46.380316] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-04. [2025-10-28T19:31:46.788183] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-10-28T19:31:46.934143] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-10-28T19:31:47.180316] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-05. [2025-10-28T19:31:47.238709] [DEBUG] [REMOTE ] JLS: Error fetching primary data for 2025-05: 'API call returned an empty response.' [2025-10-28T19:31:47.239068] [WARN ] [REMOTE ] JLS: No data returned for month 2025-05 [2025-10-28T19:31:47.239158] [FATAL] [REMOTE ] JLS: API call failed - aborting fetch to avoid wasting further API calls [2025-10-28T19:31:47.239230] [FATAL] [MAIN ] JLS: Failed to fetch primary data. [2025-10-28T19:31:47.239292] [WARN ] [MAIN ] JLS: Deleting existing primary and derivative data due to fetch failure. [2025-10-28T19:31:47.239366] [INFO ] [LOCAL ] JLS: Starting deletion of primary data. [2025-10-28T19:31:47.239428] [DEBUG] [LOCAL ] JLS: No primary data file found to delete. [2025-10-28T19:31:47.239464] [INFO ] [LOCAL ] JLS: Starting deletion of derivative data. [2025-10-28T19:31:47.239618] [DEBUG] [LOCAL ] JLS: Deleted derivative data file. [2025-10-28T19:31:47.239732] [INFO ] [MAIN ] Update Progress: 1157/2366 symbols completed. JLS took 8.4s. Estimated remaining: 2h 38m 33s. Rate: 7.6 symbols/min [2025-10-28T19:31:47.980223] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-06. [2025-10-28T19:31:48.780318] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-06. [2025-10-28T19:31:49.580255] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-06. [2025-10-28T19:31:50.591409] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-28T19:31:50.598382] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-07. [2025-10-28T19:31:56.163139] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-06 (8.18 seconds). [2025-10-28T19:31:56.173879] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-07. [2025-10-28T19:31:57.587000] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-28T19:31:57.599515] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-08. [2025-10-28T19:31:58.717626] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-06 (9.94 seconds). [2025-10-28T19:31:58.726595] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-07. [2025-10-28T19:31:59.094967] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-28T19:31:59.108044] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-09. [2025-10-28T19:31:59.931801] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-10-28T19:31:59.941187] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-08. [2025-10-28T19:32:00.500059] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-28T19:32:00.511355] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-10. [2025-10-28T19:32:01.189099] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-07 (10.59 seconds). [2025-10-28T19:32:01.196447] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-08. [2025-10-28T19:32:02.275188] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-28T19:32:02.284815] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-09. [2025-10-28T19:32:03.224344] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-28T19:32:03.234624] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-10. [2025-10-28T19:32:04.503893] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-08 (4.56 seconds). [2025-10-28T19:32:04.512697] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-09. [2025-10-28T19:32:05.591590] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-28T19:32:05.602415] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-10. [2025-10-28T19:32:06.269266] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-10 (3.03 seconds). [2025-10-28T19:32:06.274765] [INFO ] [REMOTE ] JLL: Full fetch complete (44936 records). [2025-10-28T19:32:06.274880] [DEBUG] [VALIDATOR ] JLL: Validating primary data. [2025-10-28T19:32:06.657918] [DEBUG] [VALIDATOR ] JLL: All expected trading days are present. [2025-10-28T19:32:06.658017] [DEBUG] [VALIDATOR ] JLL: Primary data validation passed. [2025-10-28T19:32:06.658962] [INFO ] [MAIN ] JLL: Fetched primary data is valid. [2025-10-28T19:32:06.659050] [DEBUG] [LOCAL ] JLL: Saving primary data. [2025-10-28T19:32:06.660247] [DEBUG] [LOCAL ] JLL: Trimmed 44936 records to 30962 (keeping 200 days of data) [2025-10-28T19:32:06.859850] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-10 (1.26 seconds). [2025-10-28T19:32:06.870880] [INFO ] [REMOTE ] JKS: Full fetch complete (58426 records). [2025-10-28T19:32:06.881938] [DEBUG] [VALIDATOR ] JKS: Validating primary data. [2025-10-28T19:32:06.881839] [DEBUG] [LOCAL ] JLL: Primary data saved (30962 records). [2025-10-28T19:32:06.882242] [INFO ] [MAIN ] JLL: Full history saved. [2025-10-28T19:32:06.882429] [INFO ] [MAIN ] Update Progress: 1158/2366 symbols completed. JLL took 38.2s. Estimated remaining: 2h 38m 38s. Rate: 7.6 symbols/min [2025-10-28T19:32:07.290943] [DEBUG] [VALIDATOR ] JKS: All expected trading days are present. [2025-10-28T19:32:07.291023] [DEBUG] [VALIDATOR ] JKS: Primary data validation passed. [2025-10-28T19:32:07.291919] [INFO ] [MAIN ] JKS: Fetched primary data is valid. [2025-10-28T19:32:07.291985] [DEBUG] [LOCAL ] JKS: Saving primary data. [2025-10-28T19:32:07.293204] [DEBUG] [LOCAL ] JKS: Trimmed 58426 records to 38705 (keeping 200 days of data) [2025-10-28T19:32:07.522422] [DEBUG] [LOCAL ] JKS: Primary data saved (38705 records). [2025-10-28T19:32:07.522564] [INFO ] [MAIN ] JKS: Full history saved. [2025-10-28T19:32:07.522665] [INFO ] [MAIN ] Update Progress: 1159/2366 symbols completed. JKS took 43.3s. Estimated remaining: 2h 38m 22s. Rate: 7.6 symbols/min [2025-10-28T19:32:10.385486] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-10 (9.87 seconds). [2025-10-28T19:32:10.396928] [INFO ] [REMOTE ] JHX: Full fetch complete (63700 records). [2025-10-28T19:32:10.397108] [DEBUG] [VALIDATOR ] JHX: Validating primary data. [2025-10-28T19:32:10.849331] [DEBUG] [VALIDATOR ] JHX: All expected trading days are present. [2025-10-28T19:32:10.849444] [DEBUG] [VALIDATOR ] JHX: Primary data validation passed. [2025-10-28T19:32:10.850593] [INFO ] [MAIN ] JHX: Fetched primary data is valid. [2025-10-28T19:32:10.850681] [DEBUG] [LOCAL ] JHX: Saving primary data. [2025-10-28T19:32:10.852172] [DEBUG] [LOCAL ] JHX: Trimmed 63700 records to 53186 (keeping 200 days of data) [2025-10-28T19:32:11.188465] [DEBUG] [LOCAL ] JHX: Primary data saved (53186 records). [2025-10-28T19:32:11.188595] [INFO ] [MAIN ] JHX: Full history saved. [2025-10-28T19:32:11.188695] [INFO ] [MAIN ] Update Progress: 1160/2366 symbols completed. JHX took 54.1s. Estimated remaining: 2h 38m 10s. Rate: 7.6 symbols/min [2025-10-28T19:32:11.800594] [INFO ] [MAIN ] JOBY: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:32:11.981516] [INFO ] [MAIN ] JMIA: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:32:11.979840] [INFO ] [MAIN ] JNJ: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:32:11.984013] [INFO ] [MAIN ] JMM: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:32:11.984693] [DEBUG] [LOCAL ] JMM: No existing data file found in primary storage. [2025-10-28T19:32:11.984845] [WARN ] [MAIN ] JMM: No existing data found, performing full refresh instead. [2025-10-28T19:32:11.985057] [INFO ] [MAIN ] JMM: Wiping existing primary data before full refresh. [2025-10-28T19:32:11.985106] [INFO ] [LOCAL ] JMM: Starting deletion of primary data. [2025-10-28T19:32:11.985148] [DEBUG] [LOCAL ] JMM: No primary data file found to delete. [2025-10-28T19:32:11.985179] [INFO ] [MAIN ] JMM: Starting full primary refresh. [2025-10-28T19:32:12.331828] [DEBUG] [LOCAL ] JOBY: Loaded 53809 existing records from primary storage. [2025-10-28T19:32:12.345302] [INFO ] [MAIN ] JOBY: Loaded 53809 existing records. [2025-10-28T19:32:12.406362] [DEBUG] [LOCAL ] JMIA: Loaded 51192 existing records from primary storage. [2025-10-28T19:32:12.448679] [INFO ] [MAIN ] JMIA: Loaded 51192 existing records. [2025-10-28T19:32:12.589438] [DEBUG] [LOCAL ] JNJ: Loaded 53753 existing records from primary storage. [2025-10-28T19:32:12.543751] [INFO ] [REMOTE ] JMM: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:32:12.651985] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-01. [2025-10-28T19:32:12.652139] [INFO ] [MAIN ] JNJ: Loaded 53753 existing records. [2025-10-28T19:32:12.817318] [WARN ] [MAIN ] JOBY: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:32:12.919116] [WARN ] [MAIN ] JMIA: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:32:12.916041] [INFO ] [MAIN ] JOBY: Wiping existing primary data before full refresh. [2025-10-28T19:32:12.941773] [INFO ] [MAIN ] JMIA: Wiping existing primary data before full refresh. [2025-10-28T19:32:12.941873] [INFO ] [LOCAL ] JMIA: Starting deletion of primary data. [2025-10-28T19:32:12.947033] [INFO ] [LOCAL ] JOBY: Starting deletion of primary data. [2025-10-28T19:32:12.968709] [DEBUG] [LOCAL ] JMIA: Deleted primary data file. [2025-10-28T19:32:12.958409] [DEBUG] [LOCAL ] JOBY: Deleted primary data file. [2025-10-28T19:32:12.974053] [INFO ] [MAIN ] JOBY: Starting full primary refresh. [2025-10-28T19:32:12.973990] [INFO ] [MAIN ] JMIA: Starting full primary refresh. [2025-10-28T19:32:13.207711] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-10-28T19:32:13.299689] [WARN ] [MAIN ] JNJ: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:32:13.311532] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-02. [2025-10-28T19:32:13.311850] [INFO ] [MAIN ] JNJ: Wiping existing primary data before full refresh. [2025-10-28T19:32:13.322704] [INFO ] [LOCAL ] JNJ: Starting deletion of primary data. [2025-10-28T19:32:13.475600] [DEBUG] [LOCAL ] JNJ: Deleted primary data file. [2025-10-28T19:32:13.480923] [INFO ] [MAIN ] JNJ: Starting full primary refresh. [2025-10-28T19:32:13.779497] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-28T19:32:13.805114] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-03. [2025-10-28T19:32:13.957349] [INFO ] [REMOTE ] JOBY: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:32:13.971182] [INFO ] [REMOTE ] JMIA: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:32:13.992508] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-01. [2025-10-28T19:32:13.993059] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-01. [2025-10-28T19:32:14.230199] [INFO ] [REMOTE ] JNJ: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:32:14.233957] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-01. [2025-10-28T19:32:14.234159] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-28T19:32:14.236384] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-04. [2025-10-28T19:32:14.559558] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-04 (0.32 seconds). [2025-10-28T19:32:14.560665] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-05. [2025-10-28T19:32:14.850244] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-05 (0.29 seconds). [2025-10-28T19:32:14.851572] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-06. [2025-10-28T19:32:15.138846] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-06 (0.29 seconds). [2025-10-28T19:32:15.140133] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-07. [2025-10-28T19:32:15.367502] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-28T19:32:15.377313] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-02. [2025-10-28T19:32:15.710125] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-10-28T19:32:15.711381] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-08. [2025-10-28T19:32:16.081596] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-10-28T19:32:16.082993] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-09. [2025-10-28T19:32:16.084285] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-10-28T19:32:16.096260] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-02. [2025-10-28T19:32:16.299800] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-01 (2.31 seconds). [2025-10-28T19:32:16.310051] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-02. [2025-10-28T19:32:16.381833] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-09 (0.30 seconds). [2025-10-28T19:32:16.382850] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-10. [2025-10-28T19:32:16.541011] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-28T19:32:16.550566] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-03. [2025-10-28T19:32:16.792087] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-10 (0.41 seconds). [2025-10-28T19:32:16.792913] [INFO ] [REMOTE ] JMM: Full fetch complete (2325 records). [2025-10-28T19:32:16.792979] [DEBUG] [VALIDATOR ] JMM: Validating primary data. [2025-10-28T19:32:16.966387] [WARN ] [VALIDATOR ] JMM: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-10-28T19:32:16.966566] [FATAL] [MAIN ] JMM: Fetched primary data is invalid. Refusing to save it. [2025-10-28T19:32:16.966611] [WARN ] [MAIN ] JMM: Deleting existing primary and derivative data due to validation failure. [2025-10-28T19:32:16.966675] [INFO ] [LOCAL ] JMM: Starting deletion of primary data. [2025-10-28T19:32:16.966748] [DEBUG] [LOCAL ] JMM: No primary data file found to delete. [2025-10-28T19:32:16.966784] [INFO ] [LOCAL ] JMM: Starting deletion of derivative data. [2025-10-28T19:32:16.966823] [DEBUG] [LOCAL ] JMM: No derivative data file found to delete. [2025-10-28T19:32:16.966875] [INFO ] [MAIN ] Update Progress: 1161/2366 symbols completed. JMM took 5.8s. Estimated remaining: 2h 38m 0s. Rate: 7.6 symbols/min [2025-10-28T19:32:17.130801] [INFO ] [MAIN ] JOE: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:32:17.152321] [DEBUG] [LOCAL ] JOE: Loaded 23241 existing records from primary storage. [2025-10-28T19:32:17.152549] [INFO ] [MAIN ] JOE: Loaded 23241 existing records. [2025-10-28T19:32:17.325798] [WARN ] [MAIN ] JOE: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:32:17.326040] [INFO ] [MAIN ] JOE: Wiping existing primary data before full refresh. [2025-10-28T19:32:17.326096] [INFO ] [LOCAL ] JOE: Starting deletion of primary data. [2025-10-28T19:32:17.326348] [DEBUG] [LOCAL ] JOE: Deleted primary data file. [2025-10-28T19:32:17.326407] [INFO ] [MAIN ] JOE: Starting full primary refresh. [2025-10-28T19:32:17.682804] [INFO ] [REMOTE ] JOE: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:32:17.683264] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-01. [2025-10-28T19:32:17.714220] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-10-28T19:32:17.724371] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-03. [2025-10-28T19:32:17.869141] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-28T19:32:17.879840] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-04. [2025-10-28T19:32:18.340718] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-10-28T19:32:18.350939] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-03. [2025-10-28T19:32:18.384299] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-28T19:32:18.390460] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-02. [2025-10-28T19:32:19.109966] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-28T19:32:19.120813] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-05. [2025-10-28T19:32:19.418960] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-10-28T19:32:19.431821] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-04. [2025-10-28T19:32:20.650474] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-28T19:32:20.661566] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-06. [2025-10-28T19:32:21.183950] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-28T19:32:21.196200] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-05. [2025-10-28T19:32:21.955779] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-02 (3.57 seconds). [2025-10-28T19:32:21.960674] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-03. [2025-10-28T19:32:22.014694] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-28T19:32:22.025065] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-07. [2025-10-28T19:32:23.090978] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-10-28T19:32:23.102416] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-06. [2025-10-28T19:32:23.425356] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-10-28T19:32:23.436350] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-08. [2025-10-28T19:32:24.895148] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-10-28T19:32:24.907359] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-09. [2025-10-28T19:32:27.613635] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-03 (5.65 seconds). [2025-10-28T19:32:27.621704] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-04. [2025-10-28T19:32:28.642916] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-10-28T19:32:28.649039] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-05. [2025-10-28T19:32:29.487113] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-28T19:32:29.493482] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-06. [2025-10-28T19:32:31.666805] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-03 (13.32 seconds). [2025-10-28T19:32:31.677954] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-04. [2025-10-28T19:32:37.394391] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-06 (14.29 seconds). [2025-10-28T19:32:37.405162] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-07. [2025-10-28T19:32:39.169454] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-10-28T19:32:39.181290] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-08. [2025-10-28T19:32:42.206727] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-09 (17.30 seconds). [2025-10-28T19:32:42.217849] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-10. [2025-10-28T19:32:44.224994] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-06 (14.73 seconds). [2025-10-28T19:32:44.231124] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-07. [2025-10-28T19:32:45.067545] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-10-28T19:32:45.073723] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-08. [2025-10-28T19:32:53.367194] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-10 (11.15 seconds). [2025-10-28T19:32:53.377977] [INFO ] [REMOTE ] JMIA: Full fetch complete (73495 records). [2025-10-28T19:32:53.378130] [DEBUG] [VALIDATOR ] JMIA: Validating primary data. [2025-10-28T19:32:53.765695] [DEBUG] [VALIDATOR ] JMIA: All expected trading days are present. [2025-10-28T19:32:53.765782] [DEBUG] [VALIDATOR ] JMIA: Primary data validation passed. [2025-10-28T19:32:53.766882] [INFO ] [MAIN ] JMIA: Fetched primary data is valid. [2025-10-28T19:32:53.766947] [DEBUG] [LOCAL ] JMIA: Saving primary data. [2025-10-28T19:32:53.768310] [DEBUG] [LOCAL ] JMIA: Trimmed 73495 records to 51198 (keeping 200 days of data) [2025-10-28T19:32:54.084191] [DEBUG] [LOCAL ] JMIA: Primary data saved (51198 records). [2025-10-28T19:32:54.084371] [INFO ] [MAIN ] JMIA: Full history saved. [2025-10-28T19:32:54.084476] [INFO ] [MAIN ] Update Progress: 1162/2366 symbols completed. JMIA took 42.9s. Estimated remaining: 2h 38m 23s. Rate: 7.6 symbols/min [2025-10-28T19:32:54.263589] [INFO ] [MAIN ] JOF: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:32:54.272553] [DEBUG] [LOCAL ] JOF: Loaded 6868 existing records from primary storage. [2025-10-28T19:32:54.272806] [INFO ] [MAIN ] JOF: Loaded 6868 existing records. [2025-10-28T19:32:54.448605] [WARN ] [MAIN ] JOF: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:32:54.448877] [INFO ] [MAIN ] JOF: Wiping existing primary data before full refresh. [2025-10-28T19:32:54.448925] [INFO ] [LOCAL ] JOF: Starting deletion of primary data. [2025-10-28T19:32:54.449116] [DEBUG] [LOCAL ] JOF: Deleted primary data file. [2025-10-28T19:32:54.449157] [INFO ] [MAIN ] JOF: Starting full primary refresh. [2025-10-28T19:32:54.806765] [INFO ] [REMOTE ] JOF: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:32:54.807106] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-01. [2025-10-28T19:32:55.113498] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-04 (23.44 seconds). [2025-10-28T19:32:55.125486] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-05. [2025-10-28T19:32:55.211754] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-10-28T19:32:55.213298] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-02. [2025-10-28T19:32:55.579159] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-10-28T19:32:55.580918] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-03. [2025-10-28T19:32:56.173428] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-10-28T19:32:56.176713] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-04. [2025-10-28T19:32:56.648129] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-10-28T19:32:56.652038] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-05. [2025-10-28T19:32:57.047114] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-10-28T19:32:57.050393] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-06. [2025-10-28T19:32:57.332635] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-05 (2.21 seconds). [2025-10-28T19:32:57.343953] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-06. [2025-10-28T19:32:57.497145] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-28T19:32:57.499221] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-07. [2025-10-28T19:32:57.913887] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-10-28T19:32:57.916003] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-08. [2025-10-28T19:32:58.427832] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-28T19:32:58.430797] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-09. [2025-10-28T19:32:59.399634] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-10-28T19:32:59.410433] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-07. [2025-10-28T19:33:00.826504] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-09 (2.40 seconds). [2025-10-28T19:33:00.829340] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-10. [2025-10-28T19:33:01.430588] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-10 (0.60 seconds). [2025-10-28T19:33:01.434266] [INFO ] [REMOTE ] JOF: Full fetch complete (9582 records). [2025-10-28T19:33:01.434430] [DEBUG] [VALIDATOR ] JOF: Validating primary data. [2025-10-28T19:33:01.835785] [DEBUG] [VALIDATOR ] JOF: All expected trading days are present. [2025-10-28T19:33:01.836220] [DEBUG] [VALIDATOR ] JOF: Primary data validation passed. [2025-10-28T19:33:01.836578] [INFO ] [MAIN ] JOF: Fetched primary data is valid. [2025-10-28T19:33:01.836791] [DEBUG] [LOCAL ] JOF: Saving primary data. [2025-10-28T19:33:01.837787] [DEBUG] [LOCAL ] JOF: Trimmed 9582 records to 6891 (keeping 200 days of data) [2025-10-28T19:33:01.878810] [DEBUG] [LOCAL ] JOF: Primary data saved (6891 records). [2025-10-28T19:33:01.879036] [INFO ] [MAIN ] JOF: Full history saved. [2025-10-28T19:33:01.879256] [INFO ] [MAIN ] Update Progress: 1163/2366 symbols completed. JOF took 7.8s. Estimated remaining: 2h 38m 15s. Rate: 7.6 symbols/min [2025-10-28T19:33:01.982867] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-07 (2.57 seconds). [2025-10-28T19:33:02.025861] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-08. [2025-10-28T19:33:02.090525] [INFO ] [MAIN ] JPC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:33:02.124263] [DEBUG] [LOCAL ] JPC: Loaded 36745 existing records from primary storage. [2025-10-28T19:33:02.124539] [INFO ] [MAIN ] JPC: Loaded 36745 existing records. [2025-10-28T19:33:02.296823] [WARN ] [MAIN ] JPC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:33:02.297017] [INFO ] [MAIN ] JPC: Wiping existing primary data before full refresh. [2025-10-28T19:33:02.297064] [INFO ] [LOCAL ] JPC: Starting deletion of primary data. [2025-10-28T19:33:02.297464] [DEBUG] [LOCAL ] JPC: Deleted primary data file. [2025-10-28T19:33:02.297520] [INFO ] [MAIN ] JPC: Starting full primary refresh. [2025-10-28T19:33:02.662974] [INFO ] [REMOTE ] JPC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:33:02.663298] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-01. [2025-10-28T19:33:03.774595] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-28T19:33:03.783201] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-02. [2025-10-28T19:33:04.116410] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-10-28T19:33:04.127993] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-09. [2025-10-28T19:33:06.166640] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-10-28T19:33:06.178250] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-10. [2025-10-28T19:33:06.993597] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-08 (27.81 seconds). [2025-10-28T19:33:07.005201] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-09. [2025-10-28T19:33:08.799067] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-10-28T19:33:08.810774] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-10. [2025-10-28T19:33:09.084820] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-08 (24.01 seconds). [2025-10-28T19:33:09.089987] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-09. [2025-10-28T19:33:09.787836] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-10-28T19:33:09.793561] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-10. [2025-10-28T19:33:10.960249] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-10 (2.15 seconds). [2025-10-28T19:33:10.971143] [INFO ] [REMOTE ] JNJ: Full fetch complete (77933 records). [2025-10-28T19:33:10.971301] [DEBUG] [VALIDATOR ] JNJ: Validating primary data. [2025-10-28T19:33:11.372207] [DEBUG] [VALIDATOR ] JNJ: All expected trading days are present. [2025-10-28T19:33:11.372274] [DEBUG] [VALIDATOR ] JNJ: Primary data validation passed. [2025-10-28T19:33:11.373288] [INFO ] [MAIN ] JNJ: Fetched primary data is valid. [2025-10-28T19:33:11.373349] [DEBUG] [LOCAL ] JNJ: Saving primary data. [2025-10-28T19:33:11.374723] [DEBUG] [LOCAL ] JNJ: Trimmed 77933 records to 53753 (keeping 200 days of data) [2025-10-28T19:33:11.707432] [DEBUG] [LOCAL ] JNJ: Primary data saved (53753 records). [2025-10-28T19:33:11.707578] [INFO ] [MAIN ] JNJ: Full history saved. [2025-10-28T19:33:11.707957] [INFO ] [MAIN ] Update Progress: 1164/2366 symbols completed. JNJ took 1m 1s. Estimated remaining: 2h 38m 9s. Rate: 7.6 symbols/min [2025-10-28T19:33:11.875721] [INFO ] [MAIN ] JPM: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:33:11.927140] [DEBUG] [LOCAL ] JPM: Loaded 53794 existing records from primary storage. [2025-10-28T19:33:11.927463] [INFO ] [MAIN ] JPM: Loaded 53794 existing records. [2025-10-28T19:33:12.100996] [WARN ] [MAIN ] JPM: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:33:12.101203] [INFO ] [MAIN ] JPM: Wiping existing primary data before full refresh. [2025-10-28T19:33:12.101248] [INFO ] [LOCAL ] JPM: Starting deletion of primary data. [2025-10-28T19:33:12.101872] [DEBUG] [LOCAL ] JPM: Deleted primary data file. [2025-10-28T19:33:12.101928] [INFO ] [MAIN ] JPM: Starting full primary refresh. [2025-10-28T19:33:12.453599] [INFO ] [REMOTE ] JPM: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:33:12.454012] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-01. [2025-10-28T19:33:12.964359] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-10 (3.17 seconds). [2025-10-28T19:33:12.968841] [INFO ] [REMOTE ] JOE: Full fetch complete (35227 records). [2025-10-28T19:33:12.968920] [DEBUG] [VALIDATOR ] JOE: Validating primary data. [2025-10-28T19:33:13.345838] [DEBUG] [VALIDATOR ] JOE: All expected trading days are present. [2025-10-28T19:33:13.345912] [DEBUG] [VALIDATOR ] JOE: Primary data validation passed. [2025-10-28T19:33:13.346707] [INFO ] [MAIN ] JOE: Fetched primary data is valid. [2025-10-28T19:33:13.346768] [DEBUG] [LOCAL ] JOE: Saving primary data. [2025-10-28T19:33:13.347557] [DEBUG] [LOCAL ] JOE: Trimmed 35227 records to 23070 (keeping 200 days of data) [2025-10-28T19:33:13.484371] [DEBUG] [LOCAL ] JOE: Primary data saved (23070 records). [2025-10-28T19:33:13.484487] [INFO ] [MAIN ] JOE: Full history saved. [2025-10-28T19:33:13.484568] [INFO ] [MAIN ] Update Progress: 1165/2366 symbols completed. JOE took 56.5s. Estimated remaining: 2h 37m 54s. Rate: 7.6 symbols/min [2025-10-28T19:33:13.661405] [INFO ] [MAIN ] JQC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:33:13.695861] [DEBUG] [LOCAL ] JQC: Loaded 33597 existing records from primary storage. [2025-10-28T19:33:13.696220] [INFO ] [MAIN ] JQC: Loaded 33597 existing records. [2025-10-28T19:33:13.884823] [WARN ] [MAIN ] JQC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:33:13.885070] [INFO ] [MAIN ] JQC: Wiping existing primary data before full refresh. [2025-10-28T19:33:13.885138] [INFO ] [LOCAL ] JQC: Starting deletion of primary data. [2025-10-28T19:33:13.885563] [DEBUG] [LOCAL ] JQC: Deleted primary data file. [2025-10-28T19:33:13.885622] [INFO ] [MAIN ] JQC: Starting full primary refresh. [2025-10-28T19:33:14.253973] [INFO ] [REMOTE ] JQC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:33:14.254432] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-01. [2025-10-28T19:33:14.286155] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-10-28T19:33:14.298589] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-02. [2025-10-28T19:33:15.264266] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-28T19:33:15.272026] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-02. [2025-10-28T19:33:15.645495] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-10 (9.47 seconds). [2025-10-28T19:33:15.660520] [INFO ] [REMOTE ] JOBY: Full fetch complete (77974 records). [2025-10-28T19:33:15.660749] [DEBUG] [VALIDATOR ] JOBY: Validating primary data. [2025-10-28T19:33:16.038047] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-02 (12.25 seconds). [2025-10-28T19:33:16.097249] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-03. [2025-10-28T19:33:16.120342] [DEBUG] [VALIDATOR ] JOBY: All expected trading days are present. [2025-10-28T19:33:16.120561] [DEBUG] [VALIDATOR ] JOBY: Primary data validation passed. [2025-10-28T19:33:16.121666] [INFO ] [MAIN ] JOBY: Fetched primary data is valid. [2025-10-28T19:33:16.121959] [DEBUG] [LOCAL ] JOBY: Saving primary data. [2025-10-28T19:33:16.140564] [DEBUG] [LOCAL ] JOBY: Trimmed 77974 records to 53809 (keeping 200 days of data) [2025-10-28T19:33:16.142160] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-28T19:33:16.149562] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-03. [2025-10-28T19:33:16.287065] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-10-28T19:33:16.304397] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-03. [2025-10-28T19:33:16.515260] [DEBUG] [LOCAL ] JOBY: Primary data saved (53809 records). [2025-10-28T19:33:16.515402] [INFO ] [MAIN ] JOBY: Full history saved. [2025-10-28T19:33:16.515486] [INFO ] [MAIN ] Update Progress: 1166/2366 symbols completed. JOBY took 1m 5s. Estimated remaining: 2h 37m 42s. Rate: 7.6 symbols/min [2025-10-28T19:33:16.689947] [INFO ] [MAIN ] JRI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:33:16.706384] [DEBUG] [LOCAL ] JRI: Loaded 15041 existing records from primary storage. [2025-10-28T19:33:16.706740] [INFO ] [MAIN ] JRI: Loaded 15041 existing records. [2025-10-28T19:33:16.880765] [WARN ] [MAIN ] JRI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:33:16.880976] [INFO ] [MAIN ] JRI: Wiping existing primary data before full refresh. [2025-10-28T19:33:16.881023] [INFO ] [LOCAL ] JRI: Starting deletion of primary data. [2025-10-28T19:33:16.881307] [DEBUG] [LOCAL ] JRI: Deleted primary data file. [2025-10-28T19:33:16.881366] [INFO ] [MAIN ] JRI: Starting full primary refresh. [2025-10-28T19:33:17.251584] [INFO ] [REMOTE ] JRI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:33:17.252364] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-01. [2025-10-28T19:33:17.285185] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-28T19:33:17.345111] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-04. [2025-10-28T19:33:17.348131] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-10-28T19:33:17.357062] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-04. [2025-10-28T19:33:18.048135] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-28T19:33:18.053169] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-02. [2025-10-28T19:33:18.151557] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-10-28T19:33:18.163069] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-04. [2025-10-28T19:33:18.200215] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-28T19:33:18.209446] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-05. [2025-10-28T19:33:18.382804] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-10-28T19:33:18.390885] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-05. [2025-10-28T19:33:19.188355] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-10-28T19:33:19.196317] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-06. [2025-10-28T19:33:19.255522] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-28T19:33:19.262607] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-06. [2025-10-28T19:33:19.921691] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-28T19:33:19.933923] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-05. [2025-10-28T19:33:20.127274] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-10-28T19:33:20.134713] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-07. [2025-10-28T19:33:21.116167] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-28T19:33:21.124465] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-08. [2025-10-28T19:33:21.324457] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-02 (3.27 seconds). [2025-10-28T19:33:21.328443] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-03. [2025-10-28T19:33:21.925489] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-28T19:33:21.929463] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-04. [2025-10-28T19:33:21.985890] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-28T19:33:21.994883] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-09. [2025-10-28T19:33:22.612118] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-10-28T19:33:22.616694] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-05. [2025-10-28T19:33:22.934892] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-10-28T19:33:22.943099] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-10. [2025-10-28T19:33:23.265847] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-28T19:33:23.269376] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-06. [2025-10-28T19:33:23.839514] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-28T19:33:23.842962] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-07. [2025-10-28T19:33:24.472036] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-28T19:33:24.476636] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-08. [2025-10-28T19:33:25.000908] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-06 (5.74 seconds). [2025-10-28T19:33:25.006825] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-07. [2025-10-28T19:33:25.019368] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-28T19:33:25.022594] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-09. [2025-10-28T19:33:25.659131] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-10-28T19:33:25.665471] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-10. [2025-10-28T19:33:26.037151] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-28T19:33:26.045777] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-08. [2025-10-28T19:33:26.518267] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-28T19:33:26.521910] [INFO ] [REMOTE ] JRI: Full fetch complete (22692 records). [2025-10-28T19:33:26.521994] [DEBUG] [VALIDATOR ] JRI: Validating primary data. [2025-10-28T19:33:26.895588] [DEBUG] [VALIDATOR ] JRI: All expected trading days are present. [2025-10-28T19:33:26.895723] [DEBUG] [VALIDATOR ] JRI: Primary data validation passed. [2025-10-28T19:33:26.896299] [INFO ] [MAIN ] JRI: Fetched primary data is valid. [2025-10-28T19:33:26.896383] [DEBUG] [LOCAL ] JRI: Saving primary data. [2025-10-28T19:33:26.897327] [DEBUG] [LOCAL ] JRI: Trimmed 22692 records to 15017 (keeping 200 days of data) [2025-10-28T19:33:26.998149] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-28T19:33:27.012603] [DEBUG] [LOCAL ] JRI: Primary data saved (15017 records). [2025-10-28T19:33:27.012870] [INFO ] [MAIN ] JRI: Full history saved. [2025-10-28T19:33:27.020393] [INFO ] [MAIN ] Update Progress: 1167/2366 symbols completed. JRI took 10.5s. Estimated remaining: 2h 37m 36s. Rate: 7.6 symbols/min [2025-10-28T19:33:27.064629] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-09. [2025-10-28T19:33:27.193166] [INFO ] [MAIN ] JRS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:33:27.205716] [DEBUG] [LOCAL ] JRS: Loaded 11423 existing records from primary storage. [2025-10-28T19:33:27.205947] [INFO ] [MAIN ] JRS: Loaded 11423 existing records. [2025-10-28T19:33:27.383978] [WARN ] [MAIN ] JRS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:33:27.384206] [INFO ] [MAIN ] JRS: Wiping existing primary data before full refresh. [2025-10-28T19:33:27.384272] [INFO ] [LOCAL ] JRS: Starting deletion of primary data. [2025-10-28T19:33:27.384480] [DEBUG] [LOCAL ] JRS: Deleted primary data file. [2025-10-28T19:33:27.384521] [INFO ] [MAIN ] JRS: Starting full primary refresh. [2025-10-28T19:33:27.734489] [INFO ] [REMOTE ] JRS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:33:27.734817] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-01. [2025-10-28T19:33:28.068380] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-28T19:33:28.075791] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-10. [2025-10-28T19:33:28.101539] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-10-28T19:33:28.104315] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-02. [2025-10-28T19:33:28.604743] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-28T19:33:28.607431] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-03. [2025-10-28T19:33:29.089665] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-10 (1.01 seconds). [2025-10-28T19:33:29.096957] [INFO ] [REMOTE ] JQC: Full fetch complete (50080 records). [2025-10-28T19:33:29.097049] [DEBUG] [VALIDATOR ] JQC: Validating primary data. [2025-10-28T19:33:29.205681] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-10-28T19:33:29.234454] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-04. [2025-10-28T19:33:29.487321] [DEBUG] [VALIDATOR ] JQC: All expected trading days are present. [2025-10-28T19:33:29.487402] [DEBUG] [VALIDATOR ] JQC: Primary data validation passed. [2025-10-28T19:33:29.488247] [INFO ] [MAIN ] JQC: Fetched primary data is valid. [2025-10-28T19:33:29.488309] [DEBUG] [LOCAL ] JQC: Saving primary data. [2025-10-28T19:33:29.489363] [DEBUG] [LOCAL ] JQC: Trimmed 50080 records to 33418 (keeping 200 days of data) [2025-10-28T19:33:29.681472] [DEBUG] [LOCAL ] JQC: Primary data saved (33418 records). [2025-10-28T19:33:29.681602] [INFO ] [MAIN ] JQC: Full history saved. [2025-10-28T19:33:29.681700] [INFO ] [MAIN ] Update Progress: 1168/2366 symbols completed. JQC took 16.2s. Estimated remaining: 2h 37m 23s. Rate: 7.6 symbols/min [2025-10-28T19:33:29.860925] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-10-28T19:33:29.864087] [INFO ] [MAIN ] JXN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:33:29.867159] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-05. [2025-10-28T19:33:29.907763] [DEBUG] [LOCAL ] JXN: Loaded 43924 existing records from primary storage. [2025-10-28T19:33:29.908049] [INFO ] [MAIN ] JXN: Loaded 43924 existing records. [2025-10-28T19:33:30.085548] [WARN ] [MAIN ] JXN: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:33:30.085778] [INFO ] [MAIN ] JXN: Wiping existing primary data before full refresh. [2025-10-28T19:33:30.085830] [INFO ] [LOCAL ] JXN: Starting deletion of primary data. [2025-10-28T19:33:30.086325] [DEBUG] [LOCAL ] JXN: Deleted primary data file. [2025-10-28T19:33:30.086384] [INFO ] [MAIN ] JXN: Starting full primary refresh. [2025-10-28T19:33:30.436342] [INFO ] [REMOTE ] JXN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:33:30.436707] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-01. [2025-10-28T19:33:33.169686] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-10 (10.23 seconds). [2025-10-28T19:33:33.177583] [INFO ] [REMOTE ] JPC: Full fetch complete (54865 records). [2025-10-28T19:33:33.177745] [DEBUG] [VALIDATOR ] JPC: Validating primary data. [2025-10-28T19:33:33.594558] [DEBUG] [VALIDATOR ] JPC: All expected trading days are present. [2025-10-28T19:33:33.594669] [DEBUG] [VALIDATOR ] JPC: Primary data validation passed. [2025-10-28T19:33:33.595533] [INFO ] [MAIN ] JPC: Fetched primary data is valid. [2025-10-28T19:33:33.595686] [DEBUG] [LOCAL ] JPC: Saving primary data. [2025-10-28T19:33:33.596872] [DEBUG] [LOCAL ] JPC: Trimmed 54865 records to 36664 (keeping 200 days of data) [2025-10-28T19:33:33.781572] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-05 (13.85 seconds). [2025-10-28T19:33:33.823401] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-06. [2025-10-28T19:33:33.854096] [DEBUG] [LOCAL ] JPC: Primary data saved (36664 records). [2025-10-28T19:33:33.854217] [INFO ] [MAIN ] JPC: Full history saved. [2025-10-28T19:33:33.854296] [INFO ] [MAIN ] Update Progress: 1169/2366 symbols completed. JPC took 32.0s. Estimated remaining: 2h 37m 11s. Rate: 7.6 symbols/min [2025-10-28T19:33:34.020899] [INFO ] [MAIN ] K: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:33:34.067246] [DEBUG] [LOCAL ] K: Loaded 50265 existing records from primary storage. [2025-10-28T19:33:34.067590] [INFO ] [MAIN ] K: Loaded 50265 existing records. [2025-10-28T19:33:34.245690] [WARN ] [MAIN ] K: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:33:34.245903] [INFO ] [MAIN ] K: Wiping existing primary data before full refresh. [2025-10-28T19:33:34.245950] [INFO ] [LOCAL ] K: Starting deletion of primary data. [2025-10-28T19:33:34.246317] [DEBUG] [LOCAL ] K: Deleted primary data file. [2025-10-28T19:33:34.246359] [INFO ] [MAIN ] K: Starting full primary refresh. [2025-10-28T19:33:34.604948] [INFO ] [REMOTE ] K: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:33:34.605310] [INFO ] [REMOTE ] K: Fetching primary data for 2025-01. [2025-10-28T19:33:35.246291] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-05 (5.38 seconds). [2025-10-28T19:33:35.251037] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-06. [2025-10-28T19:33:35.472628] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-28T19:33:35.484195] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-07. [2025-10-28T19:33:35.756356] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-28T19:33:35.766187] [INFO ] [REMOTE ] K: Fetching primary data for 2025-02. [2025-10-28T19:33:35.823203] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-10-28T19:33:35.827210] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-07. [2025-10-28T19:33:36.375405] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-10-28T19:33:36.379331] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-08. [2025-10-28T19:33:36.874832] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-28T19:33:36.884853] [INFO ] [REMOTE ] K: Fetching primary data for 2025-03. [2025-10-28T19:33:36.901826] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-10-28T19:33:36.905175] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-09. [2025-10-28T19:33:37.444313] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-10-28T19:33:37.456804] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-08. [2025-10-28T19:33:38.100534] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-28T19:33:38.110392] [INFO ] [REMOTE ] K: Fetching primary data for 2025-04. [2025-10-28T19:33:39.264963] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-10-28T19:33:39.276611] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-09. [2025-10-28T19:33:39.325088] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-01 (8.89 seconds). [2025-10-28T19:33:39.333565] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-02. [2025-10-28T19:33:39.419902] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-10-28T19:33:39.430628] [INFO ] [REMOTE ] K: Fetching primary data for 2025-05. [2025-10-28T19:33:40.795553] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-10-28T19:33:40.806330] [INFO ] [REMOTE ] K: Fetching primary data for 2025-06. [2025-10-28T19:33:42.078258] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-09 (5.17 seconds). [2025-10-28T19:33:42.081991] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-10. [2025-10-28T19:33:42.151391] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-10-28T19:33:42.163044] [INFO ] [REMOTE ] K: Fetching primary data for 2025-07. [2025-10-28T19:33:42.756850] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-28T19:33:42.759802] [INFO ] [REMOTE ] JRS: Full fetch complete (16064 records). [2025-10-28T19:33:42.760001] [DEBUG] [VALIDATOR ] JRS: Validating primary data. [2025-10-28T19:33:43.138039] [DEBUG] [VALIDATOR ] JRS: All expected trading days are present. [2025-10-28T19:33:43.138148] [DEBUG] [VALIDATOR ] JRS: Primary data validation passed. [2025-10-28T19:33:43.138737] [INFO ] [MAIN ] JRS: Fetched primary data is valid. [2025-10-28T19:33:43.138802] [DEBUG] [LOCAL ] JRS: Saving primary data. [2025-10-28T19:33:43.139621] [DEBUG] [LOCAL ] JRS: Trimmed 16064 records to 11407 (keeping 200 days of data) [2025-10-28T19:33:43.214216] [DEBUG] [LOCAL ] JRS: Primary data saved (11407 records). [2025-10-28T19:33:43.214603] [INFO ] [MAIN ] JRS: Full history saved. [2025-10-28T19:33:43.214821] [INFO ] [MAIN ] Update Progress: 1170/2366 symbols completed. JRS took 16.2s. Estimated remaining: 2h 37m 5s. Rate: 7.6 symbols/min [2025-10-28T19:33:43.398178] [INFO ] [MAIN ] KAI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:33:43.432148] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-10-28T19:33:43.448410] [INFO ] [REMOTE ] K: Fetching primary data for 2025-08. [2025-10-28T19:33:43.456744] [DEBUG] [LOCAL ] KAI: Loaded 13227 existing records from primary storage. [2025-10-28T19:33:43.457099] [INFO ] [MAIN ] KAI: Loaded 13227 existing records. [2025-10-28T19:33:43.643598] [WARN ] [MAIN ] KAI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:33:43.643973] [INFO ] [MAIN ] KAI: Wiping existing primary data before full refresh. [2025-10-28T19:33:43.644036] [INFO ] [LOCAL ] KAI: Starting deletion of primary data. [2025-10-28T19:33:43.644323] [DEBUG] [LOCAL ] KAI: Deleted primary data file. [2025-10-28T19:33:43.644384] [INFO ] [MAIN ] KAI: Starting full primary refresh. [2025-10-28T19:33:44.024743] [INFO ] [REMOTE ] KAI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:33:44.025123] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-01. [2025-10-28T19:33:44.601394] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-28T19:33:44.611990] [INFO ] [REMOTE ] K: Fetching primary data for 2025-09. [2025-10-28T19:33:44.706098] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-28T19:33:44.708406] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-02. [2025-10-28T19:33:45.510334] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-28T19:33:45.514337] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-03. [2025-10-28T19:33:47.884611] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-03 (2.37 seconds). [2025-10-28T19:33:47.888141] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-04. [2025-10-28T19:33:48.582972] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-10-28T19:33:48.587280] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-05. [2025-10-28T19:33:48.982215] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-02 (9.65 seconds). [2025-10-28T19:33:48.990845] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-03. [2025-10-28T19:33:49.255630] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-10-28T19:33:49.259609] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-06. [2025-10-28T19:33:50.369094] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-28T19:33:50.379766] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-04. [2025-10-28T19:33:51.510974] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-28T19:33:51.520984] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-05. [2025-10-28T19:33:52.699367] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-28T19:33:52.709340] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-06. [2025-10-28T19:33:57.639627] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-09 (18.36 seconds). [2025-10-28T19:33:57.651551] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-10. [2025-10-28T19:33:59.754311] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-10 (2.10 seconds). [2025-10-28T19:33:59.766000] [INFO ] [REMOTE ] JPM: Full fetch complete (77973 records). [2025-10-28T19:33:59.766219] [DEBUG] [VALIDATOR ] JPM: Validating primary data. [2025-10-28T19:34:00.251582] [DEBUG] [VALIDATOR ] JPM: All expected trading days are present. [2025-10-28T19:34:00.252008] [DEBUG] [VALIDATOR ] JPM: Primary data validation passed. [2025-10-28T19:34:00.254347] [INFO ] [MAIN ] JPM: Fetched primary data is valid. [2025-10-28T19:34:00.254467] [DEBUG] [LOCAL ] JPM: Saving primary data. [2025-10-28T19:34:00.256792] [DEBUG] [LOCAL ] JPM: Trimmed 77973 records to 53794 (keeping 200 days of data) [2025-10-28T19:34:00.738152] [DEBUG] [LOCAL ] JPM: Primary data saved (53794 records). [2025-10-28T19:34:00.738305] [INFO ] [MAIN ] JPM: Full history saved. [2025-10-28T19:34:00.739000] [INFO ] [MAIN ] Update Progress: 1171/2366 symbols completed. JPM took 49.0s. Estimated remaining: 2h 37m 7s. Rate: 7.6 symbols/min [2025-10-28T19:34:00.940962] [INFO ] [MAIN ] KAR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:34:00.984529] [DEBUG] [LOCAL ] KAR: Loaded 39580 existing records from primary storage. [2025-10-28T19:34:00.984866] [INFO ] [MAIN ] KAR: Loaded 39580 existing records. [2025-10-28T19:34:01.177003] [WARN ] [MAIN ] KAR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:34:01.177247] [INFO ] [MAIN ] KAR: Wiping existing primary data before full refresh. [2025-10-28T19:34:01.177335] [INFO ] [LOCAL ] KAR: Starting deletion of primary data. [2025-10-28T19:34:01.178193] [DEBUG] [LOCAL ] KAR: Deleted primary data file. [2025-10-28T19:34:01.178253] [INFO ] [MAIN ] KAR: Starting full primary refresh. [2025-10-28T19:34:01.556368] [INFO ] [REMOTE ] KAR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:34:01.556744] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-01. [2025-10-28T19:34:02.756208] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-10-28T19:34:02.763185] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-02. [2025-10-28T19:34:03.718268] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-28T19:34:03.726350] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-03. [2025-10-28T19:34:04.734495] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-10-28T19:34:04.743173] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-04. [2025-10-28T19:34:05.821137] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-28T19:34:05.830057] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-05. [2025-10-28T19:34:06.855042] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-10-28T19:34:06.863306] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-06. [2025-10-28T19:34:09.333471] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-06 (20.07 seconds). [2025-10-28T19:34:09.338167] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-07. [2025-10-28T19:34:09.969024] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-28T19:34:09.973055] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-08. [2025-10-28T19:34:10.522703] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-28T19:34:10.526383] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-09. [2025-10-28T19:34:12.901513] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-09 (28.29 seconds). [2025-10-28T19:34:12.916774] [INFO ] [REMOTE ] K: Fetching primary data for 2025-10. [2025-10-28T19:34:15.139990] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-06 (8.28 seconds). [2025-10-28T19:34:15.148931] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-07. [2025-10-28T19:34:16.243544] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-28T19:34:16.253508] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-08. [2025-10-28T19:34:17.297053] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-28T19:34:17.309024] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-09. [2025-10-28T19:34:18.329525] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-28T19:34:18.338687] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-10. [2025-10-28T19:34:18.434186] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-09 (7.91 seconds). [2025-10-28T19:34:18.437318] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-10. [2025-10-28T19:34:19.203762] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-06 (26.49 seconds). [2025-10-28T19:34:19.213685] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-07. [2025-10-28T19:34:19.502008] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-28T19:34:19.510093] [INFO ] [REMOTE ] KAR: Full fetch complete (57068 records). [2025-10-28T19:34:19.510224] [DEBUG] [VALIDATOR ] KAR: Validating primary data. [2025-10-28T19:34:19.891600] [DEBUG] [VALIDATOR ] KAR: All expected trading days are present. [2025-10-28T19:34:19.891704] [DEBUG] [VALIDATOR ] KAR: Primary data validation passed. [2025-10-28T19:34:19.892591] [INFO ] [MAIN ] KAR: Fetched primary data is valid. [2025-10-28T19:34:19.892675] [DEBUG] [LOCAL ] KAR: Saving primary data. [2025-10-28T19:34:19.893863] [DEBUG] [LOCAL ] KAR: Trimmed 57068 records to 39565 (keeping 200 days of data) [2025-10-28T19:34:20.114301] [DEBUG] [LOCAL ] KAR: Primary data saved (39565 records). [2025-10-28T19:34:20.114422] [INFO ] [MAIN ] KAR: Full history saved. [2025-10-28T19:34:20.114499] [INFO ] [MAIN ] Update Progress: 1172/2366 symbols completed. KAR took 19.4s. Estimated remaining: 2h 37m 11s. Rate: 7.6 symbols/min [2025-10-28T19:34:20.287967] [INFO ] [MAIN ] KB: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:34:20.316306] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-28T19:34:20.326022] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-08. [2025-10-28T19:34:20.347815] [DEBUG] [LOCAL ] KB: Loaded 22731 existing records from primary storage. [2025-10-28T19:34:20.348065] [INFO ] [MAIN ] KB: Loaded 22731 existing records. [2025-10-28T19:34:20.579916] [WARN ] [MAIN ] KB: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:34:20.580143] [INFO ] [MAIN ] KB: Wiping existing primary data before full refresh. [2025-10-28T19:34:20.580189] [INFO ] [LOCAL ] KB: Starting deletion of primary data. [2025-10-28T19:34:20.580671] [DEBUG] [LOCAL ] KB: Deleted primary data file. [2025-10-28T19:34:20.580735] [INFO ] [MAIN ] KB: Starting full primary refresh. [2025-10-28T19:34:21.008793] [INFO ] [REMOTE ] KB: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:34:21.009082] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-01. [2025-10-28T19:34:21.245324] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-10 (2.81 seconds). [2025-10-28T19:34:21.248512] [INFO ] [REMOTE ] KAI: Full fetch complete (19426 records). [2025-10-28T19:34:21.248585] [DEBUG] [VALIDATOR ] KAI: Validating primary data. [2025-10-28T19:34:21.626539] [DEBUG] [VALIDATOR ] KAI: All expected trading days are present. [2025-10-28T19:34:21.626776] [DEBUG] [VALIDATOR ] KAI: Primary data validation passed. [2025-10-28T19:34:21.627245] [INFO ] [MAIN ] KAI: Fetched primary data is valid. [2025-10-28T19:34:21.627314] [DEBUG] [LOCAL ] KAI: Saving primary data. [2025-10-28T19:34:21.627996] [DEBUG] [LOCAL ] KAI: Trimmed 19426 records to 13188 (keeping 200 days of data) [2025-10-28T19:34:21.730940] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-28T19:34:21.747570] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-09. [2025-10-28T19:34:21.747212] [DEBUG] [LOCAL ] KAI: Primary data saved (13188 records). [2025-10-28T19:34:21.747743] [INFO ] [MAIN ] KAI: Full history saved. [2025-10-28T19:34:21.747997] [INFO ] [MAIN ] Update Progress: 1173/2366 symbols completed. KAI took 38.5s. Estimated remaining: 2h 36m 57s. Rate: 7.6 symbols/min [2025-10-28T19:34:21.914310] [INFO ] [MAIN ] KBDC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:34:21.934774] [DEBUG] [LOCAL ] KBDC: Loaded 22512 existing records from primary storage. [2025-10-28T19:34:21.935013] [INFO ] [MAIN ] KBDC: Loaded 22512 existing records. [2025-10-28T19:34:22.106665] [WARN ] [MAIN ] KBDC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:34:22.106858] [INFO ] [MAIN ] KBDC: Wiping existing primary data before full refresh. [2025-10-28T19:34:22.106907] [INFO ] [LOCAL ] KBDC: Starting deletion of primary data. [2025-10-28T19:34:22.107351] [DEBUG] [LOCAL ] KBDC: Deleted primary data file. [2025-10-28T19:34:22.107433] [INFO ] [MAIN ] KBDC: Starting full primary refresh. [2025-10-28T19:34:22.454617] [INFO ] [REMOTE ] KBDC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:34:22.454960] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-01. [2025-10-28T19:34:22.889424] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-28T19:34:22.898933] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-10. [2025-10-28T19:34:23.166423] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-10-28T19:34:23.170390] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-02. [2025-10-28T19:34:23.996386] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-10 (1.10 seconds). [2025-10-28T19:34:24.004071] [INFO ] [REMOTE ] JXN: Full fetch complete (65158 records). [2025-10-28T19:34:24.004176] [DEBUG] [VALIDATOR ] JXN: Validating primary data. [2025-10-28T19:34:24.376393] [DEBUG] [VALIDATOR ] JXN: All expected trading days are present. [2025-10-28T19:34:24.376472] [DEBUG] [VALIDATOR ] JXN: Primary data validation passed. [2025-10-28T19:34:24.377339] [INFO ] [MAIN ] JXN: Fetched primary data is valid. [2025-10-28T19:34:24.377402] [DEBUG] [LOCAL ] JXN: Saving primary data. [2025-10-28T19:34:24.378614] [DEBUG] [LOCAL ] JXN: Trimmed 65158 records to 43769 (keeping 200 days of data) [2025-10-28T19:34:24.638244] [DEBUG] [LOCAL ] JXN: Primary data saved (43769 records). [2025-10-28T19:34:24.638363] [INFO ] [MAIN ] JXN: Full history saved. [2025-10-28T19:34:24.638976] [INFO ] [MAIN ] Update Progress: 1174/2366 symbols completed. JXN took 55.0s. Estimated remaining: 2h 36m 44s. Rate: 7.6 symbols/min [2025-10-28T19:34:24.806853] [INFO ] [MAIN ] KBH: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:34:24.854006] [DEBUG] [LOCAL ] KBH: Loaded 48545 existing records from primary storage. [2025-10-28T19:34:24.854335] [INFO ] [MAIN ] KBH: Loaded 48545 existing records. [2025-10-28T19:34:25.056232] [WARN ] [MAIN ] KBH: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:34:25.056706] [INFO ] [MAIN ] KBH: Wiping existing primary data before full refresh. [2025-10-28T19:34:25.058255] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-10 (12.14 seconds). [2025-10-28T19:34:25.057006] [INFO ] [LOCAL ] KBH: Starting deletion of primary data. [2025-10-28T19:34:25.061714] [DEBUG] [LOCAL ] KBH: Deleted primary data file. [2025-10-28T19:34:25.067764] [INFO ] [MAIN ] KBH: Starting full primary refresh. [2025-10-28T19:34:25.141897] [INFO ] [REMOTE ] K: Full fetch complete (72253 records). [2025-10-28T19:34:25.165128] [DEBUG] [VALIDATOR ] K: Validating primary data. [2025-10-28T19:34:25.688239] [INFO ] [REMOTE ] KBH: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:34:25.709076] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-01. [2025-10-28T19:34:25.829967] [DEBUG] [VALIDATOR ] K: All expected trading days are present. [2025-10-28T19:34:25.830042] [DEBUG] [VALIDATOR ] K: Primary data validation passed. [2025-10-28T19:34:25.831048] [INFO ] [MAIN ] K: Fetched primary data is valid. [2025-10-28T19:34:25.831110] [DEBUG] [LOCAL ] K: Saving primary data. [2025-10-28T19:34:25.832445] [DEBUG] [LOCAL ] K: Trimmed 72253 records to 50245 (keeping 200 days of data) [2025-10-28T19:34:26.142086] [DEBUG] [LOCAL ] K: Primary data saved (50245 records). [2025-10-28T19:34:26.142211] [INFO ] [MAIN ] K: Full history saved. [2025-10-28T19:34:26.142290] [INFO ] [MAIN ] Update Progress: 1175/2366 symbols completed. K took 52.3s. Estimated remaining: 2h 36m 29s. Rate: 7.6 symbols/min [2025-10-28T19:34:26.306701] [INFO ] [MAIN ] KBR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:34:26.349803] [DEBUG] [LOCAL ] KBR: Loaded 47929 existing records from primary storage. [2025-10-28T19:34:26.350088] [INFO ] [MAIN ] KBR: Loaded 47929 existing records. [2025-10-28T19:34:26.522889] [WARN ] [MAIN ] KBR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:34:26.523085] [INFO ] [MAIN ] KBR: Wiping existing primary data before full refresh. [2025-10-28T19:34:26.523131] [INFO ] [LOCAL ] KBR: Starting deletion of primary data. [2025-10-28T19:34:26.523707] [DEBUG] [LOCAL ] KBR: Deleted primary data file. [2025-10-28T19:34:26.523763] [INFO ] [MAIN ] KBR: Starting full primary refresh. [2025-10-28T19:34:26.872883] [INFO ] [REMOTE ] KBR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:34:26.873270] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-01. [2025-10-28T19:34:26.913508] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-01 (5.90 seconds). [2025-10-28T19:34:26.917688] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-02. [2025-10-28T19:34:27.147463] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-10-28T19:34:27.157159] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-02. [2025-10-28T19:34:27.686343] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-10-28T19:34:27.691234] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-03. [2025-10-28T19:34:28.243887] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-28T19:34:28.253294] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-02. [2025-10-28T19:34:28.354565] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-28T19:34:28.363854] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-03. [2025-10-28T19:34:29.599689] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-28T19:34:29.610012] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-04. [2025-10-28T19:34:30.839072] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-10-28T19:34:30.849618] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-05. [2025-10-28T19:34:31.438068] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-02 (8.27 seconds). [2025-10-28T19:34:31.442000] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-03. [2025-10-28T19:34:32.019788] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-28T19:34:32.030048] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-06. [2025-10-28T19:34:32.170007] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-28T19:34:32.174979] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-04. [2025-10-28T19:34:32.927374] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-28T19:34:32.933012] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-05. [2025-10-28T19:34:33.220289] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-28T19:34:33.230307] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-07. [2025-10-28T19:34:33.592253] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-10-28T19:34:33.597268] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-06. [2025-10-28T19:34:34.213084] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-28T19:34:34.217279] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-07. [2025-10-28T19:34:34.494385] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-28T19:34:34.505517] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-08. [2025-10-28T19:34:35.627228] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-28T19:34:35.637568] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-09. [2025-10-28T19:34:35.837447] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-03 (8.15 seconds). [2025-10-28T19:34:35.843708] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-04. [2025-10-28T19:34:36.639079] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-28T19:34:36.657921] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-05. [2025-10-28T19:34:36.660942] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-02 (8.41 seconds). [2025-10-28T19:34:36.670783] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-03. [2025-10-28T19:34:36.765710] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-28T19:34:36.777901] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-10. [2025-10-28T19:34:37.585770] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-28T19:34:37.591718] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-06. [2025-10-28T19:34:37.841605] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-10-28T19:34:37.852049] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-04. [2025-10-28T19:34:37.906165] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-28T19:34:37.916034] [INFO ] [REMOTE ] KBH: Full fetch complete (70989 records). [2025-10-28T19:34:37.916197] [DEBUG] [VALIDATOR ] KBH: Validating primary data. [2025-10-28T19:34:38.315929] [DEBUG] [VALIDATOR ] KBH: All expected trading days are present. [2025-10-28T19:34:38.316126] [DEBUG] [VALIDATOR ] KBH: Primary data validation passed. [2025-10-28T19:34:38.317325] [INFO ] [MAIN ] KBH: Fetched primary data is valid. [2025-10-28T19:34:38.317462] [DEBUG] [LOCAL ] KBH: Saving primary data. [2025-10-28T19:34:38.319045] [DEBUG] [LOCAL ] KBH: Trimmed 70989 records to 48535 (keeping 200 days of data) [2025-10-28T19:34:38.586637] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-28T19:34:38.590402] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-07 (4.37 seconds). [2025-10-28T19:34:38.601534] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-07. [2025-10-28T19:34:38.602166] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-08. [2025-10-28T19:34:38.656956] [DEBUG] [LOCAL ] KBH: Primary data saved (48535 records). [2025-10-28T19:34:38.657084] [INFO ] [MAIN ] KBH: Full history saved. [2025-10-28T19:34:38.657708] [INFO ] [MAIN ] Update Progress: 1176/2366 symbols completed. KBH took 14.0s. Estimated remaining: 2h 36m 26s. Rate: 7.6 symbols/min [2025-10-28T19:34:38.826740] [INFO ] [MAIN ] KD: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:34:38.878233] [DEBUG] [LOCAL ] KD: Loaded 52295 existing records from primary storage. [2025-10-28T19:34:38.878525] [INFO ] [MAIN ] KD: Loaded 52295 existing records. [2025-10-28T19:34:39.058603] [WARN ] [MAIN ] KD: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:34:39.058996] [INFO ] [MAIN ] KD: Wiping existing primary data before full refresh. [2025-10-28T19:34:39.059227] [INFO ] [LOCAL ] KD: Starting deletion of primary data. [2025-10-28T19:34:39.059713] [DEBUG] [LOCAL ] KD: Deleted primary data file. [2025-10-28T19:34:39.059771] [INFO ] [MAIN ] KD: Starting full primary refresh. [2025-10-28T19:34:39.397093] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-10-28T19:34:39.398008] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-10-28T19:34:39.466030] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-05. [2025-10-28T19:34:39.459827] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-09. [2025-10-28T19:34:39.499666] [INFO ] [REMOTE ] KD: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:34:39.502033] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-01. [2025-10-28T19:34:39.521514] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-28T19:34:39.528790] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-08. [2025-10-28T19:34:40.313292] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-10-28T19:34:40.318561] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-09. [2025-10-28T19:34:40.369476] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-10-28T19:34:40.376156] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-10. [2025-10-28T19:34:40.744312] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-28T19:34:40.754854] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-06. [2025-10-28T19:34:40.847932] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-10-28T19:34:40.858209] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-02. [2025-10-28T19:34:41.113705] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-10-28T19:34:41.120168] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-10. [2025-10-28T19:34:41.247207] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-28T19:34:41.253826] [INFO ] [REMOTE ] KBDC: Full fetch complete (31293 records). [2025-10-28T19:34:41.253947] [DEBUG] [VALIDATOR ] KBDC: Validating primary data. [2025-10-28T19:34:41.624668] [DEBUG] [VALIDATOR ] KBDC: All expected trading days are present. [2025-10-28T19:34:41.624752] [DEBUG] [VALIDATOR ] KBDC: Primary data validation passed. [2025-10-28T19:34:41.625458] [INFO ] [MAIN ] KBDC: Fetched primary data is valid. [2025-10-28T19:34:41.625520] [DEBUG] [LOCAL ] KBDC: Saving primary data. [2025-10-28T19:34:41.626288] [DEBUG] [LOCAL ] KBDC: Trimmed 31293 records to 22598 (keeping 200 days of data) [2025-10-28T19:34:41.758447] [DEBUG] [LOCAL ] KBDC: Primary data saved (22598 records). [2025-10-28T19:34:41.758566] [INFO ] [MAIN ] KBDC: Full history saved. [2025-10-28T19:34:41.758673] [INFO ] [MAIN ] Update Progress: 1177/2366 symbols completed. KBDC took 20.0s. Estimated remaining: 2h 36m 13s. Rate: 7.6 symbols/min [2025-10-28T19:34:41.929880] [INFO ] [MAIN ] KEN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:34:41.936710] [DEBUG] [LOCAL ] KEN: Loaded 4395 existing records from primary storage. [2025-10-28T19:34:41.936951] [INFO ] [MAIN ] KEN: Loaded 4395 existing records. [2025-10-28T19:34:42.071026] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-28T19:34:42.102969] [INFO ] [REMOTE ] KB: Full fetch complete (33246 records). [2025-10-28T19:34:42.129279] [DEBUG] [VALIDATOR ] KB: Validating primary data. [2025-10-28T19:34:42.132100] [WARN ] [MAIN ] KEN: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:34:42.132762] [INFO ] [MAIN ] KEN: Wiping existing primary data before full refresh. [2025-10-28T19:34:42.132969] [INFO ] [LOCAL ] KEN: Starting deletion of primary data. [2025-10-28T19:34:42.144124] [DEBUG] [LOCAL ] KEN: Deleted primary data file. [2025-10-28T19:34:42.144445] [INFO ] [MAIN ] KEN: Starting full primary refresh. [2025-10-28T19:34:42.636314] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-28T19:34:42.715603] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-03. [2025-10-28T19:34:42.886719] [DEBUG] [VALIDATOR ] KB: All expected trading days are present. [2025-10-28T19:34:42.887372] [DEBUG] [VALIDATOR ] KB: Primary data validation passed. [2025-10-28T19:34:42.888789] [INFO ] [MAIN ] KB: Fetched primary data is valid. [2025-10-28T19:34:42.888868] [DEBUG] [LOCAL ] KB: Saving primary data. [2025-10-28T19:34:42.909130] [INFO ] [REMOTE ] KEN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:34:42.909562] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-01. [2025-10-28T19:34:42.910514] [DEBUG] [LOCAL ] KB: Trimmed 33246 records to 22618 (keeping 200 days of data) [2025-10-28T19:34:43.043350] [DEBUG] [LOCAL ] KB: Primary data saved (22618 records). [2025-10-28T19:34:43.043476] [INFO ] [MAIN ] KB: Full history saved. [2025-10-28T19:34:43.043553] [INFO ] [MAIN ] Update Progress: 1178/2366 symbols completed. KB took 22.9s. Estimated remaining: 2h 35m 59s. Rate: 7.6 symbols/min [2025-10-28T19:34:43.209512] [INFO ] [MAIN ] KEP: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:34:43.240742] [DEBUG] [LOCAL ] KEP: Loaded 32538 existing records from primary storage. [2025-10-28T19:34:43.241017] [INFO ] [MAIN ] KEP: Loaded 32538 existing records. [2025-10-28T19:34:43.414272] [WARN ] [MAIN ] KEP: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:34:43.414425] [INFO ] [MAIN ] KEP: Wiping existing primary data before full refresh. [2025-10-28T19:34:43.414469] [INFO ] [LOCAL ] KEP: Starting deletion of primary data. [2025-10-28T19:34:43.414886] [DEBUG] [LOCAL ] KEP: Deleted primary data file. [2025-10-28T19:34:43.414943] [INFO ] [MAIN ] KEP: Starting full primary refresh. [2025-10-28T19:34:43.560596] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-10-28T19:34:43.606349] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-02. [2025-10-28T19:34:43.779898] [INFO ] [REMOTE ] KEP: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:34:43.780172] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-01. [2025-10-28T19:34:43.961729] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-10-28T19:34:43.962871] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-03. [2025-10-28T19:34:44.051385] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-28T19:34:44.062357] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-04. [2025-10-28T19:34:44.586159] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-10-28T19:34:44.588082] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-04. [2025-10-28T19:34:44.919867] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-10-28T19:34:44.925480] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-02. [2025-10-28T19:34:45.063882] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-28T19:34:45.066256] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-05. [2025-10-28T19:34:45.702204] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-28T19:34:45.706885] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-03. [2025-10-28T19:34:46.461603] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-10-28T19:34:46.466419] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-04. [2025-10-28T19:34:48.006456] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-06 (7.25 seconds). [2025-10-28T19:34:48.026130] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-07. [2025-10-28T19:34:50.114236] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-10-28T19:34:50.124954] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-08. [2025-10-28T19:34:51.505592] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-04 (7.44 seconds). [2025-10-28T19:34:51.517122] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-05. [2025-10-28T19:34:51.544990] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-28T19:34:51.556604] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-09. [2025-10-28T19:34:51.883943] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-05 (6.82 seconds). [2025-10-28T19:34:51.885493] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-06. [2025-10-28T19:34:52.295524] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-10-28T19:34:52.297294] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-07. [2025-10-28T19:34:52.744141] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-28T19:34:52.754170] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-10. [2025-10-28T19:34:52.762665] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-28T19:34:52.764356] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-08. [2025-10-28T19:34:53.116923] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-10-28T19:34:53.118409] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-09. [2025-10-28T19:34:53.216388] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-10-28T19:34:53.227721] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-06. [2025-10-28T19:34:54.063524] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-04 (7.60 seconds). [2025-10-28T19:34:54.069661] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-05. [2025-10-28T19:34:54.525563] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-10-28T19:34:54.536723] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-07. [2025-10-28T19:34:54.770260] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-10-28T19:34:54.771685] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-10. [2025-10-28T19:34:54.962911] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-28T19:34:54.969635] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-06. [2025-10-28T19:34:55.089263] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-10 (0.32 seconds). [2025-10-28T19:34:55.090500] [INFO ] [REMOTE ] KEN: Full fetch complete (5827 records). [2025-10-28T19:34:55.090570] [DEBUG] [VALIDATOR ] KEN: Validating primary data. [2025-10-28T19:34:55.444465] [DEBUG] [VALIDATOR ] KEN: All expected trading days are present. [2025-10-28T19:34:55.444543] [DEBUG] [VALIDATOR ] KEN: Primary data validation passed. [2025-10-28T19:34:55.444723] [INFO ] [MAIN ] KEN: Fetched primary data is valid. [2025-10-28T19:34:55.444784] [DEBUG] [LOCAL ] KEN: Saving primary data. [2025-10-28T19:34:55.445167] [DEBUG] [LOCAL ] KEN: Trimmed 5827 records to 4287 (keeping 200 days of data) [2025-10-28T19:34:55.470991] [DEBUG] [LOCAL ] KEN: Primary data saved (4287 records). [2025-10-28T19:34:55.471115] [INFO ] [MAIN ] KEN: Full history saved. [2025-10-28T19:34:55.471237] [INFO ] [MAIN ] Update Progress: 1179/2366 symbols completed. KEN took 13.7s. Estimated remaining: 2h 35m 56s. Rate: 7.6 symbols/min [2025-10-28T19:34:55.649531] [INFO ] [MAIN ] KEX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:34:55.685744] [DEBUG] [LOCAL ] KEX: Loaded 38625 existing records from primary storage. [2025-10-28T19:34:55.686132] [INFO ] [MAIN ] KEX: Loaded 38625 existing records. [2025-10-28T19:34:55.881831] [WARN ] [MAIN ] KEX: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:34:55.882465] [INFO ] [MAIN ] KEX: Wiping existing primary data before full refresh. [2025-10-28T19:34:55.882564] [INFO ] [LOCAL ] KEX: Starting deletion of primary data. [2025-10-28T19:34:55.883303] [DEBUG] [LOCAL ] KEX: Deleted primary data file. [2025-10-28T19:34:55.883395] [INFO ] [MAIN ] KEX: Starting full primary refresh. [2025-10-28T19:34:56.042550] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-28T19:34:56.175867] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-08. [2025-10-28T19:34:56.204440] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-10-28T19:34:56.235401] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-07. [2025-10-28T19:34:56.325404] [INFO ] [REMOTE ] KEX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:34:56.325749] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-01. [2025-10-28T19:34:57.354056] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-28T19:34:57.362287] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-08. [2025-10-28T19:34:57.604859] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-28T19:34:57.613183] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-02. [2025-10-28T19:34:58.340633] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-10-28T19:34:58.348858] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-09. [2025-10-28T19:34:58.369856] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-28T19:34:58.377434] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-03. [2025-10-28T19:34:59.349572] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-28T19:34:59.356870] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-10. [2025-10-28T19:34:59.394461] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-10-28T19:34:59.402583] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-04. [2025-10-28T19:35:00.506454] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-28T19:35:00.515819] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-05. [2025-10-28T19:35:00.535280] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-28T19:35:00.542249] [INFO ] [REMOTE ] KEP: Full fetch complete (42651 records). [2025-10-28T19:35:00.542350] [DEBUG] [VALIDATOR ] KEP: Validating primary data. [2025-10-28T19:35:00.919770] [DEBUG] [VALIDATOR ] KEP: All expected trading days are present. [2025-10-28T19:35:00.919857] [DEBUG] [VALIDATOR ] KEP: Primary data validation passed. [2025-10-28T19:35:00.920680] [INFO ] [MAIN ] KEP: Fetched primary data is valid. [2025-10-28T19:35:00.920741] [DEBUG] [LOCAL ] KEP: Saving primary data. [2025-10-28T19:35:00.921681] [DEBUG] [LOCAL ] KEP: Trimmed 42651 records to 32541 (keeping 200 days of data) [2025-10-28T19:35:01.106960] [DEBUG] [LOCAL ] KEP: Primary data saved (32541 records). [2025-10-28T19:35:01.107091] [INFO ] [MAIN ] KEP: Full history saved. [2025-10-28T19:35:01.107169] [INFO ] [MAIN ] Update Progress: 1180/2366 symbols completed. KEP took 18.1s. Estimated remaining: 2h 35m 45s. Rate: 7.6 symbols/min [2025-10-28T19:35:01.273900] [INFO ] [MAIN ] KEY: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:35:01.274065] [DEBUG] [LOCAL ] KEY: No existing data file found in primary storage. [2025-10-28T19:35:01.274125] [WARN ] [MAIN ] KEY: No existing data found, performing full refresh instead. [2025-10-28T19:35:01.274238] [INFO ] [MAIN ] KEY: Wiping existing primary data before full refresh. [2025-10-28T19:35:01.274280] [INFO ] [LOCAL ] KEY: Starting deletion of primary data. [2025-10-28T19:35:01.274326] [DEBUG] [LOCAL ] KEY: No primary data file found to delete. [2025-10-28T19:35:01.274360] [INFO ] [MAIN ] KEY: Starting full primary refresh. [2025-10-28T19:35:01.662312] [INFO ] [REMOTE ] KEY: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:35:01.662690] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-01. [2025-10-28T19:35:02.476094] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-10 (9.72 seconds). [2025-10-28T19:35:02.489178] [INFO ] [REMOTE ] KBR: Full fetch complete (70091 records). [2025-10-28T19:35:02.489389] [DEBUG] [VALIDATOR ] KBR: Validating primary data. [2025-10-28T19:35:02.891446] [DEBUG] [VALIDATOR ] KBR: All expected trading days are present. [2025-10-28T19:35:02.891534] [DEBUG] [VALIDATOR ] KBR: Primary data validation passed. [2025-10-28T19:35:02.892519] [INFO ] [MAIN ] KBR: Fetched primary data is valid. [2025-10-28T19:35:02.892582] [DEBUG] [LOCAL ] KBR: Saving primary data. [2025-10-28T19:35:02.893912] [DEBUG] [LOCAL ] KBR: Trimmed 70091 records to 47937 (keeping 200 days of data) [2025-10-28T19:35:03.178876] [DEBUG] [LOCAL ] KBR: Primary data saved (47937 records). [2025-10-28T19:35:03.179014] [INFO ] [MAIN ] KBR: Full history saved. [2025-10-28T19:35:03.179096] [INFO ] [MAIN ] Update Progress: 1181/2366 symbols completed. KBR took 37.0s. Estimated remaining: 2h 35m 32s. Rate: 7.6 symbols/min [2025-10-28T19:35:03.357691] [INFO ] [MAIN ] KEYS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:35:03.391975] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-10-28T19:35:03.402990] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-02. [2025-10-28T19:35:03.434628] [DEBUG] [LOCAL ] KEYS: Loaded 42921 existing records from primary storage. [2025-10-28T19:35:03.434922] [INFO ] [MAIN ] KEYS: Loaded 42921 existing records. [2025-10-28T19:35:03.629917] [WARN ] [MAIN ] KEYS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:35:03.630137] [INFO ] [MAIN ] KEYS: Wiping existing primary data before full refresh. [2025-10-28T19:35:03.630184] [INFO ] [LOCAL ] KEYS: Starting deletion of primary data. [2025-10-28T19:35:03.630544] [DEBUG] [LOCAL ] KEYS: Deleted primary data file. [2025-10-28T19:35:03.630583] [INFO ] [MAIN ] KEYS: Starting full primary refresh. [2025-10-28T19:35:03.975978] [INFO ] [REMOTE ] KEYS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:35:03.976291] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-01. [2025-10-28T19:35:05.518210] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-02 (2.12 seconds). [2025-10-28T19:35:05.528368] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-03. [2025-10-28T19:35:05.567791] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-10-28T19:35:05.576102] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-02. [2025-10-28T19:35:06.212823] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-08 (10.04 seconds). [2025-10-28T19:35:06.224251] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-09. [2025-10-28T19:35:07.819588] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-10-28T19:35:07.831170] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-10. [2025-10-28T19:35:09.415874] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-10 (1.58 seconds). [2025-10-28T19:35:09.426526] [INFO ] [REMOTE ] KD: Full fetch complete (76065 records). [2025-10-28T19:35:09.426696] [DEBUG] [VALIDATOR ] KD: Validating primary data. [2025-10-28T19:35:09.811434] [DEBUG] [VALIDATOR ] KD: All expected trading days are present. [2025-10-28T19:35:09.811509] [DEBUG] [VALIDATOR ] KD: Primary data validation passed. [2025-10-28T19:35:09.812502] [INFO ] [MAIN ] KD: Fetched primary data is valid. [2025-10-28T19:35:09.812562] [DEBUG] [LOCAL ] KD: Saving primary data. [2025-10-28T19:35:09.813937] [DEBUG] [LOCAL ] KD: Trimmed 76065 records to 52294 (keeping 200 days of data) [2025-10-28T19:35:10.108310] [DEBUG] [LOCAL ] KD: Primary data saved (52294 records). [2025-10-28T19:35:10.108428] [INFO ] [MAIN ] KD: Full history saved. [2025-10-28T19:35:10.109190] [INFO ] [MAIN ] Update Progress: 1182/2366 symbols completed. KD took 31.5s. Estimated remaining: 2h 35m 23s. Rate: 7.6 symbols/min [2025-10-28T19:35:10.274115] [INFO ] [MAIN ] KF: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:35:10.279446] [DEBUG] [LOCAL ] KF: Loaded 2320 existing records from primary storage. [2025-10-28T19:35:10.279623] [INFO ] [MAIN ] KF: Loaded 2320 existing records. [2025-10-28T19:35:10.453349] [WARN ] [MAIN ] KF: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:35:10.453593] [INFO ] [MAIN ] KF: Wiping existing primary data before full refresh. [2025-10-28T19:35:10.453667] [INFO ] [LOCAL ] KF: Starting deletion of primary data. [2025-10-28T19:35:10.453849] [DEBUG] [LOCAL ] KF: Deleted primary data file. [2025-10-28T19:35:10.453904] [INFO ] [MAIN ] KF: Starting full primary refresh. [2025-10-28T19:35:10.809908] [INFO ] [REMOTE ] KF: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:35:10.810265] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-01. [2025-10-28T19:35:11.583086] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-28T19:35:11.584316] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-02. [2025-10-28T19:35:11.889721] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-10-28T19:35:11.890920] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-03. [2025-10-28T19:35:11.927536] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-05 (11.41 seconds). [2025-10-28T19:35:11.935823] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-06. [2025-10-28T19:35:12.401370] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-28T19:35:12.402789] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-04. [2025-10-28T19:35:12.818382] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-28T19:35:12.825439] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-07. [2025-10-28T19:35:15.649869] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-03 (10.12 seconds). [2025-10-28T19:35:15.660925] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-04. [2025-10-28T19:35:18.048407] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-02 (12.47 seconds). [2025-10-28T19:35:18.057045] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-03. [2025-10-28T19:35:18.423751] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-04 (6.02 seconds). [2025-10-28T19:35:18.425087] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-05. [2025-10-28T19:35:18.682768] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-07 (5.86 seconds). [2025-10-28T19:35:18.690878] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-08. [2025-10-28T19:35:18.764190] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-10-28T19:35:18.765591] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-06. [2025-10-28T19:35:19.137738] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-10-28T19:35:19.139213] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-07. [2025-10-28T19:35:19.261309] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-28T19:35:19.270876] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-04. [2025-10-28T19:35:19.451151] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-07 (0.31 seconds). [2025-10-28T19:35:19.452211] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-08. [2025-10-28T19:35:19.596135] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-28T19:35:19.604706] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-09. [2025-10-28T19:35:19.676208] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-08 (0.22 seconds). [2025-10-28T19:35:19.677451] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-09. [2025-10-28T19:35:19.967802] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-09 (0.29 seconds). [2025-10-28T19:35:19.968903] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-10. [2025-10-28T19:35:20.411357] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-28T19:35:20.412395] [INFO ] [REMOTE ] KF: Full fetch complete (3428 records). [2025-10-28T19:35:20.412463] [DEBUG] [VALIDATOR ] KF: Validating primary data. [2025-10-28T19:35:20.801774] [DEBUG] [VALIDATOR ] KF: All expected trading days are present. [2025-10-28T19:35:20.801881] [DEBUG] [VALIDATOR ] KF: Primary data validation passed. [2025-10-28T19:35:20.802070] [INFO ] [MAIN ] KF: Fetched primary data is valid. [2025-10-28T19:35:20.802685] [DEBUG] [LOCAL ] KF: Saving primary data. [2025-10-28T19:35:20.804145] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-10-28T19:35:20.813871] [DEBUG] [LOCAL ] KF: Trimmed 3428 records to 2314 (keeping 200 days of data) [2025-10-28T19:35:20.815037] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-05. [2025-10-28T19:35:20.829485] [DEBUG] [LOCAL ] KF: Primary data saved (2314 records). [2025-10-28T19:35:20.829719] [INFO ] [MAIN ] KF: Full history saved. [2025-10-28T19:35:20.829815] [INFO ] [MAIN ] Update Progress: 1183/2366 symbols completed. KF took 10.7s. Estimated remaining: 2h 35m 18s. Rate: 7.6 symbols/min [2025-10-28T19:35:20.997896] [INFO ] [MAIN ] KFRC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:35:21.022485] [DEBUG] [LOCAL ] KFRC: Loaded 20906 existing records from primary storage. [2025-10-28T19:35:21.022751] [INFO ] [MAIN ] KFRC: Loaded 20906 existing records. [2025-10-28T19:35:21.203578] [WARN ] [MAIN ] KFRC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:35:21.203850] [INFO ] [MAIN ] KFRC: Wiping existing primary data before full refresh. [2025-10-28T19:35:21.203914] [INFO ] [LOCAL ] KFRC: Starting deletion of primary data. [2025-10-28T19:35:21.204238] [DEBUG] [LOCAL ] KFRC: Deleted primary data file. [2025-10-28T19:35:21.204298] [INFO ] [MAIN ] KFRC: Starting full primary refresh. [2025-10-28T19:35:21.554884] [INFO ] [REMOTE ] KFRC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:35:21.555306] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-01. [2025-10-28T19:35:21.954720] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-28T19:35:21.964035] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-06. [2025-10-28T19:35:22.360169] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-28T19:35:22.362897] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-02. [2025-10-28T19:35:22.928187] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-10-28T19:35:22.933329] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-03. [2025-10-28T19:35:22.969968] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-28T19:35:22.978505] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-07. [2025-10-28T19:35:24.103621] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-28T19:35:24.112898] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-08. [2025-10-28T19:35:26.707922] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-04 (11.05 seconds). [2025-10-28T19:35:26.719490] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-05. [2025-10-28T19:35:28.046688] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-28T19:35:28.058124] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-06. [2025-10-28T19:35:29.308734] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-28T19:35:29.319788] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-07. [2025-10-28T19:35:30.757869] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-10-28T19:35:30.771541] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-08. [2025-10-28T19:35:32.119257] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-10-28T19:35:32.130448] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-09. [2025-10-28T19:35:33.343542] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-28T19:35:33.354537] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-10. [2025-10-28T19:35:34.097782] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-10 (0.74 seconds). [2025-10-28T19:35:34.108416] [INFO ] [REMOTE ] KEY: Full fetch complete (77427 records). [2025-10-28T19:35:34.108528] [DEBUG] [VALIDATOR ] KEY: Validating primary data. [2025-10-28T19:35:34.301797] [WARN ] [VALIDATOR ] KEY: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-28T19:35:34.302552] [FATAL] [MAIN ] KEY: Fetched primary data is invalid. Refusing to save it. [2025-10-28T19:35:34.302626] [WARN ] [MAIN ] KEY: Deleting existing primary and derivative data due to validation failure. [2025-10-28T19:35:34.302741] [INFO ] [LOCAL ] KEY: Starting deletion of primary data. [2025-10-28T19:35:34.302814] [DEBUG] [LOCAL ] KEY: No primary data file found to delete. [2025-10-28T19:35:34.302854] [INFO ] [LOCAL ] KEY: Starting deletion of derivative data. [2025-10-28T19:35:34.302896] [DEBUG] [LOCAL ] KEY: No derivative data file found to delete. [2025-10-28T19:35:34.302957] [INFO ] [MAIN ] Update Progress: 1184/2366 symbols completed. KEY took 33.2s. Estimated remaining: 2h 35m 16s. Rate: 7.6 symbols/min [2025-10-28T19:35:34.470367] [INFO ] [MAIN ] KFS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:35:34.480696] [DEBUG] [LOCAL ] KFS: Loaded 8681 existing records from primary storage. [2025-10-28T19:35:34.480893] [INFO ] [MAIN ] KFS: Loaded 8681 existing records. [2025-10-28T19:35:34.659028] [WARN ] [MAIN ] KFS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:35:34.679900] [INFO ] [MAIN ] KFS: Wiping existing primary data before full refresh. [2025-10-28T19:35:34.682493] [INFO ] [LOCAL ] KFS: Starting deletion of primary data. [2025-10-28T19:35:34.682959] [DEBUG] [LOCAL ] KFS: Deleted primary data file. [2025-10-28T19:35:34.684215] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-09 (15.08 seconds). [2025-10-28T19:35:34.683393] [INFO ] [MAIN ] KFS: Starting full primary refresh. [2025-10-28T19:35:34.737791] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-10. [2025-10-28T19:35:35.060625] [INFO ] [REMOTE ] KFS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:35:35.060956] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-01. [2025-10-28T19:35:35.739930] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-28T19:35:35.741777] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-02. [2025-10-28T19:35:35.972931] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-28T19:35:35.981722] [INFO ] [REMOTE ] KEX: Full fetch complete (56210 records). [2025-10-28T19:35:35.981867] [DEBUG] [VALIDATOR ] KEX: Validating primary data. [2025-10-28T19:35:36.094913] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-10-28T19:35:36.106864] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-03. [2025-10-28T19:35:36.370864] [DEBUG] [VALIDATOR ] KEX: All expected trading days are present. [2025-10-28T19:35:36.370991] [DEBUG] [VALIDATOR ] KEX: Primary data validation passed. [2025-10-28T19:35:36.371945] [INFO ] [MAIN ] KEX: Fetched primary data is valid. [2025-10-28T19:35:36.372007] [DEBUG] [LOCAL ] KEX: Saving primary data. [2025-10-28T19:35:36.373136] [DEBUG] [LOCAL ] KEX: Trimmed 56210 records to 38656 (keeping 200 days of data) [2025-10-28T19:35:36.599827] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-10-28T19:35:36.603822] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-04. [2025-10-28T19:35:36.609921] [DEBUG] [LOCAL ] KEX: Primary data saved (38656 records). [2025-10-28T19:35:36.610075] [INFO ] [MAIN ] KEX: Full history saved. [2025-10-28T19:35:36.610174] [INFO ] [MAIN ] Update Progress: 1185/2366 symbols completed. KEX took 41.1s. Estimated remaining: 2h 35m 2s. Rate: 7.6 symbols/min [2025-10-28T19:35:36.780012] [INFO ] [MAIN ] KFY: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:35:36.780190] [DEBUG] [LOCAL ] KFY: No existing data file found in primary storage. [2025-10-28T19:35:36.780272] [WARN ] [MAIN ] KFY: No existing data found, performing full refresh instead. [2025-10-28T19:35:36.780404] [INFO ] [MAIN ] KFY: Wiping existing primary data before full refresh. [2025-10-28T19:35:36.780451] [INFO ] [LOCAL ] KFY: Starting deletion of primary data. [2025-10-28T19:35:36.780500] [DEBUG] [LOCAL ] KFY: No primary data file found to delete. [2025-10-28T19:35:36.780538] [INFO ] [MAIN ] KFY: Starting full primary refresh. [2025-10-28T19:35:37.154053] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-28T19:35:37.153776] [INFO ] [REMOTE ] KFY: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:35:37.156662] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-05. [2025-10-28T19:35:37.157680] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-01. [2025-10-28T19:35:37.168462] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-03 (14.24 seconds). [2025-10-28T19:35:37.172392] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-04. [2025-10-28T19:35:37.647811] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-10-28T19:35:37.650128] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-06. [2025-10-28T19:35:37.951347] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-28T19:35:37.955896] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-05. [2025-10-28T19:35:38.153904] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-10-28T19:35:38.156463] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-07. [2025-10-28T19:35:38.188468] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-28T19:35:38.194101] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-02. [2025-10-28T19:35:38.657210] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-28T19:35:38.661961] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-06. [2025-10-28T19:35:39.156484] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-28T19:35:39.163378] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-03. [2025-10-28T19:35:40.213518] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-28T19:35:40.225803] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-04. [2025-10-28T19:35:40.432988] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-07 (2.28 seconds). [2025-10-28T19:35:40.435805] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-08. [2025-10-28T19:35:40.987017] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-10-28T19:35:40.989599] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-09. [2025-10-28T19:35:41.349114] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-28T19:35:41.363786] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-10-28T19:35:41.580238] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-10. [2025-10-28T19:35:42.102031] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-28T19:35:42.104316] [INFO ] [REMOTE ] KFS: Full fetch complete (11347 records). [2025-10-28T19:35:42.104382] [DEBUG] [VALIDATOR ] KFS: Validating primary data. [2025-10-28T19:35:42.382746] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-05. [2025-10-28T19:35:42.463017] [DEBUG] [VALIDATOR ] KFS: All expected trading days are present. [2025-10-28T19:35:42.463092] [DEBUG] [VALIDATOR ] KFS: Primary data validation passed. [2025-10-28T19:35:42.463382] [INFO ] [MAIN ] KFS: Fetched primary data is valid. [2025-10-28T19:35:42.463421] [DEBUG] [LOCAL ] KFS: Saving primary data. [2025-10-28T19:35:42.463904] [DEBUG] [LOCAL ] KFS: Trimmed 11347 records to 8698 (keeping 200 days of data) [2025-10-28T19:35:42.512379] [DEBUG] [LOCAL ] KFS: Primary data saved (8698 records). [2025-10-28T19:35:42.512498] [INFO ] [MAIN ] KFS: Full history saved. [2025-10-28T19:35:42.512587] [INFO ] [MAIN ] Update Progress: 1186/2366 symbols completed. KFS took 8.2s. Estimated remaining: 2h 34m 52s. Rate: 7.6 symbols/min [2025-10-28T19:35:42.677751] [INFO ] [MAIN ] KGC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:35:42.727389] [DEBUG] [LOCAL ] KGC: Loaded 53699 existing records from primary storage. [2025-10-28T19:35:42.727697] [INFO ] [MAIN ] KGC: Loaded 53699 existing records. [2025-10-28T19:35:42.905292] [WARN ] [MAIN ] KGC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:35:42.905722] [INFO ] [MAIN ] KGC: Wiping existing primary data before full refresh. [2025-10-28T19:35:42.905778] [INFO ] [LOCAL ] KGC: Starting deletion of primary data. [2025-10-28T19:35:42.906474] [DEBUG] [LOCAL ] KGC: Deleted primary data file. [2025-10-28T19:35:42.906531] [INFO ] [MAIN ] KGC: Starting full primary refresh. [2025-10-28T19:35:43.260300] [INFO ] [REMOTE ] KGC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:35:43.260727] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-01. [2025-10-28T19:35:43.276750] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-10-28T19:35:43.985339] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-06. [2025-10-28T19:35:44.003712] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-08 (19.89 seconds). [2025-10-28T19:35:44.780236] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-09. [2025-10-28T19:35:44.843999] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-10-28T19:35:44.923139] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-28T19:35:45.580347] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-02. [2025-10-28T19:35:45.966143] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-28T19:35:46.017854] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-06 (7.36 seconds). [2025-10-28T19:35:46.380312] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-07. [2025-10-28T19:35:47.180270] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-07. [2025-10-28T19:35:47.980270] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-10. [2025-10-28T19:35:48.066062] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-10-28T19:35:48.780302] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-08. [2025-10-28T19:35:49.360411] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-10 (1.38 seconds). [2025-10-28T19:35:49.369496] [INFO ] [REMOTE ] KEYS: Full fetch complete (63158 records). [2025-10-28T19:35:49.369700] [DEBUG] [VALIDATOR ] KEYS: Validating primary data. [2025-10-28T19:35:49.773405] [DEBUG] [VALIDATOR ] KEYS: All expected trading days are present. [2025-10-28T19:35:49.773602] [DEBUG] [VALIDATOR ] KEYS: Primary data validation passed. [2025-10-28T19:35:49.774561] [INFO ] [MAIN ] KEYS: Fetched primary data is valid. [2025-10-28T19:35:49.774662] [DEBUG] [LOCAL ] KEYS: Saving primary data. [2025-10-28T19:35:49.790418] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-28T19:35:49.796067] [DEBUG] [LOCAL ] KEYS: Trimmed 63158 records to 42890 (keeping 200 days of data) [2025-10-28T19:35:49.797134] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-09. [2025-10-28T19:35:50.059330] [DEBUG] [LOCAL ] KEYS: Primary data saved (42890 records). [2025-10-28T19:35:50.059481] [INFO ] [MAIN ] KEYS: Full history saved. [2025-10-28T19:35:50.059566] [INFO ] [MAIN ] Update Progress: 1187/2366 symbols completed. KEYS took 46.9s. Estimated remaining: 2h 34m 44s. Rate: 7.6 symbols/min [2025-10-28T19:35:50.233829] [INFO ] [MAIN ] KGS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:35:50.276425] [DEBUG] [LOCAL ] KGS: Loaded 45875 existing records from primary storage. [2025-10-28T19:35:50.276767] [INFO ] [MAIN ] KGS: Loaded 45875 existing records. [2025-10-28T19:35:50.460313] [WARN ] [MAIN ] KGS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:35:50.460536] [INFO ] [MAIN ] KGS: Wiping existing primary data before full refresh. [2025-10-28T19:35:50.460589] [INFO ] [LOCAL ] KGS: Starting deletion of primary data. [2025-10-28T19:35:50.461136] [DEBUG] [LOCAL ] KGS: Deleted primary data file. [2025-10-28T19:35:50.461193] [INFO ] [MAIN ] KGS: Starting full primary refresh. [2025-10-28T19:35:50.833908] [INFO ] [REMOTE ] KGS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:35:50.834319] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-01. [2025-10-28T19:35:50.853546] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-28T19:35:51.180285] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-10. [2025-10-28T19:35:52.178360] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-10 (1.00 seconds). [2025-10-28T19:35:52.184138] [INFO ] [REMOTE ] KFY: Full fetch complete (43235 records). [2025-10-28T19:35:52.184220] [DEBUG] [VALIDATOR ] KFY: Validating primary data. [2025-10-28T19:35:52.552389] [DEBUG] [VALIDATOR ] KFY: All expected trading days are present. [2025-10-28T19:35:52.552461] [DEBUG] [VALIDATOR ] KFY: Primary data validation passed. [2025-10-28T19:35:52.553198] [INFO ] [MAIN ] KFY: Fetched primary data is valid. [2025-10-28T19:35:52.553258] [DEBUG] [LOCAL ] KFY: Saving primary data. [2025-10-28T19:35:52.554143] [DEBUG] [LOCAL ] KFY: Trimmed 43235 records to 28988 (keeping 200 days of data) [2025-10-28T19:35:52.731018] [DEBUG] [LOCAL ] KFY: Primary data saved (28988 records). [2025-10-28T19:35:52.731173] [INFO ] [MAIN ] KFY: Full history saved. [2025-10-28T19:35:52.731250] [INFO ] [MAIN ] Update Progress: 1188/2366 symbols completed. KFY took 16.1s. Estimated remaining: 2h 34m 31s. Rate: 7.6 symbols/min [2025-10-28T19:35:52.899395] [INFO ] [MAIN ] KIM: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:35:52.947921] [DEBUG] [LOCAL ] KIM: Loaded 52988 existing records from primary storage. [2025-10-28T19:35:52.948231] [INFO ] [MAIN ] KIM: Loaded 52988 existing records. [2025-10-28T19:35:53.050592] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-07 (6.67 seconds). [2025-10-28T19:35:53.081994] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-08. [2025-10-28T19:35:53.143575] [WARN ] [MAIN ] KIM: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:35:53.143759] [INFO ] [MAIN ] KIM: Wiping existing primary data before full refresh. [2025-10-28T19:35:53.143807] [INFO ] [LOCAL ] KIM: Starting deletion of primary data. [2025-10-28T19:35:53.144563] [DEBUG] [LOCAL ] KIM: Deleted primary data file. [2025-10-28T19:35:53.144621] [INFO ] [MAIN ] KIM: Starting full primary refresh. [2025-10-28T19:35:53.505716] [INFO ] [REMOTE ] KIM: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:35:53.506043] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-01. [2025-10-28T19:35:53.905982] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-28T19:35:53.912010] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-09. [2025-10-28T19:35:54.732785] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-10-28T19:35:54.761833] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-02. [2025-10-28T19:35:54.776863] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-02 (9.20 seconds). [2025-10-28T19:35:55.180290] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-03. [2025-10-28T19:35:55.927182] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-28T19:35:55.980211] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-03. [2025-10-28T19:35:56.501952] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-28T19:35:56.780362] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-04. [2025-10-28T19:35:57.201423] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-28T19:35:57.580277] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-04. [2025-10-28T19:35:58.329171] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-01 (7.49 seconds). [2025-10-28T19:35:58.380232] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-02. [2025-10-28T19:35:58.574397] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-09 (4.66 seconds). [2025-10-28T19:35:58.834680] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-28T19:35:59.180309] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-10. [2025-10-28T19:35:59.436527] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-28T19:35:59.980348] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-03. [2025-10-28T19:36:00.241161] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-28T19:36:00.247149] [INFO ] [REMOTE ] KFRC: Full fetch complete (27420 records). [2025-10-28T19:36:00.247237] [DEBUG] [VALIDATOR ] KFRC: Validating primary data. [2025-10-28T19:36:00.660294] [DEBUG] [VALIDATOR ] KFRC: All expected trading days are present. [2025-10-28T19:36:00.660374] [DEBUG] [VALIDATOR ] KFRC: Primary data validation passed. [2025-10-28T19:36:00.660973] [INFO ] [MAIN ] KFRC: Fetched primary data is valid. [2025-10-28T19:36:00.661038] [DEBUG] [LOCAL ] KFRC: Saving primary data. [2025-10-28T19:36:00.661742] [DEBUG] [LOCAL ] KFRC: Trimmed 27420 records to 20978 (keeping 200 days of data) [2025-10-28T19:36:00.781879] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-05. [2025-10-28T19:36:00.784851] [DEBUG] [LOCAL ] KFRC: Primary data saved (20978 records). [2025-10-28T19:36:00.784939] [INFO ] [MAIN ] KFRC: Full history saved. [2025-10-28T19:36:00.785769] [INFO ] [MAIN ] Update Progress: 1189/2366 symbols completed. KFRC took 40.0s. Estimated remaining: 2h 34m 23s. Rate: 7.6 symbols/min [2025-10-28T19:36:00.952723] [INFO ] [MAIN ] KIO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:36:00.973967] [DEBUG] [LOCAL ] KIO: Loaded 21584 existing records from primary storage. [2025-10-28T19:36:00.974233] [INFO ] [MAIN ] KIO: Loaded 21584 existing records. [2025-10-28T19:36:01.151877] [WARN ] [MAIN ] KIO: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:36:01.152232] [INFO ] [MAIN ] KIO: Wiping existing primary data before full refresh. [2025-10-28T19:36:01.152289] [INFO ] [LOCAL ] KIO: Starting deletion of primary data. [2025-10-28T19:36:01.152544] [DEBUG] [LOCAL ] KIO: Deleted primary data file. [2025-10-28T19:36:01.152584] [INFO ] [MAIN ] KIO: Starting full primary refresh. [2025-10-28T19:36:01.537233] [INFO ] [REMOTE ] KIO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:36:01.532208] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-28T19:36:01.580475] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-04. [2025-10-28T19:36:02.155366] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-10-28T19:36:02.380313] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-01. [2025-10-28T19:36:02.857826] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-28T19:36:03.180258] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-05. [2025-10-28T19:36:03.980254] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-06. [2025-10-28T19:36:04.377046] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-28T19:36:04.780257] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-06. [2025-10-28T19:36:05.074853] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-10-28T19:36:05.580253] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-07. [2025-10-28T19:36:05.802565] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-28T19:36:06.380298] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-07. [2025-10-28T19:36:06.689716] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-01 (4.31 seconds). [2025-10-28T19:36:07.073896] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-10-28T19:36:07.180227] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-08. [2025-10-28T19:36:07.510072] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-28T19:36:07.980300] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-02. [2025-10-28T19:36:08.269877] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-04 (11.49 seconds). [2025-10-28T19:36:08.676058] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-10-28T19:36:08.763635] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-10-28T19:36:08.780238] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-03. [2025-10-28T19:36:09.580270] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-09. [2025-10-28T19:36:09.641431] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-28T19:36:10.380300] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-08. [2025-10-28T19:36:10.716491] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-10-28T19:36:11.180307] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-10. [2025-10-28T19:36:11.655924] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-10-28T19:36:11.980291] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-09. [2025-10-28T19:36:12.598558] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-28T19:36:12.610582] [INFO ] [REMOTE ] KIM: Full fetch complete (76971 records). [2025-10-28T19:36:12.610869] [DEBUG] [VALIDATOR ] KIM: Validating primary data. [2025-10-28T19:36:12.781049] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-05. [2025-10-28T19:36:13.037136] [DEBUG] [VALIDATOR ] KIM: All expected trading days are present. [2025-10-28T19:36:13.037352] [DEBUG] [VALIDATOR ] KIM: Primary data validation passed. [2025-10-28T19:36:13.038867] [INFO ] [MAIN ] KIM: Fetched primary data is valid. [2025-10-28T19:36:13.038949] [DEBUG] [LOCAL ] KIM: Saving primary data. [2025-10-28T19:36:13.041016] [DEBUG] [LOCAL ] KIM: Trimmed 76971 records to 52988 (keeping 200 days of data) [2025-10-28T19:36:13.309681] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-28T19:36:13.447305] [DEBUG] [LOCAL ] KIM: Primary data saved (52988 records). [2025-10-28T19:36:13.447512] [INFO ] [MAIN ] KIM: Full history saved. [2025-10-28T19:36:13.447617] [INFO ] [MAIN ] Update Progress: 1190/2366 symbols completed. KIM took 20.7s. Estimated remaining: 2h 34m 20s. Rate: 7.6 symbols/min [2025-10-28T19:36:13.585432] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-04. [2025-10-28T19:36:13.635340] [INFO ] [MAIN ] KKR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:36:13.698202] [DEBUG] [LOCAL ] KKR: Loaded 53494 existing records from primary storage. [2025-10-28T19:36:13.698816] [INFO ] [MAIN ] KKR: Loaded 53494 existing records. [2025-10-28T19:36:13.888154] [WARN ] [MAIN ] KKR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:36:13.888474] [INFO ] [MAIN ] KKR: Wiping existing primary data before full refresh. [2025-10-28T19:36:13.888525] [INFO ] [LOCAL ] KKR: Starting deletion of primary data. [2025-10-28T19:36:13.889301] [DEBUG] [LOCAL ] KKR: Deleted primary data file. [2025-10-28T19:36:13.889360] [INFO ] [MAIN ] KKR: Starting full primary refresh. [2025-10-28T19:36:14.270203] [INFO ] [REMOTE ] KKR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:36:14.370005] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-10-28T19:36:14.380200] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-05. [2025-10-28T19:36:15.180256] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-10. [2025-10-28T19:36:15.980320] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-01. [2025-10-28T19:36:16.654507] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-28T19:36:16.663900] [INFO ] [REMOTE ] KGS: Full fetch complete (66579 records). [2025-10-28T19:36:16.664049] [DEBUG] [VALIDATOR ] KGS: Validating primary data. [2025-10-28T19:36:17.072595] [DEBUG] [VALIDATOR ] KGS: All expected trading days are present. [2025-10-28T19:36:17.072700] [DEBUG] [VALIDATOR ] KGS: Primary data validation passed. [2025-10-28T19:36:17.073625] [INFO ] [MAIN ] KGS: Fetched primary data is valid. [2025-10-28T19:36:17.073698] [DEBUG] [LOCAL ] KGS: Saving primary data. [2025-10-28T19:36:17.074985] [DEBUG] [LOCAL ] KGS: Trimmed 66579 records to 45848 (keeping 200 days of data) [2025-10-28T19:36:17.344760] [DEBUG] [LOCAL ] KGS: Primary data saved (45848 records). [2025-10-28T19:36:17.344887] [INFO ] [MAIN ] KGS: Full history saved. [2025-10-28T19:36:17.344989] [INFO ] [MAIN ] Update Progress: 1191/2366 symbols completed. KGS took 27.3s. Estimated remaining: 2h 34m 8s. Rate: 7.6 symbols/min [2025-10-28T19:36:17.519047] [INFO ] [MAIN ] KKRS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:36:17.527090] [DEBUG] [LOCAL ] KKRS: Loaded 5455 existing records from primary storage. [2025-10-28T19:36:17.527303] [INFO ] [MAIN ] KKRS: Loaded 5455 existing records. [2025-10-28T19:36:17.709244] [WARN ] [MAIN ] KKRS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:36:17.709464] [INFO ] [MAIN ] KKRS: Wiping existing primary data before full refresh. [2025-10-28T19:36:17.709512] [INFO ] [LOCAL ] KKRS: Starting deletion of primary data. [2025-10-28T19:36:17.709736] [DEBUG] [LOCAL ] KKRS: Deleted primary data file. [2025-10-28T19:36:17.709796] [INFO ] [MAIN ] KKRS: Starting full primary refresh. [2025-10-28T19:36:18.085019] [INFO ] [REMOTE ] KKRS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:36:18.085363] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-01. [2025-10-28T19:36:21.952123] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-05 (9.17 seconds). [2025-10-28T19:36:21.964932] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-06. [2025-10-28T19:36:23.509759] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-05 (9.13 seconds). [2025-10-28T19:36:23.515067] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-06. [2025-10-28T19:36:23.564570] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-10-28T19:36:23.575607] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-07. [2025-10-28T19:36:24.218305] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-28T19:36:24.222870] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-07. [2025-10-28T19:36:25.050990] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-10-28T19:36:25.056622] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-08. [2025-10-28T19:36:25.270120] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-10-28T19:36:25.282182] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-08. [2025-10-28T19:36:25.862681] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-10-28T19:36:25.868186] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-09. [2025-10-28T19:36:26.674096] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-28T19:36:26.698156] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-09. [2025-10-28T19:36:26.700443] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-10-28T19:36:26.708371] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-10. [2025-10-28T19:36:26.978317] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-01 (11.00 seconds). [2025-10-28T19:36:26.991319] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-02. [2025-10-28T19:36:27.481044] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-01 (9.40 seconds). [2025-10-28T19:36:27.483265] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-02. [2025-10-28T19:36:27.680187] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-28T19:36:27.686347] [INFO ] [REMOTE ] KIO: Full fetch complete (32570 records). [2025-10-28T19:36:27.686471] [DEBUG] [VALIDATOR ] KIO: Validating primary data. [2025-10-28T19:36:28.098448] [DEBUG] [VALIDATOR ] KIO: All expected trading days are present. [2025-10-28T19:36:28.098548] [DEBUG] [VALIDATOR ] KIO: Primary data validation passed. [2025-10-28T19:36:28.099296] [INFO ] [MAIN ] KIO: Fetched primary data is valid. [2025-10-28T19:36:28.099371] [DEBUG] [LOCAL ] KIO: Saving primary data. [2025-10-28T19:36:28.100488] [DEBUG] [LOCAL ] KIO: Trimmed 32570 records to 21659 (keeping 200 days of data) [2025-10-28T19:36:28.271078] [DEBUG] [LOCAL ] KIO: Primary data saved (21659 records). [2025-10-28T19:36:28.271284] [INFO ] [MAIN ] KIO: Full history saved. [2025-10-28T19:36:28.271603] [INFO ] [MAIN ] Update Progress: 1192/2366 symbols completed. KIO took 27.5s. Estimated remaining: 2h 34m 4s. Rate: 7.6 symbols/min [2025-10-28T19:36:28.305294] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-10-28T19:36:28.368004] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-10. [2025-10-28T19:36:28.460688] [INFO ] [MAIN ] KKRT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:36:28.460865] [DEBUG] [LOCAL ] KKRT: No existing data file found in primary storage. [2025-10-28T19:36:28.460902] [WARN ] [MAIN ] KKRT: No existing data found, performing full refresh instead. [2025-10-28T19:36:28.461011] [INFO ] [MAIN ] KKRT: Wiping existing primary data before full refresh. [2025-10-28T19:36:28.461050] [INFO ] [LOCAL ] KKRT: Starting deletion of primary data. [2025-10-28T19:36:28.461089] [DEBUG] [LOCAL ] KKRT: No primary data file found to delete. [2025-10-28T19:36:28.461120] [INFO ] [MAIN ] KKRT: Starting full primary refresh. [2025-10-28T19:36:28.676919] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-28T19:36:28.724531] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-03. [2025-10-28T19:36:28.831563] [INFO ] [REMOTE ] KKRT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:36:28.831904] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-01. [2025-10-28T19:36:28.971864] [DEBUG] [REMOTE ] KKRT: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-28T19:36:28.972196] [WARN ] [REMOTE ] KKRT: No data returned for month 2025-01 [2025-10-28T19:36:28.972286] [FATAL] [REMOTE ] KKRT: API call failed - aborting fetch to avoid wasting further API calls [2025-10-28T19:36:28.972331] [FATAL] [MAIN ] KKRT: Failed to fetch primary data. [2025-10-28T19:36:28.972387] [WARN ] [MAIN ] KKRT: Deleting existing primary and derivative data due to fetch failure. [2025-10-28T19:36:28.972457] [INFO ] [LOCAL ] KKRT: Starting deletion of primary data. [2025-10-28T19:36:28.972519] [DEBUG] [LOCAL ] KKRT: No primary data file found to delete. [2025-10-28T19:36:28.972554] [INFO ] [LOCAL ] KKRT: Starting deletion of derivative data. [2025-10-28T19:36:28.972591] [DEBUG] [LOCAL ] KKRT: No derivative data file found to delete. [2025-10-28T19:36:28.972636] [INFO ] [MAIN ] Update Progress: 1193/2366 symbols completed. KKRT took 0.7s. Estimated remaining: 2h 33m 49s. Rate: 7.6 symbols/min [2025-10-28T19:36:29.144713] [INFO ] [MAIN ] KLAR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:36:29.144979] [DEBUG] [LOCAL ] KLAR: No existing data file found in primary storage. [2025-10-28T19:36:29.145054] [WARN ] [MAIN ] KLAR: No existing data found, performing full refresh instead. [2025-10-28T19:36:29.145214] [INFO ] [MAIN ] KLAR: Wiping existing primary data before full refresh. [2025-10-28T19:36:29.150119] [INFO ] [LOCAL ] KLAR: Starting deletion of primary data. [2025-10-28T19:36:29.150993] [DEBUG] [LOCAL ] KLAR: No primary data file found to delete. [2025-10-28T19:36:29.151051] [INFO ] [MAIN ] KLAR: Starting full primary refresh. [2025-10-28T19:36:29.151432] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-28T19:36:29.197284] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-04. [2025-10-28T19:36:29.538476] [INFO ] [REMOTE ] KLAR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:36:29.580247] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-01. [2025-10-28T19:36:29.716242] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-10-28T19:36:29.736569] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-28T19:36:29.736911] [WARN ] [REMOTE ] KLAR: No data returned for month 2025-01 [2025-10-28T19:36:29.736997] [FATAL] [REMOTE ] KLAR: API call failed - aborting fetch to avoid wasting further API calls [2025-10-28T19:36:29.737075] [FATAL] [MAIN ] KLAR: Failed to fetch primary data. [2025-10-28T19:36:29.737138] [WARN ] [MAIN ] KLAR: Deleting existing primary and derivative data due to fetch failure. [2025-10-28T19:36:29.737209] [INFO ] [LOCAL ] KLAR: Starting deletion of primary data. [2025-10-28T19:36:29.737270] [DEBUG] [LOCAL ] KLAR: No primary data file found to delete. [2025-10-28T19:36:29.737304] [INFO ] [LOCAL ] KLAR: Starting deletion of derivative data. [2025-10-28T19:36:29.737343] [DEBUG] [LOCAL ] KLAR: No derivative data file found to delete. [2025-10-28T19:36:29.737390] [INFO ] [MAIN ] Update Progress: 1194/2366 symbols completed. KLAR took 0.8s. Estimated remaining: 2h 33m 34s. Rate: 7.6 symbols/min [2025-10-28T19:36:29.901371] [INFO ] [MAIN ] KLC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:36:29.937347] [DEBUG] [LOCAL ] KLC: Loaded 35861 existing records from primary storage. [2025-10-28T19:36:29.937633] [INFO ] [MAIN ] KLC: Loaded 35861 existing records. [2025-10-28T19:36:30.110041] [WARN ] [MAIN ] KLC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:36:30.110330] [INFO ] [MAIN ] KLC: Wiping existing primary data before full refresh. [2025-10-28T19:36:30.110387] [INFO ] [LOCAL ] KLC: Starting deletion of primary data. [2025-10-28T19:36:30.110709] [DEBUG] [LOCAL ] KLC: Deleted primary data file. [2025-10-28T19:36:30.110767] [INFO ] [MAIN ] KLC: Starting full primary refresh. [2025-10-28T19:36:30.385516] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-05. [2025-10-28T19:36:30.468104] [INFO ] [REMOTE ] KLC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:36:30.496487] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-10 (2.13 seconds). [2025-10-28T19:36:30.507336] [INFO ] [REMOTE ] KGC: Full fetch complete (77875 records). [2025-10-28T19:36:30.507455] [DEBUG] [VALIDATOR ] KGC: Validating primary data. [2025-10-28T19:36:30.906931] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-10-28T19:36:30.907148] [DEBUG] [VALIDATOR ] KGC: All expected trading days are present. [2025-10-28T19:36:30.909452] [DEBUG] [VALIDATOR ] KGC: Primary data validation passed. [2025-10-28T19:36:30.910478] [INFO ] [MAIN ] KGC: Fetched primary data is valid. [2025-10-28T19:36:30.910540] [DEBUG] [LOCAL ] KGC: Saving primary data. [2025-10-28T19:36:30.911956] [DEBUG] [LOCAL ] KGC: Trimmed 77875 records to 53699 (keeping 200 days of data) [2025-10-28T19:36:31.186524] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-06. [2025-10-28T19:36:31.234547] [DEBUG] [LOCAL ] KGC: Primary data saved (53699 records). [2025-10-28T19:36:31.234681] [INFO ] [MAIN ] KGC: Full history saved. [2025-10-28T19:36:31.234787] [INFO ] [MAIN ] Update Progress: 1195/2366 symbols completed. KGC took 48.7s. Estimated remaining: 2h 33m 20s. Rate: 7.6 symbols/min [2025-10-28T19:36:31.410376] [INFO ] [MAIN ] KMI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:36:31.466044] [DEBUG] [LOCAL ] KMI: Loaded 53693 existing records from primary storage. [2025-10-28T19:36:31.466337] [INFO ] [MAIN ] KMI: Loaded 53693 existing records. [2025-10-28T19:36:31.640953] [WARN ] [MAIN ] KMI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:36:31.641173] [INFO ] [MAIN ] KMI: Wiping existing primary data before full refresh. [2025-10-28T19:36:31.641219] [INFO ] [LOCAL ] KMI: Starting deletion of primary data. [2025-10-28T19:36:31.641587] [DEBUG] [LOCAL ] KMI: Deleted primary data file. [2025-10-28T19:36:31.641677] [INFO ] [MAIN ] KMI: Starting full primary refresh. [2025-10-28T19:36:31.987923] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-01. [2025-10-28T19:36:31.992296] [INFO ] [REMOTE ] KMI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:36:32.780220] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-01. [2025-10-28T19:36:32.989233] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-28T19:36:33.580252] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-02. [2025-10-28T19:36:34.328345] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-10-28T19:36:34.380282] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-02. [2025-10-28T19:36:34.471698] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-28T19:36:34.706112] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-02 (7.71 seconds). [2025-10-28T19:36:35.180235] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-03. [2025-10-28T19:36:35.233625] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-06 (4.05 seconds). [2025-10-28T19:36:35.752322] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-28T19:36:35.980258] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-07. [2025-10-28T19:36:36.780286] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-03. [2025-10-28T19:36:37.327374] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-28T19:36:37.580324] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-03. [2025-10-28T19:36:38.199207] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-28T19:36:38.380258] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-04. [2025-10-28T19:36:39.180244] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-08. [2025-10-28T19:36:39.955475] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-10-28T19:36:39.980230] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-05. [2025-10-28T19:36:41.305901] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-03 (6.13 seconds). [2025-10-28T19:36:41.313513] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-04. [2025-10-28T19:36:42.150761] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-08 (2.97 seconds). [2025-10-28T19:36:42.152513] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-09. [2025-10-28T19:36:42.379224] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-28T19:36:42.388080] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-05. [2025-10-28T19:36:42.591358] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-10-28T19:36:43.180291] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-10. [2025-10-28T19:36:43.584770] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-10 (0.40 seconds). [2025-10-28T19:36:43.585980] [INFO ] [REMOTE ] KKRS: Full fetch complete (7498 records). [2025-10-28T19:36:43.586052] [DEBUG] [VALIDATOR ] KKRS: Validating primary data. [2025-10-28T19:36:43.953759] [DEBUG] [VALIDATOR ] KKRS: All expected trading days are present. [2025-10-28T19:36:43.953892] [DEBUG] [VALIDATOR ] KKRS: Primary data validation passed. [2025-10-28T19:36:43.954313] [INFO ] [MAIN ] KKRS: Fetched primary data is valid. [2025-10-28T19:36:43.954446] [DEBUG] [LOCAL ] KKRS: Saving primary data. [2025-10-28T19:36:43.955629] [DEBUG] [LOCAL ] KKRS: Trimmed 7498 records to 5436 (keeping 200 days of data) [2025-10-28T19:36:44.000744] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-10-28T19:36:44.018393] [DEBUG] [LOCAL ] KKRS: Primary data saved (5436 records). [2025-10-28T19:36:44.018485] [INFO ] [MAIN ] KKRS: Full history saved. [2025-10-28T19:36:44.018589] [INFO ] [MAIN ] Update Progress: 1196/2366 symbols completed. KKRS took 26.7s. Estimated remaining: 2h 33m 17s. Rate: 7.6 symbols/min [2025-10-28T19:36:44.018957] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-06. [2025-10-28T19:36:44.187981] [INFO ] [MAIN ] KMPB: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:36:44.193596] [DEBUG] [LOCAL ] KMPB: Loaded 3417 existing records from primary storage. [2025-10-28T19:36:44.193782] [INFO ] [MAIN ] KMPB: Loaded 3417 existing records. [2025-10-28T19:36:44.368269] [WARN ] [MAIN ] KMPB: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:36:44.368446] [INFO ] [MAIN ] KMPB: Wiping existing primary data before full refresh. [2025-10-28T19:36:44.368490] [INFO ] [LOCAL ] KMPB: Starting deletion of primary data. [2025-10-28T19:36:44.368612] [DEBUG] [LOCAL ] KMPB: Deleted primary data file. [2025-10-28T19:36:44.368684] [INFO ] [MAIN ] KMPB: Starting full primary refresh. [2025-10-28T19:36:44.713415] [INFO ] [REMOTE ] KMPB: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:36:44.780209] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-01. [2025-10-28T19:36:45.063270] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-10-28T19:36:45.192818] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-10-28T19:36:45.580290] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-02. [2025-10-28T19:36:46.380230] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-07. [2025-10-28T19:36:47.461776] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-28T19:36:47.469316] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-08. [2025-10-28T19:36:47.645785] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-03 (10.07 seconds). [2025-10-28T19:36:47.980280] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-04. [2025-10-28T19:36:48.122701] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-02 (2.54 seconds). [2025-10-28T19:36:48.480390] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-10-28T19:36:48.729468] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-05 (8.75 seconds). [2025-10-28T19:36:48.780238] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-09. [2025-10-28T19:36:49.535376] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-10-28T19:36:49.580210] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-05. [2025-10-28T19:36:49.793537] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-10-28T19:36:50.380233] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-06. [2025-10-28T19:36:51.048292] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-10-28T19:36:51.180326] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-06. [2025-10-28T19:36:51.522749] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-28T19:36:51.980363] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-10. [2025-10-28T19:36:52.449268] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-10-28T19:36:52.780262] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-07. [2025-10-28T19:36:53.070232] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-28T19:36:53.077818] [INFO ] [REMOTE ] KLC: Full fetch complete (50687 records). [2025-10-28T19:36:53.077920] [DEBUG] [VALIDATOR ] KLC: Validating primary data. [2025-10-28T19:36:53.466227] [DEBUG] [VALIDATOR ] KLC: All expected trading days are present. [2025-10-28T19:36:53.466303] [DEBUG] [VALIDATOR ] KLC: Primary data validation passed. [2025-10-28T19:36:53.467172] [INFO ] [MAIN ] KLC: Fetched primary data is valid. [2025-10-28T19:36:53.467232] [DEBUG] [LOCAL ] KLC: Saving primary data. [2025-10-28T19:36:53.468300] [DEBUG] [LOCAL ] KLC: Trimmed 50687 records to 35763 (keeping 200 days of data) [2025-10-28T19:36:53.581675] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-07. [2025-10-28T19:36:53.667726] [DEBUG] [LOCAL ] KLC: Primary data saved (35763 records). [2025-10-28T19:36:53.667856] [INFO ] [MAIN ] KLC: Full history saved. [2025-10-28T19:36:53.668835] [INFO ] [MAIN ] Update Progress: 1197/2366 symbols completed. KLC took 23.9s. Estimated remaining: 2h 33m 11s. Rate: 7.6 symbols/min [2025-10-28T19:36:54.380253] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-03. [2025-10-28T19:36:54.427378] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-10-28T19:36:54.741796] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-10-28T19:36:55.094382] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-10-28T19:36:55.180287] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-08. [2025-10-28T19:36:55.980257] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-08. [2025-10-28T19:36:56.448821] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-10-28T19:36:56.780276] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-09. [2025-10-28T19:36:57.309682] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-28T19:36:57.580351] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-04. [2025-10-28T19:36:57.887566] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-04 (0.31 seconds). [2025-10-28T19:36:58.170161] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-10-28T19:36:58.380262] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-09. [2025-10-28T19:36:59.180262] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-05. [2025-10-28T19:36:59.408353] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-05 (0.23 seconds). [2025-10-28T19:36:59.851919] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-10-28T19:36:59.980281] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-10. [2025-10-28T19:37:00.780334] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-06. [2025-10-28T19:37:01.580296] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-10. [2025-10-28T19:37:01.588091] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-10-28T19:37:01.874412] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-10 (1.89 seconds). [2025-10-28T19:37:01.886554] [INFO ] [REMOTE ] KKR: Full fetch complete (77655 records). [2025-10-28T19:37:01.886811] [DEBUG] [VALIDATOR ] KKR: Validating primary data. [2025-10-28T19:37:02.304633] [DEBUG] [VALIDATOR ] KKR: All expected trading days are present. [2025-10-28T19:37:02.304807] [DEBUG] [VALIDATOR ] KKR: Primary data validation passed. [2025-10-28T19:37:02.306583] [INFO ] [MAIN ] KKR: Fetched primary data is valid. [2025-10-28T19:37:02.306683] [DEBUG] [LOCAL ] KKR: Saving primary data. [2025-10-28T19:37:02.308933] [DEBUG] [LOCAL ] KKR: Trimmed 77655 records to 53492 (keeping 200 days of data) [2025-10-28T19:37:02.404708] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-07. [2025-10-28T19:37:02.675851] [DEBUG] [LOCAL ] KKR: Primary data saved (53492 records). [2025-10-28T19:37:02.676079] [INFO ] [MAIN ] KKR: Full history saved. [2025-10-28T19:37:02.676221] [INFO ] [MAIN ] Update Progress: 1198/2366 symbols completed. KKR took 49.2s. Estimated remaining: 2h 33m 4s. Rate: 7.6 symbols/min [2025-10-28T19:37:02.753898] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-10-28T19:37:03.180316] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-08. [2025-10-28T19:37:03.539294] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-10-28T19:37:03.980287] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-09. [2025-10-28T19:37:04.352089] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-10-28T19:37:04.780297] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-10. [2025-10-28T19:37:05.204382] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-10 (0.42 seconds). [2025-10-28T19:37:05.205738] [INFO ] [REMOTE ] KMPB: Full fetch complete (4914 records). [2025-10-28T19:37:05.205823] [DEBUG] [VALIDATOR ] KMPB: Validating primary data. [2025-10-28T19:37:05.570426] [DEBUG] [VALIDATOR ] KMPB: All expected trading days are present. [2025-10-28T19:37:05.570512] [DEBUG] [VALIDATOR ] KMPB: Primary data validation passed. [2025-10-28T19:37:05.570721] [INFO ] [MAIN ] KMPB: Fetched primary data is valid. [2025-10-28T19:37:05.570782] [DEBUG] [LOCAL ] KMPB: Saving primary data. [2025-10-28T19:37:05.571149] [DEBUG] [LOCAL ] KMPB: Trimmed 4914 records to 3417 (keeping 200 days of data) [2025-10-28T19:37:05.592072] [DEBUG] [LOCAL ] KMPB: Primary data saved (3417 records). [2025-10-28T19:37:05.592217] [INFO ] [MAIN ] KMPB: Full history saved. [2025-10-28T19:37:05.592302] [INFO ] [MAIN ] Update Progress: 1199/2366 symbols completed. KMPB took 21.6s. Estimated remaining: 2h 32m 51s. Rate: 7.6 symbols/min [2025-10-28T19:37:08.381443] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-10 (6.80 seconds). [2025-10-28T19:37:08.392194] [INFO ] [REMOTE ] KMI: Full fetch complete (77873 records). [2025-10-28T19:37:08.392347] [DEBUG] [VALIDATOR ] KMI: Validating primary data. [2025-10-28T19:37:08.797864] [DEBUG] [VALIDATOR ] KMI: All expected trading days are present. [2025-10-28T19:37:08.797944] [DEBUG] [VALIDATOR ] KMI: Primary data validation passed. [2025-10-28T19:37:08.799224] [INFO ] [MAIN ] KMI: Fetched primary data is valid. [2025-10-28T19:37:08.799313] [DEBUG] [LOCAL ] KMI: Saving primary data. [2025-10-28T19:37:08.800757] [DEBUG] [LOCAL ] KMI: Trimmed 77873 records to 53693 (keeping 200 days of data) [2025-10-28T19:37:09.115638] [DEBUG] [LOCAL ] KMI: Primary data saved (53693 records). [2025-10-28T19:37:09.115796] [INFO ] [MAIN ] KMI: Full history saved. [2025-10-28T19:37:09.115872] [INFO ] [MAIN ] Update Progress: 1200/2366 symbols completed. KMI took 37.9s. Estimated remaining: 2h 32m 39s. Rate: 7.6 symbols/min [2025-10-28T19:37:09.755541] [INFO ] [MAIN ] KMT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:37:09.815056] [INFO ] [MAIN ] KMPR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:37:09.832331] [INFO ] [MAIN ] KMX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:37:09.851913] [INFO ] [MAIN ] KN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:37:09.941761] [DEBUG] [LOCAL ] KN: Loaded 38260 existing records from primary storage. [2025-10-28T19:37:09.941226] [DEBUG] [LOCAL ] KMT: Loaded 42540 existing records from primary storage. [2025-10-28T19:37:09.970284] [INFO ] [MAIN ] KN: Loaded 38260 existing records. [2025-10-28T19:37:09.991943] [DEBUG] [LOCAL ] KMPR: Loaded 40466 existing records from primary storage. [2025-10-28T19:37:09.981595] [INFO ] [MAIN ] KMT: Loaded 42540 existing records. [2025-10-28T19:37:10.007725] [DEBUG] [LOCAL ] KMX: Loaded 53284 existing records from primary storage. [2025-10-28T19:37:10.051607] [INFO ] [MAIN ] KMX: Loaded 53284 existing records. [2025-10-28T19:37:10.051785] [INFO ] [MAIN ] KMPR: Loaded 40466 existing records. [2025-10-28T19:37:10.593354] [WARN ] [MAIN ] KN: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:37:10.603979] [WARN ] [MAIN ] KMT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:37:10.627502] [INFO ] [MAIN ] KN: Wiping existing primary data before full refresh. [2025-10-28T19:37:10.632361] [INFO ] [LOCAL ] KN: Starting deletion of primary data. [2025-10-28T19:37:10.627432] [INFO ] [MAIN ] KMT: Wiping existing primary data before full refresh. [2025-10-28T19:37:10.658139] [INFO ] [LOCAL ] KMT: Starting deletion of primary data. [2025-10-28T19:37:10.682797] [DEBUG] [LOCAL ] KN: Deleted primary data file. [2025-10-28T19:37:10.682942] [INFO ] [MAIN ] KN: Starting full primary refresh. [2025-10-28T19:37:10.687399] [WARN ] [MAIN ] KMX: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:37:10.716829] [INFO ] [MAIN ] KMX: Wiping existing primary data before full refresh. [2025-10-28T19:37:10.735138] [DEBUG] [LOCAL ] KMT: Deleted primary data file. [2025-10-28T19:37:10.751014] [INFO ] [LOCAL ] KMX: Starting deletion of primary data. [2025-10-28T19:37:10.751095] [INFO ] [MAIN ] KMT: Starting full primary refresh. [2025-10-28T19:37:10.777018] [WARN ] [MAIN ] KMPR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:37:10.813502] [DEBUG] [LOCAL ] KMX: Deleted primary data file. [2025-10-28T19:37:10.813864] [INFO ] [MAIN ] KMX: Starting full primary refresh. [2025-10-28T19:37:10.813772] [INFO ] [MAIN ] KMPR: Wiping existing primary data before full refresh. [2025-10-28T19:37:10.875200] [INFO ] [LOCAL ] KMPR: Starting deletion of primary data. [2025-10-28T19:37:11.019486] [DEBUG] [LOCAL ] KMPR: Deleted primary data file. [2025-10-28T19:37:11.059184] [INFO ] [MAIN ] KMPR: Starting full primary refresh. [2025-10-28T19:37:12.027596] [INFO ] [REMOTE ] KMX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:37:12.050454] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-01. [2025-10-28T19:37:12.069876] [INFO ] [REMOTE ] KN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:37:12.116944] [INFO ] [REMOTE ] KMT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:37:12.078588] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-01. [2025-10-28T19:37:12.117722] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-01. [2025-10-28T19:37:12.227968] [INFO ] [REMOTE ] KMPR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:37:12.228235] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-01. [2025-10-28T19:37:13.287632] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-28T19:37:13.293307] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-02. [2025-10-28T19:37:13.383234] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-28T19:37:13.391062] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-02. [2025-10-28T19:37:13.500552] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-28T19:37:13.508520] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-02. [2025-10-28T19:37:14.516952] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-28T19:37:14.529164] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-03. [2025-10-28T19:37:14.531106] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-01 (2.48 seconds). [2025-10-28T19:37:14.542977] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-02. [2025-10-28T19:37:15.610133] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-28T19:37:15.619909] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-04. [2025-10-28T19:37:15.785134] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-10-28T19:37:15.794601] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-03. [2025-10-28T19:37:16.703659] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-28T19:37:16.713872] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-05. [2025-10-28T19:37:17.307705] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-10-28T19:37:17.319356] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-04. [2025-10-28T19:37:17.831826] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-28T19:37:17.841028] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-06. [2025-10-28T19:37:18.857264] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-28T19:37:18.869045] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-05. [2025-10-28T19:37:19.138306] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-02 (5.84 seconds). [2025-10-28T19:37:19.144079] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-03. [2025-10-28T19:37:19.994390] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-28T19:37:20.002513] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-04. [2025-10-28T19:37:20.189433] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-28T19:37:20.200876] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-06. [2025-10-28T19:37:21.423095] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-28T19:37:21.434014] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-07. [2025-10-28T19:37:23.031621] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-10-28T19:37:23.043850] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-08. [2025-10-28T19:37:24.434029] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-06 (6.59 seconds). [2025-10-28T19:37:24.441973] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-07. [2025-10-28T19:37:24.473052] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-28T19:37:24.484593] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-09. [2025-10-28T19:37:27.633604] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-02 (14.13 seconds). [2025-10-28T19:37:27.646555] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-03. [2025-10-28T19:37:28.839796] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-28T19:37:28.848603] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-04. [2025-10-28T19:37:30.151262] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-10-28T19:37:30.161081] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-05. [2025-10-28T19:37:31.322031] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-07 (6.88 seconds). [2025-10-28T19:37:31.330493] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-08. [2025-10-28T19:37:31.472168] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-28T19:37:31.481312] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-06. [2025-10-28T19:37:32.335427] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-28T19:37:32.344042] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-09. [2025-10-28T19:37:32.555946] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-28T19:37:32.564886] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-07. [2025-10-28T19:37:33.387903] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-28T19:37:33.397829] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-10. [2025-10-28T19:37:33.625859] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-28T19:37:33.635983] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-08. [2025-10-28T19:37:34.100474] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-04 (14.10 seconds). [2025-10-28T19:37:34.108760] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-05. [2025-10-28T19:37:34.639152] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-10 (1.24 seconds). [2025-10-28T19:37:34.648356] [INFO ] [REMOTE ] KN: Full fetch complete (56813 records). [2025-10-28T19:37:34.648518] [DEBUG] [VALIDATOR ] KN: Validating primary data. [2025-10-28T19:37:35.135340] [DEBUG] [VALIDATOR ] KN: All expected trading days are present. [2025-10-28T19:37:35.135760] [DEBUG] [VALIDATOR ] KN: Primary data validation passed. [2025-10-28T19:37:35.172383] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-28T19:37:35.168820] [INFO ] [MAIN ] KN: Fetched primary data is valid. [2025-10-28T19:37:35.183775] [DEBUG] [LOCAL ] KN: Saving primary data. [2025-10-28T19:37:35.184424] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-09. [2025-10-28T19:37:35.193600] [DEBUG] [LOCAL ] KN: Trimmed 56813 records to 38185 (keeping 200 days of data) [2025-10-28T19:37:35.212171] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-28T19:37:35.306862] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-06. [2025-10-28T19:37:35.548220] [DEBUG] [LOCAL ] KN: Primary data saved (38185 records). [2025-10-28T19:37:35.548479] [INFO ] [MAIN ] KN: Full history saved. [2025-10-28T19:37:35.549014] [INFO ] [MAIN ] Update Progress: 1201/2366 symbols completed. KN took 26.4s. Estimated remaining: 2h 32m 49s. Rate: 7.6 symbols/min [2025-10-28T19:37:35.826067] [INFO ] [MAIN ] KNF: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:37:35.873769] [DEBUG] [LOCAL ] KNF: Loaded 36587 existing records from primary storage. [2025-10-28T19:37:35.874229] [INFO ] [MAIN ] KNF: Loaded 36587 existing records. [2025-10-28T19:37:36.099338] [WARN ] [MAIN ] KNF: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:37:36.099567] [INFO ] [MAIN ] KNF: Wiping existing primary data before full refresh. [2025-10-28T19:37:36.099621] [INFO ] [LOCAL ] KNF: Starting deletion of primary data. [2025-10-28T19:37:36.099996] [DEBUG] [LOCAL ] KNF: Deleted primary data file. [2025-10-28T19:37:36.100047] [INFO ] [MAIN ] KNF: Starting full primary refresh. [2025-10-28T19:37:36.489133] [INFO ] [REMOTE ] KNF: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:37:36.489751] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-01. [2025-10-28T19:37:36.517332] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-28T19:37:36.528383] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-10. [2025-10-28T19:37:36.817345] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-10-28T19:37:36.824905] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-07. [2025-10-28T19:37:37.380324] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-28T19:37:37.388707] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-02. [2025-10-28T19:37:37.691633] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-28T19:37:37.699389] [INFO ] [REMOTE ] KMT: Full fetch complete (61695 records). [2025-10-28T19:37:37.699535] [DEBUG] [VALIDATOR ] KMT: Validating primary data. [2025-10-28T19:37:38.090403] [DEBUG] [VALIDATOR ] KMT: All expected trading days are present. [2025-10-28T19:37:38.090496] [DEBUG] [VALIDATOR ] KMT: Primary data validation passed. [2025-10-28T19:37:38.091418] [INFO ] [MAIN ] KMT: Fetched primary data is valid. [2025-10-28T19:37:38.091495] [DEBUG] [LOCAL ] KMT: Saving primary data. [2025-10-28T19:37:38.093040] [DEBUG] [LOCAL ] KMT: Trimmed 61695 records to 42364 (keeping 200 days of data) [2025-10-28T19:37:38.178084] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-28T19:37:38.224317] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-08. [2025-10-28T19:37:38.370971] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-28T19:37:38.379593] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-03. [2025-10-28T19:37:38.400832] [DEBUG] [LOCAL ] KMT: Primary data saved (42364 records). [2025-10-28T19:37:38.400932] [INFO ] [MAIN ] KMT: Full history saved. [2025-10-28T19:37:38.401007] [INFO ] [MAIN ] Update Progress: 1202/2366 symbols completed. KMT took 29.3s. Estimated remaining: 2h 32m 36s. Rate: 7.6 symbols/min [2025-10-28T19:37:38.578697] [INFO ] [MAIN ] KNOP: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:37:38.578878] [DEBUG] [LOCAL ] KNOP: No existing data file found in primary storage. [2025-10-28T19:37:38.578915] [WARN ] [MAIN ] KNOP: No existing data found, performing full refresh instead. [2025-10-28T19:37:38.579017] [INFO ] [MAIN ] KNOP: Wiping existing primary data before full refresh. [2025-10-28T19:37:38.579057] [INFO ] [LOCAL ] KNOP: Starting deletion of primary data. [2025-10-28T19:37:38.579096] [DEBUG] [LOCAL ] KNOP: No primary data file found to delete. [2025-10-28T19:37:38.579131] [INFO ] [MAIN ] KNOP: Starting full primary refresh. [2025-10-28T19:37:38.925055] [INFO ] [REMOTE ] KNOP: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:37:38.925372] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-01. [2025-10-28T19:37:39.288062] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-28T19:37:39.295856] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-04. [2025-10-28T19:37:39.343124] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-28T19:37:39.353434] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-09. [2025-10-28T19:37:39.496209] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-10-28T19:37:39.980259] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-02. [2025-10-28T19:37:40.113926] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-28T19:37:40.455452] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-28T19:37:40.780274] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-05. [2025-10-28T19:37:41.580248] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-10. [2025-10-28T19:37:41.808023] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-28T19:37:42.380286] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-06. [2025-10-28T19:37:42.523619] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-02 (2.54 seconds). [2025-10-28T19:37:42.862426] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-10 (1.28 seconds). [2025-10-28T19:37:42.871360] [INFO ] [REMOTE ] KMPR: Full fetch complete (53993 records). [2025-10-28T19:37:42.871461] [DEBUG] [VALIDATOR ] KMPR: Validating primary data. [2025-10-28T19:37:43.180538] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-03. [2025-10-28T19:37:43.273264] [DEBUG] [VALIDATOR ] KMPR: All expected trading days are present. [2025-10-28T19:37:43.273411] [DEBUG] [VALIDATOR ] KMPR: Primary data validation passed. [2025-10-28T19:37:43.274320] [INFO ] [MAIN ] KMPR: Fetched primary data is valid. [2025-10-28T19:37:43.274398] [DEBUG] [LOCAL ] KMPR: Saving primary data. [2025-10-28T19:37:43.275717] [DEBUG] [LOCAL ] KMPR: Trimmed 53993 records to 40506 (keeping 200 days of data) [2025-10-28T19:37:43.356973] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-28T19:37:43.538897] [DEBUG] [LOCAL ] KMPR: Primary data saved (40506 records). [2025-10-28T19:37:43.539016] [INFO ] [MAIN ] KMPR: Full history saved. [2025-10-28T19:37:43.539613] [INFO ] [MAIN ] Update Progress: 1203/2366 symbols completed. KMPR took 34.4s. Estimated remaining: 2h 32m 26s. Rate: 7.6 symbols/min [2025-10-28T19:37:43.705046] [INFO ] [MAIN ] KNSL: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:37:43.725173] [DEBUG] [LOCAL ] KNSL: Loaded 18472 existing records from primary storage. [2025-10-28T19:37:43.725399] [INFO ] [MAIN ] KNSL: Loaded 18472 existing records. [2025-10-28T19:37:43.912035] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-10-28T19:37:43.915791] [WARN ] [MAIN ] KNSL: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:37:43.919308] [INFO ] [MAIN ] KNSL: Wiping existing primary data before full refresh. [2025-10-28T19:37:43.919368] [INFO ] [LOCAL ] KNSL: Starting deletion of primary data. [2025-10-28T19:37:43.919711] [DEBUG] [LOCAL ] KNSL: Deleted primary data file. [2025-10-28T19:37:43.919779] [INFO ] [MAIN ] KNSL: Starting full primary refresh. [2025-10-28T19:37:43.985514] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-07. [2025-10-28T19:37:44.265857] [INFO ] [REMOTE ] KNSL: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:37:44.780255] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-01. [2025-10-28T19:37:45.155488] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-28T19:37:45.557176] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-28T19:37:45.580221] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-02. [2025-10-28T19:37:46.190095] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-09 (21.71 seconds). [2025-10-28T19:37:46.368013] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-10-28T19:37:46.380196] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-03. [2025-10-28T19:37:47.180325] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-08. [2025-10-28T19:37:47.980309] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-04. [2025-10-28T19:37:48.560446] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-28T19:37:48.780300] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-10. [2025-10-28T19:37:49.580306] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-05. [2025-10-28T19:37:50.549431] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-10 (1.77 seconds). [2025-10-28T19:37:50.560228] [INFO ] [REMOTE ] KMX: Full fetch complete (76441 records). [2025-10-28T19:37:50.560366] [DEBUG] [VALIDATOR ] KMX: Validating primary data. [2025-10-28T19:37:50.973829] [DEBUG] [VALIDATOR ] KMX: All expected trading days are present. [2025-10-28T19:37:50.973918] [DEBUG] [VALIDATOR ] KMX: Primary data validation passed. [2025-10-28T19:37:50.974962] [INFO ] [MAIN ] KMX: Fetched primary data is valid. [2025-10-28T19:37:50.975025] [DEBUG] [LOCAL ] KMX: Saving primary data. [2025-10-28T19:37:50.976475] [DEBUG] [LOCAL ] KMX: Trimmed 76441 records to 53284 (keeping 200 days of data) [2025-10-28T19:37:51.283006] [DEBUG] [LOCAL ] KMX: Primary data saved (53284 records). [2025-10-28T19:37:51.283183] [INFO ] [MAIN ] KMX: Full history saved. [2025-10-28T19:37:51.283287] [INFO ] [MAIN ] Update Progress: 1204/2366 symbols completed. KMX took 42.2s. Estimated remaining: 2h 32m 18s. Rate: 7.6 symbols/min [2025-10-28T19:37:51.448682] [INFO ] [MAIN ] KNTK: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:37:51.490045] [DEBUG] [LOCAL ] KNTK: Loaded 47192 existing records from primary storage. [2025-10-28T19:37:51.490350] [INFO ] [MAIN ] KNTK: Loaded 47192 existing records. [2025-10-28T19:37:51.664619] [WARN ] [MAIN ] KNTK: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:37:51.664878] [INFO ] [MAIN ] KNTK: Wiping existing primary data before full refresh. [2025-10-28T19:37:51.664926] [INFO ] [LOCAL ] KNTK: Starting deletion of primary data. [2025-10-28T19:37:51.665120] [DEBUG] [LOCAL ] KNTK: Deleted primary data file. [2025-10-28T19:37:51.665176] [INFO ] [MAIN ] KNTK: Starting full primary refresh. [2025-10-28T19:37:52.017618] [INFO ] [REMOTE ] KNTK: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:37:52.018104] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-01. [2025-10-28T19:37:52.545728] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-03 (6.17 seconds). [2025-10-28T19:37:52.549770] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-04. [2025-10-28T19:37:53.052183] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-10-28T19:37:53.060251] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-02. [2025-10-28T19:37:53.349755] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-10-28T19:37:53.354765] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-05. [2025-10-28T19:37:54.024298] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-28T19:37:54.032521] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-03. [2025-10-28T19:37:54.046738] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-10-28T19:37:54.380370] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-06. [2025-10-28T19:37:55.173186] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-10-28T19:37:55.180220] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-07. [2025-10-28T19:37:55.225619] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-10-28T19:37:55.980374] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-04. [2025-10-28T19:37:57.605578] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-05 (8.03 seconds). [2025-10-28T19:37:57.608195] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-06. [2025-10-28T19:37:58.089400] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-28T19:37:58.092070] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-07. [2025-10-28T19:37:58.324400] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-08 (11.14 seconds). [2025-10-28T19:37:58.380268] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-09. [2025-10-28T19:37:59.476809] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-28T19:37:59.485291] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-10. [2025-10-28T19:38:04.706952] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-07 (6.61 seconds). [2025-10-28T19:38:04.710004] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-08. [2025-10-28T19:38:04.989484] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-07 (9.81 seconds). [2025-10-28T19:38:04.997942] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-08. [2025-10-28T19:38:05.198818] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-10-28T19:38:05.202089] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-09. [2025-10-28T19:38:05.665319] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-28T19:38:05.670181] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-09. [2025-10-28T19:38:05.791491] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-10-28T19:38:05.794898] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-10. [2025-10-28T19:38:06.527661] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-10 (0.73 seconds). [2025-10-28T19:38:06.530561] [INFO ] [REMOTE ] KNOP: Full fetch complete (14639 records). [2025-10-28T19:38:06.530632] [DEBUG] [VALIDATOR ] KNOP: Validating primary data. [2025-10-28T19:38:06.898546] [DEBUG] [VALIDATOR ] KNOP: All expected trading days are present. [2025-10-28T19:38:06.898624] [DEBUG] [VALIDATOR ] KNOP: Primary data validation passed. [2025-10-28T19:38:06.899008] [INFO ] [MAIN ] KNOP: Fetched primary data is valid. [2025-10-28T19:38:06.899059] [DEBUG] [LOCAL ] KNOP: Saving primary data. [2025-10-28T19:38:06.899569] [DEBUG] [LOCAL ] KNOP: Trimmed 14639 records to 9773 (keeping 200 days of data) [2025-10-28T19:38:06.957114] [DEBUG] [LOCAL ] KNOP: Primary data saved (9773 records). [2025-10-28T19:38:06.957231] [INFO ] [MAIN ] KNOP: Full history saved. [2025-10-28T19:38:06.957299] [INFO ] [MAIN ] Update Progress: 1205/2366 symbols completed. KNOP took 28.6s. Estimated remaining: 2h 32m 18s. Rate: 7.6 symbols/min [2025-10-28T19:38:07.130585] [INFO ] [MAIN ] KNX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:38:07.177869] [DEBUG] [LOCAL ] KNX: Loaded 52645 existing records from primary storage. [2025-10-28T19:38:07.178178] [INFO ] [MAIN ] KNX: Loaded 52645 existing records. [2025-10-28T19:38:07.351965] [WARN ] [MAIN ] KNX: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:38:07.352163] [INFO ] [MAIN ] KNX: Wiping existing primary data before full refresh. [2025-10-28T19:38:07.352217] [INFO ] [LOCAL ] KNX: Starting deletion of primary data. [2025-10-28T19:38:07.352456] [DEBUG] [LOCAL ] KNX: Deleted primary data file. [2025-10-28T19:38:07.352513] [INFO ] [MAIN ] KNX: Starting full primary refresh. [2025-10-28T19:38:07.702700] [INFO ] [REMOTE ] KNX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:38:07.703015] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-01. [2025-10-28T19:38:14.559577] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-10 (15.07 seconds). [2025-10-28T19:38:14.568604] [INFO ] [REMOTE ] KNF: Full fetch complete (51517 records). [2025-10-28T19:38:14.568804] [DEBUG] [VALIDATOR ] KNF: Validating primary data. [2025-10-28T19:38:14.965832] [DEBUG] [VALIDATOR ] KNF: All expected trading days are present. [2025-10-28T19:38:14.965914] [DEBUG] [VALIDATOR ] KNF: Primary data validation passed. [2025-10-28T19:38:14.966780] [INFO ] [MAIN ] KNF: Fetched primary data is valid. [2025-10-28T19:38:14.966841] [DEBUG] [LOCAL ] KNF: Saving primary data. [2025-10-28T19:38:14.968066] [DEBUG] [LOCAL ] KNF: Trimmed 51517 records to 36657 (keeping 200 days of data) [2025-10-28T19:38:15.190796] [DEBUG] [LOCAL ] KNF: Primary data saved (36657 records). [2025-10-28T19:38:15.190910] [INFO ] [MAIN ] KNF: Full history saved. [2025-10-28T19:38:15.190987] [INFO ] [MAIN ] Update Progress: 1206/2366 symbols completed. KNF took 39.6s. Estimated remaining: 2h 32m 10s. Rate: 7.6 symbols/min [2025-10-28T19:38:15.356707] [INFO ] [MAIN ] KO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:38:15.356861] [DEBUG] [LOCAL ] KO: No existing data file found in primary storage. [2025-10-28T19:38:15.356897] [WARN ] [MAIN ] KO: No existing data found, performing full refresh instead. [2025-10-28T19:38:15.357024] [INFO ] [MAIN ] KO: Wiping existing primary data before full refresh. [2025-10-28T19:38:15.357065] [INFO ] [LOCAL ] KO: Starting deletion of primary data. [2025-10-28T19:38:15.357107] [DEBUG] [LOCAL ] KO: No primary data file found to delete. [2025-10-28T19:38:15.357138] [INFO ] [MAIN ] KO: Starting full primary refresh. [2025-10-28T19:38:15.716775] [INFO ] [REMOTE ] KO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:38:15.717103] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-01. [2025-10-28T19:38:15.910243] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-04 (19.93 seconds). [2025-10-28T19:38:15.919478] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-05. [2025-10-28T19:38:17.179834] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-28T19:38:17.190363] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-06. [2025-10-28T19:38:17.637945] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-28T19:38:17.649385] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-02. [2025-10-28T19:38:19.069514] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-09 (13.40 seconds). [2025-10-28T19:38:19.074101] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-10. [2025-10-28T19:38:19.586965] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-28T19:38:19.604548] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-03. [2025-10-28T19:38:19.922403] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-28T19:38:19.927561] [INFO ] [REMOTE ] KNSL: Full fetch complete (27226 records). [2025-10-28T19:38:19.927676] [DEBUG] [VALIDATOR ] KNSL: Validating primary data. [2025-10-28T19:38:20.311804] [DEBUG] [VALIDATOR ] KNSL: All expected trading days are present. [2025-10-28T19:38:20.311905] [DEBUG] [VALIDATOR ] KNSL: Primary data validation passed. [2025-10-28T19:38:20.312802] [INFO ] [MAIN ] KNSL: Fetched primary data is valid. [2025-10-28T19:38:20.312864] [DEBUG] [LOCAL ] KNSL: Saving primary data. [2025-10-28T19:38:20.313750] [DEBUG] [LOCAL ] KNSL: Trimmed 27226 records to 18536 (keeping 200 days of data) [2025-10-28T19:38:20.436771] [DEBUG] [LOCAL ] KNSL: Primary data saved (18536 records). [2025-10-28T19:38:20.436967] [INFO ] [MAIN ] KNSL: Full history saved. [2025-10-28T19:38:20.437066] [INFO ] [MAIN ] Update Progress: 1207/2366 symbols completed. KNSL took 36.9s. Estimated remaining: 2h 31m 60s. Rate: 7.6 symbols/min [2025-10-28T19:38:20.612399] [INFO ] [MAIN ] KODK: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:38:20.659988] [DEBUG] [LOCAL ] KODK: Loaded 43487 existing records from primary storage. [2025-10-28T19:38:20.660460] [INFO ] [MAIN ] KODK: Loaded 43487 existing records. [2025-10-28T19:38:20.845294] [WARN ] [MAIN ] KODK: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:38:20.845606] [INFO ] [MAIN ] KODK: Wiping existing primary data before full refresh. [2025-10-28T19:38:20.845686] [INFO ] [LOCAL ] KODK: Starting deletion of primary data. [2025-10-28T19:38:20.846576] [DEBUG] [LOCAL ] KODK: Deleted primary data file. [2025-10-28T19:38:20.846667] [INFO ] [MAIN ] KODK: Starting full primary refresh. [2025-10-28T19:38:21.220622] [INFO ] [REMOTE ] KODK: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:38:21.221061] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-01. [2025-10-28T19:38:21.504413] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-10-28T19:38:21.516805] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-04. [2025-10-28T19:38:22.381973] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-10-28T19:38:22.396817] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-02. [2025-10-28T19:38:23.423761] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-10-28T19:38:23.451389] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-05. [2025-10-28T19:38:23.463708] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-28T19:38:23.473547] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-03. [2025-10-28T19:38:24.630521] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-28T19:38:24.640701] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-04. [2025-10-28T19:38:25.307191] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-10-28T19:38:25.318482] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-06. [2025-10-28T19:38:26.055195] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-28T19:38:26.066362] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-05. [2025-10-28T19:38:27.251026] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-28T19:38:27.261985] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-06. [2025-10-28T19:38:27.314389] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-10-28T19:38:27.325576] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-07. [2025-10-28T19:38:28.270417] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-28T19:38:28.279256] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-07. [2025-10-28T19:38:29.368325] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-10-28T19:38:29.380157] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-08. [2025-10-28T19:38:29.522586] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-10-28T19:38:29.532494] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-08. [2025-10-28T19:38:29.897880] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-01 (22.19 seconds). [2025-10-28T19:38:29.907971] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-02. [2025-10-28T19:38:31.075613] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-10-28T19:38:31.085870] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-03. [2025-10-28T19:38:31.291587] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-10-28T19:38:31.303635] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-09. [2025-10-28T19:38:32.142577] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-06 (14.95 seconds). [2025-10-28T19:38:32.154060] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-07. [2025-10-28T19:38:32.289891] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-10-28T19:38:32.301056] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-04. [2025-10-28T19:38:33.285824] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-28T19:38:33.297293] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-08. [2025-10-28T19:38:33.407880] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-10-28T19:38:33.419104] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-10. [2025-10-28T19:38:33.904482] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-10-28T19:38:33.915899] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-05. [2025-10-28T19:38:34.423033] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-28T19:38:34.432751] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-09. [2025-10-28T19:38:35.061969] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-10-28T19:38:35.072941] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-06. [2025-10-28T19:38:35.549384] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-10 (2.13 seconds). [2025-10-28T19:38:35.560326] [INFO ] [REMOTE ] KO: Full fetch complete (77218 records). [2025-10-28T19:38:35.560490] [DEBUG] [VALIDATOR ] KO: Validating primary data. [2025-10-28T19:38:35.756595] [WARN ] [VALIDATOR ] KO: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-10-28T19:38:35.757309] [FATAL] [MAIN ] KO: Fetched primary data is invalid. Refusing to save it. [2025-10-28T19:38:35.757378] [WARN ] [MAIN ] KO: Deleting existing primary and derivative data due to validation failure. [2025-10-28T19:38:35.757448] [INFO ] [LOCAL ] KO: Starting deletion of primary data. [2025-10-28T19:38:35.757514] [DEBUG] [LOCAL ] KO: No primary data file found to delete. [2025-10-28T19:38:35.757550] [INFO ] [LOCAL ] KO: Starting deletion of derivative data. [2025-10-28T19:38:35.757589] [DEBUG] [LOCAL ] KO: No derivative data file found to delete. [2025-10-28T19:38:35.757667] [INFO ] [MAIN ] Update Progress: 1208/2366 symbols completed. KO took 20.6s. Estimated remaining: 2h 31m 59s. Rate: 7.6 symbols/min [2025-10-28T19:38:35.924780] [INFO ] [MAIN ] KOF: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:38:35.950013] [DEBUG] [LOCAL ] KOF: Loaded 26160 existing records from primary storage. [2025-10-28T19:38:35.950254] [INFO ] [MAIN ] KOF: Loaded 26160 existing records. [2025-10-28T19:38:36.130333] [WARN ] [MAIN ] KOF: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:38:36.130701] [INFO ] [MAIN ] KOF: Wiping existing primary data before full refresh. [2025-10-28T19:38:36.130776] [INFO ] [LOCAL ] KOF: Starting deletion of primary data. [2025-10-28T19:38:36.131021] [DEBUG] [LOCAL ] KOF: Deleted primary data file. [2025-10-28T19:38:36.131151] [INFO ] [MAIN ] KOF: Starting full primary refresh. [2025-10-28T19:38:36.482291] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-10-28T19:38:36.538870] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-07. [2025-10-28T19:38:36.578715] [INFO ] [REMOTE ] KOF: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:38:36.580197] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-01. [2025-10-28T19:38:37.652042] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-10-28T19:38:37.658457] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-02. [2025-10-28T19:38:37.910770] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-10-28T19:38:37.922591] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-08. [2025-10-28T19:38:38.481205] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-28T19:38:38.487693] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-03. [2025-10-28T19:38:38.975082] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-28T19:38:38.986472] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-09. [2025-10-28T19:38:39.245963] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-28T19:38:39.250961] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-04. [2025-10-28T19:38:40.146804] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-10-28T19:38:40.153312] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-05. [2025-10-28T19:38:40.255344] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-28T19:38:40.266826] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-10. [2025-10-28T19:38:40.992208] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-10-28T19:38:40.998245] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-06. [2025-10-28T19:38:41.690880] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-10 (1.42 seconds). [2025-10-28T19:38:41.701697] [INFO ] [REMOTE ] KNX: Full fetch complete (76346 records). [2025-10-28T19:38:41.701846] [DEBUG] [VALIDATOR ] KNX: Validating primary data. [2025-10-28T19:38:42.103899] [DEBUG] [VALIDATOR ] KNX: All expected trading days are present. [2025-10-28T19:38:42.103975] [DEBUG] [VALIDATOR ] KNX: Primary data validation passed. [2025-10-28T19:38:42.105010] [INFO ] [MAIN ] KNX: Fetched primary data is valid. [2025-10-28T19:38:42.105071] [DEBUG] [LOCAL ] KNX: Saving primary data. [2025-10-28T19:38:42.106538] [DEBUG] [LOCAL ] KNX: Trimmed 76346 records to 52642 (keeping 200 days of data) [2025-10-28T19:38:42.426357] [DEBUG] [LOCAL ] KNX: Primary data saved (52642 records). [2025-10-28T19:38:42.426491] [INFO ] [MAIN ] KNX: Full history saved. [2025-10-28T19:38:42.426586] [INFO ] [MAIN ] Update Progress: 1209/2366 symbols completed. KNX took 35.5s. Estimated remaining: 2h 31m 50s. Rate: 7.6 symbols/min [2025-10-28T19:38:42.600542] [INFO ] [MAIN ] KOP: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:38:42.618299] [DEBUG] [LOCAL ] KOP: Loaded 17144 existing records from primary storage. [2025-10-28T19:38:42.618527] [INFO ] [MAIN ] KOP: Loaded 17144 existing records. [2025-10-28T19:38:42.822086] [WARN ] [MAIN ] KOP: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:38:42.822343] [INFO ] [MAIN ] KOP: Wiping existing primary data before full refresh. [2025-10-28T19:38:42.822398] [INFO ] [LOCAL ] KOP: Starting deletion of primary data. [2025-10-28T19:38:42.822592] [DEBUG] [LOCAL ] KOP: Deleted primary data file. [2025-10-28T19:38:42.822633] [INFO ] [MAIN ] KOP: Starting full primary refresh. [2025-10-28T19:38:43.187219] [INFO ] [REMOTE ] KOP: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:38:43.187600] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-01. [2025-10-28T19:38:43.787523] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-08 (14.26 seconds). [2025-10-28T19:38:43.797728] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-09. [2025-10-28T19:38:44.020052] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-10-28T19:38:44.023940] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-02. [2025-10-28T19:38:44.669833] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-28T19:38:44.673782] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-03. [2025-10-28T19:38:44.813774] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-10-28T19:38:44.822924] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-10. [2025-10-28T19:38:45.431253] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-10-28T19:38:45.438386] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-04. [2025-10-28T19:38:45.969467] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-10 (1.15 seconds). [2025-10-28T19:38:45.979773] [INFO ] [REMOTE ] KODK: Full fetch complete (63218 records). [2025-10-28T19:38:45.979972] [DEBUG] [VALIDATOR ] KODK: Validating primary data. [2025-10-28T19:38:46.381155] [DEBUG] [VALIDATOR ] KODK: All expected trading days are present. [2025-10-28T19:38:46.388108] [DEBUG] [VALIDATOR ] KODK: Primary data validation passed. [2025-10-28T19:38:46.401152] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-28T19:38:46.402488] [INFO ] [MAIN ] KODK: Fetched primary data is valid. [2025-10-28T19:38:46.409263] [DEBUG] [LOCAL ] KODK: Saving primary data. [2025-10-28T19:38:46.409595] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-05. [2025-10-28T19:38:46.411636] [DEBUG] [LOCAL ] KODK: Trimmed 63218 records to 43385 (keeping 200 days of data) [2025-10-28T19:38:46.654468] [DEBUG] [LOCAL ] KODK: Primary data saved (43385 records). [2025-10-28T19:38:46.654608] [INFO ] [MAIN ] KODK: Full history saved. [2025-10-28T19:38:46.655364] [INFO ] [MAIN ] Update Progress: 1210/2366 symbols completed. KODK took 26.2s. Estimated remaining: 2h 31m 39s. Rate: 7.6 symbols/min [2025-10-28T19:38:46.827314] [INFO ] [MAIN ] KORE: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:38:46.827478] [DEBUG] [LOCAL ] KORE: No existing data file found in primary storage. [2025-10-28T19:38:46.827515] [WARN ] [MAIN ] KORE: No existing data found, performing full refresh instead. [2025-10-28T19:38:46.827622] [INFO ] [MAIN ] KORE: Wiping existing primary data before full refresh. [2025-10-28T19:38:46.827695] [INFO ] [LOCAL ] KORE: Starting deletion of primary data. [2025-10-28T19:38:46.827749] [DEBUG] [LOCAL ] KORE: No primary data file found to delete. [2025-10-28T19:38:46.827782] [INFO ] [MAIN ] KORE: Starting full primary refresh. [2025-10-28T19:38:47.206688] [INFO ] [REMOTE ] KORE: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:38:47.212375] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-01. [2025-10-28T19:38:47.219829] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-10-28T19:38:47.224610] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-06. [2025-10-28T19:38:47.899988] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-10-28T19:38:47.902606] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-02. [2025-10-28T19:38:48.241036] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-10-28T19:38:48.242493] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-03. [2025-10-28T19:38:48.471565] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-09 (14.04 seconds). [2025-10-28T19:38:48.481987] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-10. [2025-10-28T19:38:49.769056] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-28T19:38:49.781320] [INFO ] [REMOTE ] KNTK: Full fetch complete (66189 records). [2025-10-28T19:38:49.781471] [DEBUG] [VALIDATOR ] KNTK: Validating primary data. [2025-10-28T19:38:50.160669] [DEBUG] [VALIDATOR ] KNTK: All expected trading days are present. [2025-10-28T19:38:50.160759] [DEBUG] [VALIDATOR ] KNTK: Primary data validation passed. [2025-10-28T19:38:50.161696] [INFO ] [MAIN ] KNTK: Fetched primary data is valid. [2025-10-28T19:38:50.161758] [DEBUG] [LOCAL ] KNTK: Saving primary data. [2025-10-28T19:38:50.163116] [DEBUG] [LOCAL ] KNTK: Trimmed 66189 records to 47159 (keeping 200 days of data) [2025-10-28T19:38:50.449982] [DEBUG] [LOCAL ] KNTK: Primary data saved (47159 records). [2025-10-28T19:38:50.450142] [INFO ] [MAIN ] KNTK: Full history saved. [2025-10-28T19:38:50.450262] [INFO ] [MAIN ] Update Progress: 1211/2366 symbols completed. KNTK took 59.2s. Estimated remaining: 2h 31m 27s. Rate: 7.6 symbols/min [2025-10-28T19:38:50.623442] [INFO ] [MAIN ] KOS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:38:50.675391] [DEBUG] [LOCAL ] KOS: Loaded 53087 existing records from primary storage. [2025-10-28T19:38:50.675741] [INFO ] [MAIN ] KOS: Loaded 53087 existing records. [2025-10-28T19:38:50.872893] [WARN ] [MAIN ] KOS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:38:50.873105] [INFO ] [MAIN ] KOS: Wiping existing primary data before full refresh. [2025-10-28T19:38:50.873152] [INFO ] [LOCAL ] KOS: Starting deletion of primary data. [2025-10-28T19:38:50.873961] [DEBUG] [LOCAL ] KOS: Deleted primary data file. [2025-10-28T19:38:50.874032] [INFO ] [MAIN ] KOS: Starting full primary refresh. [2025-10-28T19:38:51.268723] [INFO ] [REMOTE ] KOS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:38:51.269030] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-01. [2025-10-28T19:38:51.573128] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-06 (10.57 seconds). [2025-10-28T19:38:51.579339] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-07. [2025-10-28T19:38:52.143615] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-03 (3.90 seconds). [2025-10-28T19:38:52.145235] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-04. [2025-10-28T19:38:52.440924] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-04 (0.30 seconds). [2025-10-28T19:38:52.442563] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-05. [2025-10-28T19:38:52.596559] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-28T19:38:52.607070] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-02. [2025-10-28T19:38:52.758808] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-10-28T19:38:52.760425] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-06. [2025-10-28T19:38:53.039185] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-06 (0.28 seconds). [2025-10-28T19:38:53.040867] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-07. [2025-10-28T19:38:54.004780] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-10-28T19:38:54.014922] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-03. [2025-10-28T19:38:55.878268] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-06 (8.65 seconds). [2025-10-28T19:38:55.881808] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-07. [2025-10-28T19:38:56.574341] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-10-28T19:38:56.578349] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-08. [2025-10-28T19:38:56.757750] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-07 (3.72 seconds). [2025-10-28T19:38:56.759077] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-08. [2025-10-28T19:38:57.062579] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-08 (0.30 seconds). [2025-10-28T19:38:57.063745] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-09. [2025-10-28T19:38:57.375198] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-09 (0.31 seconds). [2025-10-28T19:38:57.376407] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-10. [2025-10-28T19:38:57.811993] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-10 (0.44 seconds). [2025-10-28T19:38:57.813246] [INFO ] [REMOTE ] KORE: Full fetch complete (3770 records). [2025-10-28T19:38:57.813315] [DEBUG] [VALIDATOR ] KORE: Validating primary data. [2025-10-28T19:38:58.161398] [DEBUG] [VALIDATOR ] KORE: All expected trading days are present. [2025-10-28T19:38:58.161475] [DEBUG] [VALIDATOR ] KORE: Primary data validation passed. [2025-10-28T19:38:58.161619] [INFO ] [MAIN ] KORE: Fetched primary data is valid. [2025-10-28T19:38:58.161684] [DEBUG] [LOCAL ] KORE: Saving primary data. [2025-10-28T19:38:58.162042] [DEBUG] [LOCAL ] KORE: Trimmed 3770 records to 2278 (keeping 200 days of data) [2025-10-28T19:38:58.174684] [DEBUG] [LOCAL ] KORE: Primary data saved (2278 records). [2025-10-28T19:38:58.174752] [INFO ] [MAIN ] KORE: Full history saved. [2025-10-28T19:38:58.174812] [INFO ] [MAIN ] Update Progress: 1212/2366 symbols completed. KORE took 11.5s. Estimated remaining: 2h 31m 19s. Rate: 7.6 symbols/min [2025-10-28T19:38:58.340104] [INFO ] [MAIN ] KR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:38:58.391689] [DEBUG] [LOCAL ] KR: Loaded 53681 existing records from primary storage. [2025-10-28T19:38:58.391999] [INFO ] [MAIN ] KR: Loaded 53681 existing records. [2025-10-28T19:38:58.568981] [WARN ] [MAIN ] KR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:38:58.569203] [INFO ] [MAIN ] KR: Wiping existing primary data before full refresh. [2025-10-28T19:38:58.569254] [INFO ] [LOCAL ] KR: Starting deletion of primary data. [2025-10-28T19:38:58.570095] [DEBUG] [LOCAL ] KR: Deleted primary data file. [2025-10-28T19:38:58.570151] [INFO ] [MAIN ] KR: Starting full primary refresh. [2025-10-28T19:38:58.918606] [INFO ] [REMOTE ] KR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:38:58.918898] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-01. [2025-10-28T19:39:00.125502] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-07 (8.55 seconds). [2025-10-28T19:39:00.131684] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-08. [2025-10-28T19:39:00.280340] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-10-28T19:39:00.291313] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-02. [2025-10-28T19:39:00.991285] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-10-28T19:39:01.000508] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-09. [2025-10-28T19:39:01.709552] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-10-28T19:39:01.721066] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-03. [2025-10-28T19:39:01.823211] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-10-28T19:39:01.830294] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-10. [2025-10-28T19:39:02.936896] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-28T19:39:02.942402] [INFO ] [REMOTE ] KOF: Full fetch complete (37790 records). [2025-10-28T19:39:02.942492] [DEBUG] [VALIDATOR ] KOF: Validating primary data. [2025-10-28T19:39:03.323266] [DEBUG] [VALIDATOR ] KOF: All expected trading days are present. [2025-10-28T19:39:03.323393] [DEBUG] [VALIDATOR ] KOF: Primary data validation passed. [2025-10-28T19:39:03.324435] [INFO ] [MAIN ] KOF: Fetched primary data is valid. [2025-10-28T19:39:03.324524] [DEBUG] [LOCAL ] KOF: Saving primary data. [2025-10-28T19:39:03.325577] [DEBUG] [LOCAL ] KOF: Trimmed 37790 records to 25986 (keeping 200 days of data) [2025-10-28T19:39:03.483778] [DEBUG] [LOCAL ] KOF: Primary data saved (25986 records). [2025-10-28T19:39:03.484071] [INFO ] [MAIN ] KOF: Full history saved. [2025-10-28T19:39:03.484156] [INFO ] [MAIN ] Update Progress: 1213/2366 symbols completed. KOF took 27.7s. Estimated remaining: 2h 31m 9s. Rate: 7.6 symbols/min [2025-10-28T19:39:03.612589] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-10-28T19:39:03.642333] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-04. [2025-10-28T19:39:03.697360] [INFO ] [MAIN ] KRC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:39:03.736152] [DEBUG] [LOCAL ] KRC: Loaded 47927 existing records from primary storage. [2025-10-28T19:39:03.736445] [INFO ] [MAIN ] KRC: Loaded 47927 existing records. [2025-10-28T19:39:03.908392] [WARN ] [MAIN ] KRC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:39:03.908569] [INFO ] [MAIN ] KRC: Wiping existing primary data before full refresh. [2025-10-28T19:39:03.908613] [INFO ] [LOCAL ] KRC: Starting deletion of primary data. [2025-10-28T19:39:03.909384] [DEBUG] [LOCAL ] KRC: Deleted primary data file. [2025-10-28T19:39:03.909441] [INFO ] [MAIN ] KRC: Starting full primary refresh. [2025-10-28T19:39:04.256504] [INFO ] [REMOTE ] KRC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:39:04.256837] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-01. [2025-10-28T19:39:05.160488] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-10-28T19:39:05.172611] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-05. [2025-10-28T19:39:15.593779] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-03 (21.58 seconds). [2025-10-28T19:39:15.611128] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-04. [2025-10-28T19:39:17.004975] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-10-28T19:39:17.016275] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-05. [2025-10-28T19:39:18.322874] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-28T19:39:18.334209] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-06. [2025-10-28T19:39:19.198614] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-01 (14.94 seconds). [2025-10-28T19:39:19.207920] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-02. [2025-10-28T19:39:19.592081] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-10-28T19:39:19.602820] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-07. [2025-10-28T19:39:21.432080] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-08 (24.85 seconds). [2025-10-28T19:39:21.436758] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-09. [2025-10-28T19:39:22.099543] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-28T19:39:22.106894] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-10. [2025-10-28T19:39:22.829190] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-10 (0.72 seconds). [2025-10-28T19:39:22.833148] [INFO ] [REMOTE ] KOP: Full fetch complete (25330 records). [2025-10-28T19:39:22.833225] [DEBUG] [VALIDATOR ] KOP: Validating primary data. [2025-10-28T19:39:23.206727] [DEBUG] [VALIDATOR ] KOP: All expected trading days are present. [2025-10-28T19:39:23.206831] [DEBUG] [VALIDATOR ] KOP: Primary data validation passed. [2025-10-28T19:39:23.207456] [INFO ] [MAIN ] KOP: Fetched primary data is valid. [2025-10-28T19:39:23.207521] [DEBUG] [LOCAL ] KOP: Saving primary data. [2025-10-28T19:39:23.208318] [DEBUG] [LOCAL ] KOP: Trimmed 25330 records to 17107 (keeping 200 days of data) [2025-10-28T19:39:23.313017] [DEBUG] [LOCAL ] KOP: Primary data saved (17107 records). [2025-10-28T19:39:23.313161] [INFO ] [MAIN ] KOP: Full history saved. [2025-10-28T19:39:23.313237] [INFO ] [MAIN ] Update Progress: 1214/2366 symbols completed. KOP took 40.9s. Estimated remaining: 2h 31m 12s. Rate: 7.6 symbols/min [2025-10-28T19:39:23.488632] [INFO ] [MAIN ] KREF: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:39:23.522014] [DEBUG] [LOCAL ] KREF: Loaded 37851 existing records from primary storage. [2025-10-28T19:39:23.522302] [INFO ] [MAIN ] KREF: Loaded 37851 existing records. [2025-10-28T19:39:23.708110] [WARN ] [MAIN ] KREF: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:39:23.708415] [INFO ] [MAIN ] KREF: Wiping existing primary data before full refresh. [2025-10-28T19:39:23.708494] [INFO ] [LOCAL ] KREF: Starting deletion of primary data. [2025-10-28T19:39:23.709246] [DEBUG] [LOCAL ] KREF: Deleted primary data file. [2025-10-28T19:39:23.709308] [INFO ] [MAIN ] KREF: Starting full primary refresh. [2025-10-28T19:39:24.076698] [INFO ] [REMOTE ] KREF: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:39:24.077021] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-01. [2025-10-28T19:39:24.896042] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-28T19:39:24.902518] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-02. [2025-10-28T19:39:25.861916] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-28T19:39:25.868108] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-03. [2025-10-28T19:39:26.785026] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-28T19:39:26.792805] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-04. [2025-10-28T19:39:27.843452] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-10-28T19:39:27.852249] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-05. [2025-10-28T19:39:28.853051] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-10-28T19:39:28.862111] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-06. [2025-10-28T19:39:29.832974] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-28T19:39:29.841547] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-07. [2025-10-28T19:39:30.868567] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-28T19:39:30.877503] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-08. [2025-10-28T19:39:31.743457] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-28T19:39:31.751302] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-09. [2025-10-28T19:39:32.808243] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-28T19:39:32.817877] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-10. [2025-10-28T19:39:34.086773] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-10 (1.27 seconds). [2025-10-28T19:39:34.095025] [INFO ] [REMOTE ] KREF: Full fetch complete (53070 records). [2025-10-28T19:39:34.095188] [DEBUG] [VALIDATOR ] KREF: Validating primary data. [2025-10-28T19:39:34.502667] [DEBUG] [VALIDATOR ] KREF: All expected trading days are present. [2025-10-28T19:39:34.502762] [DEBUG] [VALIDATOR ] KREF: Primary data validation passed. [2025-10-28T19:39:34.503609] [INFO ] [MAIN ] KREF: Fetched primary data is valid. [2025-10-28T19:39:34.503693] [DEBUG] [LOCAL ] KREF: Saving primary data. [2025-10-28T19:39:34.504876] [DEBUG] [LOCAL ] KREF: Trimmed 53070 records to 37791 (keeping 200 days of data) [2025-10-28T19:39:34.732057] [DEBUG] [LOCAL ] KREF: Primary data saved (37791 records). [2025-10-28T19:39:34.732206] [INFO ] [MAIN ] KREF: Full history saved. [2025-10-28T19:39:34.732288] [INFO ] [MAIN ] Update Progress: 1215/2366 symbols completed. KREF took 11.4s. Estimated remaining: 2h 31m 8s. Rate: 7.6 symbols/min [2025-10-28T19:39:34.925362] [INFO ] [MAIN ] KRG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:39:34.971154] [DEBUG] [LOCAL ] KRG: Loaded 49194 existing records from primary storage. [2025-10-28T19:39:34.971514] [INFO ] [MAIN ] KRG: Loaded 49194 existing records. [2025-10-28T19:39:35.158188] [WARN ] [MAIN ] KRG: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:39:35.158408] [INFO ] [MAIN ] KRG: Wiping existing primary data before full refresh. [2025-10-28T19:39:35.158455] [INFO ] [LOCAL ] KRG: Starting deletion of primary data. [2025-10-28T19:39:35.159000] [DEBUG] [LOCAL ] KRG: Deleted primary data file. [2025-10-28T19:39:35.159063] [INFO ] [MAIN ] KRG: Starting full primary refresh. [2025-10-28T19:39:35.511252] [INFO ] [REMOTE ] KRG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:39:35.511560] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-01. [2025-10-28T19:39:36.698982] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-10-28T19:39:36.708905] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-02. [2025-10-28T19:39:37.849667] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-10-28T19:39:37.859334] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-03. [2025-10-28T19:39:38.412425] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-07 (18.81 seconds). [2025-10-28T19:39:38.423963] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-08. [2025-10-28T19:39:38.592884] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-05 (33.42 seconds). [2025-10-28T19:39:38.604220] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-06. [2025-10-28T19:39:39.017590] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-28T19:39:39.027857] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-04. [2025-10-28T19:39:39.753471] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-10-28T19:39:39.768897] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-09. [2025-10-28T19:39:39.931614] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-28T19:39:39.945426] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-07. [2025-10-28T19:39:40.158605] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-28T19:39:40.169506] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-05. [2025-10-28T19:39:41.334976] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-28T19:39:41.345576] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-06. [2025-10-28T19:39:42.456128] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-28T19:39:42.466754] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-07. [2025-10-28T19:39:43.618772] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-10-28T19:39:43.630722] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-08. [2025-10-28T19:39:52.162094] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-02 (32.95 seconds). [2025-10-28T19:39:52.171632] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-03. [2025-10-28T19:39:53.517821] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-28T19:39:53.528219] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-04. [2025-10-28T19:39:54.725317] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-28T19:39:54.735842] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-05. [2025-10-28T19:39:55.211607] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-09 (15.44 seconds). [2025-10-28T19:39:55.223107] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-10. [2025-10-28T19:39:55.983857] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-28T19:39:55.994431] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-06. [2025-10-28T19:39:56.718262] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-10 (1.50 seconds). [2025-10-28T19:39:56.729459] [INFO ] [REMOTE ] KOS: Full fetch complete (77032 records). [2025-10-28T19:39:56.729634] [DEBUG] [VALIDATOR ] KOS: Validating primary data. [2025-10-28T19:39:57.134980] [DEBUG] [VALIDATOR ] KOS: All expected trading days are present. [2025-10-28T19:39:57.135176] [DEBUG] [VALIDATOR ] KOS: Primary data validation passed. [2025-10-28T19:39:57.136429] [INFO ] [MAIN ] KOS: Fetched primary data is valid. [2025-10-28T19:39:57.136593] [DEBUG] [LOCAL ] KOS: Saving primary data. [2025-10-28T19:39:57.138326] [DEBUG] [LOCAL ] KOS: Trimmed 77032 records to 53090 (keeping 200 days of data) [2025-10-28T19:39:57.353958] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-28T19:39:57.395693] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-07. [2025-10-28T19:39:57.471025] [DEBUG] [LOCAL ] KOS: Primary data saved (53090 records). [2025-10-28T19:39:57.471182] [INFO ] [MAIN ] KOS: Full history saved. [2025-10-28T19:39:57.471293] [INFO ] [MAIN ] Update Progress: 1216/2366 symbols completed. KOS took 1m 7s. Estimated remaining: 2h 31m 14s. Rate: 7.6 symbols/min [2025-10-28T19:39:57.652265] [INFO ] [MAIN ] KRMN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:39:57.652767] [DEBUG] [LOCAL ] KRMN: No existing data file found in primary storage. [2025-10-28T19:39:57.652891] [WARN ] [MAIN ] KRMN: No existing data found, performing full refresh instead. [2025-10-28T19:39:57.653016] [INFO ] [MAIN ] KRMN: Wiping existing primary data before full refresh. [2025-10-28T19:39:57.653060] [INFO ] [LOCAL ] KRMN: Starting deletion of primary data. [2025-10-28T19:39:57.653105] [DEBUG] [LOCAL ] KRMN: No primary data file found to delete. [2025-10-28T19:39:57.653142] [INFO ] [MAIN ] KRMN: Starting full primary refresh. [2025-10-28T19:39:57.827274] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-07 (17.88 seconds). [2025-10-28T19:39:57.875495] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-08. [2025-10-28T19:39:58.117794] [INFO ] [REMOTE ] KRMN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:39:58.118220] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-01. [2025-10-28T19:39:58.254109] [DEBUG] [REMOTE ] KRMN: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-28T19:39:58.254452] [WARN ] [REMOTE ] KRMN: No data returned for month 2025-01 [2025-10-28T19:39:58.254555] [FATAL] [REMOTE ] KRMN: API call failed - aborting fetch to avoid wasting further API calls [2025-10-28T19:39:58.254626] [FATAL] [MAIN ] KRMN: Failed to fetch primary data. [2025-10-28T19:39:58.254712] [WARN ] [MAIN ] KRMN: Deleting existing primary and derivative data due to fetch failure. [2025-10-28T19:39:58.254784] [INFO ] [LOCAL ] KRMN: Starting deletion of primary data. [2025-10-28T19:39:58.254850] [DEBUG] [LOCAL ] KRMN: No primary data file found to delete. [2025-10-28T19:39:58.254888] [INFO ] [LOCAL ] KRMN: Starting deletion of derivative data. [2025-10-28T19:39:58.254927] [DEBUG] [LOCAL ] KRMN: No derivative data file found to delete. [2025-10-28T19:39:58.254975] [INFO ] [MAIN ] Update Progress: 1217/2366 symbols completed. KRMN took 0.8s. Estimated remaining: 2h 30m 59s. Rate: 7.6 symbols/min [2025-10-28T19:39:58.431693] [INFO ] [MAIN ] KRO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:39:58.460864] [DEBUG] [LOCAL ] KRO: Loaded 26446 existing records from primary storage. [2025-10-28T19:39:58.461242] [INFO ] [MAIN ] KRO: Loaded 26446 existing records. [2025-10-28T19:39:58.659026] [WARN ] [MAIN ] KRO: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:39:58.659383] [INFO ] [MAIN ] KRO: Wiping existing primary data before full refresh. [2025-10-28T19:39:58.659462] [INFO ] [LOCAL ] KRO: Starting deletion of primary data. [2025-10-28T19:39:58.660057] [DEBUG] [LOCAL ] KRO: Deleted primary data file. [2025-10-28T19:39:58.660197] [INFO ] [MAIN ] KRO: Starting full primary refresh. [2025-10-28T19:39:58.865464] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-28T19:39:58.945161] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-08. [2025-10-28T19:39:59.107153] [INFO ] [REMOTE ] KRO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:39:59.107582] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-01. [2025-10-28T19:39:59.267395] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-28T19:39:59.278727] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-09. [2025-10-28T19:39:59.832102] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-28T19:39:59.836194] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-02. [2025-10-28T19:40:00.037881] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-10-28T19:40:00.048336] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-09. [2025-10-28T19:40:00.529689] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-10-28T19:40:00.533263] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-03. [2025-10-28T19:40:00.859074] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-28T19:40:00.870925] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-10. [2025-10-28T19:40:01.322900] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-28T19:40:01.333396] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-10. [2025-10-28T19:40:01.399459] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-28T19:40:01.407243] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-04. [2025-10-28T19:40:02.343801] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-10-28T19:40:02.355819] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-05. [2025-10-28T19:40:02.600787] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-28T19:40:02.617967] [INFO ] [REMOTE ] KR: Full fetch complete (77844 records). [2025-10-28T19:40:02.618218] [DEBUG] [VALIDATOR ] KR: Validating primary data. [2025-10-28T19:40:03.174878] [DEBUG] [VALIDATOR ] KR: All expected trading days are present. [2025-10-28T19:40:03.176208] [DEBUG] [VALIDATOR ] KR: Primary data validation passed. [2025-10-28T19:40:03.183220] [INFO ] [MAIN ] KR: Fetched primary data is valid. [2025-10-28T19:40:03.181741] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-10 (1.85 seconds). [2025-10-28T19:40:03.183874] [DEBUG] [LOCAL ] KR: Saving primary data. [2025-10-28T19:40:03.196420] [INFO ] [REMOTE ] KRC: Full fetch complete (70041 records). [2025-10-28T19:40:03.196781] [DEBUG] [VALIDATOR ] KRC: Validating primary data. [2025-10-28T19:40:03.197526] [DEBUG] [LOCAL ] KR: Trimmed 77844 records to 53681 (keeping 200 days of data) [2025-10-28T19:40:03.550519] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-28T19:40:03.584850] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-06. [2025-10-28T19:40:03.871850] [DEBUG] [VALIDATOR ] KRC: All expected trading days are present. [2025-10-28T19:40:03.872928] [DEBUG] [VALIDATOR ] KRC: Primary data validation passed. [2025-10-28T19:40:03.875257] [INFO ] [MAIN ] KRC: Fetched primary data is valid. [2025-10-28T19:40:03.877343] [DEBUG] [LOCAL ] KRC: Saving primary data. [2025-10-28T19:40:03.898894] [DEBUG] [LOCAL ] KRC: Trimmed 70041 records to 47934 (keeping 200 days of data) [2025-10-28T19:40:04.069249] [DEBUG] [LOCAL ] KR: Primary data saved (53681 records). [2025-10-28T19:40:04.074693] [INFO ] [MAIN ] KR: Full history saved. [2025-10-28T19:40:04.089346] [INFO ] [MAIN ] Update Progress: 1218/2366 symbols completed. KR took 1m 6s. Estimated remaining: 2h 30m 49s. Rate: 7.6 symbols/min [2025-10-28T19:40:04.388354] [INFO ] [MAIN ] KRP: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:40:04.446840] [DEBUG] [LOCAL ] KRC: Primary data saved (47934 records). [2025-10-28T19:40:04.447039] [INFO ] [MAIN ] KRC: Full history saved. [2025-10-28T19:40:04.447298] [INFO ] [MAIN ] Update Progress: 1219/2366 symbols completed. KRC took 1m 1s. Estimated remaining: 2h 30m 34s. Rate: 7.6 symbols/min [2025-10-28T19:40:04.639465] [INFO ] [MAIN ] KSS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:40:04.640631] [DEBUG] [LOCAL ] KRP: Loaded 35495 existing records from primary storage. [2025-10-28T19:40:04.640868] [INFO ] [MAIN ] KRP: Loaded 35495 existing records. [2025-10-28T19:40:04.843208] [WARN ] [MAIN ] KRP: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:40:04.843491] [INFO ] [MAIN ] KRP: Wiping existing primary data before full refresh. [2025-10-28T19:40:04.843545] [INFO ] [LOCAL ] KRP: Starting deletion of primary data. [2025-10-28T19:40:04.844000] [DEBUG] [LOCAL ] KRP: Deleted primary data file. [2025-10-28T19:40:04.844058] [INFO ] [MAIN ] KRP: Starting full primary refresh. [2025-10-28T19:40:05.050695] [DEBUG] [LOCAL ] KSS: Loaded 53574 existing records from primary storage. [2025-10-28T19:40:05.077271] [INFO ] [MAIN ] KSS: Loaded 53574 existing records. [2025-10-28T19:40:05.436341] [WARN ] [MAIN ] KSS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:40:05.440120] [INFO ] [REMOTE ] KRP: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:40:05.440493] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-01. [2025-10-28T19:40:05.441365] [INFO ] [MAIN ] KSS: Wiping existing primary data before full refresh. [2025-10-28T19:40:05.441438] [INFO ] [LOCAL ] KSS: Starting deletion of primary data. [2025-10-28T19:40:05.441628] [DEBUG] [LOCAL ] KSS: Deleted primary data file. [2025-10-28T19:40:05.441719] [INFO ] [MAIN ] KSS: Starting full primary refresh. [2025-10-28T19:40:05.799972] [INFO ] [REMOTE ] KSS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:40:05.800265] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-01. [2025-10-28T19:40:06.886747] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-28T19:40:06.895108] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-02. [2025-10-28T19:40:07.103325] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-08 (23.47 seconds). [2025-10-28T19:40:07.114287] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-09. [2025-10-28T19:40:07.200775] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-10-28T19:40:07.211531] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-02. [2025-10-28T19:40:07.875608] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-28T19:40:07.883484] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-03. [2025-10-28T19:40:08.521081] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-28T19:40:08.531916] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-10. [2025-10-28T19:40:08.585073] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-10-28T19:40:08.595604] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-03. [2025-10-28T19:40:09.098364] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-06 (5.51 seconds). [2025-10-28T19:40:09.104123] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-07. [2025-10-28T19:40:09.331597] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-10-28T19:40:09.342075] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-04. [2025-10-28T19:40:09.971778] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-10 (1.44 seconds). [2025-10-28T19:40:09.981829] [INFO ] [REMOTE ] KRG: Full fetch complete (71438 records). [2025-10-28T19:40:09.981956] [DEBUG] [VALIDATOR ] KRG: Validating primary data. [2025-10-28T19:40:10.404851] [DEBUG] [VALIDATOR ] KRG: All expected trading days are present. [2025-10-28T19:40:10.405490] [DEBUG] [VALIDATOR ] KRG: Primary data validation passed. [2025-10-28T19:40:10.407197] [INFO ] [MAIN ] KRG: Fetched primary data is valid. [2025-10-28T19:40:10.407283] [DEBUG] [LOCAL ] KRG: Saving primary data. [2025-10-28T19:40:10.409052] [DEBUG] [LOCAL ] KRG: Trimmed 71438 records to 49201 (keeping 200 days of data) [2025-10-28T19:40:10.631822] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-10-28T19:40:10.697014] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-04. [2025-10-28T19:40:10.784042] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-10-28T19:40:10.796028] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-05. [2025-10-28T19:40:10.810510] [DEBUG] [LOCAL ] KRG: Primary data saved (49201 records). [2025-10-28T19:40:10.810599] [INFO ] [MAIN ] KRG: Full history saved. [2025-10-28T19:40:10.810696] [INFO ] [MAIN ] Update Progress: 1220/2366 symbols completed. KRG took 36.1s. Estimated remaining: 2h 30m 25s. Rate: 7.6 symbols/min [2025-10-28T19:40:10.981384] [INFO ] [MAIN ] KT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:40:11.021057] [DEBUG] [LOCAL ] KT: Loaded 45188 existing records from primary storage. [2025-10-28T19:40:11.021367] [INFO ] [MAIN ] KT: Loaded 45188 existing records. [2025-10-28T19:40:11.199329] [WARN ] [MAIN ] KT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:40:11.199555] [INFO ] [MAIN ] KT: Wiping existing primary data before full refresh. [2025-10-28T19:40:11.199601] [INFO ] [LOCAL ] KT: Starting deletion of primary data. [2025-10-28T19:40:11.200465] [DEBUG] [LOCAL ] KT: Deleted primary data file. [2025-10-28T19:40:11.200522] [INFO ] [MAIN ] KT: Starting full primary refresh. [2025-10-28T19:40:11.549235] [INFO ] [REMOTE ] KT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:40:11.549519] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-01. [2025-10-28T19:40:11.809267] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-10-28T19:40:11.818540] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-06. [2025-10-28T19:40:12.460286] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-10-28T19:40:12.474856] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-05. [2025-10-28T19:40:12.758683] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-28T19:40:12.768086] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-02. [2025-10-28T19:40:12.800784] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-10-28T19:40:12.809129] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-07. [2025-10-28T19:40:13.808275] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-28T19:40:13.816875] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-08. [2025-10-28T19:40:13.856224] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-28T19:40:13.865674] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-03. [2025-10-28T19:40:14.102497] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-28T19:40:14.113889] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-06. [2025-10-28T19:40:14.936292] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-28T19:40:14.945349] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-09. [2025-10-28T19:40:15.004336] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-28T19:40:15.015706] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-04. [2025-10-28T19:40:15.422456] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-28T19:40:15.433459] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-07. [2025-10-28T19:40:15.934891] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-10-28T19:40:15.942845] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-10. [2025-10-28T19:40:16.043938] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-28T19:40:16.058229] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-05. [2025-10-28T19:40:16.942706] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-07 (7.84 seconds). [2025-10-28T19:40:16.949452] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-08. [2025-10-28T19:40:17.015542] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-10-28T19:40:17.027854] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-08. [2025-10-28T19:40:17.130513] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-10-28T19:40:17.141393] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-06. [2025-10-28T19:40:17.769676] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-28T19:40:17.777279] [INFO ] [REMOTE ] KRP: Full fetch complete (54683 records). [2025-10-28T19:40:17.777462] [DEBUG] [VALIDATOR ] KRP: Validating primary data. [2025-10-28T19:40:17.904226] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-10-28T19:40:17.932739] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-09. [2025-10-28T19:40:18.222028] [DEBUG] [VALIDATOR ] KRP: All expected trading days are present. [2025-10-28T19:40:18.222284] [DEBUG] [VALIDATOR ] KRP: Primary data validation passed. [2025-10-28T19:40:18.223389] [INFO ] [MAIN ] KRP: Fetched primary data is valid. [2025-10-28T19:40:18.223476] [DEBUG] [LOCAL ] KRP: Saving primary data. [2025-10-28T19:40:18.253992] [DEBUG] [LOCAL ] KRP: Trimmed 54683 records to 35449 (keeping 200 days of data) [2025-10-28T19:40:18.256605] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-10-28T19:40:18.268171] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-07. [2025-10-28T19:40:18.491446] [DEBUG] [LOCAL ] KRP: Primary data saved (35449 records). [2025-10-28T19:40:18.491674] [INFO ] [MAIN ] KRP: Full history saved. [2025-10-28T19:40:18.491890] [INFO ] [MAIN ] Update Progress: 1221/2366 symbols completed. KRP took 14.4s. Estimated remaining: 2h 30m 17s. Rate: 7.6 symbols/min [2025-10-28T19:40:18.707190] [INFO ] [MAIN ] KTB: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:40:18.712772] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-10-28T19:40:18.726499] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-09. [2025-10-28T19:40:18.761239] [DEBUG] [LOCAL ] KTB: Loaded 39895 existing records from primary storage. [2025-10-28T19:40:18.761550] [INFO ] [MAIN ] KTB: Loaded 39895 existing records. [2025-10-28T19:40:18.949990] [WARN ] [MAIN ] KTB: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:40:18.950343] [INFO ] [MAIN ] KTB: Wiping existing primary data before full refresh. [2025-10-28T19:40:18.950419] [INFO ] [LOCAL ] KTB: Starting deletion of primary data. [2025-10-28T19:40:18.957816] [DEBUG] [LOCAL ] KTB: Deleted primary data file. [2025-10-28T19:40:18.969418] [INFO ] [MAIN ] KTB: Starting full primary refresh. [2025-10-28T19:40:19.036157] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-10-28T19:40:19.080304] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-10. [2025-10-28T19:40:19.335488] [INFO ] [REMOTE ] KTB: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:40:19.335861] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-01. [2025-10-28T19:40:20.164942] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-10-28T19:40:20.191392] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-10. [2025-10-28T19:40:20.192910] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-10 (1.11 seconds). [2025-10-28T19:40:20.199730] [INFO ] [REMOTE ] KRO: Full fetch complete (35412 records). [2025-10-28T19:40:20.199816] [DEBUG] [VALIDATOR ] KRO: Validating primary data. [2025-10-28T19:40:20.592683] [DEBUG] [VALIDATOR ] KRO: All expected trading days are present. [2025-10-28T19:40:20.592859] [DEBUG] [VALIDATOR ] KRO: Primary data validation passed. [2025-10-28T19:40:20.593683] [INFO ] [MAIN ] KRO: Fetched primary data is valid. [2025-10-28T19:40:20.593767] [DEBUG] [LOCAL ] KRO: Saving primary data. [2025-10-28T19:40:20.595025] [DEBUG] [LOCAL ] KRO: Trimmed 35412 records to 26457 (keeping 200 days of data) [2025-10-28T19:40:20.614616] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-10-28T19:40:20.675320] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-02. [2025-10-28T19:40:20.770367] [DEBUG] [LOCAL ] KRO: Primary data saved (26457 records). [2025-10-28T19:40:20.770485] [INFO ] [MAIN ] KRO: Full history saved. [2025-10-28T19:40:20.770560] [INFO ] [MAIN ] Update Progress: 1222/2366 symbols completed. KRO took 22.5s. Estimated remaining: 2h 30m 4s. Rate: 7.6 symbols/min [2025-10-28T19:40:20.941991] [INFO ] [MAIN ] KTF: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:40:20.953115] [DEBUG] [LOCAL ] KTF: Loaded 11395 existing records from primary storage. [2025-10-28T19:40:20.953342] [INFO ] [MAIN ] KTF: Loaded 11395 existing records. [2025-10-28T19:40:21.137839] [WARN ] [MAIN ] KTF: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:40:21.138064] [INFO ] [MAIN ] KTF: Wiping existing primary data before full refresh. [2025-10-28T19:40:21.138110] [INFO ] [LOCAL ] KTF: Starting deletion of primary data. [2025-10-28T19:40:21.138429] [DEBUG] [LOCAL ] KTF: Deleted primary data file. [2025-10-28T19:40:21.138484] [INFO ] [MAIN ] KTF: Starting full primary refresh. [2025-10-28T19:40:21.489284] [INFO ] [REMOTE ] KTF: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:40:21.489557] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-01. [2025-10-28T19:40:22.499936] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-10 (2.31 seconds). [2025-10-28T19:40:22.510950] [INFO ] [REMOTE ] KSS: Full fetch complete (77737 records). [2025-10-28T19:40:22.511098] [DEBUG] [VALIDATOR ] KSS: Validating primary data. [2025-10-28T19:40:22.914684] [DEBUG] [VALIDATOR ] KSS: All expected trading days are present. [2025-10-28T19:40:22.914782] [DEBUG] [VALIDATOR ] KSS: Primary data validation passed. [2025-10-28T19:40:22.915878] [INFO ] [MAIN ] KSS: Fetched primary data is valid. [2025-10-28T19:40:22.915960] [DEBUG] [LOCAL ] KSS: Saving primary data. [2025-10-28T19:40:22.917496] [DEBUG] [LOCAL ] KSS: Trimmed 77737 records to 53573 (keeping 200 days of data) [2025-10-28T19:40:23.166296] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-10-28T19:40:23.178980] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-02. [2025-10-28T19:40:23.261618] [DEBUG] [LOCAL ] KSS: Primary data saved (53573 records). [2025-10-28T19:40:23.261886] [INFO ] [MAIN ] KSS: Full history saved. [2025-10-28T19:40:23.261980] [INFO ] [MAIN ] Update Progress: 1223/2366 symbols completed. KSS took 18.8s. Estimated remaining: 2h 29m 51s. Rate: 7.6 symbols/min [2025-10-28T19:40:23.445550] [INFO ] [MAIN ] KVUE: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:40:23.499741] [DEBUG] [LOCAL ] KVUE: Loaded 53667 existing records from primary storage. [2025-10-28T19:40:23.500088] [INFO ] [MAIN ] KVUE: Loaded 53667 existing records. [2025-10-28T19:40:23.689727] [WARN ] [MAIN ] KVUE: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:40:23.690118] [INFO ] [MAIN ] KVUE: Wiping existing primary data before full refresh. [2025-10-28T19:40:23.690278] [INFO ] [LOCAL ] KVUE: Starting deletion of primary data. [2025-10-28T19:40:23.691155] [DEBUG] [LOCAL ] KVUE: Deleted primary data file. [2025-10-28T19:40:23.691214] [INFO ] [MAIN ] KVUE: Starting full primary refresh. [2025-10-28T19:40:23.805724] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-10-28T19:40:23.829254] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-03. [2025-10-28T19:40:24.067958] [INFO ] [REMOTE ] KVUE: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:40:24.068313] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-01. [2025-10-28T19:40:25.365777] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-28T19:40:25.376878] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-02. [2025-10-28T19:40:26.868497] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-28T19:40:26.878832] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-03. [2025-10-28T19:40:28.509079] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-10-28T19:40:28.521232] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-04. [2025-10-28T19:40:29.928917] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-28T19:40:29.940393] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-05. [2025-10-28T19:40:30.420293] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-07 (12.15 seconds). [2025-10-28T19:40:30.429585] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-08. [2025-10-28T19:40:31.228846] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-10-28T19:40:31.240161] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-06. [2025-10-28T19:40:31.558926] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-28T19:40:31.568425] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-09. [2025-10-28T19:40:32.318200] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-02 (11.64 seconds). [2025-10-28T19:40:32.326472] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-03. [2025-10-28T19:40:32.558460] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-28T19:40:32.574726] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-07. [2025-10-28T19:40:32.780610] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-28T19:40:32.791046] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-10. [2025-10-28T19:40:33.398097] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-28T19:40:33.407004] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-04. [2025-10-28T19:40:34.139194] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-28T19:40:34.150906] [INFO ] [REMOTE ] KT: Full fetch complete (66553 records). [2025-10-28T19:40:34.151037] [DEBUG] [VALIDATOR ] KT: Validating primary data. [2025-10-28T19:40:34.540670] [DEBUG] [VALIDATOR ] KT: All expected trading days are present. [2025-10-28T19:40:34.540836] [DEBUG] [VALIDATOR ] KT: Primary data validation passed. [2025-10-28T19:40:34.541939] [INFO ] [MAIN ] KT: Fetched primary data is valid. [2025-10-28T19:40:34.542083] [DEBUG] [LOCAL ] KT: Saving primary data. [2025-10-28T19:40:34.543612] [DEBUG] [LOCAL ] KT: Trimmed 66553 records to 45095 (keeping 200 days of data) [2025-10-28T19:40:34.657267] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-28T19:40:34.678834] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-05. [2025-10-28T19:40:34.845715] [DEBUG] [LOCAL ] KT: Primary data saved (45095 records). [2025-10-28T19:40:34.845833] [INFO ] [MAIN ] KT: Full history saved. [2025-10-28T19:40:34.845959] [INFO ] [MAIN ] Update Progress: 1224/2366 symbols completed. KT took 24.0s. Estimated remaining: 2h 29m 47s. Rate: 7.6 symbols/min [2025-10-28T19:40:35.039119] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-03 (11.21 seconds). [2025-10-28T19:40:35.061026] [INFO ] [MAIN ] KVYO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:40:35.061595] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-04. [2025-10-28T19:40:35.106908] [DEBUG] [LOCAL ] KVYO: Loaded 50902 existing records from primary storage. [2025-10-28T19:40:35.107203] [INFO ] [MAIN ] KVYO: Loaded 50902 existing records. [2025-10-28T19:40:35.280061] [WARN ] [MAIN ] KVYO: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:40:35.280278] [INFO ] [MAIN ] KVYO: Wiping existing primary data before full refresh. [2025-10-28T19:40:35.280323] [INFO ] [LOCAL ] KVYO: Starting deletion of primary data. [2025-10-28T19:40:35.280505] [DEBUG] [LOCAL ] KVYO: Deleted primary data file. [2025-10-28T19:40:35.280542] [INFO ] [MAIN ] KVYO: Starting full primary refresh. [2025-10-28T19:40:35.634837] [INFO ] [REMOTE ] KVYO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:40:35.635253] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-01. [2025-10-28T19:40:35.763628] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-10-28T19:40:35.768090] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-05. [2025-10-28T19:40:35.792333] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-28T19:40:35.801458] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-06. [2025-10-28T19:40:36.335142] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-10-28T19:40:36.337870] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-06. [2025-10-28T19:40:36.719829] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-28T19:40:36.727831] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-07. [2025-10-28T19:40:36.792454] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-10-28T19:40:36.796110] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-07. [2025-10-28T19:40:36.966946] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-28T19:40:36.976001] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-02. [2025-10-28T19:40:37.311210] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-10-28T19:40:37.314541] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-08. [2025-10-28T19:40:37.705170] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-28T19:40:37.714423] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-08. [2025-10-28T19:40:37.887779] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-28T19:40:37.891038] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-09. [2025-10-28T19:40:38.077012] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-28T19:40:38.086128] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-03. [2025-10-28T19:40:38.389270] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-28T19:40:38.392343] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-10. [2025-10-28T19:40:39.017374] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-28T19:40:39.020603] [INFO ] [REMOTE ] KTF: Full fetch complete (17544 records). [2025-10-28T19:40:39.020739] [DEBUG] [VALIDATOR ] KTF: Validating primary data. [2025-10-28T19:40:39.447076] [DEBUG] [VALIDATOR ] KTF: All expected trading days are present. [2025-10-28T19:40:39.447220] [DEBUG] [VALIDATOR ] KTF: Primary data validation passed. [2025-10-28T19:40:39.447888] [INFO ] [MAIN ] KTF: Fetched primary data is valid. [2025-10-28T19:40:39.447963] [DEBUG] [LOCAL ] KTF: Saving primary data. [2025-10-28T19:40:39.448889] [DEBUG] [LOCAL ] KTF: Trimmed 17544 records to 11465 (keeping 200 days of data) [2025-10-28T19:40:39.529147] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-28T19:40:39.543010] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-04. [2025-10-28T19:40:39.561018] [DEBUG] [LOCAL ] KTF: Primary data saved (11465 records). [2025-10-28T19:40:39.561119] [INFO ] [MAIN ] KTF: Full history saved. [2025-10-28T19:40:39.561194] [INFO ] [MAIN ] Update Progress: 1225/2366 symbols completed. KTF took 18.8s. Estimated remaining: 2h 29m 36s. Rate: 7.6 symbols/min [2025-10-28T19:40:39.751989] [INFO ] [MAIN ] KW: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:40:39.787898] [DEBUG] [LOCAL ] KW: Loaded 40000 existing records from primary storage. [2025-10-28T19:40:39.788175] [INFO ] [MAIN ] KW: Loaded 40000 existing records. [2025-10-28T19:40:39.972456] [WARN ] [MAIN ] KW: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:40:39.972684] [INFO ] [MAIN ] KW: Wiping existing primary data before full refresh. [2025-10-28T19:40:39.972743] [INFO ] [LOCAL ] KW: Starting deletion of primary data. [2025-10-28T19:40:39.973024] [DEBUG] [LOCAL ] KW: Deleted primary data file. [2025-10-28T19:40:39.973064] [INFO ] [MAIN ] KW: Starting full primary refresh. [2025-10-28T19:40:40.372618] [INFO ] [REMOTE ] KW: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:40:40.372988] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-01. [2025-10-28T19:40:40.958686] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-28T19:40:40.969226] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-05. [2025-10-28T19:40:41.429390] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-28T19:40:41.438381] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-02. [2025-10-28T19:40:42.512226] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-28T19:40:42.519637] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-03. [2025-10-28T19:40:43.605606] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-28T19:40:43.615693] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-04. [2025-10-28T19:40:44.744425] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-10-28T19:40:44.753848] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-05. [2025-10-28T19:40:45.791926] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-10-28T19:40:45.801148] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-06. [2025-10-28T19:40:48.609802] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-07 (16.04 seconds). [2025-10-28T19:40:48.621250] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-08. [2025-10-28T19:40:49.928582] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-10-28T19:40:49.941198] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-09. [2025-10-28T19:40:50.874688] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-08 (13.16 seconds). [2025-10-28T19:40:50.884236] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-09. [2025-10-28T19:40:51.675375] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-10-28T19:40:51.688291] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-10. [2025-10-28T19:40:51.953507] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-28T19:40:51.962823] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-10. [2025-10-28T19:40:52.361071] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-28T19:40:52.372798] [INFO ] [REMOTE ] KVUE: Full fetch complete (77845 records). [2025-10-28T19:40:52.373026] [DEBUG] [VALIDATOR ] KVUE: Validating primary data. [2025-10-28T19:40:52.809869] [DEBUG] [VALIDATOR ] KVUE: All expected trading days are present. [2025-10-28T19:40:52.809987] [DEBUG] [VALIDATOR ] KVUE: Primary data validation passed. [2025-10-28T19:40:52.811779] [INFO ] [MAIN ] KVUE: Fetched primary data is valid. [2025-10-28T19:40:52.811872] [DEBUG] [LOCAL ] KVUE: Saving primary data. [2025-10-28T19:40:52.814251] [DEBUG] [LOCAL ] KVUE: Trimmed 77845 records to 53667 (keeping 200 days of data) [2025-10-28T19:40:53.178472] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-28T19:40:53.193822] [INFO ] [REMOTE ] KTB: Full fetch complete (58242 records). [2025-10-28T19:40:53.202941] [DEBUG] [VALIDATOR ] KTB: Validating primary data. [2025-10-28T19:40:53.213502] [DEBUG] [LOCAL ] KVUE: Primary data saved (53667 records). [2025-10-28T19:40:53.213818] [INFO ] [MAIN ] KVUE: Full history saved. [2025-10-28T19:40:53.213925] [INFO ] [MAIN ] Update Progress: 1226/2366 symbols completed. KVUE took 30.0s. Estimated remaining: 2h 29m 33s. Rate: 7.6 symbols/min [2025-10-28T19:40:53.544855] [INFO ] [MAIN ] KWR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:40:53.719924] [DEBUG] [LOCAL ] KWR: Loaded 15417 existing records from primary storage. [2025-10-28T19:40:53.748311] [INFO ] [MAIN ] KWR: Loaded 15417 existing records. [2025-10-28T19:40:53.875015] [DEBUG] [VALIDATOR ] KTB: All expected trading days are present. [2025-10-28T19:40:53.886144] [DEBUG] [VALIDATOR ] KTB: Primary data validation passed. [2025-10-28T19:40:53.898323] [INFO ] [MAIN ] KTB: Fetched primary data is valid. [2025-10-28T19:40:53.904172] [DEBUG] [LOCAL ] KTB: Saving primary data. [2025-10-28T19:40:53.973094] [DEBUG] [LOCAL ] KTB: Trimmed 58242 records to 39775 (keeping 200 days of data) [2025-10-28T19:40:53.977825] [WARN ] [MAIN ] KWR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:40:53.978413] [INFO ] [MAIN ] KWR: Wiping existing primary data before full refresh. [2025-10-28T19:40:53.978714] [INFO ] [LOCAL ] KWR: Starting deletion of primary data. [2025-10-28T19:40:53.979018] [DEBUG] [LOCAL ] KWR: Deleted primary data file. [2025-10-28T19:40:53.979077] [INFO ] [MAIN ] KWR: Starting full primary refresh. [2025-10-28T19:40:54.475420] [DEBUG] [LOCAL ] KTB: Primary data saved (39775 records). [2025-10-28T19:40:54.491581] [INFO ] [MAIN ] KTB: Full history saved. [2025-10-28T19:40:54.500170] [INFO ] [MAIN ] Update Progress: 1227/2366 symbols completed. KTB took 36.0s. Estimated remaining: 2h 29m 19s. Rate: 7.6 symbols/min [2025-10-28T19:40:54.691995] [INFO ] [REMOTE ] KWR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:40:54.702689] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-01. [2025-10-28T19:40:54.758339] [INFO ] [MAIN ] KYN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:40:54.788333] [DEBUG] [LOCAL ] KYN: Loaded 29810 existing records from primary storage. [2025-10-28T19:40:54.788573] [INFO ] [MAIN ] KYN: Loaded 29810 existing records. [2025-10-28T19:40:54.962939] [WARN ] [MAIN ] KYN: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:40:54.963175] [INFO ] [MAIN ] KYN: Wiping existing primary data before full refresh. [2025-10-28T19:40:54.963229] [INFO ] [LOCAL ] KYN: Starting deletion of primary data. [2025-10-28T19:40:54.963407] [DEBUG] [LOCAL ] KYN: Deleted primary data file. [2025-10-28T19:40:54.963481] [INFO ] [MAIN ] KYN: Starting full primary refresh. [2025-10-28T19:40:55.326518] [INFO ] [REMOTE ] KYN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:40:55.327098] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-01. [2025-10-28T19:40:55.421217] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-28T19:40:55.424799] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-02. [2025-10-28T19:40:56.062868] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-05 (15.09 seconds). [2025-10-28T19:40:56.085487] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-06. [2025-10-28T19:40:56.087843] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-10-28T19:40:56.092827] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-03. [2025-10-28T19:40:56.215901] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-28T19:40:56.223020] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-02. [2025-10-28T19:40:56.811314] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-28T19:40:56.815814] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-04. [2025-10-28T19:40:57.047057] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-10-28T19:40:57.053437] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-03. [2025-10-28T19:40:57.109099] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-10-28T19:40:57.119638] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-07. [2025-10-28T19:40:57.425082] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-10-28T19:40:57.430001] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-05. [2025-10-28T19:40:57.730122] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-10-28T19:40:57.736487] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-04. [2025-10-28T19:40:58.216174] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-10-28T19:40:58.220250] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-06. [2025-10-28T19:40:58.257605] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-10-28T19:40:58.268145] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-08. [2025-10-28T19:40:58.692479] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-10-28T19:40:58.700304] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-05. [2025-10-28T19:40:58.856805] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-10-28T19:40:58.860810] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-07. [2025-10-28T19:40:59.418145] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-10-28T19:40:59.425509] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-06. [2025-10-28T19:40:59.457300] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-10-28T19:40:59.470197] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-09. [2025-10-28T19:40:59.483980] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-10-28T19:40:59.488481] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-08. [2025-10-28T19:41:00.643052] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-10-28T19:41:00.649263] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-07. [2025-10-28T19:41:01.051971] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-28T19:41:01.063471] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-10. [2025-10-28T19:41:01.748330] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-10-28T19:41:01.755861] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-08. [2025-10-28T19:41:02.492692] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-28T19:41:02.503791] [INFO ] [REMOTE ] KVYO: Full fetch complete (72436 records). [2025-10-28T19:41:02.504023] [DEBUG] [VALIDATOR ] KVYO: Validating primary data. [2025-10-28T19:41:02.578575] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-10-28T19:41:02.634436] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-09. [2025-10-28T19:41:02.919720] [DEBUG] [VALIDATOR ] KVYO: All expected trading days are present. [2025-10-28T19:41:02.919797] [DEBUG] [VALIDATOR ] KVYO: Primary data validation passed. [2025-10-28T19:41:02.920764] [INFO ] [MAIN ] KVYO: Fetched primary data is valid. [2025-10-28T19:41:02.920824] [DEBUG] [LOCAL ] KVYO: Saving primary data. [2025-10-28T19:41:02.922094] [DEBUG] [LOCAL ] KVYO: Trimmed 72436 records to 50922 (keeping 200 days of data) [2025-10-28T19:41:03.140403] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-06 (17.34 seconds). [2025-10-28T19:41:03.157844] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-07. [2025-10-28T19:41:03.241474] [DEBUG] [LOCAL ] KVYO: Primary data saved (50922 records). [2025-10-28T19:41:03.241587] [INFO ] [MAIN ] KVYO: Full history saved. [2025-10-28T19:41:03.241682] [INFO ] [MAIN ] Update Progress: 1228/2366 symbols completed. KVYO took 28.4s. Estimated remaining: 2h 29m 12s. Rate: 7.6 symbols/min [2025-10-28T19:41:03.407044] [INFO ] [MAIN ] L: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:41:03.443421] [DEBUG] [LOCAL ] L: Loaded 40785 existing records from primary storage. [2025-10-28T19:41:03.443703] [INFO ] [MAIN ] L: Loaded 40785 existing records. [2025-10-28T19:41:03.619364] [WARN ] [MAIN ] L: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:41:03.619616] [INFO ] [MAIN ] L: Wiping existing primary data before full refresh. [2025-10-28T19:41:03.619698] [INFO ] [LOCAL ] L: Starting deletion of primary data. [2025-10-28T19:41:03.620014] [DEBUG] [LOCAL ] L: Deleted primary data file. [2025-10-28T19:41:03.620070] [INFO ] [MAIN ] L: Starting full primary refresh. [2025-10-28T19:41:03.889966] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-28T19:41:03.927582] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-10. [2025-10-28T19:41:03.998772] [INFO ] [REMOTE ] L: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:41:03.999031] [INFO ] [REMOTE ] L: Fetching primary data for 2025-01. [2025-10-28T19:41:04.252174] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-28T19:41:04.261068] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-08. [2025-10-28T19:41:05.083080] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-10 (1.16 seconds). [2025-10-28T19:41:05.089247] [INFO ] [REMOTE ] KYN: Full fetch complete (44365 records). [2025-10-28T19:41:05.089332] [DEBUG] [VALIDATOR ] KYN: Validating primary data. [2025-10-28T19:41:05.491485] [DEBUG] [VALIDATOR ] KYN: All expected trading days are present. [2025-10-28T19:41:05.493304] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-10-28T19:41:05.492133] [DEBUG] [VALIDATOR ] KYN: Primary data validation passed. [2025-10-28T19:41:05.502072] [INFO ] [MAIN ] KYN: Fetched primary data is valid. [2025-10-28T19:41:05.502538] [DEBUG] [LOCAL ] KYN: Saving primary data. [2025-10-28T19:41:05.503171] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-09. [2025-10-28T19:41:05.504554] [DEBUG] [LOCAL ] KYN: Trimmed 44365 records to 29647 (keeping 200 days of data) [2025-10-28T19:41:05.678707] [DEBUG] [LOCAL ] KYN: Primary data saved (29647 records). [2025-10-28T19:41:05.678831] [INFO ] [MAIN ] KYN: Full history saved. [2025-10-28T19:41:05.678907] [INFO ] [MAIN ] Update Progress: 1229/2366 symbols completed. KYN took 11.2s. Estimated remaining: 2h 28m 59s. Rate: 7.6 symbols/min [2025-10-28T19:41:05.845676] [INFO ] [MAIN ] LAC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:41:05.898431] [DEBUG] [LOCAL ] LAC: Loaded 52585 existing records from primary storage. [2025-10-28T19:41:05.898742] [INFO ] [MAIN ] LAC: Loaded 52585 existing records. [2025-10-28T19:41:06.071563] [WARN ] [MAIN ] LAC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:41:06.071791] [INFO ] [MAIN ] LAC: Wiping existing primary data before full refresh. [2025-10-28T19:41:06.071847] [INFO ] [LOCAL ] LAC: Starting deletion of primary data. [2025-10-28T19:41:06.072022] [DEBUG] [LOCAL ] LAC: Deleted primary data file. [2025-10-28T19:41:06.072059] [INFO ] [MAIN ] LAC: Starting full primary refresh. [2025-10-28T19:41:06.439090] [INFO ] [REMOTE ] LAC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:41:06.439463] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-01. [2025-10-28T19:41:06.498335] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-28T19:41:06.506604] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-10. [2025-10-28T19:41:08.053803] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-28T19:41:08.061765] [INFO ] [REMOTE ] KW: Full fetch complete (57178 records). [2025-10-28T19:41:08.061881] [DEBUG] [VALIDATOR ] KW: Validating primary data. [2025-10-28T19:41:08.385806] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-10-28T19:41:08.398261] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-02. [2025-10-28T19:41:08.488243] [DEBUG] [VALIDATOR ] KW: All expected trading days are present. [2025-10-28T19:41:08.488317] [DEBUG] [VALIDATOR ] KW: Primary data validation passed. [2025-10-28T19:41:08.489845] [INFO ] [MAIN ] KW: Fetched primary data is valid. [2025-10-28T19:41:08.489906] [DEBUG] [LOCAL ] KW: Saving primary data. [2025-10-28T19:41:08.490985] [DEBUG] [LOCAL ] KW: Trimmed 57178 records to 39949 (keeping 200 days of data) [2025-10-28T19:41:08.721909] [DEBUG] [LOCAL ] KW: Primary data saved (39949 records). [2025-10-28T19:41:08.722048] [INFO ] [MAIN ] KW: Full history saved. [2025-10-28T19:41:08.722128] [INFO ] [MAIN ] Update Progress: 1230/2366 symbols completed. KW took 29.2s. Estimated remaining: 2h 28m 47s. Rate: 7.6 symbols/min [2025-10-28T19:41:08.898545] [INFO ] [MAIN ] LAD: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:41:08.922317] [DEBUG] [LOCAL ] LAD: Loaded 23328 existing records from primary storage. [2025-10-28T19:41:08.922574] [INFO ] [MAIN ] LAD: Loaded 23328 existing records. [2025-10-28T19:41:09.101233] [WARN ] [MAIN ] LAD: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:41:09.101459] [INFO ] [MAIN ] LAD: Wiping existing primary data before full refresh. [2025-10-28T19:41:09.101505] [INFO ] [LOCAL ] LAD: Starting deletion of primary data. [2025-10-28T19:41:09.101768] [DEBUG] [LOCAL ] LAD: Deleted primary data file. [2025-10-28T19:41:09.101825] [INFO ] [MAIN ] LAD: Starting full primary refresh. [2025-10-28T19:41:09.463034] [INFO ] [REMOTE ] LAD: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:41:09.463440] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-01. [2025-10-28T19:41:09.883713] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-10-28T19:41:09.894360] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-03. [2025-10-28T19:41:10.376396] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-10-28T19:41:10.388191] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-02. [2025-10-28T19:41:11.268302] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-28T19:41:11.274117] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-03. [2025-10-28T19:41:12.111609] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-08 (12.62 seconds). [2025-10-28T19:41:12.116395] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-09. [2025-10-28T19:41:12.136743] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-10-28T19:41:12.144687] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-04. [2025-10-28T19:41:12.621773] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-10-28T19:41:12.625206] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-10. [2025-10-28T19:41:13.337067] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-10 (0.71 seconds). [2025-10-28T19:41:13.340700] [INFO ] [REMOTE ] KWR: Full fetch complete (22965 records). [2025-10-28T19:41:13.340864] [DEBUG] [VALIDATOR ] KWR: Validating primary data. [2025-10-28T19:41:13.768428] [DEBUG] [VALIDATOR ] KWR: All expected trading days are present. [2025-10-28T19:41:13.768581] [DEBUG] [VALIDATOR ] KWR: Primary data validation passed. [2025-10-28T19:41:13.770014] [INFO ] [MAIN ] KWR: Fetched primary data is valid. [2025-10-28T19:41:13.770129] [DEBUG] [LOCAL ] KWR: Saving primary data. [2025-10-28T19:41:13.771626] [DEBUG] [LOCAL ] KWR: Trimmed 22965 records to 15320 (keeping 200 days of data) [2025-10-28T19:41:13.881857] [DEBUG] [LOCAL ] KWR: Primary data saved (15320 records). [2025-10-28T19:41:13.882074] [INFO ] [MAIN ] KWR: Full history saved. [2025-10-28T19:41:13.882188] [INFO ] [MAIN ] Update Progress: 1231/2366 symbols completed. KWR took 20.7s. Estimated remaining: 2h 28m 37s. Rate: 7.6 symbols/min [2025-10-28T19:41:14.069240] [INFO ] [MAIN ] LADR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:41:14.116354] [DEBUG] [LOCAL ] LADR: Loaded 39131 existing records from primary storage. [2025-10-28T19:41:14.116846] [INFO ] [MAIN ] LADR: Loaded 39131 existing records. [2025-10-28T19:41:14.303047] [WARN ] [MAIN ] LADR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:41:14.303391] [INFO ] [MAIN ] LADR: Wiping existing primary data before full refresh. [2025-10-28T19:41:14.303469] [INFO ] [LOCAL ] LADR: Starting deletion of primary data. [2025-10-28T19:41:14.303856] [DEBUG] [LOCAL ] LADR: Deleted primary data file. [2025-10-28T19:41:14.303918] [INFO ] [MAIN ] LADR: Starting full primary refresh. [2025-10-28T19:41:14.703476] [INFO ] [REMOTE ] LADR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:41:14.704149] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-01. [2025-10-28T19:41:15.623966] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-28T19:41:15.631724] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-02. [2025-10-28T19:41:16.544558] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-28T19:41:16.551611] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-03. [2025-10-28T19:41:16.856797] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-01 (12.86 seconds). [2025-10-28T19:41:16.864767] [INFO ] [REMOTE ] L: Fetching primary data for 2025-02. [2025-10-28T19:41:17.499879] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-28T19:41:17.507945] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-04. [2025-10-28T19:41:18.585744] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-28T19:41:18.595197] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-05. [2025-10-28T19:41:31.724571] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-03 (21.83 seconds). [2025-10-28T19:41:31.735602] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-04. [2025-10-28T19:41:33.212826] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-28T19:41:33.223680] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-05. [2025-10-28T19:41:34.659113] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-28T19:41:34.669960] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-06. [2025-10-28T19:41:35.980958] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-10-28T19:41:35.991844] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-07. [2025-10-28T19:41:37.539516] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-10-28T19:41:37.551923] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-08. [2025-10-28T19:41:44.630023] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-04 (32.49 seconds). [2025-10-28T19:41:44.636613] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-05. [2025-10-28T19:41:45.404976] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-28T19:41:45.410359] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-06. [2025-10-28T19:41:52.080454] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-08 (14.53 seconds). [2025-10-28T19:41:52.091678] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-09. [2025-10-28T19:41:53.685583] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-28T19:41:53.696982] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-10. [2025-10-28T19:41:55.926048] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-10 (2.23 seconds). [2025-10-28T19:41:55.937105] [INFO ] [REMOTE ] LAC: Full fetch complete (76157 records). [2025-10-28T19:41:55.937262] [DEBUG] [VALIDATOR ] LAC: Validating primary data. [2025-10-28T19:41:56.054111] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-06 (10.64 seconds). [2025-10-28T19:41:56.069633] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-07. [2025-10-28T19:41:56.352285] [DEBUG] [VALIDATOR ] LAC: All expected trading days are present. [2025-10-28T19:41:56.352360] [DEBUG] [VALIDATOR ] LAC: Primary data validation passed. [2025-10-28T19:41:56.353484] [INFO ] [MAIN ] LAC: Fetched primary data is valid. [2025-10-28T19:41:56.353547] [DEBUG] [LOCAL ] LAC: Saving primary data. [2025-10-28T19:41:56.354927] [DEBUG] [LOCAL ] LAC: Trimmed 76157 records to 52592 (keeping 200 days of data) [2025-10-28T19:41:56.652309] [DEBUG] [LOCAL ] LAC: Primary data saved (52592 records). [2025-10-28T19:41:56.652446] [INFO ] [MAIN ] LAC: Full history saved. [2025-10-28T19:41:56.653417] [INFO ] [MAIN ] Update Progress: 1232/2366 symbols completed. LAC took 51.0s. Estimated remaining: 2h 29m 1s. Rate: 7.6 symbols/min [2025-10-28T19:41:56.825278] [INFO ] [MAIN ] LANV: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:41:56.831294] [DEBUG] [LOCAL ] LANV: Loaded 2761 existing records from primary storage. [2025-10-28T19:41:56.831494] [INFO ] [MAIN ] LANV: Loaded 2761 existing records. [2025-10-28T19:41:57.040693] [WARN ] [MAIN ] LANV: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:41:57.041200] [INFO ] [MAIN ] LANV: Wiping existing primary data before full refresh. [2025-10-28T19:41:57.041392] [INFO ] [LOCAL ] LANV: Starting deletion of primary data. [2025-10-28T19:41:57.041601] [DEBUG] [LOCAL ] LANV: Deleted primary data file. [2025-10-28T19:41:57.041815] [INFO ] [MAIN ] LANV: Starting full primary refresh. [2025-10-28T19:41:57.187009] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-28T19:41:57.247583] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-08. [2025-10-28T19:41:57.625725] [INFO ] [REMOTE ] LANV: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:41:57.627147] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-01. [2025-10-28T19:41:58.013064] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-10-28T19:41:58.016360] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-02. [2025-10-28T19:41:58.098041] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-10-28T19:41:58.103871] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-09. [2025-10-28T19:41:58.301313] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-02 (0.28 seconds). [2025-10-28T19:41:58.302776] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-03. [2025-10-28T19:41:58.597396] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-03 (0.29 seconds). [2025-10-28T19:41:58.599051] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-04. [2025-10-28T19:41:58.760581] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-10-28T19:41:58.765799] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-10. [2025-10-28T19:41:59.685812] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-10 (0.92 seconds). [2025-10-28T19:41:59.691385] [INFO ] [REMOTE ] LAD: Full fetch complete (35775 records). [2025-10-28T19:41:59.691525] [DEBUG] [VALIDATOR ] LAD: Validating primary data. [2025-10-28T19:42:00.076112] [DEBUG] [VALIDATOR ] LAD: All expected trading days are present. [2025-10-28T19:42:00.076202] [DEBUG] [VALIDATOR ] LAD: Primary data validation passed. [2025-10-28T19:42:00.076986] [INFO ] [MAIN ] LAD: Fetched primary data is valid. [2025-10-28T19:42:00.077048] [DEBUG] [LOCAL ] LAD: Saving primary data. [2025-10-28T19:42:00.078041] [DEBUG] [LOCAL ] LAD: Trimmed 35775 records to 23261 (keeping 200 days of data) [2025-10-28T19:42:00.225960] [DEBUG] [LOCAL ] LAD: Primary data saved (23261 records). [2025-10-28T19:42:00.226095] [INFO ] [MAIN ] LAD: Full history saved. [2025-10-28T19:42:00.226176] [INFO ] [MAIN ] Update Progress: 1233/2366 symbols completed. LAD took 51.5s. Estimated remaining: 2h 28m 49s. Rate: 7.6 symbols/min [2025-10-28T19:42:00.395085] [INFO ] [MAIN ] LAR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:42:00.395265] [DEBUG] [LOCAL ] LAR: No existing data file found in primary storage. [2025-10-28T19:42:00.395302] [WARN ] [MAIN ] LAR: No existing data found, performing full refresh instead. [2025-10-28T19:42:00.395407] [INFO ] [MAIN ] LAR: Wiping existing primary data before full refresh. [2025-10-28T19:42:00.395467] [INFO ] [LOCAL ] LAR: Starting deletion of primary data. [2025-10-28T19:42:00.395507] [DEBUG] [LOCAL ] LAR: No primary data file found to delete. [2025-10-28T19:42:00.395538] [INFO ] [MAIN ] LAR: Starting full primary refresh. [2025-10-28T19:42:00.757750] [INFO ] [REMOTE ] LAR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:42:00.758026] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-01. [2025-10-28T19:42:00.964048] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-02 (44.10 seconds). [2025-10-28T19:42:00.971847] [INFO ] [REMOTE ] L: Fetching primary data for 2025-03. [2025-10-28T19:42:01.297357] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-10-28T19:42:01.300334] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-02. [2025-10-28T19:42:01.609088] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-05 (43.01 seconds). [2025-10-28T19:42:01.616910] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-06. [2025-10-28T19:42:02.114321] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-10-28T19:42:02.122939] [INFO ] [REMOTE ] L: Fetching primary data for 2025-04. [2025-10-28T19:42:02.513707] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-10-28T19:42:02.522611] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-03. [2025-10-28T19:42:02.556296] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-28T19:42:02.564405] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-07. [2025-10-28T19:42:03.470914] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-04 (4.87 seconds). [2025-10-28T19:42:03.472404] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-05. [2025-10-28T19:42:03.694896] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-28T19:42:03.704298] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-08. [2025-10-28T19:42:03.714436] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-05 (0.24 seconds). [2025-10-28T19:42:03.715383] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-06. [2025-10-28T19:42:03.950220] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-06 (0.23 seconds). [2025-10-28T19:42:03.951517] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-07. [2025-10-28T19:42:04.341076] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-10-28T19:42:04.342486] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-08. [2025-10-28T19:42:04.663618] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-10-28T19:42:04.675761] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-09. [2025-10-28T19:42:05.496754] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-10-28T19:42:05.498631] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-09. [2025-10-28T19:42:05.711264] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-10-28T19:42:05.720058] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-10. [2025-10-28T19:42:05.841538] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-10-28T19:42:05.843255] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-10. [2025-10-28T19:42:06.295015] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-10 (0.45 seconds). [2025-10-28T19:42:06.296153] [INFO ] [REMOTE ] LANV: Full fetch complete (4204 records). [2025-10-28T19:42:06.296220] [DEBUG] [VALIDATOR ] LANV: Validating primary data. [2025-10-28T19:42:06.654618] [DEBUG] [VALIDATOR ] LANV: All expected trading days are present. [2025-10-28T19:42:06.654719] [DEBUG] [VALIDATOR ] LANV: Primary data validation passed. [2025-10-28T19:42:06.654870] [INFO ] [MAIN ] LANV: Fetched primary data is valid. [2025-10-28T19:42:06.654908] [DEBUG] [LOCAL ] LANV: Saving primary data. [2025-10-28T19:42:06.655241] [DEBUG] [LOCAL ] LANV: Trimmed 4204 records to 2765 (keeping 200 days of data) [2025-10-28T19:42:06.670452] [DEBUG] [LOCAL ] LANV: Primary data saved (2765 records). [2025-10-28T19:42:06.670517] [INFO ] [MAIN ] LANV: Full history saved. [2025-10-28T19:42:06.670586] [INFO ] [MAIN ] Update Progress: 1234/2366 symbols completed. LANV took 10.0s. Estimated remaining: 2h 28m 40s. Rate: 7.6 symbols/min [2025-10-28T19:42:06.837952] [INFO ] [MAIN ] LAW: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:42:06.854003] [DEBUG] [LOCAL ] LAW: Loaded 15098 existing records from primary storage. [2025-10-28T19:42:06.854221] [INFO ] [MAIN ] LAW: Loaded 15098 existing records. [2025-10-28T19:42:07.040394] [WARN ] [MAIN ] LAW: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:42:07.040801] [INFO ] [MAIN ] LAW: Wiping existing primary data before full refresh. [2025-10-28T19:42:07.040957] [INFO ] [LOCAL ] LAW: Starting deletion of primary data. [2025-10-28T19:42:07.041233] [DEBUG] [LOCAL ] LAW: Deleted primary data file. [2025-10-28T19:42:07.041307] [INFO ] [MAIN ] LAW: Starting full primary refresh. [2025-10-28T19:42:07.176607] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-28T19:42:07.228121] [INFO ] [REMOTE ] LADR: Full fetch complete (55649 records). [2025-10-28T19:42:07.237419] [DEBUG] [VALIDATOR ] LADR: Validating primary data. [2025-10-28T19:42:07.626098] [INFO ] [REMOTE ] LAW: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:42:07.688187] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-01. [2025-10-28T19:42:07.853197] [DEBUG] [VALIDATOR ] LADR: All expected trading days are present. [2025-10-28T19:42:07.853270] [DEBUG] [VALIDATOR ] LADR: Primary data validation passed. [2025-10-28T19:42:07.854111] [INFO ] [MAIN ] LADR: Fetched primary data is valid. [2025-10-28T19:42:07.854171] [DEBUG] [LOCAL ] LADR: Saving primary data. [2025-10-28T19:42:07.855285] [DEBUG] [LOCAL ] LADR: Trimmed 55649 records to 39034 (keeping 200 days of data) [2025-10-28T19:42:08.088459] [DEBUG] [LOCAL ] LADR: Primary data saved (39034 records). [2025-10-28T19:42:08.088598] [INFO ] [MAIN ] LADR: Full history saved. [2025-10-28T19:42:08.088731] [INFO ] [MAIN ] Update Progress: 1235/2366 symbols completed. LADR took 54.2s. Estimated remaining: 2h 28m 26s. Rate: 7.6 symbols/min [2025-10-28T19:42:08.255898] [INFO ] [MAIN ] LAZ: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:42:08.294889] [DEBUG] [LOCAL ] LAZ: Loaded 44276 existing records from primary storage. [2025-10-28T19:42:08.295172] [INFO ] [MAIN ] LAZ: Loaded 44276 existing records. [2025-10-28T19:42:08.478304] [WARN ] [MAIN ] LAZ: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:42:08.478472] [INFO ] [MAIN ] LAZ: Wiping existing primary data before full refresh. [2025-10-28T19:42:08.478520] [INFO ] [LOCAL ] LAZ: Starting deletion of primary data. [2025-10-28T19:42:08.478952] [DEBUG] [LOCAL ] LAZ: Deleted primary data file. [2025-10-28T19:42:08.479021] [INFO ] [MAIN ] LAZ: Starting full primary refresh. [2025-10-28T19:42:08.837914] [INFO ] [REMOTE ] LAZ: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:42:08.838213] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-01. [2025-10-28T19:42:09.942224] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-10-28T19:42:09.951841] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-02. [2025-10-28T19:42:10.957384] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-28T19:42:10.966154] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-03. [2025-10-28T19:42:12.082248] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-28T19:42:12.091924] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-04. [2025-10-28T19:42:13.242083] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-28T19:42:13.252292] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-05. [2025-10-28T19:42:14.573621] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-04 (12.45 seconds). [2025-10-28T19:42:14.582286] [INFO ] [REMOTE ] L: Fetching primary data for 2025-05. [2025-10-28T19:42:15.640753] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-28T19:42:15.649298] [INFO ] [REMOTE ] L: Fetching primary data for 2025-06. [2025-10-28T19:42:16.726911] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-28T19:42:16.736996] [INFO ] [REMOTE ] L: Fetching primary data for 2025-07. [2025-10-28T19:42:17.868801] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-10-28T19:42:17.878079] [INFO ] [REMOTE ] L: Fetching primary data for 2025-08. [2025-10-28T19:42:19.020578] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-10-28T19:42:19.029355] [INFO ] [REMOTE ] L: Fetching primary data for 2025-09. [2025-10-28T19:42:20.107199] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-10-28T19:42:20.116319] [INFO ] [REMOTE ] L: Fetching primary data for 2025-10. [2025-10-28T19:42:26.106470] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-03 (23.58 seconds). [2025-10-28T19:42:26.116102] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-04. [2025-10-28T19:42:27.211710] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-10-28T19:42:27.221878] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-05. [2025-10-28T19:42:28.107885] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-05 (14.86 seconds). [2025-10-28T19:42:28.118874] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-06. [2025-10-28T19:42:28.794927] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-10-28T19:42:28.804445] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-06. [2025-10-28T19:42:29.230544] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-10-28T19:42:29.239979] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-07. [2025-10-28T19:42:29.364446] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-01 (21.68 seconds). [2025-10-28T19:42:29.367762] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-02. [2025-10-28T19:42:29.907530] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-28T19:42:29.916536] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-07. [2025-10-28T19:42:30.015851] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-28T19:42:30.019514] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-03. [2025-10-28T19:42:30.322157] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-28T19:42:30.332209] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-08. [2025-10-28T19:42:30.405055] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-10-28T19:42:30.408229] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-04. [2025-10-28T19:42:31.002541] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-10-28T19:42:31.005886] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-05. [2025-10-28T19:42:31.119417] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-10-28T19:42:31.130144] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-08. [2025-10-28T19:42:31.464390] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-10-28T19:42:31.473944] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-09. [2025-10-28T19:42:31.550144] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-10-28T19:42:31.553905] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-06. [2025-10-28T19:42:32.219400] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-10-28T19:42:32.223570] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-07. [2025-10-28T19:42:32.380454] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-28T19:42:32.390839] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-09. [2025-10-28T19:42:32.471926] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-10-28T19:42:32.481783] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-10. [2025-10-28T19:42:32.824671] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-10-28T19:42:32.828376] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-08. [2025-10-28T19:42:33.333034] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-10-28T19:42:33.337795] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-09. [2025-10-28T19:42:33.564684] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-10-28T19:42:33.575235] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-10. [2025-10-28T19:42:33.806791] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-28T19:42:33.810794] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-10. [2025-10-28T19:42:34.642815] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-10 (0.83 seconds). [2025-10-28T19:42:34.647133] [INFO ] [REMOTE ] LAW: Full fetch complete (21192 records). [2025-10-28T19:42:34.647220] [DEBUG] [VALIDATOR ] LAW: Validating primary data. [2025-10-28T19:42:35.028432] [DEBUG] [VALIDATOR ] LAW: All expected trading days are present. [2025-10-28T19:42:35.028527] [DEBUG] [VALIDATOR ] LAW: Primary data validation passed. [2025-10-28T19:42:35.029066] [INFO ] [MAIN ] LAW: Fetched primary data is valid. [2025-10-28T19:42:35.029128] [DEBUG] [LOCAL ] LAW: Saving primary data. [2025-10-28T19:42:35.029902] [DEBUG] [LOCAL ] LAW: Trimmed 21192 records to 15102 (keeping 200 days of data) [2025-10-28T19:42:35.121012] [DEBUG] [LOCAL ] LAW: Primary data saved (15102 records). [2025-10-28T19:42:35.121169] [INFO ] [MAIN ] LAW: Full history saved. [2025-10-28T19:42:35.121274] [INFO ] [MAIN ] Update Progress: 1236/2366 symbols completed. LAW took 28.5s. Estimated remaining: 2h 28m 36s. Rate: 7.6 symbols/min [2025-10-28T19:42:35.298598] [INFO ] [MAIN ] LB: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:42:35.335149] [DEBUG] [LOCAL ] LB: Loaded 36633 existing records from primary storage. [2025-10-28T19:42:35.335427] [INFO ] [MAIN ] LB: Loaded 36633 existing records. [2025-10-28T19:42:35.511741] [WARN ] [MAIN ] LB: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:42:35.511961] [INFO ] [MAIN ] LB: Wiping existing primary data before full refresh. [2025-10-28T19:42:35.512014] [INFO ] [LOCAL ] LB: Starting deletion of primary data. [2025-10-28T19:42:35.512239] [DEBUG] [LOCAL ] LB: Deleted primary data file. [2025-10-28T19:42:35.512294] [INFO ] [MAIN ] LB: Starting full primary refresh. [2025-10-28T19:42:35.866722] [INFO ] [REMOTE ] LB: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:42:35.867133] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-01. [2025-10-28T19:42:37.032467] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-28T19:42:37.041546] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-02. [2025-10-28T19:42:38.377766] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-10-28T19:42:38.385530] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-03. [2025-10-28T19:42:40.520846] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-10 (20.40 seconds). [2025-10-28T19:42:40.529028] [INFO ] [REMOTE ] L: Full fetch complete (59242 records). [2025-10-28T19:42:40.529128] [DEBUG] [VALIDATOR ] L: Validating primary data. [2025-10-28T19:42:40.907077] [DEBUG] [VALIDATOR ] L: All expected trading days are present. [2025-10-28T19:42:40.907154] [DEBUG] [VALIDATOR ] L: Primary data validation passed. [2025-10-28T19:42:40.908048] [INFO ] [MAIN ] L: Fetched primary data is valid. [2025-10-28T19:42:40.908111] [DEBUG] [LOCAL ] L: Saving primary data. [2025-10-28T19:42:40.909200] [DEBUG] [LOCAL ] L: Trimmed 59242 records to 40788 (keeping 200 days of data) [2025-10-28T19:42:41.154814] [DEBUG] [LOCAL ] L: Primary data saved (40788 records). [2025-10-28T19:42:41.154959] [INFO ] [MAIN ] L: Full history saved. [2025-10-28T19:42:41.155052] [INFO ] [MAIN ] Update Progress: 1237/2366 symbols completed. L took 1m 38s. Estimated remaining: 2h 28m 26s. Rate: 7.6 symbols/min [2025-10-28T19:42:43.812212] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-10 (11.33 seconds). [2025-10-28T19:42:43.820573] [INFO ] [REMOTE ] LAZ: Full fetch complete (65291 records). [2025-10-28T19:42:43.820762] [DEBUG] [VALIDATOR ] LAZ: Validating primary data. [2025-10-28T19:42:44.210899] [DEBUG] [VALIDATOR ] LAZ: All expected trading days are present. [2025-10-28T19:42:44.210983] [DEBUG] [VALIDATOR ] LAZ: Primary data validation passed. [2025-10-28T19:42:44.212015] [INFO ] [MAIN ] LAZ: Fetched primary data is valid. [2025-10-28T19:42:44.212078] [DEBUG] [LOCAL ] LAZ: Saving primary data. [2025-10-28T19:42:44.213371] [DEBUG] [LOCAL ] LAZ: Trimmed 65291 records to 44224 (keeping 200 days of data) [2025-10-28T19:42:44.475335] [DEBUG] [LOCAL ] LAZ: Primary data saved (44224 records). [2025-10-28T19:42:44.475464] [INFO ] [MAIN ] LAZ: Full history saved. [2025-10-28T19:42:44.475557] [INFO ] [MAIN ] Update Progress: 1238/2366 symbols completed. LAZ took 36.4s. Estimated remaining: 2h 28m 14s. Rate: 7.6 symbols/min [2025-10-28T19:42:48.646868] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-03 (10.26 seconds). [2025-10-28T19:42:48.655342] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-04. [2025-10-28T19:42:54.942686] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-10 (21.37 seconds). [2025-10-28T19:42:54.953403] [INFO ] [REMOTE ] LAR: Full fetch complete (63995 records). [2025-10-28T19:42:54.953562] [DEBUG] [VALIDATOR ] LAR: Validating primary data. [2025-10-28T19:42:55.148403] [WARN ] [VALIDATOR ] LAR: Validation failed - insufficient historical data. Have 191 unique days, need 200 days [2025-10-28T19:42:55.149102] [FATAL] [MAIN ] LAR: Fetched primary data is invalid. Refusing to save it. [2025-10-28T19:42:55.149176] [WARN ] [MAIN ] LAR: Deleting existing primary and derivative data due to validation failure. [2025-10-28T19:42:55.149233] [INFO ] [LOCAL ] LAR: Starting deletion of primary data. [2025-10-28T19:42:55.149296] [DEBUG] [LOCAL ] LAR: No primary data file found to delete. [2025-10-28T19:42:55.149331] [INFO ] [LOCAL ] LAR: Starting deletion of derivative data. [2025-10-28T19:42:55.149369] [DEBUG] [LOCAL ] LAR: No derivative data file found to delete. [2025-10-28T19:42:55.149431] [INFO ] [MAIN ] Update Progress: 1239/2366 symbols completed. LAR took 54.9s. Estimated remaining: 2h 28m 9s. Rate: 7.6 symbols/min [2025-10-28T19:43:01.465781] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-04 (12.81 seconds). [2025-10-28T19:43:01.477931] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-05. [2025-10-28T19:43:02.504936] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-10-28T19:43:02.514004] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-06. [2025-10-28T19:43:03.511844] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-28T19:43:03.519362] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-07. [2025-10-28T19:43:04.735734] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-10-28T19:43:04.745791] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-08. [2025-10-28T19:43:05.822533] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-28T19:43:05.832462] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-09. [2025-10-28T19:43:06.814776] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-28T19:43:06.822742] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-10. [2025-10-28T19:43:07.907973] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-10 (1.09 seconds). [2025-10-28T19:43:07.915267] [INFO ] [REMOTE ] LB: Full fetch complete (55393 records). [2025-10-28T19:43:07.915381] [DEBUG] [VALIDATOR ] LB: Validating primary data. [2025-10-28T19:43:08.292766] [DEBUG] [VALIDATOR ] LB: All expected trading days are present. [2025-10-28T19:43:08.292859] [DEBUG] [VALIDATOR ] LB: Primary data validation passed. [2025-10-28T19:43:08.293744] [INFO ] [MAIN ] LB: Fetched primary data is valid. [2025-10-28T19:43:08.293812] [DEBUG] [LOCAL ] LB: Saving primary data. [2025-10-28T19:43:08.295134] [DEBUG] [LOCAL ] LB: Trimmed 55393 records to 36485 (keeping 200 days of data) [2025-10-28T19:43:08.514601] [DEBUG] [LOCAL ] LB: Primary data saved (36485 records). [2025-10-28T19:43:08.514758] [INFO ] [MAIN ] LB: Full history saved. [2025-10-28T19:43:08.514849] [INFO ] [MAIN ] Update Progress: 1240/2366 symbols completed. LB took 33.4s. Estimated remaining: 2h 28m 6s. Rate: 7.6 symbols/min [2025-10-28T19:43:09.053055] [INFO ] [MAIN ] LDI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:43:09.208115] [INFO ] [MAIN ] LCII: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:43:09.207162] [INFO ] [MAIN ] LC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:43:09.242744] [INFO ] [MAIN ] LBRT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:43:09.289456] [DEBUG] [LOCAL ] LCII: Loaded 26354 existing records from primary storage. [2025-10-28T19:43:09.289802] [INFO ] [MAIN ] LCII: Loaded 26354 existing records. [2025-10-28T19:43:09.438125] [DEBUG] [LOCAL ] LC: Loaded 48250 existing records from primary storage. [2025-10-28T19:43:09.445425] [DEBUG] [LOCAL ] LDI: Loaded 45259 existing records from primary storage. [2025-10-28T19:43:09.456183] [INFO ] [MAIN ] LC: Loaded 48250 existing records. [2025-10-28T19:43:09.483576] [INFO ] [MAIN ] LDI: Loaded 45259 existing records. [2025-10-28T19:43:09.586564] [WARN ] [MAIN ] LCII: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:43:09.657480] [INFO ] [MAIN ] LCII: Wiping existing primary data before full refresh. [2025-10-28T19:43:09.626150] [DEBUG] [LOCAL ] LBRT: Loaded 53003 existing records from primary storage. [2025-10-28T19:43:09.714060] [INFO ] [MAIN ] LBRT: Loaded 53003 existing records. [2025-10-28T19:43:09.713404] [INFO ] [LOCAL ] LCII: Starting deletion of primary data. [2025-10-28T19:43:09.853073] [DEBUG] [LOCAL ] LCII: Deleted primary data file. [2025-10-28T19:43:09.858434] [INFO ] [MAIN ] LCII: Starting full primary refresh. [2025-10-28T19:43:09.971321] [WARN ] [MAIN ] LC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:43:10.076443] [INFO ] [MAIN ] LC: Wiping existing primary data before full refresh. [2025-10-28T19:43:10.092427] [INFO ] [LOCAL ] LC: Starting deletion of primary data. [2025-10-28T19:43:10.092321] [WARN ] [MAIN ] LDI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:43:10.127242] [INFO ] [MAIN ] LDI: Wiping existing primary data before full refresh. [2025-10-28T19:43:10.148970] [DEBUG] [LOCAL ] LC: Deleted primary data file. [2025-10-28T19:43:10.149166] [INFO ] [MAIN ] LC: Starting full primary refresh. [2025-10-28T19:43:10.149306] [INFO ] [LOCAL ] LDI: Starting deletion of primary data. [2025-10-28T19:43:10.257468] [DEBUG] [LOCAL ] LDI: Deleted primary data file. [2025-10-28T19:43:10.278678] [INFO ] [MAIN ] LDI: Starting full primary refresh. [2025-10-28T19:43:10.422131] [WARN ] [MAIN ] LBRT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:43:10.544348] [INFO ] [MAIN ] LBRT: Wiping existing primary data before full refresh. [2025-10-28T19:43:10.655284] [INFO ] [LOCAL ] LBRT: Starting deletion of primary data. [2025-10-28T19:43:10.767428] [DEBUG] [LOCAL ] LBRT: Deleted primary data file. [2025-10-28T19:43:10.783981] [INFO ] [MAIN ] LBRT: Starting full primary refresh. [2025-10-28T19:43:11.215322] [INFO ] [REMOTE ] LCII: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:43:11.319436] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-01. [2025-10-28T19:43:11.397479] [INFO ] [REMOTE ] LC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:43:11.451823] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-01. [2025-10-28T19:43:11.679382] [INFO ] [REMOTE ] LDI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:43:11.709127] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-01. [2025-10-28T19:43:11.708812] [INFO ] [REMOTE ] LBRT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:43:11.710286] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-01. [2025-10-28T19:43:12.243493] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-28T19:43:12.248519] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-02. [2025-10-28T19:43:12.814580] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-10-28T19:43:12.821805] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-02. [2025-10-28T19:43:12.905573] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-10-28T19:43:12.915484] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-02. [2025-10-28T19:43:12.931132] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-10-28T19:43:12.936565] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-03. [2025-10-28T19:43:13.043674] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-28T19:43:13.054526] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-02. [2025-10-28T19:43:13.618908] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-28T19:43:13.626027] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-03. [2025-10-28T19:43:13.784109] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-28T19:43:13.790710] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-04. [2025-10-28T19:43:14.581192] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-10-28T19:43:14.591135] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-03. [2025-10-28T19:43:14.855202] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-28T19:43:14.863171] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-05. [2025-10-28T19:43:15.755629] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-28T19:43:15.766584] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-04. [2025-10-28T19:43:17.093877] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-28T19:43:17.106438] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-05. [2025-10-28T19:43:18.310046] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-10-28T19:43:18.321006] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-06. [2025-10-28T19:43:18.849049] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-03 (5.22 seconds). [2025-10-28T19:43:18.858852] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-04. [2025-10-28T19:43:18.942123] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-02 (6.03 seconds). [2025-10-28T19:43:18.951811] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-03. [2025-10-28T19:43:19.606517] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-10-28T19:43:19.617366] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-07. [2025-10-28T19:43:19.931275] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-28T19:43:19.941385] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-05. [2025-10-28T19:43:19.994268] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-28T19:43:20.004836] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-04. [2025-10-28T19:43:21.048867] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-10-28T19:43:21.057039] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-06. [2025-10-28T19:43:22.086962] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-28T19:43:22.095702] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-07. [2025-10-28T19:43:22.296844] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-05 (7.43 seconds). [2025-10-28T19:43:22.303369] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-06. [2025-10-28T19:43:23.155145] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-28T19:43:23.161400] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-07. [2025-10-28T19:43:23.263206] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-10-28T19:43:23.273364] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-08. [2025-10-28T19:43:23.891687] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-28T19:43:23.898074] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-08. [2025-10-28T19:43:24.728129] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-10-28T19:43:24.734119] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-09. [2025-10-28T19:43:25.867850] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-04 (5.86 seconds). [2025-10-28T19:43:25.878128] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-05. [2025-10-28T19:43:26.926006] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-07 (7.31 seconds). [2025-10-28T19:43:26.937779] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-08. [2025-10-28T19:43:26.973862] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-28T19:43:26.984135] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-06. [2025-10-28T19:43:28.083748] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-10-28T19:43:28.093338] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-07. [2025-10-28T19:43:28.179604] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-28T19:43:28.190578] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-09. [2025-10-28T19:43:28.988747] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-08 (5.72 seconds). [2025-10-28T19:43:28.998374] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-09. [2025-10-28T19:43:29.517260] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-28T19:43:29.528496] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-08. [2025-10-28T19:43:30.962166] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-09 (6.23 seconds). [2025-10-28T19:43:30.967426] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-10. [2025-10-28T19:43:31.834679] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-10 (0.87 seconds). [2025-10-28T19:43:31.839864] [INFO ] [REMOTE ] LCII: Full fetch complete (38979 records). [2025-10-28T19:43:31.840037] [DEBUG] [VALIDATOR ] LCII: Validating primary data. [2025-10-28T19:43:32.267266] [DEBUG] [VALIDATOR ] LCII: All expected trading days are present. [2025-10-28T19:43:32.267373] [DEBUG] [VALIDATOR ] LCII: Primary data validation passed. [2025-10-28T19:43:32.268188] [INFO ] [MAIN ] LCII: Fetched primary data is valid. [2025-10-28T19:43:32.268282] [DEBUG] [LOCAL ] LCII: Saving primary data. [2025-10-28T19:43:32.269277] [DEBUG] [LOCAL ] LCII: Trimmed 38979 records to 26239 (keeping 200 days of data) [2025-10-28T19:43:32.433013] [DEBUG] [LOCAL ] LCII: Primary data saved (26239 records). [2025-10-28T19:43:32.433157] [INFO ] [MAIN ] LCII: Full history saved. [2025-10-28T19:43:32.433239] [INFO ] [MAIN ] Update Progress: 1241/2366 symbols completed. LCII took 23.9s. Estimated remaining: 2h 28m 13s. Rate: 7.6 symbols/min [2025-10-28T19:43:32.606211] [INFO ] [MAIN ] LDOS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:43:32.646463] [DEBUG] [LOCAL ] LDOS: Loaded 44312 existing records from primary storage. [2025-10-28T19:43:32.646775] [INFO ] [MAIN ] LDOS: Loaded 44312 existing records. [2025-10-28T19:43:32.822089] [WARN ] [MAIN ] LDOS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:43:32.822335] [INFO ] [MAIN ] LDOS: Wiping existing primary data before full refresh. [2025-10-28T19:43:32.822382] [INFO ] [LOCAL ] LDOS: Starting deletion of primary data. [2025-10-28T19:43:32.823208] [DEBUG] [LOCAL ] LDOS: Deleted primary data file. [2025-10-28T19:43:32.823266] [INFO ] [MAIN ] LDOS: Starting full primary refresh. [2025-10-28T19:43:33.176536] [INFO ] [REMOTE ] LDOS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:43:33.176878] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-01. [2025-10-28T19:43:34.175298] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-09 (5.18 seconds). [2025-10-28T19:43:34.186396] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-10. [2025-10-28T19:43:34.347980] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-28T19:43:34.359535] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-02. [2025-10-28T19:43:35.560010] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-28T19:43:35.569584] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-03. [2025-10-28T19:43:35.710838] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-28T19:43:35.721372] [INFO ] [REMOTE ] LDI: Full fetch complete (62536 records). [2025-10-28T19:43:35.721486] [DEBUG] [VALIDATOR ] LDI: Validating primary data. [2025-10-28T19:43:36.100028] [DEBUG] [VALIDATOR ] LDI: All expected trading days are present. [2025-10-28T19:43:36.100106] [DEBUG] [VALIDATOR ] LDI: Primary data validation passed. [2025-10-28T19:43:36.101014] [INFO ] [MAIN ] LDI: Fetched primary data is valid. [2025-10-28T19:43:36.101080] [DEBUG] [LOCAL ] LDI: Saving primary data. [2025-10-28T19:43:36.102537] [DEBUG] [LOCAL ] LDI: Trimmed 62536 records to 45252 (keeping 200 days of data) [2025-10-28T19:43:36.353278] [DEBUG] [LOCAL ] LDI: Primary data saved (45252 records). [2025-10-28T19:43:36.353421] [INFO ] [MAIN ] LDI: Full history saved. [2025-10-28T19:43:36.353504] [INFO ] [MAIN ] Update Progress: 1242/2366 symbols completed. LDI took 27.8s. Estimated remaining: 2h 28m 1s. Rate: 7.6 symbols/min [2025-10-28T19:43:36.556113] [INFO ] [MAIN ] LDP: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:43:36.557933] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-09 (8.37 seconds). [2025-10-28T19:43:36.569966] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-10. [2025-10-28T19:43:36.581557] [DEBUG] [LOCAL ] LDP: Loaded 12250 existing records from primary storage. [2025-10-28T19:43:36.581789] [INFO ] [MAIN ] LDP: Loaded 12250 existing records. [2025-10-28T19:43:36.762890] [WARN ] [MAIN ] LDP: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:43:36.763133] [INFO ] [MAIN ] LDP: Wiping existing primary data before full refresh. [2025-10-28T19:43:36.763179] [INFO ] [LOCAL ] LDP: Starting deletion of primary data. [2025-10-28T19:43:36.763321] [DEBUG] [LOCAL ] LDP: Deleted primary data file. [2025-10-28T19:43:36.763358] [INFO ] [MAIN ] LDP: Starting full primary refresh. [2025-10-28T19:43:37.213038] [INFO ] [REMOTE ] LDP: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:43:37.213699] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-01. [2025-10-28T19:43:37.265587] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-28T19:43:37.282184] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-04. [2025-10-28T19:43:38.087979] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-10-28T19:43:38.092397] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-02. [2025-10-28T19:43:38.543558] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-28T19:43:38.568601] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-05. [2025-10-28T19:43:38.570429] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-28T19:43:38.576327] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-03. [2025-10-28T19:43:38.925365] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-08 (9.40 seconds). [2025-10-28T19:43:38.937616] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-09. [2025-10-28T19:43:39.209479] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-10-28T19:43:39.214291] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-04. [2025-10-28T19:43:39.742765] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-28T19:43:39.753732] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-06. [2025-10-28T19:43:39.858488] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-10-28T19:43:39.862841] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-05. [2025-10-28T19:43:40.093042] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-10-28T19:43:40.104202] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-10. [2025-10-28T19:43:40.802368] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-10-28T19:43:40.812626] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-07. [2025-10-28T19:43:41.498748] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-28T19:43:41.508919] [INFO ] [REMOTE ] LC: Full fetch complete (70704 records). [2025-10-28T19:43:41.509063] [DEBUG] [VALIDATOR ] LC: Validating primary data. [2025-10-28T19:43:41.927501] [DEBUG] [VALIDATOR ] LC: All expected trading days are present. [2025-10-28T19:43:41.927703] [DEBUG] [VALIDATOR ] LC: Primary data validation passed. [2025-10-28T19:43:41.929415] [INFO ] [MAIN ] LC: Fetched primary data is valid. [2025-10-28T19:43:41.929532] [DEBUG] [LOCAL ] LC: Saving primary data. [2025-10-28T19:43:41.931596] [DEBUG] [LOCAL ] LC: Trimmed 70704 records to 48227 (keeping 200 days of data) [2025-10-28T19:43:42.250911] [DEBUG] [LOCAL ] LC: Primary data saved (48227 records). [2025-10-28T19:43:42.251102] [INFO ] [MAIN ] LC: Full history saved. [2025-10-28T19:43:42.251208] [INFO ] [MAIN ] Update Progress: 1243/2366 symbols completed. LC took 33.7s. Estimated remaining: 2h 27m 51s. Rate: 7.6 symbols/min [2025-10-28T19:43:42.437119] [INFO ] [MAIN ] LEA: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:43:42.482536] [DEBUG] [LOCAL ] LEA: Loaded 40872 existing records from primary storage. [2025-10-28T19:43:42.483014] [INFO ] [MAIN ] LEA: Loaded 40872 existing records. [2025-10-28T19:43:42.684077] [WARN ] [MAIN ] LEA: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:43:42.684423] [INFO ] [MAIN ] LEA: Wiping existing primary data before full refresh. [2025-10-28T19:43:42.684476] [INFO ] [LOCAL ] LEA: Starting deletion of primary data. [2025-10-28T19:43:42.684868] [DEBUG] [LOCAL ] LEA: Deleted primary data file. [2025-10-28T19:43:42.684929] [INFO ] [MAIN ] LEA: Starting full primary refresh. [2025-10-28T19:43:42.896970] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-10 (6.33 seconds). [2025-10-28T19:43:43.019418] [INFO ] [REMOTE ] LBRT: Full fetch complete (76932 records). [2025-10-28T19:43:43.031746] [DEBUG] [VALIDATOR ] LBRT: Validating primary data. [2025-10-28T19:43:43.301242] [INFO ] [REMOTE ] LEA: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:43:43.307869] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-01. [2025-10-28T19:43:43.609439] [DEBUG] [VALIDATOR ] LBRT: All expected trading days are present. [2025-10-28T19:43:43.609529] [DEBUG] [VALIDATOR ] LBRT: Primary data validation passed. [2025-10-28T19:43:43.610555] [INFO ] [MAIN ] LBRT: Fetched primary data is valid. [2025-10-28T19:43:43.610626] [DEBUG] [LOCAL ] LBRT: Saving primary data. [2025-10-28T19:43:43.612193] [DEBUG] [LOCAL ] LBRT: Trimmed 76932 records to 53005 (keeping 200 days of data) [2025-10-28T19:43:43.938991] [DEBUG] [LOCAL ] LBRT: Primary data saved (53005 records). [2025-10-28T19:43:43.939124] [INFO ] [MAIN ] LBRT: Full history saved. [2025-10-28T19:43:43.939202] [INFO ] [MAIN ] Update Progress: 1244/2366 symbols completed. LBRT took 35.4s. Estimated remaining: 2h 27m 38s. Rate: 7.6 symbols/min [2025-10-28T19:43:44.118784] [INFO ] [MAIN ] LEG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:43:44.163910] [DEBUG] [LOCAL ] LEG: Loaded 49847 existing records from primary storage. [2025-10-28T19:43:44.164232] [INFO ] [MAIN ] LEG: Loaded 49847 existing records. [2025-10-28T19:43:44.350876] [WARN ] [MAIN ] LEG: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:43:44.351260] [INFO ] [MAIN ] LEG: Wiping existing primary data before full refresh. [2025-10-28T19:43:44.351307] [INFO ] [LOCAL ] LEG: Starting deletion of primary data. [2025-10-28T19:43:44.351803] [DEBUG] [LOCAL ] LEG: Deleted primary data file. [2025-10-28T19:43:44.351860] [INFO ] [MAIN ] LEG: Starting full primary refresh. [2025-10-28T19:43:44.716979] [INFO ] [REMOTE ] LEG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:43:44.717287] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-01. [2025-10-28T19:43:45.123572] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-05 (5.26 seconds). [2025-10-28T19:43:45.127635] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-06. [2025-10-28T19:43:46.949368] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-01 (3.64 seconds). [2025-10-28T19:43:46.958294] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-02. [2025-10-28T19:43:48.027876] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-10-28T19:43:48.036094] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-03. [2025-10-28T19:43:49.328039] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-28T19:43:49.338258] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-04. [2025-10-28T19:43:49.782272] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-07 (8.97 seconds). [2025-10-28T19:43:49.791814] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-08. [2025-10-28T19:43:50.412519] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-10-28T19:43:50.421722] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-05. [2025-10-28T19:43:50.437849] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-06 (5.31 seconds). [2025-10-28T19:43:50.440707] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-07. [2025-10-28T19:43:51.114289] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-28T19:43:51.118095] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-08. [2025-10-28T19:43:51.169196] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-01 (6.45 seconds). [2025-10-28T19:43:51.179181] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-02. [2025-10-28T19:43:51.615485] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-10-28T19:43:51.624717] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-06. [2025-10-28T19:43:51.693825] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-28T19:43:51.697245] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-09. [2025-10-28T19:43:52.178854] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-10-28T19:43:52.181922] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-10. [2025-10-28T19:43:52.292962] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-28T19:43:52.304131] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-03. [2025-10-28T19:43:52.685481] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-28T19:43:52.695371] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-07. [2025-10-28T19:43:53.359490] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-28T19:43:53.362182] [INFO ] [REMOTE ] LDP: Full fetch complete (18666 records). [2025-10-28T19:43:53.362262] [DEBUG] [VALIDATOR ] LDP: Validating primary data. [2025-10-28T19:43:53.764984] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-28T19:43:53.794925] [DEBUG] [VALIDATOR ] LDP: All expected trading days are present. [2025-10-28T19:43:53.814673] [DEBUG] [VALIDATOR ] LDP: Primary data validation passed. [2025-10-28T19:43:53.827009] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-04. [2025-10-28T19:43:53.831028] [INFO ] [MAIN ] LDP: Fetched primary data is valid. [2025-10-28T19:43:53.831160] [DEBUG] [LOCAL ] LDP: Saving primary data. [2025-10-28T19:43:53.833331] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-08 (4.04 seconds). [2025-10-28T19:43:53.833839] [DEBUG] [LOCAL ] LDP: Trimmed 18666 records to 12139 (keeping 200 days of data) [2025-10-28T19:43:53.843804] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-09. [2025-10-28T19:43:53.920276] [DEBUG] [LOCAL ] LDP: Primary data saved (12139 records). [2025-10-28T19:43:53.920380] [INFO ] [MAIN ] LDP: Full history saved. [2025-10-28T19:43:53.920456] [INFO ] [MAIN ] Update Progress: 1245/2366 symbols completed. LDP took 17.6s. Estimated remaining: 2h 27m 32s. Rate: 7.6 symbols/min [2025-10-28T19:43:54.090007] [INFO ] [MAIN ] LEN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:43:54.139192] [DEBUG] [LOCAL ] LEN: Loaded 53194 existing records from primary storage. [2025-10-28T19:43:54.139504] [INFO ] [MAIN ] LEN: Loaded 53194 existing records. [2025-10-28T19:43:54.317808] [WARN ] [MAIN ] LEN: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:43:54.318074] [INFO ] [MAIN ] LEN: Wiping existing primary data before full refresh. [2025-10-28T19:43:54.318125] [INFO ] [LOCAL ] LEN: Starting deletion of primary data. [2025-10-28T19:43:54.319079] [DEBUG] [LOCAL ] LEN: Deleted primary data file. [2025-10-28T19:43:54.319141] [INFO ] [MAIN ] LEN: Starting full primary refresh. [2025-10-28T19:43:54.681320] [INFO ] [REMOTE ] LEN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:43:54.681720] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-01. [2025-10-28T19:43:55.022448] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-28T19:43:55.031764] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-10. [2025-10-28T19:43:55.922441] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-10-28T19:43:55.934117] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-02. [2025-10-28T19:43:56.317612] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-28T19:43:56.327006] [INFO ] [REMOTE ] LDOS: Full fetch complete (66578 records). [2025-10-28T19:43:56.327181] [DEBUG] [VALIDATOR ] LDOS: Validating primary data. [2025-10-28T19:43:56.782877] [DEBUG] [VALIDATOR ] LDOS: All expected trading days are present. [2025-10-28T19:43:56.783003] [DEBUG] [VALIDATOR ] LDOS: Primary data validation passed. [2025-10-28T19:43:56.784225] [INFO ] [MAIN ] LDOS: Fetched primary data is valid. [2025-10-28T19:43:56.784295] [DEBUG] [LOCAL ] LDOS: Saving primary data. [2025-10-28T19:43:56.785829] [DEBUG] [LOCAL ] LDOS: Trimmed 66578 records to 44181 (keeping 200 days of data) [2025-10-28T19:43:57.068441] [DEBUG] [LOCAL ] LDOS: Primary data saved (44181 records). [2025-10-28T19:43:57.068570] [INFO ] [MAIN ] LDOS: Full history saved. [2025-10-28T19:43:57.068670] [INFO ] [MAIN ] Update Progress: 1246/2366 symbols completed. LDOS took 24.6s. Estimated remaining: 2h 27m 20s. Rate: 7.6 symbols/min [2025-10-28T19:43:57.245195] [INFO ] [MAIN ] LEO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:43:57.281024] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-28T19:43:57.297402] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-03. [2025-10-28T19:43:57.297104] [DEBUG] [LOCAL ] LEO: Loaded 16427 existing records from primary storage. [2025-10-28T19:43:57.298391] [INFO ] [MAIN ] LEO: Loaded 16427 existing records. [2025-10-28T19:43:57.460892] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-07 (4.77 seconds). [2025-10-28T19:43:57.516049] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-08. [2025-10-28T19:43:57.536549] [WARN ] [MAIN ] LEO: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:43:57.537422] [INFO ] [MAIN ] LEO: Wiping existing primary data before full refresh. [2025-10-28T19:43:57.537473] [INFO ] [LOCAL ] LEO: Starting deletion of primary data. [2025-10-28T19:43:57.537852] [DEBUG] [LOCAL ] LEO: Deleted primary data file. [2025-10-28T19:43:57.537912] [INFO ] [MAIN ] LEO: Starting full primary refresh. [2025-10-28T19:43:57.899728] [INFO ] [REMOTE ] LEO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:43:57.900016] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-01. [2025-10-28T19:43:58.821957] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-28T19:43:58.833064] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-04. [2025-10-28T19:44:00.091042] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-01 (2.19 seconds). [2025-10-28T19:44:00.096050] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-02. [2025-10-28T19:44:00.168090] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-28T19:44:00.179574] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-05. [2025-10-28T19:44:01.130730] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-10-28T19:44:01.135843] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-03. [2025-10-28T19:44:01.685015] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-28T19:44:01.696322] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-06. [2025-10-28T19:44:01.773863] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-04 (7.95 seconds). [2025-10-28T19:44:01.785540] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-05. [2025-10-28T19:44:01.988736] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-28T19:44:01.993505] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-04. [2025-10-28T19:44:02.745617] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-28T19:44:02.751298] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-05. [2025-10-28T19:44:03.017323] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-10-28T19:44:03.028523] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-07. [2025-10-28T19:44:03.093243] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-10-28T19:44:03.104048] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-06. [2025-10-28T19:44:03.401014] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-28T19:44:03.404449] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-06. [2025-10-28T19:44:04.095156] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-28T19:44:04.099773] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-07. [2025-10-28T19:44:04.172746] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-28T19:44:04.182719] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-07. [2025-10-28T19:44:04.554243] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-10-28T19:44:04.572496] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-08. [2025-10-28T19:44:04.712578] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-28T19:44:04.716580] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-08. [2025-10-28T19:44:04.804226] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-08 (7.29 seconds). [2025-10-28T19:44:04.813628] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-09. [2025-10-28T19:44:05.269975] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-10-28T19:44:05.282745] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-08. [2025-10-28T19:44:05.312182] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-10-28T19:44:05.315989] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-09. [2025-10-28T19:44:05.744907] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-28T19:44:05.755600] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-10. [2025-10-28T19:44:05.814691] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-10-28T19:44:05.819147] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-10. [2025-10-28T19:44:06.263463] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-10-28T19:44:06.276795] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-09. [2025-10-28T19:44:06.489264] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-10 (0.67 seconds). [2025-10-28T19:44:06.492909] [INFO ] [REMOTE ] LEO: Full fetch complete (26398 records). [2025-10-28T19:44:06.493020] [DEBUG] [VALIDATOR ] LEO: Validating primary data. [2025-10-28T19:44:06.867120] [DEBUG] [VALIDATOR ] LEO: All expected trading days are present. [2025-10-28T19:44:06.867191] [DEBUG] [VALIDATOR ] LEO: Primary data validation passed. [2025-10-28T19:44:06.867826] [INFO ] [MAIN ] LEO: Fetched primary data is valid. [2025-10-28T19:44:06.867887] [DEBUG] [LOCAL ] LEO: Saving primary data. [2025-10-28T19:44:06.868536] [DEBUG] [LOCAL ] LEO: Trimmed 26398 records to 16438 (keeping 200 days of data) [2025-10-28T19:44:06.960975] [DEBUG] [LOCAL ] LEO: Primary data saved (16438 records). [2025-10-28T19:44:06.961123] [INFO ] [MAIN ] LEO: Full history saved. [2025-10-28T19:44:06.961260] [INFO ] [MAIN ] Update Progress: 1247/2366 symbols completed. LEO took 9.9s. Estimated remaining: 2h 27m 14s. Rate: 7.6 symbols/min [2025-10-28T19:44:07.132860] [INFO ] [MAIN ] LEVI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:44:07.179126] [DEBUG] [LOCAL ] LEVI: Loaded 51807 existing records from primary storage. [2025-10-28T19:44:07.179427] [INFO ] [MAIN ] LEVI: Loaded 51807 existing records. [2025-10-28T19:44:07.355624] [WARN ] [MAIN ] LEVI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:44:07.355867] [INFO ] [MAIN ] LEVI: Wiping existing primary data before full refresh. [2025-10-28T19:44:07.355916] [INFO ] [LOCAL ] LEVI: Starting deletion of primary data. [2025-10-28T19:44:07.356867] [DEBUG] [LOCAL ] LEVI: Deleted primary data file. [2025-10-28T19:44:07.356925] [INFO ] [MAIN ] LEVI: Starting full primary refresh. [2025-10-28T19:44:07.716339] [INFO ] [REMOTE ] LEVI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:44:07.716724] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-01. [2025-10-28T19:44:07.999560] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-10-28T19:44:08.011107] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-10. [2025-10-28T19:44:09.818409] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-10 (1.81 seconds). [2025-10-28T19:44:09.829313] [INFO ] [REMOTE ] LEN: Full fetch complete (77218 records). [2025-10-28T19:44:09.829512] [DEBUG] [VALIDATOR ] LEN: Validating primary data. [2025-10-28T19:44:10.179116] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-08 (4.90 seconds). [2025-10-28T19:44:10.216350] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-09. [2025-10-28T19:44:10.287753] [DEBUG] [VALIDATOR ] LEN: All expected trading days are present. [2025-10-28T19:44:10.287883] [DEBUG] [VALIDATOR ] LEN: Primary data validation passed. [2025-10-28T19:44:10.288982] [INFO ] [MAIN ] LEN: Fetched primary data is valid. [2025-10-28T19:44:10.289051] [DEBUG] [LOCAL ] LEN: Saving primary data. [2025-10-28T19:44:10.290590] [DEBUG] [LOCAL ] LEN: Trimmed 77218 records to 53188 (keeping 200 days of data) [2025-10-28T19:44:10.549601] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-10 (4.79 seconds). [2025-10-28T19:44:10.562053] [INFO ] [REMOTE ] LEA: Full fetch complete (60321 records). [2025-10-28T19:44:10.569025] [DEBUG] [VALIDATOR ] LEA: Validating primary data. [2025-10-28T19:44:10.840025] [DEBUG] [LOCAL ] LEN: Primary data saved (53188 records). [2025-10-28T19:44:10.857606] [INFO ] [MAIN ] LEN: Full history saved. [2025-10-28T19:44:10.925490] [INFO ] [MAIN ] Update Progress: 1248/2366 symbols completed. LEN took 17.0s. Estimated remaining: 2h 27m 2s. Rate: 7.6 symbols/min [2025-10-28T19:44:11.233807] [DEBUG] [VALIDATOR ] LEA: All expected trading days are present. [2025-10-28T19:44:11.234484] [DEBUG] [VALIDATOR ] LEA: Primary data validation passed. [2025-10-28T19:44:11.235596] [INFO ] [MAIN ] LEA: Fetched primary data is valid. [2025-10-28T19:44:11.250239] [DEBUG] [LOCAL ] LEA: Saving primary data. [2025-10-28T19:44:11.253541] [INFO ] [MAIN ] LFT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:44:11.255306] [DEBUG] [LOCAL ] LEA: Trimmed 60321 records to 40774 (keeping 200 days of data) [2025-10-28T19:44:11.389305] [DEBUG] [LOCAL ] LFT: Loaded 18012 existing records from primary storage. [2025-10-28T19:44:11.402443] [INFO ] [MAIN ] LFT: Loaded 18012 existing records. [2025-10-28T19:44:11.727982] [WARN ] [MAIN ] LFT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:44:11.732245] [INFO ] [MAIN ] LFT: Wiping existing primary data before full refresh. [2025-10-28T19:44:11.732333] [INFO ] [LOCAL ] LFT: Starting deletion of primary data. [2025-10-28T19:44:11.732811] [DEBUG] [LOCAL ] LFT: Deleted primary data file. [2025-10-28T19:44:11.733302] [INFO ] [MAIN ] LFT: Starting full primary refresh. [2025-10-28T19:44:11.889381] [DEBUG] [LOCAL ] LEA: Primary data saved (40774 records). [2025-10-28T19:44:11.907833] [INFO ] [MAIN ] LEA: Full history saved. [2025-10-28T19:44:11.922621] [INFO ] [MAIN ] Update Progress: 1249/2366 symbols completed. LEA took 29.7s. Estimated remaining: 2h 26m 48s. Rate: 7.6 symbols/min [2025-10-28T19:44:12.304330] [INFO ] [MAIN ] LGI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:44:12.302262] [INFO ] [REMOTE ] LFT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:44:12.304686] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-01. [2025-10-28T19:44:12.315593] [DEBUG] [LOCAL ] LGI: Loaded 9859 existing records from primary storage. [2025-10-28T19:44:12.315851] [INFO ] [MAIN ] LGI: Loaded 9859 existing records. [2025-10-28T19:44:12.497417] [WARN ] [MAIN ] LGI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:44:12.497689] [INFO ] [MAIN ] LGI: Wiping existing primary data before full refresh. [2025-10-28T19:44:12.497750] [INFO ] [LOCAL ] LGI: Starting deletion of primary data. [2025-10-28T19:44:12.498246] [DEBUG] [LOCAL ] LGI: Deleted primary data file. [2025-10-28T19:44:12.498305] [INFO ] [MAIN ] LGI: Starting full primary refresh. [2025-10-28T19:44:12.873937] [INFO ] [REMOTE ] LGI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:44:12.874259] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-01. [2025-10-28T19:44:13.072130] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-10-28T19:44:13.076480] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-02. [2025-10-28T19:44:13.590316] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-10-28T19:44:13.593440] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-03. [2025-10-28T19:44:13.623323] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-10-28T19:44:13.626004] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-02. [2025-10-28T19:44:14.025675] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-10-28T19:44:14.028159] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-03. [2025-10-28T19:44:14.295360] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-10-28T19:44:14.299900] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-04. [2025-10-28T19:44:14.561765] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-28T19:44:14.564618] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-04. [2025-10-28T19:44:15.123619] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-28T19:44:15.128819] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-05. [2025-10-28T19:44:15.146309] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-10-28T19:44:15.149155] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-05. [2025-10-28T19:44:15.630531] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-01 (7.91 seconds). [2025-10-28T19:44:15.645832] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-02. [2025-10-28T19:44:15.655369] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-28T19:44:15.658899] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-06. [2025-10-28T19:44:15.768534] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-10-28T19:44:15.772817] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-06. [2025-10-28T19:44:16.118753] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-10-28T19:44:16.121228] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-07. [2025-10-28T19:44:16.636222] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-10-28T19:44:16.638612] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-08. [2025-10-28T19:44:16.672141] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-10-28T19:44:16.677588] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-07. [2025-10-28T19:44:16.848548] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-28T19:44:16.858142] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-03. [2025-10-28T19:44:17.232309] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-10-28T19:44:17.235888] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-09. [2025-10-28T19:44:17.404451] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-10-28T19:44:17.409370] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-08. [2025-10-28T19:44:17.903209] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-10-28T19:44:17.914141] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-04. [2025-10-28T19:44:19.124496] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-28T19:44:19.135363] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-05. [2025-10-28T19:44:20.171823] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-09 (9.96 seconds). [2025-10-28T19:44:20.182891] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-10. [2025-10-28T19:44:20.359286] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-28T19:44:20.370135] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-06. [2025-10-28T19:44:21.012688] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-09 (3.78 seconds). [2025-10-28T19:44:21.014889] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-10. [2025-10-28T19:44:21.556720] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-28T19:44:21.576147] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-07. [2025-10-28T19:44:21.578020] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-28T19:44:21.582155] [INFO ] [REMOTE ] LGI: Full fetch complete (14457 records). [2025-10-28T19:44:21.582394] [DEBUG] [VALIDATOR ] LGI: Validating primary data. [2025-10-28T19:44:21.908741] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-10 (1.73 seconds). [2025-10-28T19:44:21.961072] [INFO ] [REMOTE ] LEG: Full fetch complete (72802 records). [2025-10-28T19:44:21.975603] [DEBUG] [VALIDATOR ] LEG: Validating primary data. [2025-10-28T19:44:22.040614] [DEBUG] [VALIDATOR ] LGI: All expected trading days are present. [2025-10-28T19:44:22.080935] [DEBUG] [VALIDATOR ] LGI: Primary data validation passed. [2025-10-28T19:44:22.086468] [INFO ] [MAIN ] LGI: Fetched primary data is valid. [2025-10-28T19:44:22.108079] [DEBUG] [LOCAL ] LGI: Saving primary data. [2025-10-28T19:44:22.129746] [DEBUG] [LOCAL ] LGI: Trimmed 14457 records to 9777 (keeping 200 days of data) [2025-10-28T19:44:22.423594] [DEBUG] [LOCAL ] LGI: Primary data saved (9777 records). [2025-10-28T19:44:22.441996] [INFO ] [MAIN ] LGI: Full history saved. [2025-10-28T19:44:22.459534] [INFO ] [MAIN ] Update Progress: 1250/2366 symbols completed. LGI took 10.5s. Estimated remaining: 2h 26m 43s. Rate: 7.6 symbols/min [2025-10-28T19:44:22.459675] [DEBUG] [VALIDATOR ] LEG: All expected trading days are present. [2025-10-28T19:44:22.460110] [DEBUG] [VALIDATOR ] LEG: Primary data validation passed. [2025-10-28T19:44:22.504804] [INFO ] [MAIN ] LEG: Fetched primary data is valid. [2025-10-28T19:44:22.536953] [DEBUG] [LOCAL ] LEG: Saving primary data. [2025-10-28T19:44:22.603970] [DEBUG] [LOCAL ] LEG: Trimmed 72802 records to 49848 (keeping 200 days of data) [2025-10-28T19:44:22.635824] [INFO ] [MAIN ] LH: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:44:22.838009] [DEBUG] [LOCAL ] LH: Loaded 36776 existing records from primary storage. [2025-10-28T19:44:22.863841] [INFO ] [MAIN ] LH: Loaded 36776 existing records. [2025-10-28T19:44:23.066184] [WARN ] [MAIN ] LH: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:44:23.070585] [INFO ] [MAIN ] LH: Wiping existing primary data before full refresh. [2025-10-28T19:44:23.074726] [INFO ] [LOCAL ] LH: Starting deletion of primary data. [2025-10-28T19:44:23.080147] [DEBUG] [LOCAL ] LH: Deleted primary data file. [2025-10-28T19:44:23.080282] [INFO ] [MAIN ] LH: Starting full primary refresh. [2025-10-28T19:44:23.478185] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-10-28T19:44:23.500466] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-08 (6.09 seconds). [2025-10-28T19:44:23.505704] [DEBUG] [LOCAL ] LEG: Primary data saved (49848 records). [2025-10-28T19:44:23.538983] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-09. [2025-10-28T19:44:23.538725] [INFO ] [MAIN ] LEG: Full history saved. [2025-10-28T19:44:23.550867] [INFO ] [MAIN ] Update Progress: 1251/2366 symbols completed. LEG took 39.6s. Estimated remaining: 2h 26m 29s. Rate: 7.6 symbols/min [2025-10-28T19:44:23.591257] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-08. [2025-10-28T19:44:23.608884] [INFO ] [REMOTE ] LH: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:44:23.633231] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-01. [2025-10-28T19:44:23.779420] [INFO ] [MAIN ] LHX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:44:23.824285] [DEBUG] [LOCAL ] LHX: Loaded 48276 existing records from primary storage. [2025-10-28T19:44:23.824599] [INFO ] [MAIN ] LHX: Loaded 48276 existing records. [2025-10-28T19:44:24.001430] [WARN ] [MAIN ] LHX: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:44:24.001623] [INFO ] [MAIN ] LHX: Wiping existing primary data before full refresh. [2025-10-28T19:44:24.001700] [INFO ] [LOCAL ] LHX: Starting deletion of primary data. [2025-10-28T19:44:24.002387] [DEBUG] [LOCAL ] LHX: Deleted primary data file. [2025-10-28T19:44:24.002428] [INFO ] [MAIN ] LHX: Starting full primary refresh. [2025-10-28T19:44:24.348103] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-10-28T19:44:24.368875] [INFO ] [REMOTE ] LHX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:44:24.373437] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-01. [2025-10-28T19:44:24.374805] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-10. [2025-10-28T19:44:24.695905] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-28T19:44:24.703315] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-02. [2025-10-28T19:44:24.812026] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-10-28T19:44:24.824287] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-09. [2025-10-28T19:44:25.144913] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-28T19:44:25.148432] [INFO ] [REMOTE ] LFT: Full fetch complete (23781 records). [2025-10-28T19:44:25.148508] [DEBUG] [VALIDATOR ] LFT: Validating primary data. [2025-10-28T19:44:25.543024] [DEBUG] [VALIDATOR ] LFT: All expected trading days are present. [2025-10-28T19:44:25.543129] [DEBUG] [VALIDATOR ] LFT: Primary data validation passed. [2025-10-28T19:44:25.543892] [INFO ] [MAIN ] LFT: Fetched primary data is valid. [2025-10-28T19:44:25.543994] [DEBUG] [LOCAL ] LFT: Saving primary data. [2025-10-28T19:44:25.544918] [DEBUG] [LOCAL ] LFT: Trimmed 23781 records to 18066 (keeping 200 days of data) [2025-10-28T19:44:25.654487] [DEBUG] [LOCAL ] LFT: Primary data saved (18066 records). [2025-10-28T19:44:25.654770] [INFO ] [MAIN ] LFT: Full history saved. [2025-10-28T19:44:25.654969] [INFO ] [MAIN ] Update Progress: 1252/2366 symbols completed. LFT took 14.7s. Estimated remaining: 2h 26m 16s. Rate: 7.6 symbols/min [2025-10-28T19:44:25.793716] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-10-28T19:44:25.809865] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-02. [2025-10-28T19:44:25.878366] [INFO ] [MAIN ] LII: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:44:25.903099] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-10-28T19:44:25.912555] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-03. [2025-10-28T19:44:25.935629] [DEBUG] [LOCAL ] LII: Loaded 27586 existing records from primary storage. [2025-10-28T19:44:25.935933] [INFO ] [MAIN ] LII: Loaded 27586 existing records. [2025-10-28T19:44:26.112966] [WARN ] [MAIN ] LII: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:44:26.113329] [INFO ] [MAIN ] LII: Wiping existing primary data before full refresh. [2025-10-28T19:44:26.113498] [INFO ] [LOCAL ] LII: Starting deletion of primary data. [2025-10-28T19:44:26.113838] [DEBUG] [LOCAL ] LII: Deleted primary data file. [2025-10-28T19:44:26.113953] [INFO ] [MAIN ] LII: Starting full primary refresh. [2025-10-28T19:44:26.457908] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-28T19:44:26.508448] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-10. [2025-10-28T19:44:26.508179] [INFO ] [REMOTE ] LII: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:44:26.509502] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-01. [2025-10-28T19:44:26.985899] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-10-28T19:44:26.994670] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-04. [2025-10-28T19:44:27.281452] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-10-28T19:44:27.293283] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-03. [2025-10-28T19:44:27.311557] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-28T19:44:27.317938] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-02. [2025-10-28T19:44:28.164067] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-10-28T19:44:28.174095] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-05. [2025-10-28T19:44:28.193069] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-28T19:44:28.199132] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-03. [2025-10-28T19:44:28.560792] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-10-28T19:44:28.570862] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-04. [2025-10-28T19:44:29.320867] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-28T19:44:29.328394] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-04. [2025-10-28T19:44:29.491970] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-28T19:44:29.500708] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-06. [2025-10-28T19:44:29.824140] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-28T19:44:29.835507] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-05. [2025-10-28T19:44:30.340827] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-10-28T19:44:30.348576] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-05. [2025-10-28T19:44:30.504259] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-10-28T19:44:30.512485] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-07. [2025-10-28T19:44:31.266513] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-28T19:44:31.277279] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-06. [2025-10-28T19:44:31.767576] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-28T19:44:31.776768] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-08. [2025-10-28T19:44:32.555214] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-28T19:44:32.565339] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-07. [2025-10-28T19:44:32.879854] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-10-28T19:44:32.887015] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-09. [2025-10-28T19:44:32.921460] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-10 (6.41 seconds). [2025-10-28T19:44:32.932062] [INFO ] [REMOTE ] LEVI: Full fetch complete (75009 records). [2025-10-28T19:44:32.932177] [DEBUG] [VALIDATOR ] LEVI: Validating primary data. [2025-10-28T19:44:33.326294] [DEBUG] [VALIDATOR ] LEVI: All expected trading days are present. [2025-10-28T19:44:33.326368] [DEBUG] [VALIDATOR ] LEVI: Primary data validation passed. [2025-10-28T19:44:33.327466] [INFO ] [MAIN ] LEVI: Fetched primary data is valid. [2025-10-28T19:44:33.327529] [DEBUG] [LOCAL ] LEVI: Saving primary data. [2025-10-28T19:44:33.328985] [DEBUG] [LOCAL ] LEVI: Trimmed 75009 records to 51799 (keeping 200 days of data) [2025-10-28T19:44:33.640505] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-05 (3.29 seconds). [2025-10-28T19:44:33.647927] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-06. [2025-10-28T19:44:33.668922] [DEBUG] [LOCAL ] LEVI: Primary data saved (51799 records). [2025-10-28T19:44:33.669014] [INFO ] [MAIN ] LEVI: Full history saved. [2025-10-28T19:44:33.669088] [INFO ] [MAIN ] Update Progress: 1253/2366 symbols completed. LEVI took 26.7s. Estimated remaining: 2h 26m 8s. Rate: 7.6 symbols/min [2025-10-28T19:44:33.849544] [INFO ] [MAIN ] LION: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:44:33.868097] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-10-28T19:44:33.875464] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-10. [2025-10-28T19:44:33.911896] [DEBUG] [LOCAL ] LION: Loaded 47270 existing records from primary storage. [2025-10-28T19:44:33.912188] [INFO ] [MAIN ] LION: Loaded 47270 existing records. [2025-10-28T19:44:34.088557] [WARN ] [MAIN ] LION: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:44:34.088812] [INFO ] [MAIN ] LION: Wiping existing primary data before full refresh. [2025-10-28T19:44:34.088867] [INFO ] [LOCAL ] LION: Starting deletion of primary data. [2025-10-28T19:44:34.089060] [DEBUG] [LOCAL ] LION: Deleted primary data file. [2025-10-28T19:44:34.089118] [INFO ] [MAIN ] LION: Starting full primary refresh. [2025-10-28T19:44:34.463121] [INFO ] [REMOTE ] LION: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:44:34.463478] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-01. [2025-10-28T19:44:34.530104] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-10-28T19:44:34.536193] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-07. [2025-10-28T19:44:34.930223] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-28T19:44:34.937895] [INFO ] [REMOTE ] LH: Full fetch complete (54868 records). [2025-10-28T19:44:34.938068] [DEBUG] [VALIDATOR ] LH: Validating primary data. [2025-10-28T19:44:35.344490] [DEBUG] [VALIDATOR ] LH: All expected trading days are present. [2025-10-28T19:44:35.344596] [DEBUG] [VALIDATOR ] LH: Primary data validation passed. [2025-10-28T19:44:35.345770] [INFO ] [MAIN ] LH: Fetched primary data is valid. [2025-10-28T19:44:35.345988] [DEBUG] [LOCAL ] LH: Saving primary data. [2025-10-28T19:44:35.348139] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-10-28T19:44:35.354091] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-02. [2025-10-28T19:44:35.355496] [DEBUG] [LOCAL ] LH: Trimmed 54868 records to 36806 (keeping 200 days of data) [2025-10-28T19:44:35.499895] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-10-28T19:44:35.511771] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-08. [2025-10-28T19:44:35.614301] [DEBUG] [LOCAL ] LH: Primary data saved (36806 records). [2025-10-28T19:44:35.614426] [INFO ] [MAIN ] LH: Full history saved. [2025-10-28T19:44:35.614831] [INFO ] [MAIN ] Update Progress: 1254/2366 symbols completed. LH took 13.2s. Estimated remaining: 2h 25m 55s. Rate: 7.6 symbols/min [2025-10-28T19:44:35.786218] [INFO ] [MAIN ] LITB: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:44:35.791943] [DEBUG] [LOCAL ] LITB: Loaded 3695 existing records from primary storage. [2025-10-28T19:44:35.792100] [INFO ] [MAIN ] LITB: Loaded 3695 existing records. [2025-10-28T19:44:35.971072] [WARN ] [MAIN ] LITB: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:44:35.971354] [INFO ] [MAIN ] LITB: Wiping existing primary data before full refresh. [2025-10-28T19:44:35.971423] [INFO ] [LOCAL ] LITB: Starting deletion of primary data. [2025-10-28T19:44:35.971675] [DEBUG] [LOCAL ] LITB: Deleted primary data file. [2025-10-28T19:44:35.971745] [INFO ] [MAIN ] LITB: Starting full primary refresh. [2025-10-28T19:44:36.374048] [INFO ] [REMOTE ] LITB: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:44:36.374401] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-01. [2025-10-28T19:44:36.711023] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-10-28T19:44:36.712415] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-02. [2025-10-28T19:44:37.006697] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-02 (0.29 seconds). [2025-10-28T19:44:37.008498] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-03. [2025-10-28T19:44:37.431311] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-10-28T19:44:37.433174] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-04. [2025-10-28T19:44:37.917515] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-10-28T19:44:37.920252] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-05. [2025-10-28T19:44:38.271277] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-10-28T19:44:38.272585] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-06. [2025-10-28T19:44:38.373152] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-07 (5.81 seconds). [2025-10-28T19:44:38.384045] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-08. [2025-10-28T19:44:38.519338] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-08 (3.01 seconds). [2025-10-28T19:44:38.524913] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-09. [2025-10-28T19:44:39.479616] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-10-28T19:44:39.486299] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-10. [2025-10-28T19:44:39.783553] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-28T19:44:39.781407] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-02 (4.43 seconds). [2025-10-28T19:44:39.798543] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-03. [2025-10-28T19:44:39.799797] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-09. [2025-10-28T19:44:39.975442] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-10-28T19:44:39.976726] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-07. [2025-10-28T19:44:40.271708] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-07 (0.29 seconds). [2025-10-28T19:44:40.272953] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-08. [2025-10-28T19:44:40.456441] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-10-28T19:44:40.461551] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-04. [2025-10-28T19:44:40.601877] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-10-28T19:44:40.603018] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-09. [2025-10-28T19:44:41.078002] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-10-28T19:44:41.087631] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-10. [2025-10-28T19:44:41.284233] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-10-28T19:44:41.290858] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-05. [2025-10-28T19:44:41.447357] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-10-28T19:44:41.449231] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-10. [2025-10-28T19:44:41.943515] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-28T19:44:41.944926] [INFO ] [REMOTE ] LITB: Full fetch complete (5798 records). [2025-10-28T19:44:41.944992] [DEBUG] [VALIDATOR ] LITB: Validating primary data. [2025-10-28T19:44:42.297023] [DEBUG] [VALIDATOR ] LITB: All expected trading days are present. [2025-10-28T19:44:42.297105] [DEBUG] [VALIDATOR ] LITB: Primary data validation passed. [2025-10-28T19:44:42.297269] [INFO ] [MAIN ] LITB: Fetched primary data is valid. [2025-10-28T19:44:42.297310] [DEBUG] [LOCAL ] LITB: Saving primary data. [2025-10-28T19:44:42.297705] [DEBUG] [LOCAL ] LITB: Trimmed 5798 records to 3682 (keeping 200 days of data) [2025-10-28T19:44:42.318155] [DEBUG] [LOCAL ] LITB: Primary data saved (3682 records). [2025-10-28T19:44:42.318360] [INFO ] [MAIN ] LITB: Full history saved. [2025-10-28T19:44:42.318475] [INFO ] [MAIN ] Update Progress: 1255/2366 symbols completed. LITB took 6.7s. Estimated remaining: 2h 25m 46s. Rate: 7.6 symbols/min [2025-10-28T19:44:42.492355] [INFO ] [MAIN ] LLY: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:44:42.548832] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-28T19:44:42.561091] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-10 (3.07 seconds). [2025-10-28T19:44:42.572479] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-06. [2025-10-28T19:44:42.574152] [INFO ] [REMOTE ] LII: Full fetch complete (41889 records). [2025-10-28T19:44:42.574323] [DEBUG] [VALIDATOR ] LII: Validating primary data. [2025-10-28T19:44:42.822920] [DEBUG] [LOCAL ] LLY: Loaded 53169 existing records from primary storage. [2025-10-28T19:44:42.888682] [INFO ] [MAIN ] LLY: Loaded 53169 existing records. [2025-10-28T19:44:43.172219] [DEBUG] [VALIDATOR ] LII: All expected trading days are present. [2025-10-28T19:44:43.202434] [DEBUG] [VALIDATOR ] LII: Primary data validation passed. [2025-10-28T19:44:43.202360] [WARN ] [MAIN ] LLY: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:44:43.202737] [INFO ] [MAIN ] LLY: Wiping existing primary data before full refresh. [2025-10-28T19:44:43.203736] [INFO ] [LOCAL ] LLY: Starting deletion of primary data. [2025-10-28T19:44:43.203682] [INFO ] [MAIN ] LII: Fetched primary data is valid. [2025-10-28T19:44:43.203909] [DEBUG] [LOCAL ] LII: Saving primary data. [2025-10-28T19:44:43.204104] [DEBUG] [LOCAL ] LLY: Deleted primary data file. [2025-10-28T19:44:43.204164] [INFO ] [MAIN ] LLY: Starting full primary refresh. [2025-10-28T19:44:43.308823] [DEBUG] [LOCAL ] LII: Trimmed 41889 records to 27548 (keeping 200 days of data) [2025-10-28T19:44:43.751990] [INFO ] [REMOTE ] LLY: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:44:43.756591] [DEBUG] [LOCAL ] LII: Primary data saved (27548 records). [2025-10-28T19:44:43.756889] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-01. [2025-10-28T19:44:43.757056] [INFO ] [MAIN ] LII: Full history saved. [2025-10-28T19:44:43.757295] [INFO ] [MAIN ] Update Progress: 1256/2366 symbols completed. LII took 18.1s. Estimated remaining: 2h 25m 32s. Rate: 7.6 symbols/min [2025-10-28T19:44:43.974225] [INFO ] [MAIN ] LMND: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:44:43.970889] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-10-28T19:44:43.974431] [DEBUG] [LOCAL ] LMND: No existing data file found in primary storage. [2025-10-28T19:44:43.983562] [WARN ] [MAIN ] LMND: No existing data found, performing full refresh instead. [2025-10-28T19:44:43.983756] [INFO ] [MAIN ] LMND: Wiping existing primary data before full refresh. [2025-10-28T19:44:43.983932] [INFO ] [LOCAL ] LMND: Starting deletion of primary data. [2025-10-28T19:44:43.984017] [DEBUG] [LOCAL ] LMND: No primary data file found to delete. [2025-10-28T19:44:43.984266] [INFO ] [MAIN ] LMND: Starting full primary refresh. [2025-10-28T19:44:44.027544] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-07. [2025-10-28T19:44:44.362379] [INFO ] [REMOTE ] LMND: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:44:44.362681] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-01. [2025-10-28T19:44:45.374506] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-10-28T19:44:45.388045] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-08. [2025-10-28T19:44:45.576349] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-10 (4.49 seconds). [2025-10-28T19:44:45.618172] [INFO ] [REMOTE ] LHX: Full fetch complete (70623 records). [2025-10-28T19:44:45.618399] [DEBUG] [VALIDATOR ] LHX: Validating primary data. [2025-10-28T19:44:45.752621] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-10-28T19:44:45.793089] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-02. [2025-10-28T19:44:46.284829] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-10-28T19:44:46.321046] [DEBUG] [VALIDATOR ] LHX: All expected trading days are present. [2025-10-28T19:44:46.320851] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-02. [2025-10-28T19:44:46.321251] [DEBUG] [VALIDATOR ] LHX: Primary data validation passed. [2025-10-28T19:44:46.322535] [INFO ] [MAIN ] LHX: Fetched primary data is valid. [2025-10-28T19:44:46.323253] [DEBUG] [LOCAL ] LHX: Saving primary data. [2025-10-28T19:44:46.324893] [DEBUG] [LOCAL ] LHX: Trimmed 70623 records to 48202 (keeping 200 days of data) [2025-10-28T19:44:46.628353] [DEBUG] [LOCAL ] LHX: Primary data saved (48202 records). [2025-10-28T19:44:46.628550] [INFO ] [MAIN ] LHX: Full history saved. [2025-10-28T19:44:46.628709] [INFO ] [MAIN ] Update Progress: 1257/2366 symbols completed. LHX took 23.1s. Estimated remaining: 2h 25m 20s. Rate: 7.6 symbols/min [2025-10-28T19:44:46.804399] [INFO ] [MAIN ] LMT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:44:46.834852] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-28T19:44:46.846075] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-09. [2025-10-28T19:44:46.886540] [DEBUG] [LOCAL ] LMT: Loaded 49543 existing records from primary storage. [2025-10-28T19:44:46.886894] [INFO ] [MAIN ] LMT: Loaded 49543 existing records. [2025-10-28T19:44:47.066146] [WARN ] [MAIN ] LMT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:44:47.066370] [INFO ] [MAIN ] LMT: Wiping existing primary data before full refresh. [2025-10-28T19:44:47.066418] [INFO ] [LOCAL ] LMT: Starting deletion of primary data. [2025-10-28T19:44:47.066922] [DEBUG] [LOCAL ] LMT: Deleted primary data file. [2025-10-28T19:44:47.066980] [INFO ] [MAIN ] LMT: Starting full primary refresh. [2025-10-28T19:44:47.434444] [INFO ] [REMOTE ] LMT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:44:47.434895] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-01. [2025-10-28T19:44:47.712865] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-28T19:44:47.723277] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-03. [2025-10-28T19:44:48.039515] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-28T19:44:48.050678] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-10. [2025-10-28T19:44:49.089487] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-10-28T19:44:49.099257] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-02. [2025-10-28T19:44:49.339013] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-10 (1.29 seconds). [2025-10-28T19:44:49.349575] [INFO ] [REMOTE ] LION: Full fetch complete (58633 records). [2025-10-28T19:44:49.349785] [DEBUG] [VALIDATOR ] LION: Validating primary data. [2025-10-28T19:44:49.769293] [DEBUG] [VALIDATOR ] LION: All expected trading days are present. [2025-10-28T19:44:49.769476] [DEBUG] [VALIDATOR ] LION: Primary data validation passed. [2025-10-28T19:44:49.771338] [INFO ] [MAIN ] LION: Fetched primary data is valid. [2025-10-28T19:44:49.771429] [DEBUG] [LOCAL ] LION: Saving primary data. [2025-10-28T19:44:49.773462] [DEBUG] [LOCAL ] LION: Trimmed 58633 records to 47410 (keeping 200 days of data) [2025-10-28T19:44:49.891220] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-10-28T19:44:49.917599] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-04. [2025-10-28T19:44:50.114040] [DEBUG] [LOCAL ] LION: Primary data saved (47410 records). [2025-10-28T19:44:50.114256] [INFO ] [MAIN ] LION: Full history saved. [2025-10-28T19:44:50.114365] [INFO ] [MAIN ] Update Progress: 1258/2366 symbols completed. LION took 16.4s. Estimated remaining: 2h 25m 8s. Rate: 7.6 symbols/min [2025-10-28T19:44:50.299610] [INFO ] [MAIN ] LNC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:44:50.357535] [DEBUG] [LOCAL ] LNC: Loaded 51328 existing records from primary storage. [2025-10-28T19:44:50.358226] [INFO ] [MAIN ] LNC: Loaded 51328 existing records. [2025-10-28T19:44:50.557157] [WARN ] [MAIN ] LNC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:44:50.557458] [INFO ] [MAIN ] LNC: Wiping existing primary data before full refresh. [2025-10-28T19:44:50.557511] [INFO ] [LOCAL ] LNC: Starting deletion of primary data. [2025-10-28T19:44:50.557965] [DEBUG] [LOCAL ] LNC: Deleted primary data file. [2025-10-28T19:44:50.558057] [INFO ] [MAIN ] LNC: Starting full primary refresh. [2025-10-28T19:44:50.990054] [INFO ] [REMOTE ] LNC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:44:50.990533] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-01. [2025-10-28T19:44:51.017389] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-10-28T19:44:51.027404] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-03. [2025-10-28T19:44:51.108204] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-02 (4.79 seconds). [2025-10-28T19:44:51.117924] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-03. [2025-10-28T19:44:51.805797] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-10-28T19:44:51.816973] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-05. [2025-10-28T19:44:52.160981] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-10-28T19:44:52.170860] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-02. [2025-10-28T19:44:52.468341] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-10-28T19:44:52.780239] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-04. [2025-10-28T19:44:53.304446] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-10-28T19:44:53.580315] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-03. [2025-10-28T19:44:54.100701] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-05 (2.28 seconds). [2025-10-28T19:44:54.161573] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-28T19:44:54.380253] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-06. [2025-10-28T19:44:54.810754] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-28T19:44:55.180232] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-05. [2025-10-28T19:44:55.980234] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-04. [2025-10-28T19:44:56.347812] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-03 (5.23 seconds). [2025-10-28T19:44:56.507179] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-10-28T19:44:56.780230] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-04. [2025-10-28T19:44:56.846694] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-10-28T19:44:57.225788] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-10-28T19:44:57.580314] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-07. [2025-10-28T19:44:58.059970] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-28T19:44:58.380263] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-05. [2025-10-28T19:44:59.180280] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-06. [2025-10-28T19:44:59.367771] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-28T19:44:59.766200] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-28T19:44:59.980254] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-06. [2025-10-28T19:45:00.731019] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-10-28T19:45:00.780280] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-07. [2025-10-28T19:45:01.549414] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-10-28T19:45:01.580250] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-07. [2025-10-28T19:45:02.380237] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-08. [2025-10-28T19:45:02.573738] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-10-28T19:45:02.985837] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-10-28T19:45:03.180249] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-08. [2025-10-28T19:45:03.980243] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-08. [2025-10-28T19:45:04.780293] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-05. [2025-10-28T19:45:04.886325] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-10-28T19:45:05.580250] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-09. [2025-10-28T19:45:05.680400] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-10-28T19:45:06.012533] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-28T19:45:06.380283] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-06. [2025-10-28T19:45:07.180229] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-09. [2025-10-28T19:45:07.327507] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-10-28T19:45:07.628910] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-10-28T19:45:07.981536] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-10. [2025-10-28T19:45:07.984443] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-08 (5.60 seconds). [2025-10-28T19:45:08.780271] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-09. [2025-10-28T19:45:09.580267] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-07. [2025-10-28T19:45:09.852716] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-10 (1.87 seconds). [2025-10-28T19:45:09.863928] [INFO ] [REMOTE ] LMND: Full fetch complete (75487 records). [2025-10-28T19:45:09.864101] [DEBUG] [VALIDATOR ] LMND: Validating primary data. [2025-10-28T19:45:10.264476] [DEBUG] [VALIDATOR ] LMND: All expected trading days are present. [2025-10-28T19:45:10.264557] [DEBUG] [VALIDATOR ] LMND: Primary data validation passed. [2025-10-28T19:45:10.265592] [INFO ] [MAIN ] LMND: Fetched primary data is valid. [2025-10-28T19:45:10.265685] [DEBUG] [LOCAL ] LMND: Saving primary data. [2025-10-28T19:45:10.267091] [DEBUG] [LOCAL ] LMND: Trimmed 75487 records to 52101 (keeping 200 days of data) [2025-10-28T19:45:10.573367] [DEBUG] [LOCAL ] LMND: Primary data saved (52101 records). [2025-10-28T19:45:10.573517] [INFO ] [MAIN ] LMND: Full history saved. [2025-10-28T19:45:10.573603] [INFO ] [MAIN ] Update Progress: 1259/2366 symbols completed. LMND took 26.8s. Estimated remaining: 2h 25m 11s. Rate: 7.6 symbols/min [2025-10-28T19:45:10.751180] [INFO ] [MAIN ] LND: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:45:10.775488] [DEBUG] [LOCAL ] LND: Loaded 4869 existing records from primary storage. [2025-10-28T19:45:10.783973] [INFO ] [MAIN ] LND: Loaded 4869 existing records. [2025-10-28T19:45:10.868675] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-10-28T19:45:10.942681] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-08. [2025-10-28T19:45:10.989400] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-10-28T19:45:11.022212] [WARN ] [MAIN ] LND: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:45:11.033474] [INFO ] [MAIN ] LND: Wiping existing primary data before full refresh. [2025-10-28T19:45:11.033789] [INFO ] [LOCAL ] LND: Starting deletion of primary data. [2025-10-28T19:45:11.034313] [DEBUG] [LOCAL ] LND: Deleted primary data file. [2025-10-28T19:45:11.034377] [INFO ] [MAIN ] LND: Starting full primary refresh. [2025-10-28T19:45:11.183582] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-10. [2025-10-28T19:45:11.399717] [INFO ] [REMOTE ] LND: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:45:11.703118] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-09 (4.52 seconds). [2025-10-28T19:45:11.826403] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-10 (0.64 seconds). [2025-10-28T19:45:11.837128] [INFO ] [REMOTE ] LLY: Full fetch complete (77184 records). [2025-10-28T19:45:11.837281] [DEBUG] [VALIDATOR ] LLY: Validating primary data. [2025-10-28T19:45:11.987591] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-10. [2025-10-28T19:45:12.246253] [DEBUG] [VALIDATOR ] LLY: All expected trading days are present. [2025-10-28T19:45:12.246380] [DEBUG] [VALIDATOR ] LLY: Primary data validation passed. [2025-10-28T19:45:12.247558] [INFO ] [MAIN ] LLY: Fetched primary data is valid. [2025-10-28T19:45:12.247623] [DEBUG] [LOCAL ] LLY: Saving primary data. [2025-10-28T19:45:12.249095] [DEBUG] [LOCAL ] LLY: Trimmed 77184 records to 53161 (keeping 200 days of data) [2025-10-28T19:45:12.611880] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-10-28T19:45:12.637359] [DEBUG] [LOCAL ] LLY: Primary data saved (53161 records). [2025-10-28T19:45:12.637493] [INFO ] [MAIN ] LLY: Full history saved. [2025-10-28T19:45:12.637938] [INFO ] [MAIN ] Update Progress: 1260/2366 symbols completed. LLY took 30.3s. Estimated remaining: 2h 24m 58s. Rate: 7.6 symbols/min [2025-10-28T19:45:12.789859] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-09. [2025-10-28T19:45:12.818240] [INFO ] [MAIN ] LNG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:45:12.873501] [DEBUG] [LOCAL ] LNG: Loaded 50980 existing records from primary storage. [2025-10-28T19:45:12.873911] [INFO ] [MAIN ] LNG: Loaded 50980 existing records. [2025-10-28T19:45:13.058271] [WARN ] [MAIN ] LNG: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:45:13.058553] [INFO ] [MAIN ] LNG: Wiping existing primary data before full refresh. [2025-10-28T19:45:13.058607] [INFO ] [LOCAL ] LNG: Starting deletion of primary data. [2025-10-28T19:45:13.060073] [DEBUG] [LOCAL ] LNG: Deleted primary data file. [2025-10-28T19:45:13.060133] [INFO ] [MAIN ] LNG: Starting full primary refresh. [2025-10-28T19:45:13.416905] [INFO ] [REMOTE ] LNG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:45:13.580226] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-01. [2025-10-28T19:45:13.738498] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-10 (1.75 seconds). [2025-10-28T19:45:13.748923] [INFO ] [REMOTE ] LMT: Full fetch complete (72531 records). [2025-10-28T19:45:13.749074] [DEBUG] [VALIDATOR ] LMT: Validating primary data. [2025-10-28T19:45:14.029110] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-10-28T19:45:14.169595] [DEBUG] [VALIDATOR ] LMT: All expected trading days are present. [2025-10-28T19:45:14.169749] [DEBUG] [VALIDATOR ] LMT: Primary data validation passed. [2025-10-28T19:45:14.170798] [INFO ] [MAIN ] LMT: Fetched primary data is valid. [2025-10-28T19:45:14.170876] [DEBUG] [LOCAL ] LMT: Saving primary data. [2025-10-28T19:45:14.182599] [DEBUG] [LOCAL ] LMT: Trimmed 72531 records to 49484 (keeping 200 days of data) [2025-10-28T19:45:14.203067] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-10-28T19:45:14.389600] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-10. [2025-10-28T19:45:14.518066] [DEBUG] [LOCAL ] LMT: Primary data saved (49484 records). [2025-10-28T19:45:14.518196] [INFO ] [MAIN ] LMT: Full history saved. [2025-10-28T19:45:14.518273] [INFO ] [MAIN ] Update Progress: 1261/2366 symbols completed. LMT took 27.9s. Estimated remaining: 2h 24m 45s. Rate: 7.6 symbols/min [2025-10-28T19:45:14.686547] [INFO ] [MAIN ] LNN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:45:14.700402] [DEBUG] [LOCAL ] LNN: Loaded 11526 existing records from primary storage. [2025-10-28T19:45:14.700630] [INFO ] [MAIN ] LNN: Loaded 11526 existing records. [2025-10-28T19:45:14.877482] [WARN ] [MAIN ] LNN: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:45:14.877717] [INFO ] [MAIN ] LNN: Wiping existing primary data before full refresh. [2025-10-28T19:45:14.877795] [INFO ] [LOCAL ] LNN: Starting deletion of primary data. [2025-10-28T19:45:14.877957] [DEBUG] [LOCAL ] LNN: Deleted primary data file. [2025-10-28T19:45:14.877997] [INFO ] [MAIN ] LNN: Starting full primary refresh. [2025-10-28T19:45:15.185434] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-01. [2025-10-28T19:45:15.242144] [INFO ] [REMOTE ] LNN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:45:15.908930] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-28T19:45:15.919085] [INFO ] [REMOTE ] LNC: Full fetch complete (74513 records). [2025-10-28T19:45:15.919236] [DEBUG] [VALIDATOR ] LNC: Validating primary data. [2025-10-28T19:45:15.988708] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-02. [2025-10-28T19:45:16.340253] [DEBUG] [VALIDATOR ] LNC: All expected trading days are present. [2025-10-28T19:45:16.340345] [DEBUG] [VALIDATOR ] LNC: Primary data validation passed. [2025-10-28T19:45:16.341508] [INFO ] [MAIN ] LNC: Fetched primary data is valid. [2025-10-28T19:45:16.341575] [DEBUG] [LOCAL ] LNC: Saving primary data. [2025-10-28T19:45:16.343093] [DEBUG] [LOCAL ] LNC: Trimmed 74513 records to 51302 (keeping 200 days of data) [2025-10-28T19:45:16.584802] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-10-28T19:45:16.671047] [DEBUG] [LOCAL ] LNC: Primary data saved (51302 records). [2025-10-28T19:45:16.671196] [INFO ] [MAIN ] LNC: Full history saved. [2025-10-28T19:45:16.671568] [INFO ] [MAIN ] Update Progress: 1262/2366 symbols completed. LNC took 26.6s. Estimated remaining: 2h 24m 33s. Rate: 7.6 symbols/min [2025-10-28T19:45:16.785361] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-01. [2025-10-28T19:45:16.866432] [INFO ] [MAIN ] LOAR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:45:16.909681] [DEBUG] [LOCAL ] LOAR: Loaded 41789 existing records from primary storage. [2025-10-28T19:45:16.910044] [INFO ] [MAIN ] LOAR: Loaded 41789 existing records. [2025-10-28T19:45:17.099237] [WARN ] [MAIN ] LOAR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:45:17.099430] [INFO ] [MAIN ] LOAR: Wiping existing primary data before full refresh. [2025-10-28T19:45:17.099475] [INFO ] [LOCAL ] LOAR: Starting deletion of primary data. [2025-10-28T19:45:17.099802] [DEBUG] [LOCAL ] LOAR: Deleted primary data file. [2025-10-28T19:45:17.099860] [INFO ] [MAIN ] LOAR: Starting full primary refresh. [2025-10-28T19:45:17.476869] [INFO ] [REMOTE ] LOAR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:45:17.487053] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-10-28T19:45:17.580279] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-02. [2025-10-28T19:45:18.050794] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-10-28T19:45:18.380274] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-01. [2025-10-28T19:45:19.180298] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-03. [2025-10-28T19:45:19.613572] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-10-28T19:45:19.980327] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-04. [2025-10-28T19:45:20.404175] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-28T19:45:20.780246] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-03. [2025-10-28T19:45:21.099428] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-01 (2.72 seconds). [2025-10-28T19:45:21.260757] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-01 (6.08 seconds). [2025-10-28T19:45:21.290811] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-10-28T19:45:21.580262] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-05. [2025-10-28T19:45:21.960067] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-10-28T19:45:22.380328] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-06. [2025-10-28T19:45:22.765083] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-10-28T19:45:23.180257] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-04. [2025-10-28T19:45:23.980228] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-02. [2025-10-28T19:45:24.780325] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-07. [2025-10-28T19:45:24.994405] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-10-28T19:45:25.418623] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-28T19:45:25.580251] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-02. [2025-10-28T19:45:25.812508] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-28T19:45:26.380280] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-05. [2025-10-28T19:45:27.180314] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-08. [2025-10-28T19:45:27.500172] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-28T19:45:27.579170] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-10-28T19:45:27.980353] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-09. [2025-10-28T19:45:28.389240] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-10-28T19:45:28.651972] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-02 (3.07 seconds). [2025-10-28T19:45:28.780218] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-03. [2025-10-28T19:45:29.580288] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-10. [2025-10-28T19:45:29.697679] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-10-28T19:45:30.380309] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-04. [2025-10-28T19:45:30.389089] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-10 (0.81 seconds). [2025-10-28T19:45:30.391681] [INFO ] [REMOTE ] LND: Full fetch complete (7798 records). [2025-10-28T19:45:30.391774] [DEBUG] [VALIDATOR ] LND: Validating primary data. [2025-10-28T19:45:30.754767] [DEBUG] [VALIDATOR ] LND: All expected trading days are present. [2025-10-28T19:45:30.754840] [DEBUG] [VALIDATOR ] LND: Primary data validation passed. [2025-10-28T19:45:30.755029] [INFO ] [MAIN ] LND: Fetched primary data is valid. [2025-10-28T19:45:30.755066] [DEBUG] [LOCAL ] LND: Saving primary data. [2025-10-28T19:45:30.755441] [DEBUG] [LOCAL ] LND: Trimmed 7798 records to 4868 (keeping 200 days of data) [2025-10-28T19:45:30.782615] [DEBUG] [LOCAL ] LND: Primary data saved (4868 records). [2025-10-28T19:45:30.782716] [INFO ] [MAIN ] LND: Full history saved. [2025-10-28T19:45:30.782793] [INFO ] [MAIN ] Update Progress: 1263/2366 symbols completed. LND took 20.2s. Estimated remaining: 2h 24m 30s. Rate: 7.6 symbols/min [2025-10-28T19:45:30.948779] [INFO ] [MAIN ] LOB: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:45:30.974274] [DEBUG] [LOCAL ] LOB: Loaded 26452 existing records from primary storage. [2025-10-28T19:45:30.974526] [INFO ] [MAIN ] LOB: Loaded 26452 existing records. [2025-10-28T19:45:31.150573] [WARN ] [MAIN ] LOB: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:45:31.150815] [INFO ] [MAIN ] LOB: Wiping existing primary data before full refresh. [2025-10-28T19:45:31.150862] [INFO ] [LOCAL ] LOB: Starting deletion of primary data. [2025-10-28T19:45:31.151088] [DEBUG] [LOCAL ] LOB: Deleted primary data file. [2025-10-28T19:45:31.151127] [INFO ] [MAIN ] LOB: Starting full primary refresh. [2025-10-28T19:45:31.185471] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-06. [2025-10-28T19:45:31.520814] [INFO ] [REMOTE ] LOB: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:45:31.544970] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-10-28T19:45:31.873340] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-10-28T19:45:31.980363] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-01. [2025-10-28T19:45:32.759037] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-10-28T19:45:32.780288] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-02. [2025-10-28T19:45:33.515199] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-10-28T19:45:33.580266] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-03. [2025-10-28T19:45:34.380244] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-07. [2025-10-28T19:45:34.481522] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-10-28T19:45:35.012867] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-10-28T19:45:35.180314] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-05. [2025-10-28T19:45:35.980290] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-04. [2025-10-28T19:45:36.428080] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-28T19:45:36.780281] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-08. [2025-10-28T19:45:37.386793] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-10-28T19:45:37.580245] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-05. [2025-10-28T19:45:38.380302] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-03. [2025-10-28T19:45:39.078139] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-08 (2.30 seconds). [2025-10-28T19:45:39.180303] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-06. [2025-10-28T19:45:39.675000] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-10-28T19:45:39.980286] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-04. [2025-10-28T19:45:40.780253] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-09. [2025-10-28T19:45:41.336528] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-10-28T19:45:41.580254] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-10. [2025-10-28T19:45:42.344906] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-10 (0.76 seconds). [2025-10-28T19:45:42.348274] [INFO ] [REMOTE ] LNN: Full fetch complete (16366 records). [2025-10-28T19:45:42.348350] [DEBUG] [VALIDATOR ] LNN: Validating primary data. [2025-10-28T19:45:42.637117] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-05 (5.06 seconds). [2025-10-28T19:45:42.670446] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-06. [2025-10-28T19:45:42.753513] [DEBUG] [VALIDATOR ] LNN: All expected trading days are present. [2025-10-28T19:45:42.753591] [DEBUG] [VALIDATOR ] LNN: Primary data validation passed. [2025-10-28T19:45:42.753977] [INFO ] [MAIN ] LNN: Fetched primary data is valid. [2025-10-28T19:45:42.754037] [DEBUG] [LOCAL ] LNN: Saving primary data. [2025-10-28T19:45:42.754522] [DEBUG] [LOCAL ] LNN: Trimmed 16366 records to 11561 (keeping 200 days of data) [2025-10-28T19:45:42.842003] [DEBUG] [LOCAL ] LNN: Primary data saved (11561 records). [2025-10-28T19:45:42.842745] [INFO ] [MAIN ] LNN: Full history saved. [2025-10-28T19:45:42.842906] [INFO ] [MAIN ] Update Progress: 1264/2366 symbols completed. LNN took 28.3s. Estimated remaining: 2h 24m 26s. Rate: 7.6 symbols/min [2025-10-28T19:45:43.044288] [INFO ] [MAIN ] LOCL: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:45:43.051704] [DEBUG] [LOCAL ] LOCL: Loaded 3246 existing records from primary storage. [2025-10-28T19:45:43.051972] [INFO ] [MAIN ] LOCL: Loaded 3246 existing records. [2025-10-28T19:45:43.247348] [WARN ] [MAIN ] LOCL: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:45:43.247735] [INFO ] [MAIN ] LOCL: Wiping existing primary data before full refresh. [2025-10-28T19:45:43.247804] [INFO ] [LOCAL ] LOCL: Starting deletion of primary data. [2025-10-28T19:45:43.247982] [DEBUG] [LOCAL ] LOCL: Deleted primary data file. [2025-10-28T19:45:43.248024] [INFO ] [MAIN ] LOCL: Starting full primary refresh. [2025-10-28T19:45:43.582387] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-10-28T19:45:43.624949] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-07. [2025-10-28T19:45:43.649294] [INFO ] [REMOTE ] LOCL: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:45:43.980232] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-01. [2025-10-28T19:45:44.299620] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-01 (0.32 seconds). [2025-10-28T19:45:44.487671] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-28T19:45:44.780276] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-02. [2025-10-28T19:45:45.019300] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-02 (0.24 seconds). [2025-10-28T19:45:45.283886] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-06 (6.10 seconds). [2025-10-28T19:45:45.580273] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-07. [2025-10-28T19:45:46.380245] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-08. [2025-10-28T19:45:46.624113] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-28T19:45:47.168622] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-10-28T19:45:47.180224] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-09. [2025-10-28T19:45:47.980284] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-03. [2025-10-28T19:45:48.211925] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-04 (8.23 seconds). [2025-10-28T19:45:48.262508] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-03 (0.28 seconds). [2025-10-28T19:45:48.780303] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-05. [2025-10-28T19:45:49.345229] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-10-28T19:45:49.580300] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-10. [2025-10-28T19:45:50.380241] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-04. [2025-10-28T19:45:50.573726] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-10 (0.99 seconds). [2025-10-28T19:45:50.580055] [INFO ] [REMOTE ] LOB: Full fetch complete (38762 records). [2025-10-28T19:45:50.580231] [DEBUG] [VALIDATOR ] LOB: Validating primary data. [2025-10-28T19:45:50.996203] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-10-28T19:45:51.014348] [DEBUG] [VALIDATOR ] LOB: All expected trading days are present. [2025-10-28T19:45:51.014425] [DEBUG] [VALIDATOR ] LOB: Primary data validation passed. [2025-10-28T19:45:51.015267] [INFO ] [MAIN ] LOB: Fetched primary data is valid. [2025-10-28T19:45:51.015328] [DEBUG] [LOCAL ] LOB: Saving primary data. [2025-10-28T19:45:51.016254] [DEBUG] [LOCAL ] LOB: Trimmed 38762 records to 26260 (keeping 200 days of data) [2025-10-28T19:45:51.178533] [DEBUG] [LOCAL ] LOB: Primary data saved (26260 records). [2025-10-28T19:45:51.178696] [INFO ] [MAIN ] LOB: Full history saved. [2025-10-28T19:45:51.178787] [INFO ] [MAIN ] Update Progress: 1265/2366 symbols completed. LOB took 20.4s. Estimated remaining: 2h 24m 18s. Rate: 7.6 symbols/min [2025-10-28T19:45:51.190197] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-05. [2025-10-28T19:45:51.361928] [INFO ] [MAIN ] LOMA: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:45:51.395338] [DEBUG] [LOCAL ] LOMA: Loaded 32945 existing records from primary storage. [2025-10-28T19:45:51.395599] [INFO ] [MAIN ] LOMA: Loaded 32945 existing records. [2025-10-28T19:45:51.579503] [WARN ] [MAIN ] LOMA: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:45:51.579907] [INFO ] [MAIN ] LOMA: Wiping existing primary data before full refresh. [2025-10-28T19:45:51.580261] [INFO ] [LOCAL ] LOMA: Starting deletion of primary data. [2025-10-28T19:45:51.580472] [DEBUG] [LOCAL ] LOMA: Deleted primary data file. [2025-10-28T19:45:51.580514] [INFO ] [MAIN ] LOMA: Starting full primary refresh. [2025-10-28T19:45:51.662098] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-10-28T19:45:51.962038] [INFO ] [REMOTE ] LOMA: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:45:51.980220] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-01. [2025-10-28T19:45:52.129090] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-05 (3.35 seconds). [2025-10-28T19:45:52.780263] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-06. [2025-10-28T19:45:52.900502] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-28T19:45:53.157283] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-10-28T19:45:53.580302] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-08. [2025-10-28T19:45:54.380402] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-06. [2025-10-28T19:45:54.647060] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-10-28T19:45:55.180257] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-07. [2025-10-28T19:45:55.679558] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-10-28T19:45:55.741662] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-10-28T19:45:55.980262] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-07. [2025-10-28T19:45:56.780312] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-09. [2025-10-28T19:45:57.395600] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-28T19:45:57.580233] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-08. [2025-10-28T19:45:57.926057] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-10-28T19:45:58.380237] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-10. [2025-10-28T19:45:58.918386] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-28T19:45:59.180239] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-09. [2025-10-28T19:45:59.431751] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-10 (1.05 seconds). [2025-10-28T19:45:59.439136] [INFO ] [REMOTE ] LOAR: Full fetch complete (55981 records). [2025-10-28T19:45:59.439264] [DEBUG] [VALIDATOR ] LOAR: Validating primary data. [2025-10-28T19:45:59.811215] [DEBUG] [VALIDATOR ] LOAR: All expected trading days are present. [2025-10-28T19:45:59.811293] [DEBUG] [VALIDATOR ] LOAR: Primary data validation passed. [2025-10-28T19:45:59.812193] [INFO ] [MAIN ] LOAR: Fetched primary data is valid. [2025-10-28T19:45:59.812277] [DEBUG] [LOCAL ] LOAR: Saving primary data. [2025-10-28T19:45:59.813445] [DEBUG] [LOCAL ] LOAR: Trimmed 55981 records to 41655 (keeping 200 days of data) [2025-10-28T19:45:59.988132] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-02. [2025-10-28T19:46:00.058376] [DEBUG] [LOCAL ] LOAR: Primary data saved (41655 records). [2025-10-28T19:46:00.058496] [INFO ] [MAIN ] LOAR: Full history saved. [2025-10-28T19:46:00.058884] [INFO ] [MAIN ] Update Progress: 1266/2366 symbols completed. LOAR took 43.4s. Estimated remaining: 2h 24m 11s. Rate: 7.6 symbols/min [2025-10-28T19:46:00.221599] [INFO ] [MAIN ] LOW: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:46:00.270413] [DEBUG] [LOCAL ] LOW: Loaded 52939 existing records from primary storage. [2025-10-28T19:46:00.270756] [INFO ] [MAIN ] LOW: Loaded 52939 existing records. [2025-10-28T19:46:00.447543] [WARN ] [MAIN ] LOW: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:46:00.447856] [INFO ] [MAIN ] LOW: Wiping existing primary data before full refresh. [2025-10-28T19:46:00.448011] [INFO ] [LOCAL ] LOW: Starting deletion of primary data. [2025-10-28T19:46:00.448959] [DEBUG] [LOCAL ] LOW: Deleted primary data file. [2025-10-28T19:46:00.449019] [INFO ] [MAIN ] LOW: Starting full primary refresh. [2025-10-28T19:46:00.757311] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-10-28T19:46:00.789638] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-08. [2025-10-28T19:46:00.888236] [INFO ] [REMOTE ] LOW: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:46:01.000513] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-10-28T19:46:01.094120] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-08 (0.30 seconds). [2025-10-28T19:46:01.580245] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-09. [2025-10-28T19:46:02.046623] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-10-28T19:46:02.380304] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-01. [2025-10-28T19:46:03.180325] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-10. [2025-10-28T19:46:03.795031] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-28T19:46:03.980297] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-03. [2025-10-28T19:46:04.672060] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-28T19:46:04.683019] [INFO ] [REMOTE ] LNG: Full fetch complete (74663 records). [2025-10-28T19:46:04.683198] [DEBUG] [VALIDATOR ] LNG: Validating primary data. [2025-10-28T19:46:04.788369] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-02. [2025-10-28T19:46:05.024416] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-28T19:46:05.121420] [DEBUG] [VALIDATOR ] LNG: All expected trading days are present. [2025-10-28T19:46:05.121491] [DEBUG] [VALIDATOR ] LNG: Primary data validation passed. [2025-10-28T19:46:05.122770] [INFO ] [MAIN ] LNG: Fetched primary data is valid. [2025-10-28T19:46:05.122834] [DEBUG] [LOCAL ] LNG: Saving primary data. [2025-10-28T19:46:05.124318] [DEBUG] [LOCAL ] LNG: Trimmed 74663 records to 50969 (keeping 200 days of data) [2025-10-28T19:46:05.446479] [DEBUG] [LOCAL ] LNG: Primary data saved (50969 records). [2025-10-28T19:46:05.446920] [INFO ] [MAIN ] LNG: Full history saved. [2025-10-28T19:46:05.447682] [INFO ] [MAIN ] Update Progress: 1267/2366 symbols completed. LNG took 52.8s. Estimated remaining: 2h 24m 1s. Rate: 7.6 symbols/min [2025-10-28T19:46:05.591190] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-10. [2025-10-28T19:46:05.623900] [INFO ] [MAIN ] LPG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:46:05.660834] [DEBUG] [LOCAL ] LPG: Loaded 38804 existing records from primary storage. [2025-10-28T19:46:05.661110] [INFO ] [MAIN ] LPG: Loaded 38804 existing records. [2025-10-28T19:46:05.834432] [WARN ] [MAIN ] LPG: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:46:05.834692] [INFO ] [MAIN ] LPG: Wiping existing primary data before full refresh. [2025-10-28T19:46:05.834748] [INFO ] [LOCAL ] LPG: Starting deletion of primary data. [2025-10-28T19:46:05.835750] [DEBUG] [LOCAL ] LPG: Deleted primary data file. [2025-10-28T19:46:05.835808] [INFO ] [MAIN ] LPG: Starting full primary refresh. [2025-10-28T19:46:06.114219] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-10 (0.52 seconds). [2025-10-28T19:46:06.148480] [INFO ] [REMOTE ] LOCL: Full fetch complete (4519 records). [2025-10-28T19:46:06.185638] [DEBUG] [VALIDATOR ] LOCL: Validating primary data. [2025-10-28T19:46:06.210006] [INFO ] [REMOTE ] LPG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:46:06.385528] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-01. [2025-10-28T19:46:06.569186] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-10-28T19:46:06.608981] [DEBUG] [VALIDATOR ] LOCL: All expected trading days are present. [2025-10-28T19:46:06.609051] [DEBUG] [VALIDATOR ] LOCL: Primary data validation passed. [2025-10-28T19:46:06.609194] [INFO ] [MAIN ] LOCL: Fetched primary data is valid. [2025-10-28T19:46:06.609231] [DEBUG] [LOCAL ] LOCL: Saving primary data. [2025-10-28T19:46:06.609574] [DEBUG] [LOCAL ] LOCL: Trimmed 4519 records to 3227 (keeping 200 days of data) [2025-10-28T19:46:06.627030] [DEBUG] [LOCAL ] LOCL: Primary data saved (3227 records). [2025-10-28T19:46:06.627089] [INFO ] [MAIN ] LOCL: Full history saved. [2025-10-28T19:46:06.627153] [INFO ] [MAIN ] Update Progress: 1268/2366 symbols completed. LOCL took 23.8s. Estimated remaining: 2h 23m 48s. Rate: 7.6 symbols/min [2025-10-28T19:46:06.792078] [INFO ] [MAIN ] LPL: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:46:06.817606] [DEBUG] [LOCAL ] LPL: Loaded 29165 existing records from primary storage. [2025-10-28T19:46:06.817855] [INFO ] [MAIN ] LPL: Loaded 29165 existing records. [2025-10-28T19:46:06.992910] [WARN ] [MAIN ] LPL: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:46:06.993071] [INFO ] [MAIN ] LPL: Wiping existing primary data before full refresh. [2025-10-28T19:46:06.993115] [INFO ] [LOCAL ] LPL: Starting deletion of primary data. [2025-10-28T19:46:06.993555] [DEBUG] [LOCAL ] LPL: Deleted primary data file. [2025-10-28T19:46:06.993611] [INFO ] [MAIN ] LPL: Starting full primary refresh. [2025-10-28T19:46:07.191003] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-03. [2025-10-28T19:46:07.349616] [INFO ] [REMOTE ] LPL: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:46:07.565202] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-28T19:46:07.980266] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-04. [2025-10-28T19:46:08.738423] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-10-28T19:46:08.780214] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-04. [2025-10-28T19:46:09.580220] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-02. [2025-10-28T19:46:10.242020] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-10-28T19:46:10.380281] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-05. [2025-10-28T19:46:10.445401] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-04 (2.47 seconds). [2025-10-28T19:46:10.691740] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-10-28T19:46:11.180280] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-05. [2025-10-28T19:46:11.711341] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-28T19:46:11.980280] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-01. [2025-10-28T19:46:12.654340] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-10-28T19:46:12.780214] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-02. [2025-10-28T19:46:13.580242] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-06. [2025-10-28T19:46:13.765601] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-05 (2.59 seconds). [2025-10-28T19:46:14.380276] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-06. [2025-10-28T19:46:14.500378] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-10-28T19:46:14.954461] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-10-28T19:46:15.180267] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-07. [2025-10-28T19:46:15.238263] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-10-28T19:46:15.980264] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-07. [2025-10-28T19:46:16.649302] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-28T19:46:16.780253] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-08. [2025-10-28T19:46:16.905126] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-10-28T19:46:17.580286] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-08. [2025-10-28T19:46:18.149394] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-10-28T19:46:18.380283] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-09. [2025-10-28T19:46:18.464572] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-28T19:46:19.180307] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-03. [2025-10-28T19:46:19.801004] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-10-28T19:46:19.980266] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-03. [2025-10-28T19:46:20.222699] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-10-28T19:46:20.761989] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-28T19:46:20.780205] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-04. [2025-10-28T19:46:21.534343] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-10-28T19:46:21.580224] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-05. [2025-10-28T19:46:22.282988] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-10-28T19:46:22.380255] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-06. [2025-10-28T19:46:23.061521] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-10-28T19:46:23.180223] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-10. [2025-10-28T19:46:23.885043] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-10 (0.70 seconds). [2025-10-28T19:46:23.895480] [INFO ] [REMOTE ] LOW: Full fetch complete (76693 records). [2025-10-28T19:46:23.895607] [DEBUG] [VALIDATOR ] LOW: Validating primary data. [2025-10-28T19:46:23.985317] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-09. [2025-10-28T19:46:24.287909] [DEBUG] [VALIDATOR ] LOW: All expected trading days are present. [2025-10-28T19:46:24.287989] [DEBUG] [VALIDATOR ] LOW: Primary data validation passed. [2025-10-28T19:46:24.289068] [INFO ] [MAIN ] LOW: Fetched primary data is valid. [2025-10-28T19:46:24.289130] [DEBUG] [LOCAL ] LOW: Saving primary data. [2025-10-28T19:46:24.290536] [DEBUG] [LOCAL ] LOW: Trimmed 76693 records to 52926 (keeping 200 days of data) [2025-10-28T19:46:24.662785] [DEBUG] [LOCAL ] LOW: Primary data saved (52926 records). [2025-10-28T19:46:24.662932] [INFO ] [MAIN ] LOW: Full history saved. [2025-10-28T19:46:24.663271] [INFO ] [MAIN ] Update Progress: 1269/2366 symbols completed. LOW took 24.6s. Estimated remaining: 2h 23m 49s. Rate: 7.6 symbols/min [2025-10-28T19:46:24.785544] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-07. [2025-10-28T19:46:24.925022] [INFO ] [MAIN ] LPX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:46:24.989582] [DEBUG] [LOCAL ] LPX: Loaded 39955 existing records from primary storage. [2025-10-28T19:46:24.990008] [INFO ] [MAIN ] LPX: Loaded 39955 existing records. [2025-10-28T19:46:25.341916] [WARN ] [MAIN ] LPX: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:46:25.345835] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-10-28T19:46:25.346202] [INFO ] [MAIN ] LPX: Wiping existing primary data before full refresh. [2025-10-28T19:46:25.346504] [INFO ] [LOCAL ] LPX: Starting deletion of primary data. [2025-10-28T19:46:25.360019] [DEBUG] [LOCAL ] LPX: Deleted primary data file. [2025-10-28T19:46:25.360144] [INFO ] [MAIN ] LPX: Starting full primary refresh. [2025-10-28T19:46:25.591482] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-10. [2025-10-28T19:46:25.790479] [INFO ] [REMOTE ] LPX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:46:25.807584] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-28T19:46:26.380254] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-01. [2025-10-28T19:46:27.180253] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-04. [2025-10-28T19:46:27.442178] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-28T19:46:27.980234] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-02. [2025-10-28T19:46:28.385693] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-28T19:46:28.780266] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-08. [2025-10-28T19:46:29.040803] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-10 (3.45 seconds). [2025-10-28T19:46:29.048739] [INFO ] [REMOTE ] LOMA: Full fetch complete (48099 records). [2025-10-28T19:46:29.048894] [DEBUG] [VALIDATOR ] LOMA: Validating primary data. [2025-10-28T19:46:29.446264] [DEBUG] [VALIDATOR ] LOMA: All expected trading days are present. [2025-10-28T19:46:29.446346] [DEBUG] [VALIDATOR ] LOMA: Primary data validation passed. [2025-10-28T19:46:29.447479] [INFO ] [MAIN ] LOMA: Fetched primary data is valid. [2025-10-28T19:46:29.447541] [DEBUG] [LOCAL ] LOMA: Saving primary data. [2025-10-28T19:46:29.448806] [DEBUG] [LOCAL ] LOMA: Trimmed 48099 records to 33069 (keeping 200 days of data) [2025-10-28T19:46:29.602801] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-05. [2025-10-28T19:46:29.654373] [DEBUG] [LOCAL ] LOMA: Primary data saved (33069 records). [2025-10-28T19:46:29.654706] [INFO ] [MAIN ] LOMA: Full history saved. [2025-10-28T19:46:29.654937] [INFO ] [MAIN ] Update Progress: 1270/2366 symbols completed. LOMA took 38.5s. Estimated remaining: 2h 23m 38s. Rate: 7.6 symbols/min [2025-10-28T19:46:29.824535] [INFO ] [MAIN ] LRN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:46:29.865556] [DEBUG] [LOCAL ] LRN: Loaded 39074 existing records from primary storage. [2025-10-28T19:46:29.865869] [INFO ] [MAIN ] LRN: Loaded 39074 existing records. [2025-10-28T19:46:30.046381] [WARN ] [MAIN ] LRN: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:46:30.046770] [INFO ] [MAIN ] LRN: Wiping existing primary data before full refresh. [2025-10-28T19:46:30.046849] [INFO ] [LOCAL ] LRN: Starting deletion of primary data. [2025-10-28T19:46:30.047120] [DEBUG] [LOCAL ] LRN: Deleted primary data file. [2025-10-28T19:46:30.047165] [INFO ] [MAIN ] LRN: Starting full primary refresh. [2025-10-28T19:46:30.175240] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-10-28T19:46:30.385458] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-09. [2025-10-28T19:46:30.440262] [INFO ] [REMOTE ] LRN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:46:30.858743] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-10-28T19:46:31.180346] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-06. [2025-10-28T19:46:31.438765] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-02 (3.46 seconds). [2025-10-28T19:46:31.568265] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-10-28T19:46:31.980256] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-03. [2025-10-28T19:46:32.780334] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-01. [2025-10-28T19:46:33.071415] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-10-28T19:46:33.580236] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-10. [2025-10-28T19:46:33.897327] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-28T19:46:34.380302] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-02. [2025-10-28T19:46:34.652742] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-10 (1.07 seconds). [2025-10-28T19:46:34.661905] [INFO ] [REMOTE ] LPL: Full fetch complete (38277 records). [2025-10-28T19:46:34.662051] [DEBUG] [VALIDATOR ] LPL: Validating primary data. [2025-10-28T19:46:35.056331] [DEBUG] [VALIDATOR ] LPL: All expected trading days are present. [2025-10-28T19:46:35.056435] [DEBUG] [VALIDATOR ] LPL: Primary data validation passed. [2025-10-28T19:46:35.057256] [INFO ] [MAIN ] LPL: Fetched primary data is valid. [2025-10-28T19:46:35.057351] [DEBUG] [LOCAL ] LPL: Saving primary data. [2025-10-28T19:46:35.058243] [DEBUG] [LOCAL ] LPL: Trimmed 38277 records to 29274 (keeping 200 days of data) [2025-10-28T19:46:35.174413] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-06 (3.99 seconds). [2025-10-28T19:46:35.186680] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-04. [2025-10-28T19:46:35.254004] [DEBUG] [LOCAL ] LPL: Primary data saved (29274 records). [2025-10-28T19:46:35.254143] [INFO ] [MAIN ] LPL: Full history saved. [2025-10-28T19:46:35.254223] [INFO ] [MAIN ] Update Progress: 1271/2366 symbols completed. LPL took 28.6s. Estimated remaining: 2h 23m 29s. Rate: 7.6 symbols/min [2025-10-28T19:46:35.431054] [INFO ] [MAIN ] LSPD: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:46:35.471386] [DEBUG] [LOCAL ] LSPD: Loaded 42066 existing records from primary storage. [2025-10-28T19:46:35.471709] [INFO ] [MAIN ] LSPD: Loaded 42066 existing records. [2025-10-28T19:46:35.648451] [WARN ] [MAIN ] LSPD: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:46:35.648691] [INFO ] [MAIN ] LSPD: Wiping existing primary data before full refresh. [2025-10-28T19:46:35.648751] [INFO ] [LOCAL ] LSPD: Starting deletion of primary data. [2025-10-28T19:46:35.648932] [DEBUG] [LOCAL ] LSPD: Deleted primary data file. [2025-10-28T19:46:35.648970] [INFO ] [MAIN ] LSPD: Starting full primary refresh. [2025-10-28T19:46:35.982185] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-07. [2025-10-28T19:46:36.007088] [INFO ] [REMOTE ] LSPD: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:46:36.295829] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-10-28T19:46:36.780308] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-01. [2025-10-28T19:46:37.407026] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-10-28T19:46:37.580230] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-08. [2025-10-28T19:46:37.825683] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-28T19:46:38.380229] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-02. [2025-10-28T19:46:38.477710] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-02 (4.10 seconds). [2025-10-28T19:46:39.180278] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-05. [2025-10-28T19:46:39.470732] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-28T19:46:39.517927] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-10-28T19:46:39.980456] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-09. [2025-10-28T19:46:40.174195] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-28T19:46:40.780302] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-03. [2025-10-28T19:46:41.105769] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-10-28T19:46:41.580326] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-03. [2025-10-28T19:46:42.084913] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-28T19:46:42.380295] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-06. [2025-10-28T19:46:42.793335] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-10-28T19:46:43.180314] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-04. [2025-10-28T19:46:43.349967] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-10-28T19:46:43.980302] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-04. [2025-10-28T19:46:44.273115] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-10-28T19:46:44.780359] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-07. [2025-10-28T19:46:45.170191] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-28T19:46:45.580253] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-10. [2025-10-28T19:46:45.801961] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-10-28T19:46:46.380286] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-05. [2025-10-28T19:46:46.762211] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-10 (1.18 seconds). [2025-10-28T19:46:46.769687] [INFO ] [REMOTE ] LPG: Full fetch complete (58513 records). [2025-10-28T19:46:46.769820] [DEBUG] [VALIDATOR ] LPG: Validating primary data. [2025-10-28T19:46:47.145767] [DEBUG] [VALIDATOR ] LPG: All expected trading days are present. [2025-10-28T19:46:47.145853] [DEBUG] [VALIDATOR ] LPG: Primary data validation passed. [2025-10-28T19:46:47.146853] [INFO ] [MAIN ] LPG: Fetched primary data is valid. [2025-10-28T19:46:47.146917] [DEBUG] [LOCAL ] LPG: Saving primary data. [2025-10-28T19:46:47.148142] [DEBUG] [LOCAL ] LPG: Trimmed 58513 records to 38700 (keeping 200 days of data) [2025-10-28T19:46:47.199208] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-05. [2025-10-28T19:46:47.382544] [DEBUG] [LOCAL ] LPG: Primary data saved (38700 records). [2025-10-28T19:46:47.382713] [INFO ] [MAIN ] LPG: Full history saved. [2025-10-28T19:46:47.382825] [INFO ] [MAIN ] Update Progress: 1272/2366 symbols completed. LPG took 41.9s. Estimated remaining: 2h 23m 24s. Rate: 7.6 symbols/min [2025-10-28T19:46:47.553885] [INFO ] [MAIN ] LTC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:46:47.589597] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-10-28T19:46:47.625470] [DEBUG] [LOCAL ] LTC: Loaded 30481 existing records from primary storage. [2025-10-28T19:46:47.625801] [INFO ] [MAIN ] LTC: Loaded 30481 existing records. [2025-10-28T19:46:47.804438] [WARN ] [MAIN ] LTC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:46:47.804699] [INFO ] [MAIN ] LTC: Wiping existing primary data before full refresh. [2025-10-28T19:46:47.804757] [INFO ] [LOCAL ] LTC: Starting deletion of primary data. [2025-10-28T19:46:47.804933] [DEBUG] [LOCAL ] LTC: Deleted primary data file. [2025-10-28T19:46:47.804971] [INFO ] [MAIN ] LTC: Starting full primary refresh. [2025-10-28T19:46:47.983278] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-06. [2025-10-28T19:46:48.176112] [INFO ] [REMOTE ] LTC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:46:48.295753] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-10-28T19:46:48.780262] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-06. [2025-10-28T19:46:49.580223] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-01. [2025-10-28T19:46:49.792570] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-10-28T19:46:50.380234] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-07. [2025-10-28T19:46:50.504419] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-28T19:46:50.702974] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-06 (2.72 seconds). [2025-10-28T19:46:51.180308] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-08. [2025-10-28T19:46:51.436267] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-10-28T19:46:51.980307] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-02. [2025-10-28T19:46:52.229067] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-10-28T19:46:52.780257] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-08. [2025-10-28T19:46:52.855217] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-28T19:46:53.580224] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-03. [2025-10-28T19:46:53.778196] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-10-28T19:46:54.292522] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-28T19:46:54.380278] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-07. [2025-10-28T19:46:55.180288] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-09. [2025-10-28T19:46:55.411557] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-28T19:46:55.980248] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-09. [2025-10-28T19:46:56.419356] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-28T19:46:56.780265] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-04. [2025-10-28T19:46:57.043314] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-10-28T19:46:57.580225] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-10. [2025-10-28T19:46:57.780726] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-28T19:46:58.380252] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-05. [2025-10-28T19:46:59.072959] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-10 (1.49 seconds). [2025-10-28T19:46:59.084192] [INFO ] [REMOTE ] LSPD: Full fetch complete (62466 records). [2025-10-28T19:46:59.084380] [DEBUG] [VALIDATOR ] LSPD: Validating primary data. [2025-10-28T19:46:59.185494] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-10. [2025-10-28T19:46:59.499316] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-28T19:46:59.526598] [DEBUG] [VALIDATOR ] LSPD: All expected trading days are present. [2025-10-28T19:46:59.527033] [DEBUG] [VALIDATOR ] LSPD: Primary data validation passed. [2025-10-28T19:46:59.528068] [INFO ] [MAIN ] LSPD: Fetched primary data is valid. [2025-10-28T19:46:59.528127] [DEBUG] [LOCAL ] LSPD: Saving primary data. [2025-10-28T19:46:59.529356] [DEBUG] [LOCAL ] LSPD: Trimmed 62466 records to 41999 (keeping 200 days of data) [2025-10-28T19:46:59.766400] [DEBUG] [LOCAL ] LSPD: Primary data saved (41999 records). [2025-10-28T19:46:59.766523] [INFO ] [MAIN ] LSPD: Full history saved. [2025-10-28T19:46:59.766598] [INFO ] [MAIN ] Update Progress: 1273/2366 symbols completed. LSPD took 24.5s. Estimated remaining: 2h 23m 20s. Rate: 7.6 symbols/min [2025-10-28T19:46:59.937929] [INFO ] [MAIN ] LTH: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:46:59.984078] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-08. [2025-10-28T19:46:59.986033] [DEBUG] [LOCAL ] LTH: Loaded 51546 existing records from primary storage. [2025-10-28T19:46:59.986387] [INFO ] [MAIN ] LTH: Loaded 51546 existing records. [2025-10-28T19:47:00.166803] [WARN ] [MAIN ] LTH: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:47:00.167034] [INFO ] [MAIN ] LTH: Wiping existing primary data before full refresh. [2025-10-28T19:47:00.167083] [INFO ] [LOCAL ] LTH: Starting deletion of primary data. [2025-10-28T19:47:00.167288] [DEBUG] [LOCAL ] LTH: Deleted primary data file. [2025-10-28T19:47:00.167345] [INFO ] [MAIN ] LTH: Starting full primary refresh. [2025-10-28T19:47:00.556372] [INFO ] [REMOTE ] LTH: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:47:00.580795] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-10 (1.40 seconds). [2025-10-28T19:47:00.589192] [INFO ] [REMOTE ] LPX: Full fetch complete (58585 records). [2025-10-28T19:47:00.589339] [DEBUG] [VALIDATOR ] LPX: Validating primary data. [2025-10-28T19:47:00.788663] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-01. [2025-10-28T19:47:00.988053] [DEBUG] [VALIDATOR ] LPX: All expected trading days are present. [2025-10-28T19:47:00.988133] [DEBUG] [VALIDATOR ] LPX: Primary data validation passed. [2025-10-28T19:47:00.989050] [INFO ] [MAIN ] LPX: Fetched primary data is valid. [2025-10-28T19:47:00.989112] [DEBUG] [LOCAL ] LPX: Saving primary data. [2025-10-28T19:47:00.990298] [DEBUG] [LOCAL ] LPX: Trimmed 58585 records to 39916 (keeping 200 days of data) [2025-10-28T19:47:01.229756] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-10-28T19:47:01.270443] [DEBUG] [LOCAL ] LPX: Primary data saved (39916 records). [2025-10-28T19:47:01.270586] [INFO ] [MAIN ] LPX: Full history saved. [2025-10-28T19:47:01.270981] [INFO ] [MAIN ] Update Progress: 1274/2366 symbols completed. LPX took 36.6s. Estimated remaining: 2h 23m 7s. Rate: 7.6 symbols/min [2025-10-28T19:47:01.442228] [INFO ] [MAIN ] LTM: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:47:01.480263] [DEBUG] [LOCAL ] LTM: Loaded 39414 existing records from primary storage. [2025-10-28T19:47:01.480564] [INFO ] [MAIN ] LTM: Loaded 39414 existing records. [2025-10-28T19:47:01.585446] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-06. [2025-10-28T19:47:01.658794] [WARN ] [MAIN ] LTM: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:47:01.659323] [INFO ] [MAIN ] LTM: Wiping existing primary data before full refresh. [2025-10-28T19:47:01.659379] [INFO ] [LOCAL ] LTM: Starting deletion of primary data. [2025-10-28T19:47:01.659625] [DEBUG] [LOCAL ] LTM: Deleted primary data file. [2025-10-28T19:47:01.659718] [INFO ] [MAIN ] LTM: Starting full primary refresh. [2025-10-28T19:47:02.018372] [INFO ] [REMOTE ] LTM: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:47:02.171987] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-10-28T19:47:02.380223] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-09. [2025-10-28T19:47:02.454904] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-10-28T19:47:03.180246] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-01. [2025-10-28T19:47:03.434188] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-28T19:47:03.980257] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-10. [2025-10-28T19:47:04.019981] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-10-28T19:47:04.780251] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-02. [2025-10-28T19:47:05.202274] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-10 (1.22 seconds). [2025-10-28T19:47:05.209582] [INFO ] [REMOTE ] LRN: Full fetch complete (58047 records). [2025-10-28T19:47:05.209740] [DEBUG] [VALIDATOR ] LRN: Validating primary data. [2025-10-28T19:47:05.604622] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-02. [2025-10-28T19:47:05.624493] [DEBUG] [VALIDATOR ] LRN: All expected trading days are present. [2025-10-28T19:47:05.624638] [DEBUG] [VALIDATOR ] LRN: Primary data validation passed. [2025-10-28T19:47:05.625718] [INFO ] [MAIN ] LRN: Fetched primary data is valid. [2025-10-28T19:47:05.626625] [DEBUG] [LOCAL ] LRN: Saving primary data. [2025-10-28T19:47:05.633487] [DEBUG] [LOCAL ] LRN: Trimmed 58047 records to 39089 (keeping 200 days of data) [2025-10-28T19:47:05.643625] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-10-28T19:47:05.880093] [DEBUG] [LOCAL ] LRN: Primary data saved (39089 records). [2025-10-28T19:47:05.880226] [INFO ] [MAIN ] LRN: Full history saved. [2025-10-28T19:47:05.880919] [INFO ] [MAIN ] Update Progress: 1275/2366 symbols completed. LRN took 36.2s. Estimated remaining: 2h 22m 56s. Rate: 7.6 symbols/min [2025-10-28T19:47:06.049012] [INFO ] [MAIN ] LU: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:47:06.097167] [DEBUG] [LOCAL ] LU: Loaded 49197 existing records from primary storage. [2025-10-28T19:47:06.097471] [INFO ] [MAIN ] LU: Loaded 49197 existing records. [2025-10-28T19:47:06.273832] [WARN ] [MAIN ] LU: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:47:06.274023] [INFO ] [MAIN ] LU: Wiping existing primary data before full refresh. [2025-10-28T19:47:06.274068] [INFO ] [LOCAL ] LU: Starting deletion of primary data. [2025-10-28T19:47:06.274256] [DEBUG] [LOCAL ] LU: Deleted primary data file. [2025-10-28T19:47:06.274292] [INFO ] [MAIN ] LU: Starting full primary refresh. [2025-10-28T19:47:06.385415] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-07. [2025-10-28T19:47:06.640323] [INFO ] [REMOTE ] LU: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:47:06.866769] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-10-28T19:47:07.180281] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-01. [2025-10-28T19:47:07.980230] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-03. [2025-10-28T19:47:08.481132] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-28T19:47:08.780273] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-03. [2025-10-28T19:47:09.200165] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-10-28T19:47:09.580234] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-04. [2025-10-28T19:47:09.651191] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-10-28T19:47:09.978356] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-07 (3.59 seconds). [2025-10-28T19:47:10.380242] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-08. [2025-10-28T19:47:10.773103] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-28T19:47:11.180243] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-05. [2025-10-28T19:47:11.402363] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-28T19:47:11.980259] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-04. [2025-10-28T19:47:12.422878] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-10-28T19:47:12.780304] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-09. [2025-10-28T19:47:12.895411] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-10-28T19:47:13.580285] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-06. [2025-10-28T19:47:13.713959] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-10-28T19:47:14.380333] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-05. [2025-10-28T19:47:14.784136] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-10-28T19:47:15.180266] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-02. [2025-10-28T19:47:15.321328] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-10-28T19:47:15.980267] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-06. [2025-10-28T19:47:16.219897] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-10-28T19:47:16.780270] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-03. [2025-10-28T19:47:17.580309] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-10. [2025-10-28T19:47:18.164545] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-28T19:47:18.380243] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-07. [2025-10-28T19:47:18.444810] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-06 (2.46 seconds). [2025-10-28T19:47:19.180254] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-07. [2025-10-28T19:47:19.578536] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-10 (2.00 seconds). [2025-10-28T19:47:19.585274] [INFO ] [REMOTE ] LTC: Full fetch complete (43920 records). [2025-10-28T19:47:19.585364] [DEBUG] [VALIDATOR ] LTC: Validating primary data. [2025-10-28T19:47:19.959513] [DEBUG] [VALIDATOR ] LTC: All expected trading days are present. [2025-10-28T19:47:19.959593] [DEBUG] [VALIDATOR ] LTC: Primary data validation passed. [2025-10-28T19:47:19.960409] [INFO ] [MAIN ] LTC: Fetched primary data is valid. [2025-10-28T19:47:19.960570] [DEBUG] [LOCAL ] LTC: Saving primary data. [2025-10-28T19:47:19.961605] [DEBUG] [LOCAL ] LTC: Trimmed 43920 records to 30479 (keeping 200 days of data) [2025-10-28T19:47:20.013279] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-04. [2025-10-28T19:47:20.177999] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-28T19:47:20.191467] [DEBUG] [LOCAL ] LTC: Primary data saved (30479 records). [2025-10-28T19:47:20.192052] [INFO ] [MAIN ] LTC: Full history saved. [2025-10-28T19:47:20.192163] [INFO ] [MAIN ] Update Progress: 1276/2366 symbols completed. LTC took 32.8s. Estimated remaining: 2h 22m 54s. Rate: 7.6 symbols/min [2025-10-28T19:47:20.427414] [INFO ] [MAIN ] LUCK: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:47:20.430152] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-10-28T19:47:20.461666] [DEBUG] [LOCAL ] LUCK: Loaded 23228 existing records from primary storage. [2025-10-28T19:47:20.462005] [INFO ] [MAIN ] LUCK: Loaded 23228 existing records. [2025-10-28T19:47:20.639681] [WARN ] [MAIN ] LUCK: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:47:20.639888] [INFO ] [MAIN ] LUCK: Wiping existing primary data before full refresh. [2025-10-28T19:47:20.639935] [INFO ] [LOCAL ] LUCK: Starting deletion of primary data. [2025-10-28T19:47:20.640111] [DEBUG] [LOCAL ] LUCK: Deleted primary data file. [2025-10-28T19:47:20.640149] [INFO ] [MAIN ] LUCK: Starting full primary refresh. [2025-10-28T19:47:20.789551] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-08. [2025-10-28T19:47:20.999515] [INFO ] [REMOTE ] LUCK: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:47:21.206559] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-10-28T19:47:21.580258] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-01. [2025-10-28T19:47:22.130983] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-28T19:47:22.380258] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-09. [2025-10-28T19:47:22.578328] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-28T19:47:23.180268] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-08. [2025-10-28T19:47:23.653465] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-10-28T19:47:23.980253] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-02. [2025-10-28T19:47:24.219227] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-28T19:47:24.780368] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-10. [2025-10-28T19:47:25.580294] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-09. [2025-10-28T19:47:26.209260] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-10 (1.43 seconds). [2025-10-28T19:47:26.219352] [INFO ] [REMOTE ] LTH: Full fetch complete (74735 records). [2025-10-28T19:47:26.219475] [DEBUG] [VALIDATOR ] LTH: Validating primary data. [2025-10-28T19:47:26.390367] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-05. [2025-10-28T19:47:26.608057] [DEBUG] [VALIDATOR ] LTH: All expected trading days are present. [2025-10-28T19:47:26.608131] [DEBUG] [VALIDATOR ] LTH: Primary data validation passed. [2025-10-28T19:47:26.609166] [INFO ] [MAIN ] LTH: Fetched primary data is valid. [2025-10-28T19:47:26.609226] [DEBUG] [LOCAL ] LTH: Saving primary data. [2025-10-28T19:47:26.610574] [DEBUG] [LOCAL ] LTH: Trimmed 74735 records to 51532 (keeping 200 days of data) [2025-10-28T19:47:26.841617] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-10-28T19:47:26.949513] [DEBUG] [LOCAL ] LTH: Primary data saved (51532 records). [2025-10-28T19:47:26.949679] [INFO ] [MAIN ] LTH: Full history saved. [2025-10-28T19:47:26.949785] [INFO ] [MAIN ] Update Progress: 1277/2366 symbols completed. LTH took 27.2s. Estimated remaining: 2h 22m 45s. Rate: 7.6 symbols/min [2025-10-28T19:47:27.040190] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-02 (3.06 seconds). [2025-10-28T19:47:27.180238] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-10. [2025-10-28T19:47:27.644894] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-28T19:47:27.980237] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-06. [2025-10-28T19:47:28.780330] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-03. [2025-10-28T19:47:29.055775] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-10-28T19:47:29.580295] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-07. [2025-10-28T19:47:29.808951] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-10-28T19:47:30.380342] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-04. [2025-10-28T19:47:30.807746] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-10-28T19:47:31.180224] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-08. [2025-10-28T19:47:31.250694] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-10-28T19:47:31.435467] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-10 (4.26 seconds). [2025-10-28T19:47:31.445088] [INFO ] [REMOTE ] LTM: Full fetch complete (51916 records). [2025-10-28T19:47:31.445218] [DEBUG] [VALIDATOR ] LTM: Validating primary data. [2025-10-28T19:47:31.856619] [DEBUG] [VALIDATOR ] LTM: All expected trading days are present. [2025-10-28T19:47:31.856874] [DEBUG] [VALIDATOR ] LTM: Primary data validation passed. [2025-10-28T19:47:31.857772] [INFO ] [MAIN ] LTM: Fetched primary data is valid. [2025-10-28T19:47:31.857834] [DEBUG] [LOCAL ] LTM: Saving primary data. [2025-10-28T19:47:31.858940] [DEBUG] [LOCAL ] LTM: Trimmed 51916 records to 39530 (keeping 200 days of data) [2025-10-28T19:47:32.016797] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-05. [2025-10-28T19:47:32.086301] [DEBUG] [LOCAL ] LTM: Primary data saved (39530 records). [2025-10-28T19:47:32.086431] [INFO ] [MAIN ] LTM: Full history saved. [2025-10-28T19:47:32.086788] [INFO ] [MAIN ] Update Progress: 1278/2366 symbols completed. LTM took 30.8s. Estimated remaining: 2h 22m 35s. Rate: 7.6 symbols/min [2025-10-28T19:47:32.946975] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-28T19:47:32.956677] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-06. [2025-10-28T19:47:33.806711] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-10-28T19:47:33.813554] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-07. [2025-10-28T19:47:34.595063] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-10-28T19:47:34.601158] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-08. [2025-10-28T19:47:35.221931] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-10-28T19:47:35.226819] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-09. [2025-10-28T19:47:35.950387] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-10-28T19:47:35.980340] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-10. [2025-10-28T19:47:36.829460] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-28T19:47:36.835041] [INFO ] [REMOTE ] LUCK: Full fetch complete (38651 records). [2025-10-28T19:47:36.835169] [DEBUG] [VALIDATOR ] LUCK: Validating primary data. [2025-10-28T19:47:37.046775] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-08 (5.87 seconds). [2025-10-28T19:47:37.144498] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-09. [2025-10-28T19:47:37.264381] [DEBUG] [VALIDATOR ] LUCK: All expected trading days are present. [2025-10-28T19:47:37.264464] [DEBUG] [VALIDATOR ] LUCK: Primary data validation passed. [2025-10-28T19:47:37.265360] [INFO ] [MAIN ] LUCK: Fetched primary data is valid. [2025-10-28T19:47:37.265422] [DEBUG] [LOCAL ] LUCK: Saving primary data. [2025-10-28T19:47:37.266364] [DEBUG] [LOCAL ] LUCK: Trimmed 38651 records to 23109 (keeping 200 days of data) [2025-10-28T19:47:37.402503] [DEBUG] [LOCAL ] LUCK: Primary data saved (23109 records). [2025-10-28T19:47:37.402635] [INFO ] [MAIN ] LUCK: Full history saved. [2025-10-28T19:47:37.402758] [INFO ] [MAIN ] Update Progress: 1279/2366 symbols completed. LUCK took 17.2s. Estimated remaining: 2h 22m 25s. Rate: 7.6 symbols/min [2025-10-28T19:47:38.470824] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-10-28T19:47:38.481599] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-10. [2025-10-28T19:47:39.805193] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-10 (1.32 seconds). [2025-10-28T19:47:39.815570] [INFO ] [REMOTE ] LU: Full fetch complete (71049 records). [2025-10-28T19:47:39.815734] [DEBUG] [VALIDATOR ] LU: Validating primary data. [2025-10-28T19:47:40.230145] [DEBUG] [VALIDATOR ] LU: All expected trading days are present. [2025-10-28T19:47:40.230223] [DEBUG] [VALIDATOR ] LU: Primary data validation passed. [2025-10-28T19:47:40.231316] [INFO ] [MAIN ] LU: Fetched primary data is valid. [2025-10-28T19:47:40.231386] [DEBUG] [LOCAL ] LU: Saving primary data. [2025-10-28T19:47:40.232770] [DEBUG] [LOCAL ] LU: Trimmed 71049 records to 49221 (keeping 200 days of data) [2025-10-28T19:47:40.497734] [DEBUG] [LOCAL ] LU: Primary data saved (49221 records). [2025-10-28T19:47:40.497861] [INFO ] [MAIN ] LU: Full history saved. [2025-10-28T19:47:40.498490] [INFO ] [MAIN ] Update Progress: 1280/2366 symbols completed. LU took 34.6s. Estimated remaining: 2h 22m 13s. Rate: 7.6 symbols/min [2025-10-28T19:47:41.085839] [INFO ] [MAIN ] LUMN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:47:41.077453] [INFO ] [MAIN ] LUXE: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:47:41.133321] [DEBUG] [LOCAL ] LUXE: No existing data file found in primary storage. [2025-10-28T19:47:41.145894] [WARN ] [MAIN ] LUXE: No existing data found, performing full refresh instead. [2025-10-28T19:47:41.211041] [INFO ] [MAIN ] LUV: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:47:41.229887] [INFO ] [MAIN ] LUXE: Wiping existing primary data before full refresh. [2025-10-28T19:47:41.229520] [INFO ] [MAIN ] LVS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:47:41.230185] [INFO ] [LOCAL ] LUXE: Starting deletion of primary data. [2025-10-28T19:47:41.230940] [DEBUG] [LOCAL ] LUXE: No primary data file found to delete. [2025-10-28T19:47:41.230998] [INFO ] [MAIN ] LUXE: Starting full primary refresh. [2025-10-28T19:47:41.508092] [DEBUG] [LOCAL ] LUMN: Loaded 53646 existing records from primary storage. [2025-10-28T19:47:41.534170] [INFO ] [MAIN ] LUMN: Loaded 53646 existing records. [2025-10-28T19:47:41.660702] [DEBUG] [LOCAL ] LUV: Loaded 53689 existing records from primary storage. [2025-10-28T19:47:41.644870] [DEBUG] [LOCAL ] LVS: Loaded 53569 existing records from primary storage. [2025-10-28T19:47:41.669826] [INFO ] [MAIN ] LUV: Loaded 53689 existing records. [2025-10-28T19:47:41.689422] [INFO ] [MAIN ] LVS: Loaded 53569 existing records. [2025-10-28T19:47:42.050540] [INFO ] [REMOTE ] LUXE: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:47:42.074847] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-01. [2025-10-28T19:47:42.159000] [WARN ] [MAIN ] LUMN: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:47:42.248439] [INFO ] [MAIN ] LUMN: Wiping existing primary data before full refresh. [2025-10-28T19:47:42.276869] [WARN ] [MAIN ] LVS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:47:42.280756] [INFO ] [LOCAL ] LUMN: Starting deletion of primary data. [2025-10-28T19:47:42.280627] [DEBUG] [REMOTE ] LUXE: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-10-28T19:47:42.280937] [INFO ] [MAIN ] LVS: Wiping existing primary data before full refresh. [2025-10-28T19:47:42.285889] [INFO ] [LOCAL ] LVS: Starting deletion of primary data. [2025-10-28T19:47:42.285587] [WARN ] [MAIN ] LUV: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:47:42.286202] [INFO ] [MAIN ] LUV: Wiping existing primary data before full refresh. [2025-10-28T19:47:42.286384] [DEBUG] [LOCAL ] LVS: Deleted primary data file. [2025-10-28T19:47:42.286274] [DEBUG] [LOCAL ] LUMN: Deleted primary data file. [2025-10-28T19:47:42.285710] [WARN ] [REMOTE ] LUXE: No data returned for month 2025-01 [2025-10-28T19:47:42.286614] [INFO ] [MAIN ] LUMN: Starting full primary refresh. [2025-10-28T19:47:42.286354] [INFO ] [LOCAL ] LUV: Starting deletion of primary data. [2025-10-28T19:47:42.286518] [INFO ] [MAIN ] LVS: Starting full primary refresh. [2025-10-28T19:47:42.286791] [FATAL] [REMOTE ] LUXE: API call failed - aborting fetch to avoid wasting further API calls [2025-10-28T19:47:42.327573] [FATAL] [MAIN ] LUXE: Failed to fetch primary data. [2025-10-28T19:47:42.366112] [WARN ] [MAIN ] LUXE: Deleting existing primary and derivative data due to fetch failure. [2025-10-28T19:47:42.303354] [DEBUG] [LOCAL ] LUV: Deleted primary data file. [2025-10-28T19:47:42.421187] [INFO ] [LOCAL ] LUXE: Starting deletion of primary data. [2025-10-28T19:47:42.421068] [INFO ] [MAIN ] LUV: Starting full primary refresh. [2025-10-28T19:47:42.462599] [DEBUG] [LOCAL ] LUXE: No primary data file found to delete. [2025-10-28T19:47:42.508302] [INFO ] [LOCAL ] LUXE: Starting deletion of derivative data. [2025-10-28T19:47:42.535418] [DEBUG] [LOCAL ] LUXE: No derivative data file found to delete. [2025-10-28T19:47:42.606367] [INFO ] [MAIN ] Update Progress: 1281/2366 symbols completed. LUXE took 2.1s. Estimated remaining: 2h 22m 0s. Rate: 7.6 symbols/min [2025-10-28T19:47:43.359529] [INFO ] [MAIN ] LVWR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:47:43.513710] [INFO ] [REMOTE ] LUMN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:47:43.617509] [INFO ] [REMOTE ] LVS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:47:43.628828] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-01. [2025-10-28T19:47:43.628479] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-01. [2025-10-28T19:47:43.697684] [DEBUG] [LOCAL ] LVWR: Loaded 18668 existing records from primary storage. [2025-10-28T19:47:43.696709] [INFO ] [REMOTE ] LUV: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:47:43.697990] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-01. [2025-10-28T19:47:43.698901] [INFO ] [MAIN ] LVWR: Loaded 18668 existing records. [2025-10-28T19:47:43.876980] [WARN ] [MAIN ] LVWR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:47:43.877231] [INFO ] [MAIN ] LVWR: Wiping existing primary data before full refresh. [2025-10-28T19:47:43.877279] [INFO ] [LOCAL ] LVWR: Starting deletion of primary data. [2025-10-28T19:47:43.877508] [DEBUG] [LOCAL ] LVWR: Deleted primary data file. [2025-10-28T19:47:43.877585] [INFO ] [MAIN ] LVWR: Starting full primary refresh. [2025-10-28T19:47:44.229128] [INFO ] [REMOTE ] LVWR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:47:44.229425] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-01. [2025-10-28T19:47:44.634273] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-10-28T19:47:44.636127] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-02. [2025-10-28T19:47:45.036860] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-10-28T19:47:45.047611] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-02. [2025-10-28T19:47:45.178197] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-10-28T19:47:45.181305] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-03. [2025-10-28T19:47:45.184424] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-10-28T19:47:45.198556] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-02. [2025-10-28T19:47:45.557090] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-10-28T19:47:45.580209] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-04. [2025-10-28T19:47:45.987137] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-10-28T19:47:46.380220] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-05. [2025-10-28T19:47:46.447814] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-10-28T19:47:46.590868] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-10-28T19:47:47.131836] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-10-28T19:47:47.180259] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-03. [2025-10-28T19:47:47.980253] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-03. [2025-10-28T19:47:48.668374] [DEBUG] [REMOTE ] LUMN: Error fetching primary data for 2025-01: ("Connection broken: InvalidChunkLength(got length b'', 0 bytes read)", InvalidChunkLength(got length b'', 0 bytes read)) [2025-10-28T19:47:48.668578] [WARN ] [REMOTE ] LUMN: No data returned for month 2025-01 [2025-10-28T19:47:48.668691] [FATAL] [REMOTE ] LUMN: API call failed - aborting fetch to avoid wasting further API calls [2025-10-28T19:47:48.668738] [FATAL] [MAIN ] LUMN: Failed to fetch primary data. [2025-10-28T19:47:48.668770] [WARN ] [MAIN ] LUMN: Deleting existing primary and derivative data due to fetch failure. [2025-10-28T19:47:48.668835] [INFO ] [LOCAL ] LUMN: Starting deletion of primary data. [2025-10-28T19:47:48.668902] [DEBUG] [LOCAL ] LUMN: No primary data file found to delete. [2025-10-28T19:47:48.668935] [INFO ] [LOCAL ] LUMN: Starting deletion of derivative data. [2025-10-28T19:47:48.669161] [DEBUG] [LOCAL ] LUMN: Deleted derivative data file. [2025-10-28T19:47:48.669232] [INFO ] [MAIN ] Update Progress: 1282/2366 symbols completed. LUMN took 8.2s. Estimated remaining: 2h 21m 51s. Rate: 7.6 symbols/min [2025-10-28T19:47:48.790375] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-06. [2025-10-28T19:47:48.852133] [INFO ] [MAIN ] LW: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:47:48.886993] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-10-28T19:47:48.940787] [DEBUG] [LOCAL ] LW: Loaded 51116 existing records from primary storage. [2025-10-28T19:47:48.941150] [INFO ] [MAIN ] LW: Loaded 51116 existing records. [2025-10-28T19:47:49.117590] [WARN ] [MAIN ] LW: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:47:49.117905] [INFO ] [MAIN ] LW: Wiping existing primary data before full refresh. [2025-10-28T19:47:49.117952] [INFO ] [LOCAL ] LW: Starting deletion of primary data. [2025-10-28T19:47:49.118323] [DEBUG] [LOCAL ] LW: Deleted primary data file. [2025-10-28T19:47:49.118380] [INFO ] [MAIN ] LW: Starting full primary refresh. [2025-10-28T19:47:49.477693] [INFO ] [REMOTE ] LW: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:47:49.580261] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-04. [2025-10-28T19:47:50.380319] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-01. [2025-10-28T19:47:51.004204] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-10-28T19:47:51.180318] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-05. [2025-10-28T19:47:51.687125] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-10-28T19:47:51.980244] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-02. [2025-10-28T19:47:52.692959] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-10-28T19:47:52.780220] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-06. [2025-10-28T19:47:52.957994] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-10-28T19:47:53.580236] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-03. [2025-10-28T19:47:54.105570] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-10-28T19:47:54.380302] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-07. [2025-10-28T19:47:54.881546] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-10-28T19:47:55.180226] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-04. [2025-10-28T19:47:55.846078] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-28T19:47:55.980349] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-08. [2025-10-28T19:47:56.460187] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-28T19:47:56.780303] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-05. [2025-10-28T19:47:57.947762] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-10-28T19:47:57.958858] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-06. [2025-10-28T19:47:59.034794] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-03 (11.05 seconds). [2025-10-28T19:47:59.046237] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-04. [2025-10-28T19:47:59.128326] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-10-28T19:47:59.180233] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-07. [2025-10-28T19:48:00.374383] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-28T19:48:00.385724] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-05. [2025-10-28T19:48:00.885350] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-10-28T19:48:00.896853] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-08. [2025-10-28T19:48:02.108301] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-10-28T19:48:02.120947] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-06. [2025-10-28T19:48:02.170495] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-06 (13.38 seconds). [2025-10-28T19:48:02.387936] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-07. [2025-10-28T19:48:02.420763] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-10-28T19:48:03.187952] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-09. [2025-10-28T19:48:03.192235] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-10-28T19:48:03.980324] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-08. [2025-10-28T19:48:04.419247] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-10-28T19:48:04.548820] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-10-28T19:48:04.780324] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-10. [2025-10-28T19:48:05.580293] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-09. [2025-10-28T19:48:06.267545] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-28T19:48:06.316309] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-28T19:48:06.327814] [INFO ] [REMOTE ] LW: Full fetch complete (74726 records). [2025-10-28T19:48:06.328025] [DEBUG] [VALIDATOR ] LW: Validating primary data. [2025-10-28T19:48:06.391792] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-10. [2025-10-28T19:48:06.750751] [DEBUG] [VALIDATOR ] LW: All expected trading days are present. [2025-10-28T19:48:06.750840] [DEBUG] [VALIDATOR ] LW: Primary data validation passed. [2025-10-28T19:48:06.751922] [INFO ] [MAIN ] LW: Fetched primary data is valid. [2025-10-28T19:48:06.751984] [DEBUG] [LOCAL ] LW: Saving primary data. [2025-10-28T19:48:06.753366] [DEBUG] [LOCAL ] LW: Trimmed 74726 records to 51101 (keeping 200 days of data) [2025-10-28T19:48:07.057915] [DEBUG] [LOCAL ] LW: Primary data saved (51101 records). [2025-10-28T19:48:07.058180] [INFO ] [MAIN ] LW: Full history saved. [2025-10-28T19:48:07.058281] [INFO ] [MAIN ] Update Progress: 1283/2366 symbols completed. LW took 18.4s. Estimated remaining: 2h 21m 52s. Rate: 7.6 symbols/min [2025-10-28T19:48:07.179803] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-10 (0.79 seconds). [2025-10-28T19:48:07.225352] [INFO ] [REMOTE ] LVWR: Full fetch complete (20844 records). [2025-10-28T19:48:07.241176] [DEBUG] [VALIDATOR ] LVWR: Validating primary data. [2025-10-28T19:48:07.244762] [INFO ] [MAIN ] LXFR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:48:07.421864] [DEBUG] [LOCAL ] LXFR: Loaded 16176 existing records from primary storage. [2025-10-28T19:48:07.439537] [INFO ] [MAIN ] LXFR: Loaded 16176 existing records. [2025-10-28T19:48:07.785873] [DEBUG] [VALIDATOR ] LVWR: All expected trading days are present. [2025-10-28T19:48:07.814594] [DEBUG] [VALIDATOR ] LVWR: Primary data validation passed. [2025-10-28T19:48:07.825011] [INFO ] [MAIN ] LVWR: Fetched primary data is valid. [2025-10-28T19:48:07.846144] [DEBUG] [LOCAL ] LVWR: Saving primary data. [2025-10-28T19:48:07.846071] [WARN ] [MAIN ] LXFR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:48:07.846906] [INFO ] [MAIN ] LXFR: Wiping existing primary data before full refresh. [2025-10-28T19:48:07.847693] [INFO ] [LOCAL ] LXFR: Starting deletion of primary data. [2025-10-28T19:48:07.847908] [DEBUG] [LOCAL ] LVWR: Trimmed 20844 records to 18684 (keeping 200 days of data) [2025-10-28T19:48:07.848227] [DEBUG] [LOCAL ] LXFR: Deleted primary data file. [2025-10-28T19:48:07.848342] [INFO ] [MAIN ] LXFR: Starting full primary refresh. [2025-10-28T19:48:08.086076] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-08 (12.11 seconds). [2025-10-28T19:48:08.140041] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-09. [2025-10-28T19:48:08.300094] [DEBUG] [LOCAL ] LVWR: Primary data saved (18684 records). [2025-10-28T19:48:08.300504] [INFO ] [MAIN ] LVWR: Full history saved. [2025-10-28T19:48:08.306013] [INFO ] [MAIN ] Update Progress: 1284/2366 symbols completed. LVWR took 25.6s. Estimated remaining: 2h 21m 39s. Rate: 7.6 symbols/min [2025-10-28T19:48:08.441124] [INFO ] [REMOTE ] LXFR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:48:08.453109] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-01. [2025-10-28T19:48:08.550994] [INFO ] [MAIN ] LXP: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:48:08.597539] [DEBUG] [LOCAL ] LXP: Loaded 50671 existing records from primary storage. [2025-10-28T19:48:08.597871] [INFO ] [MAIN ] LXP: Loaded 50671 existing records. [2025-10-28T19:48:08.775439] [WARN ] [MAIN ] LXP: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:48:08.775715] [INFO ] [MAIN ] LXP: Wiping existing primary data before full refresh. [2025-10-28T19:48:08.775773] [INFO ] [LOCAL ] LXP: Starting deletion of primary data. [2025-10-28T19:48:08.775988] [DEBUG] [LOCAL ] LXP: Deleted primary data file. [2025-10-28T19:48:08.776051] [INFO ] [MAIN ] LXP: Starting full primary refresh. [2025-10-28T19:48:09.132151] [INFO ] [REMOTE ] LXP: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:48:09.132672] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-01. [2025-10-28T19:48:09.169707] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-28T19:48:09.580242] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-02. [2025-10-28T19:48:09.770580] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-10-28T19:48:10.235009] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-10-28T19:48:10.380228] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-03. [2025-10-28T19:48:10.454133] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-10-28T19:48:11.090314] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-10-28T19:48:11.180260] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-04. [2025-10-28T19:48:11.948148] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-10-28T19:48:11.980223] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-05. [2025-10-28T19:48:12.632553] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-10-28T19:48:12.742368] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-06 (10.62 seconds). [2025-10-28T19:48:12.780246] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-02. [2025-10-28T19:48:13.580249] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-07. [2025-10-28T19:48:13.971231] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-10-28T19:48:14.380307] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-10. [2025-10-28T19:48:14.938596] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-10-28T19:48:15.180298] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-03. [2025-10-28T19:48:15.980563] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-08. [2025-10-28T19:48:16.236186] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-10 (1.86 seconds). [2025-10-28T19:48:16.247384] [INFO ] [REMOTE ] LUV: Full fetch complete (77865 records). [2025-10-28T19:48:16.247572] [DEBUG] [VALIDATOR ] LUV: Validating primary data. [2025-10-28T19:48:16.525372] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-10-28T19:48:16.701549] [DEBUG] [VALIDATOR ] LUV: All expected trading days are present. [2025-10-28T19:48:16.701628] [DEBUG] [VALIDATOR ] LUV: Primary data validation passed. [2025-10-28T19:48:16.702771] [INFO ] [MAIN ] LUV: Fetched primary data is valid. [2025-10-28T19:48:16.702834] [DEBUG] [LOCAL ] LUV: Saving primary data. [2025-10-28T19:48:16.704328] [DEBUG] [LOCAL ] LUV: Trimmed 77865 records to 53689 (keeping 200 days of data) [2025-10-28T19:48:16.791668] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-06. [2025-10-28T19:48:17.034182] [DEBUG] [LOCAL ] LUV: Primary data saved (53689 records). [2025-10-28T19:48:17.034306] [INFO ] [MAIN ] LUV: Full history saved. [2025-10-28T19:48:17.034382] [INFO ] [MAIN ] Update Progress: 1285/2366 symbols completed. LUV took 36.5s. Estimated remaining: 2h 21m 32s. Rate: 7.6 symbols/min [2025-10-28T19:48:17.202704] [INFO ] [MAIN ] LXU: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:48:17.231705] [DEBUG] [LOCAL ] LXU: Loaded 31131 existing records from primary storage. [2025-10-28T19:48:17.231964] [INFO ] [MAIN ] LXU: Loaded 31131 existing records. [2025-10-28T19:48:17.416893] [WARN ] [MAIN ] LXU: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:48:17.417106] [INFO ] [MAIN ] LXU: Wiping existing primary data before full refresh. [2025-10-28T19:48:17.417224] [INFO ] [LOCAL ] LXU: Starting deletion of primary data. [2025-10-28T19:48:17.417417] [DEBUG] [LOCAL ] LXU: Deleted primary data file. [2025-10-28T19:48:17.417458] [INFO ] [MAIN ] LXU: Starting full primary refresh. [2025-10-28T19:48:17.536848] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-10-28T19:48:17.586161] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-04. [2025-10-28T19:48:17.795926] [INFO ] [REMOTE ] LXU: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:48:18.380274] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-01. [2025-10-28T19:48:19.064403] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-28T19:48:19.180247] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-05. [2025-10-28T19:48:19.348462] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-28T19:48:19.980328] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-07. [2025-10-28T19:48:20.461218] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-28T19:48:20.685695] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-10-28T19:48:20.780261] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-08. [2025-10-28T19:48:21.459841] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-10-28T19:48:21.580318] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-06. [2025-10-28T19:48:22.380250] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-09. [2025-10-28T19:48:22.818205] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-10-28T19:48:23.066103] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-28T19:48:23.180304] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-07. [2025-10-28T19:48:23.398944] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-08 (7.42 seconds). [2025-10-28T19:48:23.980290] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-10. [2025-10-28T19:48:24.435234] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-28T19:48:24.746424] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-10 (0.77 seconds). [2025-10-28T19:48:24.750183] [INFO ] [REMOTE ] LXFR: Full fetch complete (24641 records). [2025-10-28T19:48:24.750290] [DEBUG] [VALIDATOR ] LXFR: Validating primary data. [2025-10-28T19:48:24.785368] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-02. [2025-10-28T19:48:25.122921] [DEBUG] [VALIDATOR ] LXFR: All expected trading days are present. [2025-10-28T19:48:25.123001] [DEBUG] [VALIDATOR ] LXFR: Primary data validation passed. [2025-10-28T19:48:25.123561] [INFO ] [MAIN ] LXFR: Fetched primary data is valid. [2025-10-28T19:48:25.123601] [DEBUG] [LOCAL ] LXFR: Saving primary data. [2025-10-28T19:48:25.124265] [DEBUG] [LOCAL ] LXFR: Trimmed 24641 records to 16103 (keeping 200 days of data) [2025-10-28T19:48:25.219882] [DEBUG] [LOCAL ] LXFR: Primary data saved (16103 records). [2025-10-28T19:48:25.220004] [INFO ] [MAIN ] LXFR: Full history saved. [2025-10-28T19:48:25.220079] [INFO ] [MAIN ] Update Progress: 1286/2366 symbols completed. LXFR took 18.2s. Estimated remaining: 2h 21m 24s. Rate: 7.6 symbols/min [2025-10-28T19:48:25.398415] [INFO ] [MAIN ] LYB: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:48:25.446871] [DEBUG] [LOCAL ] LYB: Loaded 53621 existing records from primary storage. [2025-10-28T19:48:25.447166] [INFO ] [MAIN ] LYB: Loaded 53621 existing records. [2025-10-28T19:48:25.587731] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-08. [2025-10-28T19:48:25.628676] [WARN ] [MAIN ] LYB: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:48:25.629057] [INFO ] [MAIN ] LYB: Wiping existing primary data before full refresh. [2025-10-28T19:48:25.629160] [INFO ] [LOCAL ] LYB: Starting deletion of primary data. [2025-10-28T19:48:25.629958] [DEBUG] [LOCAL ] LYB: Deleted primary data file. [2025-10-28T19:48:25.630034] [INFO ] [MAIN ] LYB: Starting full primary refresh. [2025-10-28T19:48:25.745338] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-28T19:48:25.997221] [INFO ] [REMOTE ] LYB: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:48:26.380219] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-03. [2025-10-28T19:48:27.180231] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-09. [2025-10-28T19:48:27.257963] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-10-28T19:48:27.980265] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-04. [2025-10-28T19:48:28.416974] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-10-28T19:48:28.780261] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-10. [2025-10-28T19:48:29.194804] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-10-28T19:48:29.580262] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-01. [2025-10-28T19:48:30.305104] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-10 (1.52 seconds). [2025-10-28T19:48:30.316337] [INFO ] [REMOTE ] LVS: Full fetch complete (77728 records). [2025-10-28T19:48:30.316471] [DEBUG] [VALIDATOR ] LVS: Validating primary data. [2025-10-28T19:48:30.385675] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-05. [2025-10-28T19:48:30.715454] [DEBUG] [VALIDATOR ] LVS: All expected trading days are present. [2025-10-28T19:48:30.715546] [DEBUG] [VALIDATOR ] LVS: Primary data validation passed. [2025-10-28T19:48:30.716633] [INFO ] [MAIN ] LVS: Fetched primary data is valid. [2025-10-28T19:48:30.716713] [DEBUG] [LOCAL ] LVS: Saving primary data. [2025-10-28T19:48:30.718201] [DEBUG] [LOCAL ] LVS: Trimmed 77728 records to 53569 (keeping 200 days of data) [2025-10-28T19:48:31.058100] [DEBUG] [LOCAL ] LVS: Primary data saved (53569 records). [2025-10-28T19:48:31.058344] [INFO ] [MAIN ] LVS: Full history saved. [2025-10-28T19:48:31.058527] [INFO ] [MAIN ] Update Progress: 1287/2366 symbols completed. LVS took 50.5s. Estimated remaining: 2h 21m 14s. Rate: 7.6 symbols/min [2025-10-28T19:48:31.257713] [INFO ] [MAIN ] LYG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:48:31.286219] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-10-28T19:48:31.300563] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-02. [2025-10-28T19:48:31.342855] [DEBUG] [LOCAL ] LYG: Loaded 52640 existing records from primary storage. [2025-10-28T19:48:31.343156] [INFO ] [MAIN ] LYG: Loaded 52640 existing records. [2025-10-28T19:48:31.535802] [WARN ] [MAIN ] LYG: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:48:31.536216] [INFO ] [MAIN ] LYG: Wiping existing primary data before full refresh. [2025-10-28T19:48:31.536379] [INFO ] [LOCAL ] LYG: Starting deletion of primary data. [2025-10-28T19:48:31.542879] [DEBUG] [LOCAL ] LYG: Deleted primary data file. [2025-10-28T19:48:31.554181] [INFO ] [MAIN ] LYG: Starting full primary refresh. [2025-10-28T19:48:31.612691] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-28T19:48:31.928123] [INFO ] [REMOTE ] LYG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:48:31.980267] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-01. [2025-10-28T19:48:32.401775] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-10-28T19:48:32.780286] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-03. [2025-10-28T19:48:33.413095] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-10-28T19:48:33.580260] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-06. [2025-10-28T19:48:34.101967] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-10-28T19:48:34.380300] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-02. [2025-10-28T19:48:34.518222] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-10-28T19:48:34.816584] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-08 (9.23 seconds). [2025-10-28T19:48:35.180306] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-09. [2025-10-28T19:48:35.730667] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-10-28T19:48:35.980284] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-03. [2025-10-28T19:48:36.780320] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-07. [2025-10-28T19:48:37.437868] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-10-28T19:48:37.580242] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-04. [2025-10-28T19:48:37.762149] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-28T19:48:38.380302] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-08. [2025-10-28T19:48:38.918509] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-10-28T19:48:39.180267] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-04. [2025-10-28T19:48:39.287320] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-10-28T19:48:39.980244] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-05. [2025-10-28T19:48:40.655631] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-10-28T19:48:40.780267] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-05. [2025-10-28T19:48:41.309034] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-10-28T19:48:41.580245] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-06. [2025-10-28T19:48:41.781763] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-09 (6.60 seconds). [2025-10-28T19:48:42.119024] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-10-28T19:48:42.380247] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-10. [2025-10-28T19:48:43.144195] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-28T19:48:43.180229] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-07. [2025-10-28T19:48:43.739761] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-10 (1.36 seconds). [2025-10-28T19:48:43.750547] [INFO ] [REMOTE ] LXP: Full fetch complete (72830 records). [2025-10-28T19:48:43.750771] [DEBUG] [VALIDATOR ] LXP: Validating primary data. [2025-10-28T19:48:43.986141] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-09. [2025-10-28T19:48:44.181759] [DEBUG] [VALIDATOR ] LXP: All expected trading days are present. [2025-10-28T19:48:44.181848] [DEBUG] [VALIDATOR ] LXP: Primary data validation passed. [2025-10-28T19:48:44.183100] [INFO ] [MAIN ] LXP: Fetched primary data is valid. [2025-10-28T19:48:44.183166] [DEBUG] [LOCAL ] LXP: Saving primary data. [2025-10-28T19:48:44.184707] [DEBUG] [LOCAL ] LXP: Trimmed 72830 records to 50647 (keeping 200 days of data) [2025-10-28T19:48:44.487743] [DEBUG] [LOCAL ] LXP: Primary data saved (50647 records). [2025-10-28T19:48:44.487921] [INFO ] [MAIN ] LXP: Full history saved. [2025-10-28T19:48:44.488026] [INFO ] [MAIN ] Update Progress: 1288/2366 symbols completed. LXP took 36.2s. Estimated remaining: 2h 21m 11s. Rate: 7.6 symbols/min [2025-10-28T19:48:44.638687] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-10-28T19:48:44.715373] [INFO ] [MAIN ] LYV: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:48:44.763704] [DEBUG] [LOCAL ] LYV: Loaded 50904 existing records from primary storage. [2025-10-28T19:48:44.764051] [INFO ] [MAIN ] LYV: Loaded 50904 existing records. [2025-10-28T19:48:44.785339] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-08. [2025-10-28T19:48:44.907499] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-28T19:48:45.005723] [WARN ] [MAIN ] LYV: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:48:45.006274] [INFO ] [MAIN ] LYV: Wiping existing primary data before full refresh. [2025-10-28T19:48:45.006475] [INFO ] [LOCAL ] LYV: Starting deletion of primary data. [2025-10-28T19:48:45.007335] [DEBUG] [LOCAL ] LYV: Deleted primary data file. [2025-10-28T19:48:45.007397] [INFO ] [MAIN ] LYV: Starting full primary refresh. [2025-10-28T19:48:45.371404] [INFO ] [REMOTE ] LYV: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:48:45.580264] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-06. [2025-10-28T19:48:46.311305] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-28T19:48:46.380247] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-01. [2025-10-28T19:48:46.916494] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-10-28T19:48:47.180246] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-07. [2025-10-28T19:48:47.917721] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-10-28T19:48:47.980220] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-02. [2025-10-28T19:48:48.661121] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-10-28T19:48:48.780262] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-10. [2025-10-28T19:48:49.251774] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-28T19:48:49.580230] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-08. [2025-10-28T19:48:49.731769] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-10 (0.95 seconds). [2025-10-28T19:48:49.737720] [INFO ] [REMOTE ] LXU: Full fetch complete (45223 records). [2025-10-28T19:48:49.737822] [DEBUG] [VALIDATOR ] LXU: Validating primary data. [2025-10-28T19:48:50.133084] [DEBUG] [VALIDATOR ] LXU: All expected trading days are present. [2025-10-28T19:48:50.133163] [DEBUG] [VALIDATOR ] LXU: Primary data validation passed. [2025-10-28T19:48:50.134071] [INFO ] [MAIN ] LXU: Fetched primary data is valid. [2025-10-28T19:48:50.134141] [DEBUG] [LOCAL ] LXU: Saving primary data. [2025-10-28T19:48:50.135114] [DEBUG] [LOCAL ] LXU: Trimmed 45223 records to 31022 (keeping 200 days of data) [2025-10-28T19:48:50.308320] [DEBUG] [LOCAL ] LXU: Primary data saved (31022 records). [2025-10-28T19:48:50.308458] [INFO ] [MAIN ] LXU: Full history saved. [2025-10-28T19:48:50.308536] [INFO ] [MAIN ] Update Progress: 1289/2366 symbols completed. LXU took 33.3s. Estimated remaining: 2h 21m 2s. Rate: 7.6 symbols/min [2025-10-28T19:48:50.388358] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-03. [2025-10-28T19:48:50.493337] [INFO ] [MAIN ] LZB: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:48:50.525276] [DEBUG] [LOCAL ] LZB: Loaded 34783 existing records from primary storage. [2025-10-28T19:48:50.525587] [INFO ] [MAIN ] LZB: Loaded 34783 existing records. [2025-10-28T19:48:50.714602] [WARN ] [MAIN ] LZB: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:48:50.714809] [INFO ] [MAIN ] LZB: Wiping existing primary data before full refresh. [2025-10-28T19:48:50.714858] [INFO ] [LOCAL ] LZB: Starting deletion of primary data. [2025-10-28T19:48:50.715460] [DEBUG] [LOCAL ] LZB: Deleted primary data file. [2025-10-28T19:48:50.715518] [INFO ] [MAIN ] LZB: Starting full primary refresh. [2025-10-28T19:48:51.079504] [INFO ] [REMOTE ] LZB: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:48:51.110258] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-10-28T19:48:51.180249] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-09. [2025-10-28T19:48:51.769774] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-28T19:48:51.980269] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-04. [2025-10-28T19:48:52.768458] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-10-28T19:48:52.780219] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-10. [2025-10-28T19:48:53.258972] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-28T19:48:53.580225] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-01. [2025-10-28T19:48:54.380213] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-09. [2025-10-28T19:48:54.547155] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-28T19:48:54.612249] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-10 (1.83 seconds). [2025-10-28T19:48:54.623110] [INFO ] [REMOTE ] LYB: Full fetch complete (77641 records). [2025-10-28T19:48:54.623262] [DEBUG] [VALIDATOR ] LYB: Validating primary data. [2025-10-28T19:48:55.022256] [DEBUG] [VALIDATOR ] LYB: All expected trading days are present. [2025-10-28T19:48:55.022345] [DEBUG] [VALIDATOR ] LYB: Primary data validation passed. [2025-10-28T19:48:55.023389] [INFO ] [MAIN ] LYB: Fetched primary data is valid. [2025-10-28T19:48:55.023452] [DEBUG] [LOCAL ] LYB: Saving primary data. [2025-10-28T19:48:55.024906] [DEBUG] [LOCAL ] LYB: Trimmed 77641 records to 53620 (keeping 200 days of data) [2025-10-28T19:48:55.200264] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-02. [2025-10-28T19:48:55.354731] [DEBUG] [LOCAL ] LYB: Primary data saved (53620 records). [2025-10-28T19:48:55.354863] [INFO ] [MAIN ] LYB: Full history saved. [2025-10-28T19:48:55.354938] [INFO ] [MAIN ] Update Progress: 1290/2366 symbols completed. LYB took 30.1s. Estimated remaining: 2h 20m 51s. Rate: 7.6 symbols/min [2025-10-28T19:48:55.535788] [INFO ] [MAIN ] LZM: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:48:55.572011] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-28T19:48:55.594050] [DEBUG] [LOCAL ] LZM: Loaded 14897 existing records from primary storage. [2025-10-28T19:48:55.594293] [INFO ] [MAIN ] LZM: Loaded 14897 existing records. [2025-10-28T19:48:55.770811] [WARN ] [MAIN ] LZM: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:48:55.771014] [INFO ] [MAIN ] LZM: Wiping existing primary data before full refresh. [2025-10-28T19:48:55.771079] [INFO ] [LOCAL ] LZM: Starting deletion of primary data. [2025-10-28T19:48:55.771477] [DEBUG] [LOCAL ] LZM: Deleted primary data file. [2025-10-28T19:48:55.771537] [INFO ] [MAIN ] LZM: Starting full primary refresh. [2025-10-28T19:48:55.990512] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-10. [2025-10-28T19:48:56.129520] [INFO ] [REMOTE ] LZM: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:48:56.189228] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-28T19:48:56.780274] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-05. [2025-10-28T19:48:57.543037] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-10 (1.55 seconds). [2025-10-28T19:48:57.553627] [INFO ] [REMOTE ] LYG: Full fetch complete (76280 records). [2025-10-28T19:48:57.553783] [DEBUG] [VALIDATOR ] LYG: Validating primary data. [2025-10-28T19:48:57.586133] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-01. [2025-10-28T19:48:57.958220] [DEBUG] [VALIDATOR ] LYG: All expected trading days are present. [2025-10-28T19:48:57.958324] [DEBUG] [VALIDATOR ] LYG: Primary data validation passed. [2025-10-28T19:48:57.959568] [INFO ] [MAIN ] LYG: Fetched primary data is valid. [2025-10-28T19:48:57.959664] [DEBUG] [LOCAL ] LYG: Saving primary data. [2025-10-28T19:48:57.961373] [DEBUG] [LOCAL ] LYG: Trimmed 76280 records to 52636 (keeping 200 days of data) [2025-10-28T19:48:58.096240] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-10-28T19:48:58.220050] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-10-28T19:48:58.316136] [DEBUG] [LOCAL ] LYG: Primary data saved (52636 records). [2025-10-28T19:48:58.316264] [INFO ] [MAIN ] LYG: Full history saved. [2025-10-28T19:48:58.317108] [INFO ] [MAIN ] Update Progress: 1291/2366 symbols completed. LYG took 27.3s. Estimated remaining: 2h 20m 40s. Rate: 7.6 symbols/min [2025-10-28T19:48:58.385487] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-03. [2025-10-28T19:48:58.491541] [INFO ] [MAIN ] M: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:48:58.543298] [DEBUG] [LOCAL ] M: Loaded 53543 existing records from primary storage. [2025-10-28T19:48:58.543672] [INFO ] [MAIN ] M: Loaded 53543 existing records. [2025-10-28T19:48:58.726536] [WARN ] [MAIN ] M: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:48:58.726876] [INFO ] [MAIN ] M: Wiping existing primary data before full refresh. [2025-10-28T19:48:58.726932] [INFO ] [LOCAL ] M: Starting deletion of primary data. [2025-10-28T19:48:58.728062] [DEBUG] [LOCAL ] M: Deleted primary data file. [2025-10-28T19:48:58.728122] [INFO ] [MAIN ] M: Starting full primary refresh. [2025-10-28T19:48:59.076069] [INFO ] [REMOTE ] M: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:48:59.180264] [INFO ] [REMOTE ] M: Fetching primary data for 2025-01. [2025-10-28T19:48:59.980264] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-02. [2025-10-28T19:49:00.084839] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-10-28T19:49:00.437131] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-10-28T19:49:00.780312] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-04. [2025-10-28T19:49:01.580296] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-06. [2025-10-28T19:49:01.777184] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-10-28T19:49:02.380247] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-03. [2025-10-28T19:49:02.956394] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-10-28T19:49:03.180258] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-05. [2025-10-28T19:49:03.980225] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-04. [2025-10-28T19:49:04.080677] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-10-28T19:49:04.723093] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-10-28T19:49:04.780222] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-06. [2025-10-28T19:49:05.116733] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-01 (5.94 seconds). [2025-10-28T19:49:05.580252] [INFO ] [REMOTE ] M: Fetching primary data for 2025-02. [2025-10-28T19:49:06.380262] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-05. [2025-10-28T19:49:06.852134] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-28T19:49:06.940414] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-10-28T19:49:07.180254] [INFO ] [REMOTE ] M: Fetching primary data for 2025-03. [2025-10-28T19:49:07.561710] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-06 (5.98 seconds). [2025-10-28T19:49:07.980251] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-07. [2025-10-28T19:49:08.788417] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-06. [2025-10-28T19:49:08.797716] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-10-28T19:49:09.272153] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-28T19:49:09.580276] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-07. [2025-10-28T19:49:09.847694] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-10-28T19:49:10.082717] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-10-28T19:49:10.380260] [INFO ] [REMOTE ] M: Fetching primary data for 2025-04. [2025-10-28T19:49:11.180253] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-08. [2025-10-28T19:49:11.724376] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-10-28T19:49:11.980282] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-08. [2025-10-28T19:49:12.761683] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-06 (7.98 seconds). [2025-10-28T19:49:12.780206] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-07. [2025-10-28T19:49:13.580243] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-09. [2025-10-28T19:49:13.816035] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-10-28T19:49:13.852470] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-10-28T19:49:14.380301] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-08. [2025-10-28T19:49:15.180323] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-09. [2025-10-28T19:49:15.695627] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-10-28T19:49:15.980220] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-09. [2025-10-28T19:49:16.519789] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-09 (2.94 seconds). [2025-10-28T19:49:16.728699] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-10-28T19:49:16.780300] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-10. [2025-10-28T19:49:17.033301] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-28T19:49:17.580230] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-10. [2025-10-28T19:49:17.595490] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-28T19:49:17.600465] [INFO ] [REMOTE ] LZM: Full fetch complete (20249 records). [2025-10-28T19:49:17.600547] [DEBUG] [VALIDATOR ] LZM: Validating primary data. [2025-10-28T19:49:17.808765] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-04 (7.43 seconds). [2025-10-28T19:49:18.027133] [DEBUG] [VALIDATOR ] LZM: All expected trading days are present. [2025-10-28T19:49:18.027213] [DEBUG] [VALIDATOR ] LZM: Primary data validation passed. [2025-10-28T19:49:18.027637] [INFO ] [MAIN ] LZM: Fetched primary data is valid. [2025-10-28T19:49:18.027736] [DEBUG] [LOCAL ] LZM: Saving primary data. [2025-10-28T19:49:18.028347] [DEBUG] [LOCAL ] LZM: Trimmed 20249 records to 14881 (keeping 200 days of data) [2025-10-28T19:49:18.112402] [DEBUG] [LOCAL ] LZM: Primary data saved (14881 records). [2025-10-28T19:49:18.112550] [INFO ] [MAIN ] LZM: Full history saved. [2025-10-28T19:49:18.112630] [INFO ] [MAIN ] Update Progress: 1292/2366 symbols completed. LZM took 22.8s. Estimated remaining: 2h 20m 42s. Rate: 7.6 symbols/min [2025-10-28T19:49:18.292074] [INFO ] [MAIN ] MA: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:49:18.346756] [DEBUG] [LOCAL ] MA: Loaded 52417 existing records from primary storage. [2025-10-28T19:49:18.347121] [INFO ] [MAIN ] MA: Loaded 52417 existing records. [2025-10-28T19:49:18.385444] [INFO ] [REMOTE ] M: Fetching primary data for 2025-05. [2025-10-28T19:49:18.561777] [WARN ] [MAIN ] MA: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:49:18.561968] [INFO ] [MAIN ] MA: Wiping existing primary data before full refresh. [2025-10-28T19:49:18.562016] [INFO ] [LOCAL ] MA: Starting deletion of primary data. [2025-10-28T19:49:18.562201] [DEBUG] [LOCAL ] MA: Deleted primary data file. [2025-10-28T19:49:18.562241] [INFO ] [MAIN ] MA: Starting full primary refresh. [2025-10-28T19:49:18.986269] [INFO ] [REMOTE ] MA: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:49:19.166681] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-10 (1.59 seconds). [2025-10-28T19:49:19.177008] [INFO ] [REMOTE ] LYV: Full fetch complete (74129 records). [2025-10-28T19:49:19.177137] [DEBUG] [VALIDATOR ] LYV: Validating primary data. [2025-10-28T19:49:19.188892] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-10. [2025-10-28T19:49:19.561746] [DEBUG] [VALIDATOR ] LYV: All expected trading days are present. [2025-10-28T19:49:19.561829] [DEBUG] [VALIDATOR ] LYV: Primary data validation passed. [2025-10-28T19:49:19.562868] [INFO ] [MAIN ] LYV: Fetched primary data is valid. [2025-10-28T19:49:19.562930] [DEBUG] [LOCAL ] LYV: Saving primary data. [2025-10-28T19:49:19.564354] [DEBUG] [LOCAL ] LYV: Trimmed 74129 records to 50878 (keeping 200 days of data) [2025-10-28T19:49:19.876791] [DEBUG] [LOCAL ] LYV: Primary data saved (50878 records). [2025-10-28T19:49:19.876950] [INFO ] [MAIN ] LYV: Full history saved. [2025-10-28T19:49:19.877065] [INFO ] [MAIN ] Update Progress: 1293/2366 symbols completed. LYV took 35.4s. Estimated remaining: 2h 20m 29s. Rate: 7.6 symbols/min [2025-10-28T19:49:19.982057] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-01. [2025-10-28T19:49:20.012574] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-10-28T19:49:20.094318] [INFO ] [MAIN ] MAA: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:49:20.134295] [DEBUG] [LOCAL ] MAA: Loaded 42844 existing records from primary storage. [2025-10-28T19:49:20.134575] [INFO ] [MAIN ] MAA: Loaded 42844 existing records. [2025-10-28T19:49:20.313278] [WARN ] [MAIN ] MAA: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:49:20.313483] [INFO ] [MAIN ] MAA: Wiping existing primary data before full refresh. [2025-10-28T19:49:20.313529] [INFO ] [LOCAL ] MAA: Starting deletion of primary data. [2025-10-28T19:49:20.313881] [DEBUG] [LOCAL ] MAA: Deleted primary data file. [2025-10-28T19:49:20.313939] [INFO ] [MAIN ] MAA: Starting full primary refresh. [2025-10-28T19:49:20.651755] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-10 (1.46 seconds). [2025-10-28T19:49:20.699855] [INFO ] [REMOTE ] MAA: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:49:20.700021] [INFO ] [REMOTE ] LZB: Full fetch complete (51177 records). [2025-10-28T19:49:20.700336] [DEBUG] [VALIDATOR ] LZB: Validating primary data. [2025-10-28T19:49:20.788161] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-01. [2025-10-28T19:49:21.087791] [DEBUG] [VALIDATOR ] LZB: All expected trading days are present. [2025-10-28T19:49:21.087862] [DEBUG] [VALIDATOR ] LZB: Primary data validation passed. [2025-10-28T19:49:21.088766] [INFO ] [MAIN ] LZB: Fetched primary data is valid. [2025-10-28T19:49:21.088826] [DEBUG] [LOCAL ] LZB: Saving primary data. [2025-10-28T19:49:21.089894] [DEBUG] [LOCAL ] LZB: Trimmed 51177 records to 34736 (keeping 200 days of data) [2025-10-28T19:49:21.294853] [DEBUG] [LOCAL ] LZB: Primary data saved (34736 records). [2025-10-28T19:49:21.294978] [INFO ] [MAIN ] LZB: Full history saved. [2025-10-28T19:49:21.295314] [INFO ] [MAIN ] Update Progress: 1294/2366 symbols completed. LZB took 31.0s. Estimated remaining: 2h 20m 16s. Rate: 7.6 symbols/min [2025-10-28T19:49:21.467089] [INFO ] [MAIN ] MAC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:49:21.498817] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-10-28T19:49:21.548129] [DEBUG] [LOCAL ] MAC: Loaded 49449 existing records from primary storage. [2025-10-28T19:49:21.548435] [INFO ] [MAIN ] MAC: Loaded 49449 existing records. [2025-10-28T19:49:21.589854] [INFO ] [REMOTE ] M: Fetching primary data for 2025-06. [2025-10-28T19:49:21.727748] [WARN ] [MAIN ] MAC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:49:21.727957] [INFO ] [MAIN ] MAC: Wiping existing primary data before full refresh. [2025-10-28T19:49:21.728009] [INFO ] [LOCAL ] MAC: Starting deletion of primary data. [2025-10-28T19:49:21.728578] [DEBUG] [LOCAL ] MAC: Deleted primary data file. [2025-10-28T19:49:21.728635] [INFO ] [MAIN ] MAC: Starting full primary refresh. [2025-10-28T19:49:22.097432] [INFO ] [REMOTE ] MAC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:49:22.120781] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-10-28T19:49:22.380245] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-01. [2025-10-28T19:49:23.091134] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-28T19:49:23.180276] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-02. [2025-10-28T19:49:23.428174] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-10-28T19:49:23.980324] [INFO ] [REMOTE ] M: Fetching primary data for 2025-07. [2025-10-28T19:49:24.265833] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-28T19:49:24.780287] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-02. [2025-10-28T19:49:25.580328] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-03. [2025-10-28T19:49:25.700311] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-10-28T19:49:26.217505] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-10-28T19:49:26.380247] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-03. [2025-10-28T19:49:26.808821] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-10-28T19:49:27.180290] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-02. [2025-10-28T19:49:27.980290] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-04. [2025-10-28T19:49:28.364449] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-10-28T19:49:28.780222] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-03. [2025-10-28T19:49:29.580369] [INFO ] [REMOTE ] M: Fetching primary data for 2025-08. [2025-10-28T19:49:30.156281] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-10-28T19:49:30.380357] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-04. [2025-10-28T19:49:31.002268] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-10-28T19:49:31.180320] [INFO ] [REMOTE ] M: Fetching primary data for 2025-09. [2025-10-28T19:49:32.129102] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-10-28T19:49:32.139986] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-05. [2025-10-28T19:49:32.579754] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-10-28T19:49:32.780264] [INFO ] [REMOTE ] M: Fetching primary data for 2025-10. [2025-10-28T19:49:34.189916] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-10 (1.41 seconds). [2025-10-28T19:49:34.200859] [INFO ] [REMOTE ] M: Full fetch complete (77656 records). [2025-10-28T19:49:34.201045] [DEBUG] [VALIDATOR ] M: Validating primary data. [2025-10-28T19:49:34.632440] [DEBUG] [VALIDATOR ] M: All expected trading days are present. [2025-10-28T19:49:34.632525] [DEBUG] [VALIDATOR ] M: Primary data validation passed. [2025-10-28T19:49:34.633635] [INFO ] [MAIN ] M: Fetched primary data is valid. [2025-10-28T19:49:34.633733] [DEBUG] [LOCAL ] M: Saving primary data. [2025-10-28T19:49:34.635235] [DEBUG] [LOCAL ] M: Trimmed 77656 records to 53542 (keeping 200 days of data) [2025-10-28T19:49:34.958989] [DEBUG] [LOCAL ] M: Primary data saved (53542 records). [2025-10-28T19:49:34.959143] [INFO ] [MAIN ] M: Full history saved. [2025-10-28T19:49:34.959867] [INFO ] [MAIN ] Update Progress: 1295/2366 symbols completed. M took 36.6s. Estimated remaining: 2h 20m 12s. Rate: 7.6 symbols/min [2025-10-28T19:49:35.141517] [INFO ] [MAIN ] MAGN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:49:35.161372] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-03 (8.78 seconds). [2025-10-28T19:49:35.173104] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-04. [2025-10-28T19:49:35.206402] [DEBUG] [LOCAL ] MAGN: Loaded 35837 existing records from primary storage. [2025-10-28T19:49:35.206676] [INFO ] [MAIN ] MAGN: Loaded 35837 existing records. [2025-10-28T19:49:35.382469] [WARN ] [MAIN ] MAGN: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:49:35.382728] [INFO ] [MAIN ] MAGN: Wiping existing primary data before full refresh. [2025-10-28T19:49:35.382781] [INFO ] [LOCAL ] MAGN: Starting deletion of primary data. [2025-10-28T19:49:35.382962] [DEBUG] [LOCAL ] MAGN: Deleted primary data file. [2025-10-28T19:49:35.382999] [INFO ] [MAIN ] MAGN: Starting full primary refresh. [2025-10-28T19:49:35.771925] [INFO ] [REMOTE ] MAGN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:49:35.772777] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-01. [2025-10-28T19:49:35.774826] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-04 (7.79 seconds). [2025-10-28T19:49:35.784446] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-05. [2025-10-28T19:49:35.798879] [DEBUG] [REMOTE ] MAC: Error fetching primary data for 2025-05: ("Connection broken: ConnectionResetError(104, 'Connection reset by peer')", ConnectionResetError(104, 'Connection reset by peer')) [2025-10-28T19:49:35.798960] [WARN ] [REMOTE ] MAC: No data returned for month 2025-05 [2025-10-28T19:49:35.799034] [FATAL] [REMOTE ] MAC: API call failed - aborting fetch to avoid wasting further API calls [2025-10-28T19:49:35.799076] [FATAL] [MAIN ] MAC: Failed to fetch primary data. [2025-10-28T19:49:35.799107] [WARN ] [MAIN ] MAC: Deleting existing primary and derivative data due to fetch failure. [2025-10-28T19:49:35.799140] [INFO ] [LOCAL ] MAC: Starting deletion of primary data. [2025-10-28T19:49:35.799187] [DEBUG] [LOCAL ] MAC: No primary data file found to delete. [2025-10-28T19:49:35.799220] [INFO ] [LOCAL ] MAC: Starting deletion of derivative data. [2025-10-28T19:49:35.799450] [DEBUG] [LOCAL ] MAC: Deleted derivative data file. [2025-10-28T19:49:35.799519] [INFO ] [MAIN ] Update Progress: 1296/2366 symbols completed. MAC took 14.5s. Estimated remaining: 2h 19m 59s. Rate: 7.6 symbols/min [2025-10-28T19:49:35.972210] [INFO ] [MAIN ] MAIN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:49:36.012029] [DEBUG] [LOCAL ] MAIN: Loaded 41726 existing records from primary storage. [2025-10-28T19:49:36.012303] [INFO ] [MAIN ] MAIN: Loaded 41726 existing records. [2025-10-28T19:49:36.186109] [WARN ] [MAIN ] MAIN: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:49:36.186341] [INFO ] [MAIN ] MAIN: Wiping existing primary data before full refresh. [2025-10-28T19:49:36.186387] [INFO ] [LOCAL ] MAIN: Starting deletion of primary data. [2025-10-28T19:49:36.186560] [DEBUG] [LOCAL ] MAIN: Deleted primary data file. [2025-10-28T19:49:36.186598] [INFO ] [MAIN ] MAIN: Starting full primary refresh. [2025-10-28T19:49:36.535753] [INFO ] [REMOTE ] MAIN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:49:36.536103] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-01. [2025-10-28T19:49:36.674549] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-10-28T19:49:36.780225] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-02. [2025-10-28T19:49:37.038026] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-10-28T19:49:37.580280] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-06. [2025-10-28T19:49:37.747288] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-10-28T19:49:38.380265] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-02. [2025-10-28T19:49:38.855570] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-10-28T19:49:39.180328] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-07. [2025-10-28T19:49:40.442229] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-10-28T19:49:40.452599] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-08. [2025-10-28T19:49:41.791860] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-10-28T19:49:41.801051] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-09. [2025-10-28T19:49:43.099694] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-10-28T19:49:43.113001] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-10. [2025-10-28T19:49:44.721116] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-10 (1.61 seconds). [2025-10-28T19:49:44.732050] [INFO ] [REMOTE ] MAA: Full fetch complete (62039 records). [2025-10-28T19:49:44.732198] [DEBUG] [VALIDATOR ] MAA: Validating primary data. [2025-10-28T19:49:45.144063] [DEBUG] [VALIDATOR ] MAA: All expected trading days are present. [2025-10-28T19:49:45.144152] [DEBUG] [VALIDATOR ] MAA: Primary data validation passed. [2025-10-28T19:49:45.145201] [INFO ] [MAIN ] MAA: Fetched primary data is valid. [2025-10-28T19:49:45.145264] [DEBUG] [LOCAL ] MAA: Saving primary data. [2025-10-28T19:49:45.146711] [DEBUG] [LOCAL ] MAA: Trimmed 62039 records to 42852 (keeping 200 days of data) [2025-10-28T19:49:45.420883] [DEBUG] [LOCAL ] MAA: Primary data saved (42852 records). [2025-10-28T19:49:45.421009] [INFO ] [MAIN ] MAA: Full history saved. [2025-10-28T19:49:45.421089] [INFO ] [MAIN ] Update Progress: 1297/2366 symbols completed. MAA took 25.5s. Estimated remaining: 2h 19m 52s. Rate: 7.6 symbols/min [2025-10-28T19:49:45.592918] [INFO ] [MAIN ] MAN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:49:45.635810] [DEBUG] [LOCAL ] MAN: Loaded 44314 existing records from primary storage. [2025-10-28T19:49:45.636146] [INFO ] [MAIN ] MAN: Loaded 44314 existing records. [2025-10-28T19:49:45.812769] [WARN ] [MAIN ] MAN: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:49:45.813030] [INFO ] [MAIN ] MAN: Wiping existing primary data before full refresh. [2025-10-28T19:49:45.813087] [INFO ] [LOCAL ] MAN: Starting deletion of primary data. [2025-10-28T19:49:45.813602] [DEBUG] [LOCAL ] MAN: Deleted primary data file. [2025-10-28T19:49:45.813691] [INFO ] [MAIN ] MAN: Starting full primary refresh. [2025-10-28T19:49:45.964038] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-04 (10.79 seconds). [2025-10-28T19:49:46.037678] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-05. [2025-10-28T19:49:46.243069] [INFO ] [REMOTE ] MAN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:49:46.243392] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-01. [2025-10-28T19:49:47.248205] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-28T19:49:47.256532] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-02. [2025-10-28T19:49:47.531745] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-10-28T19:49:47.542586] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-06. [2025-10-28T19:49:49.075192] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-10-28T19:49:49.085523] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-07. [2025-10-28T19:49:49.618169] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-02 (12.84 seconds). [2025-10-28T19:49:49.626235] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-03. [2025-10-28T19:49:50.517634] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-28T19:49:50.524985] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-04. [2025-10-28T19:49:51.585612] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-10-28T19:49:51.593559] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-05. [2025-10-28T19:49:52.453486] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-02 (14.07 seconds). [2025-10-28T19:49:52.461608] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-03. [2025-10-28T19:49:53.800507] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-28T19:49:53.809170] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-04. [2025-10-28T19:49:55.096211] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-10-28T19:49:55.105104] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-05. [2025-10-28T19:49:56.539153] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-10-28T19:49:56.549589] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-06. [2025-10-28T19:49:56.572449] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-02 (9.32 seconds). [2025-10-28T19:49:56.584329] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-03. [2025-10-28T19:49:57.659558] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-10-28T19:49:57.669102] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-04. [2025-10-28T19:49:57.734840] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-10-28T19:49:57.743398] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-07. [2025-10-28T19:49:57.825001] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-05 (6.23 seconds). [2025-10-28T19:49:57.833480] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-06. [2025-10-28T19:49:58.790290] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-28T19:49:58.823579] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-10-28T19:49:58.824124] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-05. [2025-10-28T19:49:58.832824] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-07. [2025-10-28T19:49:58.922419] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-10-28T19:49:58.932072] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-08. [2025-10-28T19:49:59.863820] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-28T19:49:59.872092] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-08. [2025-10-28T19:49:59.966494] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-10-28T19:49:59.980375] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-06. [2025-10-28T19:50:00.141534] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-10-28T19:50:00.150438] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-09. [2025-10-28T19:50:00.912602] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-10-28T19:50:00.922844] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-09. [2025-10-28T19:50:01.044570] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-10-28T19:50:01.059845] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-07. [2025-10-28T19:50:01.267156] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-10-28T19:50:01.580336] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-10. [2025-10-28T19:50:01.774228] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-10-28T19:50:02.373342] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-28T19:50:02.383847] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-10. [2025-10-28T19:50:03.124325] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-10 (1.54 seconds). [2025-10-28T19:50:03.134021] [INFO ] [REMOTE ] MAIN: Full fetch complete (60310 records). [2025-10-28T19:50:03.134152] [DEBUG] [VALIDATOR ] MAIN: Validating primary data. [2025-10-28T19:50:03.182446] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-08. [2025-10-28T19:50:03.524323] [DEBUG] [VALIDATOR ] MAIN: All expected trading days are present. [2025-10-28T19:50:03.524481] [DEBUG] [VALIDATOR ] MAIN: Primary data validation passed. [2025-10-28T19:50:03.525511] [INFO ] [MAIN ] MAIN: Fetched primary data is valid. [2025-10-28T19:50:03.525575] [DEBUG] [LOCAL ] MAIN: Saving primary data. [2025-10-28T19:50:03.526918] [DEBUG] [LOCAL ] MAIN: Trimmed 60310 records to 41648 (keeping 200 days of data) [2025-10-28T19:50:03.771220] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-10 (1.39 seconds). [2025-10-28T19:50:03.814599] [INFO ] [REMOTE ] MAGN: Full fetch complete (51825 records). [2025-10-28T19:50:03.824937] [DEBUG] [LOCAL ] MAIN: Primary data saved (41648 records). [2025-10-28T19:50:03.825206] [DEBUG] [VALIDATOR ] MAGN: Validating primary data. [2025-10-28T19:50:03.825422] [INFO ] [MAIN ] MAIN: Full history saved. [2025-10-28T19:50:03.826339] [INFO ] [MAIN ] Update Progress: 1298/2366 symbols completed. MAIN took 28.0s. Estimated remaining: 2h 19m 53s. Rate: 7.6 symbols/min [2025-10-28T19:50:04.179263] [INFO ] [MAIN ] MANU: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:50:04.487447] [DEBUG] [LOCAL ] MANU: Loaded 26885 existing records from primary storage. [2025-10-28T19:50:04.487767] [DEBUG] [VALIDATOR ] MAGN: All expected trading days are present. [2025-10-28T19:50:04.488024] [DEBUG] [VALIDATOR ] MAGN: Primary data validation passed. [2025-10-28T19:50:04.488203] [INFO ] [MAIN ] MANU: Loaded 26885 existing records. [2025-10-28T19:50:04.521748] [INFO ] [MAIN ] MAGN: Fetched primary data is valid. [2025-10-28T19:50:04.533533] [DEBUG] [LOCAL ] MAGN: Saving primary data. [2025-10-28T19:50:04.599731] [DEBUG] [LOCAL ] MAGN: Trimmed 51825 records to 35786 (keeping 200 days of data) [2025-10-28T19:50:04.740663] [WARN ] [MAIN ] MANU: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:50:04.741068] [INFO ] [MAIN ] MANU: Wiping existing primary data before full refresh. [2025-10-28T19:50:04.766843] [INFO ] [LOCAL ] MANU: Starting deletion of primary data. [2025-10-28T19:50:04.784071] [DEBUG] [LOCAL ] MANU: Deleted primary data file. [2025-10-28T19:50:04.786147] [INFO ] [MAIN ] MANU: Starting full primary refresh. [2025-10-28T19:50:05.175713] [DEBUG] [LOCAL ] MAGN: Primary data saved (35786 records). [2025-10-28T19:50:05.192498] [INFO ] [MAIN ] MAGN: Full history saved. [2025-10-28T19:50:05.203851] [INFO ] [MAIN ] Update Progress: 1299/2366 symbols completed. MAGN took 30.2s. Estimated remaining: 2h 19m 40s. Rate: 7.6 symbols/min [2025-10-28T19:50:05.419146] [INFO ] [REMOTE ] MANU: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:50:05.461977] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-01. [2025-10-28T19:50:05.464747] [INFO ] [MAIN ] MAS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:50:05.517165] [DEBUG] [LOCAL ] MAS: Loaded 52162 existing records from primary storage. [2025-10-28T19:50:05.517584] [INFO ] [MAIN ] MAS: Loaded 52162 existing records. [2025-10-28T19:50:05.725214] [WARN ] [MAIN ] MAS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:50:05.725489] [INFO ] [MAIN ] MAS: Wiping existing primary data before full refresh. [2025-10-28T19:50:05.725540] [INFO ] [LOCAL ] MAS: Starting deletion of primary data. [2025-10-28T19:50:05.725789] [DEBUG] [LOCAL ] MAS: Deleted primary data file. [2025-10-28T19:50:05.725845] [INFO ] [MAIN ] MAS: Starting full primary refresh. [2025-10-28T19:50:06.077037] [INFO ] [REMOTE ] MAS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:50:06.077356] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-01. [2025-10-28T19:50:06.232473] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-07 (17.15 seconds). [2025-10-28T19:50:06.244157] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-08. [2025-10-28T19:50:07.894295] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-10-28T19:50:07.906887] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-09. [2025-10-28T19:50:09.573427] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-10-28T19:50:09.584408] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-10. [2025-10-28T19:50:11.543758] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-10 (1.96 seconds). [2025-10-28T19:50:11.554885] [INFO ] [REMOTE ] MA: Full fetch complete (76372 records). [2025-10-28T19:50:11.555052] [DEBUG] [VALIDATOR ] MA: Validating primary data. [2025-10-28T19:50:11.955940] [DEBUG] [VALIDATOR ] MA: All expected trading days are present. [2025-10-28T19:50:11.956068] [DEBUG] [VALIDATOR ] MA: Primary data validation passed. [2025-10-28T19:50:11.957352] [INFO ] [MAIN ] MA: Fetched primary data is valid. [2025-10-28T19:50:11.957415] [DEBUG] [LOCAL ] MA: Saving primary data. [2025-10-28T19:50:11.958904] [DEBUG] [LOCAL ] MA: Trimmed 76372 records to 52412 (keeping 200 days of data) [2025-10-28T19:50:12.320536] [DEBUG] [LOCAL ] MA: Primary data saved (52412 records). [2025-10-28T19:50:12.320703] [INFO ] [MAIN ] MA: Full history saved. [2025-10-28T19:50:12.320793] [INFO ] [MAIN ] Update Progress: 1300/2366 symbols completed. MA took 54.2s. Estimated remaining: 2h 19m 32s. Rate: 7.6 symbols/min [2025-10-28T19:50:12.501534] [INFO ] [MAIN ] MATV: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:50:12.534313] [DEBUG] [LOCAL ] MATV: Loaded 34605 existing records from primary storage. [2025-10-28T19:50:12.534604] [INFO ] [MAIN ] MATV: Loaded 34605 existing records. [2025-10-28T19:50:12.716965] [WARN ] [MAIN ] MATV: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:50:12.717255] [INFO ] [MAIN ] MATV: Wiping existing primary data before full refresh. [2025-10-28T19:50:12.717309] [INFO ] [LOCAL ] MATV: Starting deletion of primary data. [2025-10-28T19:50:12.717527] [DEBUG] [LOCAL ] MATV: Deleted primary data file. [2025-10-28T19:50:12.717578] [INFO ] [MAIN ] MATV: Starting full primary refresh. [2025-10-28T19:50:13.067751] [INFO ] [REMOTE ] MATV: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:50:13.068089] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-01. [2025-10-28T19:50:13.518365] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-08 (10.34 seconds). [2025-10-28T19:50:13.529507] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-09. [2025-10-28T19:50:14.078277] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-10-28T19:50:14.084424] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-02. [2025-10-28T19:50:14.603221] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-28T19:50:14.612667] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-10. [2025-10-28T19:50:14.966148] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-10-28T19:50:14.973426] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-03. [2025-10-28T19:50:15.952949] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-10 (1.34 seconds). [2025-10-28T19:50:15.962798] [INFO ] [REMOTE ] MAN: Full fetch complete (63070 records). [2025-10-28T19:50:15.962985] [DEBUG] [VALIDATOR ] MAN: Validating primary data. [2025-10-28T19:50:16.307344] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-10-28T19:50:16.361419] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-04. [2025-10-28T19:50:16.405743] [DEBUG] [VALIDATOR ] MAN: All expected trading days are present. [2025-10-28T19:50:16.405873] [DEBUG] [VALIDATOR ] MAN: Primary data validation passed. [2025-10-28T19:50:16.406985] [INFO ] [MAIN ] MAN: Fetched primary data is valid. [2025-10-28T19:50:16.407047] [DEBUG] [LOCAL ] MAN: Saving primary data. [2025-10-28T19:50:16.408489] [DEBUG] [LOCAL ] MAN: Trimmed 63070 records to 44330 (keeping 200 days of data) [2025-10-28T19:50:16.513862] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-01 (11.05 seconds). [2025-10-28T19:50:16.519537] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-02. [2025-10-28T19:50:16.680263] [DEBUG] [LOCAL ] MAN: Primary data saved (44330 records). [2025-10-28T19:50:16.680383] [INFO ] [MAIN ] MAN: Full history saved. [2025-10-28T19:50:16.680457] [INFO ] [MAIN ] Update Progress: 1301/2366 symbols completed. MAN took 31.3s. Estimated remaining: 2h 19m 21s. Rate: 7.6 symbols/min [2025-10-28T19:50:16.849161] [INFO ] [MAIN ] MATX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:50:16.881316] [DEBUG] [LOCAL ] MATX: Loaded 31546 existing records from primary storage. [2025-10-28T19:50:16.881592] [INFO ] [MAIN ] MATX: Loaded 31546 existing records. [2025-10-28T19:50:17.062824] [WARN ] [MAIN ] MATX: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:50:17.063053] [INFO ] [MAIN ] MATX: Wiping existing primary data before full refresh. [2025-10-28T19:50:17.063101] [INFO ] [LOCAL ] MATX: Starting deletion of primary data. [2025-10-28T19:50:17.063288] [DEBUG] [LOCAL ] MATX: Deleted primary data file. [2025-10-28T19:50:17.063327] [INFO ] [MAIN ] MATX: Starting full primary refresh. [2025-10-28T19:50:17.393442] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-10-28T19:50:17.431994] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-03. [2025-10-28T19:50:17.459743] [INFO ] [REMOTE ] MATX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:50:17.460948] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-01. [2025-10-28T19:50:17.542539] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-10-28T19:50:17.551492] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-05. [2025-10-28T19:50:18.283516] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-10-28T19:50:18.288917] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-02. [2025-10-28T19:50:18.322735] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-10-28T19:50:18.329481] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-04. [2025-10-28T19:50:19.161065] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-10-28T19:50:19.167036] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-05. [2025-10-28T19:50:19.258551] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-10-28T19:50:19.264558] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-03. [2025-10-28T19:50:20.174258] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-10-28T19:50:20.180278] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-04. [2025-10-28T19:50:21.333405] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-10-28T19:50:21.341564] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-05. [2025-10-28T19:50:22.562109] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-10-28T19:50:22.571353] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-06. [2025-10-28T19:50:23.487142] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-10-28T19:50:23.494690] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-07. [2025-10-28T19:50:24.573313] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-10-28T19:50:24.580500] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-08. [2025-10-28T19:50:25.658492] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-10-28T19:50:25.665905] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-09. [2025-10-28T19:50:26.458683] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-10-28T19:50:26.465266] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-10. [2025-10-28T19:50:27.443031] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-10 (0.98 seconds). [2025-10-28T19:50:27.450664] [INFO ] [REMOTE ] MATX: Full fetch complete (44030 records). [2025-10-28T19:50:27.450892] [DEBUG] [VALIDATOR ] MATX: Validating primary data. [2025-10-28T19:50:27.852845] [DEBUG] [VALIDATOR ] MATX: All expected trading days are present. [2025-10-28T19:50:27.852929] [DEBUG] [VALIDATOR ] MATX: Primary data validation passed. [2025-10-28T19:50:27.853737] [INFO ] [MAIN ] MATX: Fetched primary data is valid. [2025-10-28T19:50:27.853798] [DEBUG] [LOCAL ] MATX: Saving primary data. [2025-10-28T19:50:27.854701] [DEBUG] [LOCAL ] MATX: Trimmed 44030 records to 31448 (keeping 200 days of data) [2025-10-28T19:50:28.060323] [DEBUG] [LOCAL ] MATX: Primary data saved (31448 records). [2025-10-28T19:50:28.060447] [INFO ] [MAIN ] MATX: Full history saved. [2025-10-28T19:50:28.060889] [INFO ] [MAIN ] Update Progress: 1302/2366 symbols completed. MATX took 11.4s. Estimated remaining: 2h 19m 16s. Rate: 7.6 symbols/min [2025-10-28T19:50:28.231990] [INFO ] [MAIN ] MAX: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:50:28.262152] [DEBUG] [LOCAL ] MAX: Loaded 30512 existing records from primary storage. [2025-10-28T19:50:28.262407] [INFO ] [MAIN ] MAX: Loaded 30512 existing records. [2025-10-28T19:50:28.438227] [WARN ] [MAIN ] MAX: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:50:28.438437] [INFO ] [MAIN ] MAX: Wiping existing primary data before full refresh. [2025-10-28T19:50:28.438493] [INFO ] [LOCAL ] MAX: Starting deletion of primary data. [2025-10-28T19:50:28.438779] [DEBUG] [LOCAL ] MAX: Deleted primary data file. [2025-10-28T19:50:28.438835] [INFO ] [MAIN ] MAX: Starting full primary refresh. [2025-10-28T19:50:28.815473] [INFO ] [REMOTE ] MAX: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:50:28.815813] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-01. [2025-10-28T19:50:29.772166] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-10-28T19:50:29.778407] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-02. [2025-10-28T19:50:30.842556] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-10-28T19:50:30.849148] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-03. [2025-10-28T19:50:37.951299] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-01 (31.87 seconds). [2025-10-28T19:50:37.961064] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-02. [2025-10-28T19:50:39.044126] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-10-28T19:50:39.053831] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-03. [2025-10-28T19:50:45.112109] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-05 (25.95 seconds). [2025-10-28T19:50:45.117444] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-06. [2025-10-28T19:50:46.117160] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-05 (28.57 seconds). [2025-10-28T19:50:46.144524] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-28T19:50:46.143251] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-06. [2025-10-28T19:50:46.153039] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-07. [2025-10-28T19:50:47.007991] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-10-28T19:50:47.017583] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-08. [2025-10-28T19:50:47.319030] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-28T19:50:47.326898] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-07. [2025-10-28T19:50:47.765558] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-10-28T19:50:47.773151] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-09. [2025-10-28T19:50:48.513628] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-28T19:50:48.526187] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-08. [2025-10-28T19:50:48.697119] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-10-28T19:50:48.704305] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-10. [2025-10-28T19:50:49.708984] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-10-28T19:50:49.719155] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-09. [2025-10-28T19:50:49.837010] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-10 (1.13 seconds). [2025-10-28T19:50:49.843157] [INFO ] [REMOTE ] MANU: Full fetch complete (39425 records). [2025-10-28T19:50:49.843281] [DEBUG] [VALIDATOR ] MANU: Validating primary data. [2025-10-28T19:50:50.259367] [DEBUG] [VALIDATOR ] MANU: All expected trading days are present. [2025-10-28T19:50:50.259538] [DEBUG] [VALIDATOR ] MANU: Primary data validation passed. [2025-10-28T19:50:50.260344] [INFO ] [MAIN ] MANU: Fetched primary data is valid. [2025-10-28T19:50:50.260405] [DEBUG] [LOCAL ] MANU: Saving primary data. [2025-10-28T19:50:50.261260] [DEBUG] [LOCAL ] MANU: Trimmed 39425 records to 26793 (keeping 200 days of data) [2025-10-28T19:50:50.414042] [DEBUG] [LOCAL ] MANU: Primary data saved (26793 records). [2025-10-28T19:50:50.414172] [INFO ] [MAIN ] MANU: Full history saved. [2025-10-28T19:50:50.414251] [INFO ] [MAIN ] Update Progress: 1303/2366 symbols completed. MANU took 46.6s. Estimated remaining: 2h 19m 20s. Rate: 7.6 symbols/min [2025-10-28T19:50:50.585298] [INFO ] [MAIN ] MBC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:50:50.625520] [DEBUG] [LOCAL ] MBC: Loaded 43734 existing records from primary storage. [2025-10-28T19:50:50.625801] [INFO ] [MAIN ] MBC: Loaded 43734 existing records. [2025-10-28T19:50:50.762238] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-03 (19.91 seconds). [2025-10-28T19:50:50.787537] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-04. [2025-10-28T19:50:50.890313] [WARN ] [MAIN ] MBC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:50:50.908360] [INFO ] [MAIN ] MBC: Wiping existing primary data before full refresh. [2025-10-28T19:50:50.908696] [INFO ] [LOCAL ] MBC: Starting deletion of primary data. [2025-10-28T19:50:50.910011] [DEBUG] [LOCAL ] MBC: Deleted primary data file. [2025-10-28T19:50:50.909968] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-10-28T19:50:50.910112] [INFO ] [MAIN ] MBC: Starting full primary refresh. [2025-10-28T19:50:50.970851] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-10. [2025-10-28T19:50:51.268415] [INFO ] [REMOTE ] MBC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:50:51.268752] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-01. [2025-10-28T19:50:51.871921] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-10-28T19:50:51.879196] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-05. [2025-10-28T19:50:52.329912] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-10-28T19:50:52.338472] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-02. [2025-10-28T19:50:52.731877] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-10-28T19:50:52.738829] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-06. [2025-10-28T19:50:53.559039] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-10-28T19:50:53.565574] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-07. [2025-10-28T19:50:54.428697] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-10-28T19:50:54.435837] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-08. [2025-10-28T19:50:57.449721] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-03 (18.40 seconds). [2025-10-28T19:50:57.460915] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-04. [2025-10-28T19:50:58.177531] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-02 (5.84 seconds). [2025-10-28T19:50:58.185802] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-03. [2025-10-28T19:50:58.840897] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-10-28T19:50:58.853590] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-05. [2025-10-28T19:51:00.292803] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-10-28T19:51:00.304219] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-06. [2025-10-28T19:51:00.718585] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-10 (9.75 seconds). [2025-10-28T19:51:00.724738] [INFO ] [REMOTE ] MATV: Full fetch complete (51845 records). [2025-10-28T19:51:00.724888] [DEBUG] [VALIDATOR ] MATV: Validating primary data. [2025-10-28T19:51:01.112669] [DEBUG] [VALIDATOR ] MATV: All expected trading days are present. [2025-10-28T19:51:01.112753] [DEBUG] [VALIDATOR ] MATV: Primary data validation passed. [2025-10-28T19:51:01.113591] [INFO ] [MAIN ] MATV: Fetched primary data is valid. [2025-10-28T19:51:01.113632] [DEBUG] [LOCAL ] MATV: Saving primary data. [2025-10-28T19:51:01.114724] [DEBUG] [LOCAL ] MATV: Trimmed 51845 records to 34396 (keeping 200 days of data) [2025-10-28T19:51:01.313754] [DEBUG] [LOCAL ] MATV: Primary data saved (34396 records). [2025-10-28T19:51:01.313896] [INFO ] [MAIN ] MATV: Full history saved. [2025-10-28T19:51:01.313974] [INFO ] [MAIN ] Update Progress: 1304/2366 symbols completed. MATV took 49.0s. Estimated remaining: 2h 19m 15s. Rate: 7.6 symbols/min [2025-10-28T19:51:01.480729] [INFO ] [MAIN ] MBI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:51:01.502893] [DEBUG] [LOCAL ] MBI: Loaded 23562 existing records from primary storage. [2025-10-28T19:51:01.503135] [INFO ] [MAIN ] MBI: Loaded 23562 existing records. [2025-10-28T19:51:01.712183] [WARN ] [MAIN ] MBI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:51:01.712605] [INFO ] [MAIN ] MBI: Wiping existing primary data before full refresh. [2025-10-28T19:51:01.712730] [INFO ] [LOCAL ] MBI: Starting deletion of primary data. [2025-10-28T19:51:01.712931] [DEBUG] [LOCAL ] MBI: Deleted primary data file. [2025-10-28T19:51:01.712995] [INFO ] [MAIN ] MBI: Starting full primary refresh. [2025-10-28T19:51:01.958116] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-10-28T19:51:02.047360] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-07. [2025-10-28T19:51:02.147147] [INFO ] [REMOTE ] MBI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:51:02.147798] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-01. [2025-10-28T19:51:02.943353] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-10-28T19:51:02.949086] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-02. [2025-10-28T19:51:03.621928] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-08 (9.19 seconds). [2025-10-28T19:51:03.628781] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-09. [2025-10-28T19:51:03.940178] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-28T19:51:03.945593] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-03. [2025-10-28T19:51:05.009814] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-10-28T19:51:05.015916] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-04. [2025-10-28T19:51:06.001864] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-10-28T19:51:06.010045] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-05. [2025-10-28T19:51:06.779048] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-10-28T19:51:06.784559] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-06. [2025-10-28T19:51:07.583246] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-10-28T19:51:07.588332] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-07. [2025-10-28T19:51:08.261709] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-10-28T19:51:08.266774] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-08. [2025-10-28T19:51:09.001193] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-03 (10.82 seconds). [2025-10-28T19:51:09.010745] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-04. [2025-10-28T19:51:09.694254] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-10-28T19:51:09.703377] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-09. [2025-10-28T19:51:10.548122] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-10-28T19:51:10.557475] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-05. [2025-10-28T19:51:11.620932] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-10-28T19:51:11.631712] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-06. [2025-10-28T19:51:12.595167] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-28T19:51:12.604143] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-07. [2025-10-28T19:51:13.501794] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-10-28T19:51:13.511486] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-08. [2025-10-28T19:51:14.671932] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-10-28T19:51:14.682255] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-09. [2025-10-28T19:51:14.921539] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-07 (12.87 seconds). [2025-10-28T19:51:14.932984] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-08. [2025-10-28T19:51:14.958492] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-09 (11.33 seconds). [2025-10-28T19:51:14.966338] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-10. [2025-10-28T19:51:15.796105] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-28T19:51:15.806545] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-10. [2025-10-28T19:51:20.056378] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-09 (10.35 seconds). [2025-10-28T19:51:20.061637] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-10. [2025-10-28T19:51:20.883616] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-28T19:51:20.888237] [INFO ] [REMOTE ] MBI: Full fetch complete (35435 records). [2025-10-28T19:51:20.888316] [DEBUG] [VALIDATOR ] MBI: Validating primary data. [2025-10-28T19:51:21.259786] [DEBUG] [VALIDATOR ] MBI: All expected trading days are present. [2025-10-28T19:51:21.259865] [DEBUG] [VALIDATOR ] MBI: Primary data validation passed. [2025-10-28T19:51:21.260571] [INFO ] [MAIN ] MBI: Fetched primary data is valid. [2025-10-28T19:51:21.260612] [DEBUG] [LOCAL ] MBI: Saving primary data. [2025-10-28T19:51:21.261395] [DEBUG] [LOCAL ] MBI: Trimmed 35435 records to 23464 (keeping 200 days of data) [2025-10-28T19:51:21.384754] [DEBUG] [LOCAL ] MBI: Primary data saved (23464 records). [2025-10-28T19:51:21.384878] [INFO ] [MAIN ] MBI: Full history saved. [2025-10-28T19:51:21.384954] [INFO ] [MAIN ] Update Progress: 1305/2366 symbols completed. MBI took 20.1s. Estimated remaining: 2h 19m 17s. Rate: 7.6 symbols/min [2025-10-28T19:51:21.554956] [INFO ] [MAIN ] MC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:51:21.593354] [DEBUG] [LOCAL ] MC: Loaded 43384 existing records from primary storage. [2025-10-28T19:51:21.593630] [INFO ] [MAIN ] MC: Loaded 43384 existing records. [2025-10-28T19:51:21.775847] [WARN ] [MAIN ] MC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:51:21.776317] [INFO ] [MAIN ] MC: Wiping existing primary data before full refresh. [2025-10-28T19:51:21.776399] [INFO ] [LOCAL ] MC: Starting deletion of primary data. [2025-10-28T19:51:21.776710] [DEBUG] [LOCAL ] MC: Deleted primary data file. [2025-10-28T19:51:21.776771] [INFO ] [MAIN ] MC: Starting full primary refresh. [2025-10-28T19:51:22.135044] [INFO ] [REMOTE ] MC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:51:22.135376] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-01. [2025-10-28T19:51:23.065287] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-10 (8.10 seconds). [2025-10-28T19:51:23.072024] [INFO ] [REMOTE ] MAX: Full fetch complete (45011 records). [2025-10-28T19:51:23.072157] [DEBUG] [VALIDATOR ] MAX: Validating primary data. [2025-10-28T19:51:23.447338] [DEBUG] [VALIDATOR ] MAX: All expected trading days are present. [2025-10-28T19:51:23.447427] [DEBUG] [VALIDATOR ] MAX: Primary data validation passed. [2025-10-28T19:51:23.448351] [INFO ] [MAIN ] MAX: Fetched primary data is valid. [2025-10-28T19:51:23.448437] [DEBUG] [LOCAL ] MAX: Saving primary data. [2025-10-28T19:51:23.449518] [DEBUG] [LOCAL ] MAX: Trimmed 45011 records to 30439 (keeping 200 days of data) [2025-10-28T19:51:23.635667] [DEBUG] [LOCAL ] MAX: Primary data saved (30439 records). [2025-10-28T19:51:23.635818] [INFO ] [MAIN ] MAX: Full history saved. [2025-10-28T19:51:23.635904] [INFO ] [MAIN ] Update Progress: 1306/2366 symbols completed. MAX took 55.6s. Estimated remaining: 2h 19m 4s. Rate: 7.6 symbols/min [2025-10-28T19:51:23.815107] [INFO ] [MAIN ] MCB: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:51:23.827723] [DEBUG] [LOCAL ] MCB: Loaded 11290 existing records from primary storage. [2025-10-28T19:51:23.827937] [INFO ] [MAIN ] MCB: Loaded 11290 existing records. [2025-10-28T19:51:24.007935] [WARN ] [MAIN ] MCB: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:51:24.008139] [INFO ] [MAIN ] MCB: Wiping existing primary data before full refresh. [2025-10-28T19:51:24.008186] [INFO ] [LOCAL ] MCB: Starting deletion of primary data. [2025-10-28T19:51:24.008340] [DEBUG] [LOCAL ] MCB: Deleted primary data file. [2025-10-28T19:51:24.008378] [INFO ] [MAIN ] MCB: Starting full primary refresh. [2025-10-28T19:51:24.364732] [INFO ] [REMOTE ] MCB: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:51:24.365034] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-01. [2025-10-28T19:51:24.967436] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-28T19:51:24.970526] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-02. [2025-10-28T19:51:25.475107] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-10-28T19:51:25.477545] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-03. [2025-10-28T19:51:26.010289] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-10-28T19:51:26.013563] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-04. [2025-10-28T19:51:26.675238] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-10-28T19:51:26.679237] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-05. [2025-10-28T19:51:27.298578] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-28T19:51:27.301698] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-06. [2025-10-28T19:51:27.788140] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-10-28T19:51:27.790969] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-07. [2025-10-28T19:51:28.489542] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-10-28T19:51:28.495200] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-08. [2025-10-28T19:51:28.949602] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-10-28T19:51:28.951991] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-09. [2025-10-28T19:51:29.493484] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-10-28T19:51:29.496501] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-10. [2025-10-28T19:51:30.320304] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-10 (0.82 seconds). [2025-10-28T19:51:30.323615] [INFO ] [REMOTE ] MCB: Full fetch complete (16920 records). [2025-10-28T19:51:30.323743] [DEBUG] [VALIDATOR ] MCB: Validating primary data. [2025-10-28T19:51:30.692610] [DEBUG] [VALIDATOR ] MCB: All expected trading days are present. [2025-10-28T19:51:30.692730] [DEBUG] [VALIDATOR ] MCB: Primary data validation passed. [2025-10-28T19:51:30.693173] [INFO ] [MAIN ] MCB: Fetched primary data is valid. [2025-10-28T19:51:30.693239] [DEBUG] [LOCAL ] MCB: Saving primary data. [2025-10-28T19:51:30.694112] [DEBUG] [LOCAL ] MCB: Trimmed 16920 records to 11282 (keeping 200 days of data) [2025-10-28T19:51:30.767341] [DEBUG] [LOCAL ] MCB: Primary data saved (11282 records). [2025-10-28T19:51:30.767475] [INFO ] [MAIN ] MCB: Full history saved. [2025-10-28T19:51:30.767552] [INFO ] [MAIN ] Update Progress: 1307/2366 symbols completed. MCB took 7.1s. Estimated remaining: 2h 18m 56s. Rate: 7.6 symbols/min [2025-10-28T19:51:30.936813] [INFO ] [MAIN ] MCD: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:51:30.936994] [DEBUG] [LOCAL ] MCD: No existing data file found in primary storage. [2025-10-28T19:51:30.937031] [WARN ] [MAIN ] MCD: No existing data found, performing full refresh instead. [2025-10-28T19:51:30.937166] [INFO ] [MAIN ] MCD: Wiping existing primary data before full refresh. [2025-10-28T19:51:30.937226] [INFO ] [LOCAL ] MCD: Starting deletion of primary data. [2025-10-28T19:51:30.937275] [DEBUG] [LOCAL ] MCD: No primary data file found to delete. [2025-10-28T19:51:30.937309] [INFO ] [MAIN ] MCD: Starting full primary refresh. [2025-10-28T19:51:31.293357] [INFO ] [REMOTE ] MCD: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:51:31.293692] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-01. [2025-10-28T19:51:31.967044] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-10 (16.16 seconds). [2025-10-28T19:51:31.976261] [INFO ] [REMOTE ] MBC: Full fetch complete (63031 records). [2025-10-28T19:51:31.976381] [DEBUG] [VALIDATOR ] MBC: Validating primary data. [2025-10-28T19:51:32.416584] [DEBUG] [VALIDATOR ] MBC: All expected trading days are present. [2025-10-28T19:51:32.416741] [DEBUG] [VALIDATOR ] MBC: Primary data validation passed. [2025-10-28T19:51:32.417820] [INFO ] [MAIN ] MBC: Fetched primary data is valid. [2025-10-28T19:51:32.417885] [DEBUG] [LOCAL ] MBC: Saving primary data. [2025-10-28T19:51:32.419169] [DEBUG] [LOCAL ] MBC: Trimmed 63031 records to 43688 (keeping 200 days of data) [2025-10-28T19:51:32.668973] [DEBUG] [LOCAL ] MBC: Primary data saved (43688 records). [2025-10-28T19:51:32.669096] [INFO ] [MAIN ] MBC: Full history saved. [2025-10-28T19:51:32.669405] [INFO ] [MAIN ] Update Progress: 1308/2366 symbols completed. MBC took 42.3s. Estimated remaining: 2h 18m 43s. Rate: 7.6 symbols/min [2025-10-28T19:51:32.833930] [INFO ] [MAIN ] MCI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:51:32.842923] [DEBUG] [LOCAL ] MCI: Loaded 6120 existing records from primary storage. [2025-10-28T19:51:32.843195] [INFO ] [MAIN ] MCI: Loaded 6120 existing records. [2025-10-28T19:51:33.015862] [WARN ] [MAIN ] MCI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:51:33.016172] [INFO ] [MAIN ] MCI: Wiping existing primary data before full refresh. [2025-10-28T19:51:33.016221] [INFO ] [LOCAL ] MCI: Starting deletion of primary data. [2025-10-28T19:51:33.016362] [DEBUG] [LOCAL ] MCI: Deleted primary data file. [2025-10-28T19:51:33.016400] [INFO ] [MAIN ] MCI: Starting full primary refresh. [2025-10-28T19:51:33.362135] [INFO ] [REMOTE ] MCI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:51:33.362437] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-01. [2025-10-28T19:51:33.628058] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-08 (18.70 seconds). [2025-10-28T19:51:33.639580] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-09. [2025-10-28T19:51:33.939938] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-10-28T19:51:33.942086] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-02. [2025-10-28T19:51:34.466957] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-10-28T19:51:34.469572] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-03. [2025-10-28T19:51:35.066725] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-10-28T19:51:35.078945] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-10. [2025-10-28T19:51:37.376032] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-03 (2.91 seconds). [2025-10-28T19:51:37.378216] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-04. [2025-10-28T19:51:37.808498] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-10-28T19:51:37.810570] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-05. [2025-10-28T19:51:38.322953] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-28T19:51:38.326085] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-06. [2025-10-28T19:51:38.865074] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-10-28T19:51:38.867334] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-07. [2025-10-28T19:51:40.574191] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-01 (18.44 seconds). [2025-10-28T19:51:40.581846] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-02. [2025-10-28T19:51:41.545239] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-10-28T19:51:41.553851] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-03. [2025-10-28T19:51:42.892626] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-10-28T19:51:42.906090] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-04. [2025-10-28T19:51:44.105861] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-10-28T19:51:44.116205] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-05. [2025-10-28T19:51:45.103471] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-10-28T19:51:45.112984] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-06. [2025-10-28T19:51:46.549278] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-10-28T19:51:46.558746] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-07. [2025-10-28T19:51:47.867912] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-10-28T19:51:47.877632] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-08. [2025-10-28T19:51:47.977176] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-10 (12.90 seconds). [2025-10-28T19:51:47.987435] [INFO ] [REMOTE ] MAS: Full fetch complete (75425 records). [2025-10-28T19:51:47.987579] [DEBUG] [VALIDATOR ] MAS: Validating primary data. [2025-10-28T19:51:48.382568] [DEBUG] [VALIDATOR ] MAS: All expected trading days are present. [2025-10-28T19:51:48.382779] [DEBUG] [VALIDATOR ] MAS: Primary data validation passed. [2025-10-28T19:51:48.383947] [INFO ] [MAIN ] MAS: Fetched primary data is valid. [2025-10-28T19:51:48.384014] [DEBUG] [LOCAL ] MAS: Saving primary data. [2025-10-28T19:51:48.385433] [DEBUG] [LOCAL ] MAS: Trimmed 75425 records to 52159 (keeping 200 days of data) [2025-10-28T19:51:48.699893] [DEBUG] [LOCAL ] MAS: Primary data saved (52159 records). [2025-10-28T19:51:48.700087] [INFO ] [MAIN ] MAS: Full history saved. [2025-10-28T19:51:48.700185] [INFO ] [MAIN ] Update Progress: 1309/2366 symbols completed. MAS took 1m 43s. Estimated remaining: 2h 18m 42s. Rate: 7.6 symbols/min [2025-10-28T19:51:48.871544] [INFO ] [MAIN ] MCK: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:51:48.906358] [DEBUG] [LOCAL ] MCK: Loaded 37561 existing records from primary storage. [2025-10-28T19:51:48.906785] [INFO ] [MAIN ] MCK: Loaded 37561 existing records. [2025-10-28T19:51:49.102753] [WARN ] [MAIN ] MCK: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:51:49.115492] [INFO ] [MAIN ] MCK: Wiping existing primary data before full refresh. [2025-10-28T19:51:49.115631] [INFO ] [LOCAL ] MCK: Starting deletion of primary data. [2025-10-28T19:51:49.115937] [DEBUG] [LOCAL ] MCK: Deleted primary data file. [2025-10-28T19:51:49.116438] [INFO ] [MAIN ] MCK: Starting full primary refresh. [2025-10-28T19:51:49.118064] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-10-28T19:51:49.229345] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-09. [2025-10-28T19:51:49.489536] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-07 (10.62 seconds). [2025-10-28T19:51:49.489048] [INFO ] [REMOTE ] MCK: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:51:49.491935] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-01. [2025-10-28T19:51:49.493151] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-08. [2025-10-28T19:51:49.925186] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-10-28T19:51:49.930781] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-09. [2025-10-28T19:51:50.276505] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-28T19:51:50.285174] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-10. [2025-10-28T19:51:50.471125] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-10-28T19:51:50.479318] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-02. [2025-10-28T19:51:51.631992] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-10 (1.35 seconds). [2025-10-28T19:51:51.640812] [INFO ] [REMOTE ] MC: Full fetch complete (63124 records). [2025-10-28T19:51:51.640933] [DEBUG] [VALIDATOR ] MC: Validating primary data. [2025-10-28T19:51:51.803172] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-01 (20.51 seconds). [2025-10-28T19:51:51.847012] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-02. [2025-10-28T19:51:51.982537] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-10-28T19:51:51.984317] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-10-28T19:51:52.011115] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-10. [2025-10-28T19:51:52.047848] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-03. [2025-10-28T19:51:52.157746] [DEBUG] [VALIDATOR ] MC: All expected trading days are present. [2025-10-28T19:51:52.157842] [DEBUG] [VALIDATOR ] MC: Primary data validation passed. [2025-10-28T19:51:52.158955] [INFO ] [MAIN ] MC: Fetched primary data is valid. [2025-10-28T19:51:52.159019] [DEBUG] [LOCAL ] MC: Saving primary data. [2025-10-28T19:51:52.160245] [DEBUG] [LOCAL ] MC: Trimmed 63124 records to 43337 (keeping 200 days of data) [2025-10-28T19:51:52.415308] [DEBUG] [LOCAL ] MC: Primary data saved (43337 records). [2025-10-28T19:51:52.415430] [INFO ] [MAIN ] MC: Full history saved. [2025-10-28T19:51:52.415526] [INFO ] [MAIN ] Update Progress: 1310/2366 symbols completed. MC took 31.0s. Estimated remaining: 2h 18m 30s. Rate: 7.6 symbols/min [2025-10-28T19:51:52.586038] [INFO ] [MAIN ] MCN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:51:52.595526] [DEBUG] [LOCAL ] MCN: Loaded 7854 existing records from primary storage. [2025-10-28T19:51:52.595819] [INFO ] [MAIN ] MCN: Loaded 7854 existing records. [2025-10-28T19:51:52.702847] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-10 (0.69 seconds). [2025-10-28T19:51:52.720426] [INFO ] [REMOTE ] MCI: Full fetch complete (9770 records). [2025-10-28T19:51:52.730782] [DEBUG] [VALIDATOR ] MCI: Validating primary data. [2025-10-28T19:51:52.867437] [WARN ] [MAIN ] MCN: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:51:52.889279] [INFO ] [MAIN ] MCN: Wiping existing primary data before full refresh. [2025-10-28T19:51:52.889423] [INFO ] [LOCAL ] MCN: Starting deletion of primary data. [2025-10-28T19:51:52.889759] [DEBUG] [LOCAL ] MCN: Deleted primary data file. [2025-10-28T19:51:52.900259] [INFO ] [MAIN ] MCN: Starting full primary refresh. [2025-10-28T19:51:53.442180] [DEBUG] [VALIDATOR ] MCI: All expected trading days are present. [2025-10-28T19:51:53.488256] [DEBUG] [VALIDATOR ] MCI: Primary data validation passed. [2025-10-28T19:51:53.507220] [INFO ] [MAIN ] MCI: Fetched primary data is valid. [2025-10-28T19:51:53.510439] [INFO ] [REMOTE ] MCN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:51:53.510828] [DEBUG] [LOCAL ] MCI: Saving primary data. [2025-10-28T19:51:53.511259] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-01. [2025-10-28T19:51:53.512597] [DEBUG] [LOCAL ] MCI: Trimmed 9770 records to 6116 (keeping 200 days of data) [2025-10-28T19:51:53.551996] [DEBUG] [LOCAL ] MCI: Primary data saved (6116 records). [2025-10-28T19:51:53.552729] [INFO ] [MAIN ] MCI: Full history saved. [2025-10-28T19:51:53.566040] [INFO ] [MAIN ] Update Progress: 1311/2366 symbols completed. MCI took 20.9s. Estimated remaining: 2h 18m 17s. Rate: 7.6 symbols/min [2025-10-28T19:51:53.607877] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-10-28T19:51:53.688399] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-04. [2025-10-28T19:51:53.760135] [INFO ] [MAIN ] MCO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:51:53.789068] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-10-28T19:51:53.799839] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-03. [2025-10-28T19:51:53.836919] [DEBUG] [LOCAL ] MCO: Loaded 39288 existing records from primary storage. [2025-10-28T19:51:53.837182] [INFO ] [MAIN ] MCO: Loaded 39288 existing records. [2025-10-28T19:51:53.974315] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-10-28T19:51:54.015550] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-02. [2025-10-28T19:51:54.036867] [WARN ] [MAIN ] MCO: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:51:54.037749] [INFO ] [MAIN ] MCO: Wiping existing primary data before full refresh. [2025-10-28T19:51:54.037824] [INFO ] [LOCAL ] MCO: Starting deletion of primary data. [2025-10-28T19:51:54.038018] [DEBUG] [LOCAL ] MCO: Deleted primary data file. [2025-10-28T19:51:54.038061] [INFO ] [MAIN ] MCO: Starting full primary refresh. [2025-10-28T19:51:54.410033] [INFO ] [REMOTE ] MCO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:51:54.410391] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-01. [2025-10-28T19:51:54.546417] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-28T19:51:54.548780] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-03. [2025-10-28T19:51:55.008849] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-10-28T19:51:55.011183] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-04. [2025-10-28T19:51:55.347477] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-10-28T19:51:55.354704] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-02. [2025-10-28T19:51:55.518738] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-10-28T19:51:55.520302] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-10-28T19:51:55.523177] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-05. [2025-10-28T19:51:55.534903] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-04. [2025-10-28T19:51:56.036235] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-10-28T19:51:56.039636] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-06. [2025-10-28T19:51:56.340373] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-10-28T19:51:56.353730] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-03. [2025-10-28T19:51:57.615076] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-10-28T19:51:57.624805] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-04. [2025-10-28T19:51:58.890783] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-10-28T19:51:58.900591] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-05. [2025-10-28T19:52:00.021027] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-10-28T19:52:00.029020] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-06. [2025-10-28T19:52:01.098733] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-10-28T19:52:01.106381] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-07. [2025-10-28T19:52:05.799368] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-04 (12.11 seconds). [2025-10-28T19:52:05.808940] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-05. [2025-10-28T19:52:07.038389] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-10-28T19:52:07.047494] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-06. [2025-10-28T19:52:08.080269] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-10-28T19:52:08.088103] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-07. [2025-10-28T19:52:08.516947] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-06 (12.48 seconds). [2025-10-28T19:52:08.519448] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-07. [2025-10-28T19:52:08.997692] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-10-28T19:52:09.000106] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-08. [2025-10-28T19:52:09.282532] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-10-28T19:52:09.290805] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-08. [2025-10-28T19:52:09.505459] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-10-28T19:52:09.507670] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-09. [2025-10-28T19:52:10.030699] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-10-28T19:52:10.033083] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-10. [2025-10-28T19:52:10.309481] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-10-28T19:52:10.318340] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-09. [2025-10-28T19:52:10.661153] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-10 (0.63 seconds). [2025-10-28T19:52:10.662992] [INFO ] [REMOTE ] MCN: Full fetch complete (11533 records). [2025-10-28T19:52:10.663057] [DEBUG] [VALIDATOR ] MCN: Validating primary data. [2025-10-28T19:52:11.022770] [DEBUG] [VALIDATOR ] MCN: All expected trading days are present. [2025-10-28T19:52:11.022863] [DEBUG] [VALIDATOR ] MCN: Primary data validation passed. [2025-10-28T19:52:11.023174] [INFO ] [MAIN ] MCN: Fetched primary data is valid. [2025-10-28T19:52:11.023233] [DEBUG] [LOCAL ] MCN: Saving primary data. [2025-10-28T19:52:11.023704] [DEBUG] [LOCAL ] MCN: Trimmed 11533 records to 7839 (keeping 200 days of data) [2025-10-28T19:52:11.067387] [DEBUG] [LOCAL ] MCN: Primary data saved (7839 records). [2025-10-28T19:52:11.067503] [INFO ] [MAIN ] MCN: Full history saved. [2025-10-28T19:52:11.067582] [INFO ] [MAIN ] Update Progress: 1312/2366 symbols completed. MCN took 18.7s. Estimated remaining: 2h 18m 17s. Rate: 7.6 symbols/min [2025-10-28T19:52:11.235475] [INFO ] [MAIN ] MCR: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:52:11.245595] [DEBUG] [LOCAL ] MCR: Loaded 8810 existing records from primary storage. [2025-10-28T19:52:11.245815] [INFO ] [MAIN ] MCR: Loaded 8810 existing records. [2025-10-28T19:52:11.430756] [WARN ] [MAIN ] MCR: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:52:11.431054] [INFO ] [MAIN ] MCR: Wiping existing primary data before full refresh. [2025-10-28T19:52:11.431158] [INFO ] [LOCAL ] MCR: Starting deletion of primary data. [2025-10-28T19:52:11.431434] [DEBUG] [LOCAL ] MCR: Deleted primary data file. [2025-10-28T19:52:11.431509] [INFO ] [MAIN ] MCR: Starting full primary refresh. [2025-10-28T19:52:11.624245] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-28T19:52:11.727906] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-10. [2025-10-28T19:52:11.840151] [INFO ] [REMOTE ] MCR: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:52:11.840926] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-01. [2025-10-28T19:52:12.500886] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-28T19:52:12.504948] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-02. [2025-10-28T19:52:12.954038] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-10-28T19:52:12.956304] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-03. [2025-10-28T19:52:13.491728] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-10-28T19:52:13.494432] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-04. [2025-10-28T19:52:14.041345] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-10-28T19:52:14.044194] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-05. [2025-10-28T19:52:16.741393] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-05 (2.70 seconds). [2025-10-28T19:52:16.744048] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-06. [2025-10-28T19:52:17.186085] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-10-28T19:52:17.188469] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-07. [2025-10-28T19:52:17.661225] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-28T19:52:17.663455] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-08. [2025-10-28T19:52:18.247309] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-10-28T19:52:18.250575] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-09. [2025-10-28T19:52:18.675124] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-10-28T19:52:18.677617] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-10. [2025-10-28T19:52:19.462134] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-10 (0.78 seconds). [2025-10-28T19:52:19.465213] [INFO ] [REMOTE ] MCR: Full fetch complete (13452 records). [2025-10-28T19:52:19.465300] [DEBUG] [VALIDATOR ] MCR: Validating primary data. [2025-10-28T19:52:19.884031] [DEBUG] [VALIDATOR ] MCR: All expected trading days are present. [2025-10-28T19:52:19.884138] [DEBUG] [VALIDATOR ] MCR: Primary data validation passed. [2025-10-28T19:52:19.884726] [INFO ] [MAIN ] MCR: Fetched primary data is valid. [2025-10-28T19:52:19.884791] [DEBUG] [LOCAL ] MCR: Saving primary data. [2025-10-28T19:52:19.885377] [DEBUG] [LOCAL ] MCR: Trimmed 13452 records to 8864 (keeping 200 days of data) [2025-10-28T19:52:19.943602] [DEBUG] [LOCAL ] MCR: Primary data saved (8864 records). [2025-10-28T19:52:19.943822] [INFO ] [MAIN ] MCR: Full history saved. [2025-10-28T19:52:19.943935] [INFO ] [MAIN ] Update Progress: 1313/2366 symbols completed. MCR took 8.9s. Estimated remaining: 2h 18m 10s. Rate: 7.6 symbols/min [2025-10-28T19:52:20.127799] [INFO ] [MAIN ] MCS: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:52:20.151803] [DEBUG] [LOCAL ] MCS: Loaded 21024 existing records from primary storage. [2025-10-28T19:52:20.152155] [INFO ] [MAIN ] MCS: Loaded 21024 existing records. [2025-10-28T19:52:20.343697] [WARN ] [MAIN ] MCS: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:52:20.343994] [INFO ] [MAIN ] MCS: Wiping existing primary data before full refresh. [2025-10-28T19:52:20.344047] [INFO ] [LOCAL ] MCS: Starting deletion of primary data. [2025-10-28T19:52:20.344328] [DEBUG] [LOCAL ] MCS: Deleted primary data file. [2025-10-28T19:52:20.344389] [INFO ] [MAIN ] MCS: Starting full primary refresh. [2025-10-28T19:52:20.806467] [INFO ] [REMOTE ] MCS: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:52:20.806912] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-01. [2025-10-28T19:52:21.469955] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-10-28T19:52:21.474883] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-02. [2025-10-28T19:52:22.219029] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-04 (26.68 seconds). [2025-10-28T19:52:22.232182] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-10-28T19:52:22.238557] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-03. [2025-10-28T19:52:22.239069] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-05. [2025-10-28T19:52:23.068450] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-10-28T19:52:23.074006] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-04. [2025-10-28T19:52:23.765739] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-28T19:52:23.777187] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-06. [2025-10-28T19:52:25.341266] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-10-28T19:52:25.352484] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-07. [2025-10-28T19:52:27.051454] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-10-28T19:52:27.063212] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-08. [2025-10-28T19:52:28.606397] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-10-28T19:52:28.617832] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-09. [2025-10-28T19:52:30.094376] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-10-28T19:52:30.105381] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-10. [2025-10-28T19:52:30.668957] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-10 (0.56 seconds). [2025-10-28T19:52:30.679877] [INFO ] [REMOTE ] MCD: Full fetch complete (77113 records). [2025-10-28T19:52:30.680018] [DEBUG] [VALIDATOR ] MCD: Validating primary data. [2025-10-28T19:52:30.870224] [WARN ] [VALIDATOR ] MCD: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-10-28T19:52:30.871146] [FATAL] [MAIN ] MCD: Fetched primary data is invalid. Refusing to save it. [2025-10-28T19:52:30.871228] [WARN ] [MAIN ] MCD: Deleting existing primary and derivative data due to validation failure. [2025-10-28T19:52:30.871319] [INFO ] [LOCAL ] MCD: Starting deletion of primary data. [2025-10-28T19:52:30.871409] [DEBUG] [LOCAL ] MCD: No primary data file found to delete. [2025-10-28T19:52:30.871459] [INFO ] [LOCAL ] MCD: Starting deletion of derivative data. [2025-10-28T19:52:30.871502] [DEBUG] [LOCAL ] MCD: No derivative data file found to delete. [2025-10-28T19:52:30.871562] [INFO ] [MAIN ] Update Progress: 1314/2366 symbols completed. MCD took 1m 0s. Estimated remaining: 2h 18m 5s. Rate: 7.6 symbols/min [2025-10-28T19:52:31.038298] [INFO ] [MAIN ] MCY: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:52:31.038490] [DEBUG] [LOCAL ] MCY: No existing data file found in primary storage. [2025-10-28T19:52:31.038526] [WARN ] [MAIN ] MCY: No existing data found, performing full refresh instead. [2025-10-28T19:52:31.038633] [INFO ] [MAIN ] MCY: Wiping existing primary data before full refresh. [2025-10-28T19:52:31.038710] [INFO ] [LOCAL ] MCY: Starting deletion of primary data. [2025-10-28T19:52:31.038758] [DEBUG] [LOCAL ] MCY: No primary data file found to delete. [2025-10-28T19:52:31.038790] [INFO ] [MAIN ] MCY: Starting full primary refresh. [2025-10-28T19:52:31.430273] [INFO ] [REMOTE ] MCY: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:52:31.430612] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-01. [2025-10-28T19:52:32.611625] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-10-28T19:52:32.620371] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-02. [2025-10-28T19:52:33.427680] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-07 (32.32 seconds). [2025-10-28T19:52:33.436376] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-08. [2025-10-28T19:52:33.636902] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-10-28T19:52:33.644524] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-03. [2025-10-28T19:52:34.464786] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-10-28T19:52:34.472715] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-09. [2025-10-28T19:52:34.751741] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-10-28T19:52:34.759716] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-04. [2025-10-28T19:52:35.544130] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-10-28T19:52:35.553141] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-10. [2025-10-28T19:52:37.085526] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-10 (1.53 seconds). [2025-10-28T19:52:37.094606] [INFO ] [REMOTE ] MCO: Full fetch complete (58424 records). [2025-10-28T19:52:37.094761] [DEBUG] [VALIDATOR ] MCO: Validating primary data. [2025-10-28T19:52:37.481283] [DEBUG] [VALIDATOR ] MCO: All expected trading days are present. [2025-10-28T19:52:37.481363] [DEBUG] [VALIDATOR ] MCO: Primary data validation passed. [2025-10-28T19:52:37.482342] [INFO ] [MAIN ] MCO: Fetched primary data is valid. [2025-10-28T19:52:37.482406] [DEBUG] [LOCAL ] MCO: Saving primary data. [2025-10-28T19:52:37.483664] [DEBUG] [LOCAL ] MCO: Trimmed 58424 records to 39204 (keeping 200 days of data) [2025-10-28T19:52:37.730791] [DEBUG] [LOCAL ] MCO: Primary data saved (39204 records). [2025-10-28T19:52:37.730920] [INFO ] [MAIN ] MCO: Full history saved. [2025-10-28T19:52:37.731253] [INFO ] [MAIN ] Update Progress: 1315/2366 symbols completed. MCO took 44.2s. Estimated remaining: 2h 17m 56s. Rate: 7.6 symbols/min [2025-10-28T19:52:37.901628] [INFO ] [MAIN ] MD: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:52:37.939573] [DEBUG] [LOCAL ] MD: Loaded 38402 existing records from primary storage. [2025-10-28T19:52:37.939868] [INFO ] [MAIN ] MD: Loaded 38402 existing records. [2025-10-28T19:52:38.122576] [WARN ] [MAIN ] MD: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:52:38.139690] [INFO ] [MAIN ] MD: Wiping existing primary data before full refresh. [2025-10-28T19:52:38.139946] [INFO ] [LOCAL ] MD: Starting deletion of primary data. [2025-10-28T19:52:38.140495] [DEBUG] [LOCAL ] MD: Deleted primary data file. [2025-10-28T19:52:38.141092] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-10 (26.41 seconds). [2025-10-28T19:52:38.141200] [INFO ] [MAIN ] MD: Starting full primary refresh. [2025-10-28T19:52:38.194972] [INFO ] [REMOTE ] MCK: Full fetch complete (56349 records). [2025-10-28T19:52:38.221396] [DEBUG] [VALIDATOR ] MCK: Validating primary data. [2025-10-28T19:52:38.827554] [INFO ] [REMOTE ] MD: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:52:38.838189] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-01. [2025-10-28T19:52:38.935793] [DEBUG] [VALIDATOR ] MCK: All expected trading days are present. [2025-10-28T19:52:38.935907] [DEBUG] [VALIDATOR ] MCK: Primary data validation passed. [2025-10-28T19:52:38.937252] [INFO ] [MAIN ] MCK: Fetched primary data is valid. [2025-10-28T19:52:38.937324] [DEBUG] [LOCAL ] MCK: Saving primary data. [2025-10-28T19:52:38.938820] [DEBUG] [LOCAL ] MCK: Trimmed 56349 records to 37402 (keeping 200 days of data) [2025-10-28T19:52:39.232269] [DEBUG] [LOCAL ] MCK: Primary data saved (37402 records). [2025-10-28T19:52:39.232433] [INFO ] [MAIN ] MCK: Full history saved. [2025-10-28T19:52:39.233432] [INFO ] [MAIN ] Update Progress: 1316/2366 symbols completed. MCK took 50.5s. Estimated remaining: 2h 17m 43s. Rate: 7.6 symbols/min [2025-10-28T19:52:39.413777] [INFO ] [MAIN ] MDST: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:52:39.423119] [DEBUG] [LOCAL ] MDST: Loaded 6157 existing records from primary storage. [2025-10-28T19:52:39.423324] [INFO ] [MAIN ] MDST: Loaded 6157 existing records. [2025-10-28T19:52:39.604387] [WARN ] [MAIN ] MDST: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:52:39.604630] [INFO ] [MAIN ] MDST: Wiping existing primary data before full refresh. [2025-10-28T19:52:39.604724] [INFO ] [LOCAL ] MDST: Starting deletion of primary data. [2025-10-28T19:52:39.604897] [DEBUG] [LOCAL ] MDST: Deleted primary data file. [2025-10-28T19:52:39.604953] [INFO ] [MAIN ] MDST: Starting full primary refresh. [2025-10-28T19:52:39.970358] [INFO ] [REMOTE ] MDST: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:52:39.987242] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-01. [2025-10-28T19:52:39.991613] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-10-28T19:52:39.999159] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-02. [2025-10-28T19:52:40.586893] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-10-28T19:52:40.589692] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-02. [2025-10-28T19:52:40.718142] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-10-28T19:52:40.725206] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-03. [2025-10-28T19:52:41.004769] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-10-28T19:52:41.006850] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-03. [2025-10-28T19:52:41.066191] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-04 (17.99 seconds). [2025-10-28T19:52:41.071586] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-05. [2025-10-28T19:52:41.670190] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-10-28T19:52:41.680949] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-04. [2025-10-28T19:52:45.489094] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-04 (10.73 seconds). [2025-10-28T19:52:45.495307] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-05. [2025-10-28T19:52:46.420794] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-10-28T19:52:46.427027] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-06. [2025-10-28T19:52:46.661616] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-03 (5.65 seconds). [2025-10-28T19:52:46.663495] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-04. [2025-10-28T19:52:47.008112] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-10-28T19:52:47.009709] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-05. [2025-10-28T19:52:47.134310] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-10-28T19:52:47.139328] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-07. [2025-10-28T19:52:48.878301] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-05 (7.81 seconds). [2025-10-28T19:52:48.882888] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-06. [2025-10-28T19:52:49.503537] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-10-28T19:52:49.507911] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-07. [2025-10-28T19:52:50.268277] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-10-28T19:52:50.273621] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-08. [2025-10-28T19:52:51.029801] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-10-28T19:52:51.035345] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-09. [2025-10-28T19:52:51.294152] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-04 (9.61 seconds). [2025-10-28T19:52:51.302005] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-05. [2025-10-28T19:52:51.504568] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-05 (4.49 seconds). [2025-10-28T19:52:51.506360] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-06. [2025-10-28T19:52:51.784745] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-28T19:52:51.790305] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-10. [2025-10-28T19:52:52.642902] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-10-28T19:52:52.644584] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-07. [2025-10-28T19:52:52.977805] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-10 (1.19 seconds). [2025-10-28T19:52:52.982783] [INFO ] [REMOTE ] MCS: Full fetch complete (30710 records). [2025-10-28T19:52:52.982898] [DEBUG] [VALIDATOR ] MCS: Validating primary data. [2025-10-28T19:52:53.252485] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-10-28T19:52:53.277861] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-08. [2025-10-28T19:52:53.374917] [DEBUG] [VALIDATOR ] MCS: All expected trading days are present. [2025-10-28T19:52:53.375000] [DEBUG] [VALIDATOR ] MCS: Primary data validation passed. [2025-10-28T19:52:53.375632] [INFO ] [MAIN ] MCS: Fetched primary data is valid. [2025-10-28T19:52:53.375709] [DEBUG] [LOCAL ] MCS: Saving primary data. [2025-10-28T19:52:53.376504] [DEBUG] [LOCAL ] MCS: Trimmed 30710 records to 21032 (keeping 200 days of data) [2025-10-28T19:52:53.523542] [DEBUG] [LOCAL ] MCS: Primary data saved (21032 records). [2025-10-28T19:52:53.517291] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-07 (6.38 seconds). [2025-10-28T19:52:53.523937] [INFO ] [MAIN ] MCS: Full history saved. [2025-10-28T19:52:53.529711] [INFO ] [MAIN ] Update Progress: 1317/2366 symbols completed. MCS took 33.6s. Estimated remaining: 2h 17m 40s. Rate: 7.6 symbols/min [2025-10-28T19:52:53.531174] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-08. [2025-10-28T19:52:53.841611] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-28T19:52:53.843906] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-09. [2025-10-28T19:52:54.259877] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-10-28T19:52:54.262296] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-10. [2025-10-28T19:52:54.501496] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-10-28T19:52:54.506900] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-09. [2025-10-28T19:52:54.836062] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-10 (0.57 seconds). [2025-10-28T19:52:54.840255] [INFO ] [REMOTE ] MDST: Full fetch complete (8964 records). [2025-10-28T19:52:54.840538] [DEBUG] [VALIDATOR ] MDST: Validating primary data. [2025-10-28T19:52:55.247000] [DEBUG] [VALIDATOR ] MDST: All expected trading days are present. [2025-10-28T19:52:55.247126] [DEBUG] [VALIDATOR ] MDST: Primary data validation passed. [2025-10-28T19:52:55.247550] [INFO ] [MAIN ] MDST: Fetched primary data is valid. [2025-10-28T19:52:55.247594] [DEBUG] [LOCAL ] MDST: Saving primary data. [2025-10-28T19:52:55.248219] [DEBUG] [LOCAL ] MDST: Trimmed 8964 records to 6210 (keeping 200 days of data) [2025-10-28T19:52:55.290542] [DEBUG] [LOCAL ] MDST: Primary data saved (6210 records). [2025-10-28T19:52:55.290730] [INFO ] [MAIN ] MDST: Full history saved. [2025-10-28T19:52:55.290844] [INFO ] [MAIN ] Update Progress: 1318/2366 symbols completed. MDST took 16.1s. Estimated remaining: 2h 17m 27s. Rate: 7.6 symbols/min [2025-10-28T19:52:56.922791] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-05 (5.62 seconds). [2025-10-28T19:52:56.931795] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-06. [2025-10-28T19:52:57.889615] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-28T19:52:57.897305] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-07. [2025-10-28T19:52:58.201453] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-09 (3.69 seconds). [2025-10-28T19:52:58.208390] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-10. [2025-10-28T19:52:59.021710] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-10-28T19:52:59.030721] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-08. [2025-10-28T19:52:59.056083] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-10 (0.85 seconds). [2025-10-28T19:52:59.062381] [INFO ] [REMOTE ] MCY: Full fetch complete (40147 records). [2025-10-28T19:52:59.062534] [DEBUG] [VALIDATOR ] MCY: Validating primary data. [2025-10-28T19:52:59.438349] [DEBUG] [VALIDATOR ] MCY: All expected trading days are present. [2025-10-28T19:52:59.438430] [DEBUG] [VALIDATOR ] MCY: Primary data validation passed. [2025-10-28T19:52:59.439223] [INFO ] [MAIN ] MCY: Fetched primary data is valid. [2025-10-28T19:52:59.439285] [DEBUG] [LOCAL ] MCY: Saving primary data. [2025-10-28T19:52:59.440249] [DEBUG] [LOCAL ] MCY: Trimmed 40147 records to 22925 (keeping 200 days of data) [2025-10-28T19:52:59.577402] [DEBUG] [LOCAL ] MCY: Primary data saved (22925 records). [2025-10-28T19:52:59.577525] [INFO ] [MAIN ] MCY: Full history saved. [2025-10-28T19:52:59.577596] [INFO ] [MAIN ] Update Progress: 1319/2366 symbols completed. MCY took 28.7s. Estimated remaining: 2h 17m 17s. Rate: 7.6 symbols/min [2025-10-28T19:53:00.150236] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-28T19:53:00.159578] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-09. [2025-10-28T19:53:01.268924] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-10-28T19:53:01.276781] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-10. [2025-10-28T19:53:04.155196] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-10 (2.88 seconds). [2025-10-28T19:53:04.163104] [INFO ] [REMOTE ] MD: Full fetch complete (55405 records). [2025-10-28T19:53:04.163224] [DEBUG] [VALIDATOR ] MD: Validating primary data. [2025-10-28T19:53:04.557781] [DEBUG] [VALIDATOR ] MD: All expected trading days are present. [2025-10-28T19:53:04.557860] [DEBUG] [VALIDATOR ] MD: Primary data validation passed. [2025-10-28T19:53:04.558861] [INFO ] [MAIN ] MD: Fetched primary data is valid. [2025-10-28T19:53:04.558944] [DEBUG] [LOCAL ] MD: Saving primary data. [2025-10-28T19:53:04.560030] [DEBUG] [LOCAL ] MD: Trimmed 55405 records to 38397 (keeping 200 days of data) [2025-10-28T19:53:04.775470] [DEBUG] [LOCAL ] MD: Primary data saved (38397 records). [2025-10-28T19:53:04.775593] [INFO ] [MAIN ] MD: Full history saved. [2025-10-28T19:53:04.775935] [INFO ] [MAIN ] Update Progress: 1320/2366 symbols completed. MD took 27.0s. Estimated remaining: 2h 17m 7s. Rate: 7.6 symbols/min [2025-10-28T19:53:05.309805] [INFO ] [MAIN ] MDU: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:53:05.425262] [INFO ] [MAIN ] MDV: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:53:05.457266] [INFO ] [MAIN ] MEC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:53:05.506683] [INFO ] [MAIN ] MDT: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:53:05.522418] [DEBUG] [LOCAL ] MDV: Loaded 8221 existing records from primary storage. [2025-10-28T19:53:05.522808] [INFO ] [MAIN ] MDV: Loaded 8221 existing records. [2025-10-28T19:53:05.642787] [DEBUG] [LOCAL ] MEC: Loaded 16889 existing records from primary storage. [2025-10-28T19:53:05.652631] [INFO ] [MAIN ] MEC: Loaded 16889 existing records. [2025-10-28T19:53:05.834289] [WARN ] [MAIN ] MDV: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:53:05.863809] [DEBUG] [LOCAL ] MDU: Loaded 47956 existing records from primary storage. [2025-10-28T19:53:05.881993] [INFO ] [MAIN ] MDV: Wiping existing primary data before full refresh. [2025-10-28T19:53:05.882217] [INFO ] [LOCAL ] MDV: Starting deletion of primary data. [2025-10-28T19:53:05.882509] [INFO ] [MAIN ] MDU: Loaded 47956 existing records. [2025-10-28T19:53:05.883278] [DEBUG] [LOCAL ] MDT: Loaded 53678 existing records from primary storage. [2025-10-28T19:53:05.894503] [INFO ] [MAIN ] MDT: Loaded 53678 existing records. [2025-10-28T19:53:05.939726] [DEBUG] [LOCAL ] MDV: Deleted primary data file. [2025-10-28T19:53:05.984341] [INFO ] [MAIN ] MDV: Starting full primary refresh. [2025-10-28T19:53:06.213840] [WARN ] [MAIN ] MEC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:53:06.339739] [INFO ] [MAIN ] MEC: Wiping existing primary data before full refresh. [2025-10-28T19:53:06.425764] [INFO ] [LOCAL ] MEC: Starting deletion of primary data. [2025-10-28T19:53:06.421546] [WARN ] [MAIN ] MDT: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:53:06.428686] [WARN ] [MAIN ] MDU: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:53:06.434508] [INFO ] [MAIN ] MDU: Wiping existing primary data before full refresh. [2025-10-28T19:53:06.434556] [INFO ] [MAIN ] MDT: Wiping existing primary data before full refresh. [2025-10-28T19:53:06.444801] [DEBUG] [LOCAL ] MEC: Deleted primary data file. [2025-10-28T19:53:06.478149] [INFO ] [LOCAL ] MDT: Starting deletion of primary data. [2025-10-28T19:53:06.468146] [INFO ] [LOCAL ] MDU: Starting deletion of primary data. [2025-10-28T19:53:06.504558] [INFO ] [MAIN ] MEC: Starting full primary refresh. [2025-10-28T19:53:06.567417] [DEBUG] [LOCAL ] MDT: Deleted primary data file. [2025-10-28T19:53:06.567555] [INFO ] [MAIN ] MDT: Starting full primary refresh. [2025-10-28T19:53:06.572706] [DEBUG] [LOCAL ] MDU: Deleted primary data file. [2025-10-28T19:53:06.604495] [INFO ] [MAIN ] MDU: Starting full primary refresh. [2025-10-28T19:53:07.192228] [INFO ] [REMOTE ] MDV: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:53:07.269191] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-01. [2025-10-28T19:53:07.619789] [INFO ] [REMOTE ] MEC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:53:07.639677] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-01. [2025-10-28T19:53:07.787360] [INFO ] [REMOTE ] MDU: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:53:07.783585] [INFO ] [REMOTE ] MDT: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:53:07.787797] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-01. [2025-10-28T19:53:07.788193] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-01. [2025-10-28T19:53:08.318459] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-10-28T19:53:08.321769] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-02. [2025-10-28T19:53:08.388010] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-10-28T19:53:08.389733] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-02. [2025-10-28T19:53:08.756801] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-10-28T19:53:08.767272] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-02. [2025-10-28T19:53:08.848163] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-10-28T19:53:08.851295] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-03. [2025-10-28T19:53:08.868634] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-10-28T19:53:08.870733] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-03. [2025-10-28T19:53:09.078858] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-10-28T19:53:09.089624] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-02. [2025-10-28T19:53:09.570684] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-10-28T19:53:09.575713] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-04. [2025-10-28T19:53:09.930459] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-28T19:53:09.940371] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-03. [2025-10-28T19:53:10.034066] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-10-28T19:53:10.036747] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-04. [2025-10-28T19:53:10.410866] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-10-28T19:53:10.421163] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-03. [2025-10-28T19:53:10.570312] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-10-28T19:53:10.572967] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-05. [2025-10-28T19:53:10.910575] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-10-28T19:53:10.915113] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-05. [2025-10-28T19:53:11.048177] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-10-28T19:53:11.050901] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-06. [2025-10-28T19:53:11.180794] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-10-28T19:53:11.191450] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-04. [2025-10-28T19:53:11.532829] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-10-28T19:53:11.536859] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-07. [2025-10-28T19:53:11.889436] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-10-28T19:53:11.900809] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-04. [2025-10-28T19:53:12.009249] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-10-28T19:53:12.013087] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-08. [2025-10-28T19:53:12.449451] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-10-28T19:53:12.459627] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-05. [2025-10-28T19:53:12.869708] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-10-28T19:53:12.873765] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-06. [2025-10-28T19:53:13.366300] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-10-28T19:53:13.377420] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-05. [2025-10-28T19:53:13.417169] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-10-28T19:53:13.419666] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-09. [2025-10-28T19:53:13.569738] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-28T19:53:13.573889] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-07. [2025-10-28T19:53:13.741252] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-10-28T19:53:13.751813] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-06. [2025-10-28T19:53:13.815872] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-10-28T19:53:13.818134] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-10. [2025-10-28T19:53:14.167247] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-10-28T19:53:14.170984] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-08. [2025-10-28T19:53:14.308088] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-10 (0.49 seconds). [2025-10-28T19:53:14.310001] [INFO ] [REMOTE ] MDV: Full fetch complete (11724 records). [2025-10-28T19:53:14.310068] [DEBUG] [VALIDATOR ] MDV: Validating primary data. [2025-10-28T19:53:14.671559] [DEBUG] [VALIDATOR ] MDV: All expected trading days are present. [2025-10-28T19:53:14.671902] [DEBUG] [VALIDATOR ] MDV: Primary data validation passed. [2025-10-28T19:53:14.672338] [INFO ] [MAIN ] MDV: Fetched primary data is valid. [2025-10-28T19:53:14.672411] [DEBUG] [LOCAL ] MDV: Saving primary data. [2025-10-28T19:53:14.673034] [DEBUG] [LOCAL ] MDV: Trimmed 11724 records to 8222 (keeping 200 days of data) [2025-10-28T19:53:14.734182] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-10-28T19:53:14.740475] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-09. [2025-10-28T19:53:14.743817] [DEBUG] [LOCAL ] MDV: Primary data saved (8222 records). [2025-10-28T19:53:14.744062] [INFO ] [MAIN ] MDV: Full history saved. [2025-10-28T19:53:14.744215] [INFO ] [MAIN ] Update Progress: 1321/2366 symbols completed. MDV took 10.0s. Estimated remaining: 2h 17m 1s. Rate: 7.6 symbols/min [2025-10-28T19:53:14.910163] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-10-28T19:53:14.969527] [INFO ] [MAIN ] MED: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:53:14.970462] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-06. [2025-10-28T19:53:14.990292] [DEBUG] [LOCAL ] MED: Loaded 20766 existing records from primary storage. [2025-10-28T19:53:14.990724] [INFO ] [MAIN ] MED: Loaded 20766 existing records. [2025-10-28T19:53:15.196501] [WARN ] [MAIN ] MED: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:53:15.196801] [INFO ] [MAIN ] MED: Wiping existing primary data before full refresh. [2025-10-28T19:53:15.196867] [INFO ] [LOCAL ] MED: Starting deletion of primary data. [2025-10-28T19:53:15.197072] [DEBUG] [LOCAL ] MED: Deleted primary data file. [2025-10-28T19:53:15.197127] [INFO ] [MAIN ] MED: Starting full primary refresh. [2025-10-28T19:53:15.491459] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-10-28T19:53:15.534351] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-10. [2025-10-28T19:53:15.574364] [INFO ] [REMOTE ] MED: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:53:15.574598] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-01. [2025-10-28T19:53:16.306544] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-10-28T19:53:16.311780] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-02. [2025-10-28T19:53:16.372230] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-10 (0.84 seconds). [2025-10-28T19:53:16.376461] [INFO ] [REMOTE ] MEC: Full fetch complete (23148 records). [2025-10-28T19:53:16.376552] [DEBUG] [VALIDATOR ] MEC: Validating primary data. [2025-10-28T19:53:16.734781] [DEBUG] [VALIDATOR ] MEC: All expected trading days are present. [2025-10-28T19:53:16.734853] [DEBUG] [VALIDATOR ] MEC: Primary data validation passed. [2025-10-28T19:53:16.735330] [INFO ] [MAIN ] MEC: Fetched primary data is valid. [2025-10-28T19:53:16.735368] [DEBUG] [LOCAL ] MEC: Saving primary data. [2025-10-28T19:53:16.735994] [DEBUG] [LOCAL ] MEC: Trimmed 23148 records to 16939 (keeping 200 days of data) [2025-10-28T19:53:16.831888] [DEBUG] [LOCAL ] MEC: Primary data saved (16939 records). [2025-10-28T19:53:16.832018] [INFO ] [MAIN ] MEC: Full history saved. [2025-10-28T19:53:16.832094] [INFO ] [MAIN ] Update Progress: 1322/2366 symbols completed. MEC took 12.0s. Estimated remaining: 2h 16m 48s. Rate: 7.6 symbols/min [2025-10-28T19:53:17.001665] [INFO ] [MAIN ] MEG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:53:17.031232] [DEBUG] [LOCAL ] MEG: Loaded 31233 existing records from primary storage. [2025-10-28T19:53:17.031472] [INFO ] [MAIN ] MEG: Loaded 31233 existing records. [2025-10-28T19:53:17.209802] [WARN ] [MAIN ] MEG: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:53:17.210115] [INFO ] [MAIN ] MEG: Wiping existing primary data before full refresh. [2025-10-28T19:53:17.215345] [INFO ] [LOCAL ] MEG: Starting deletion of primary data. [2025-10-28T19:53:17.223185] [DEBUG] [LOCAL ] MEG: Deleted primary data file. [2025-10-28T19:53:17.223720] [INFO ] [MAIN ] MEG: Starting full primary refresh. [2025-10-28T19:53:17.223635] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-10-28T19:53:17.292421] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-03. [2025-10-28T19:53:17.576021] [INFO ] [REMOTE ] MEG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:53:17.576294] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-01. [2025-10-28T19:53:18.070033] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-10-28T19:53:18.075291] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-04. [2025-10-28T19:53:18.110200] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-06 (4.36 seconds). [2025-10-28T19:53:18.119909] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-07. [2025-10-28T19:53:18.571822] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-28T19:53:18.579201] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-02. [2025-10-28T19:53:18.917265] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-10-28T19:53:18.923435] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-05. [2025-10-28T19:53:19.282905] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-10-28T19:53:19.293173] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-08. [2025-10-28T19:53:19.467455] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-10-28T19:53:19.473598] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-03. [2025-10-28T19:53:19.651569] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-10-28T19:53:19.656773] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-06. [2025-10-28T19:53:20.377136] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-10-28T19:53:20.382666] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-07. [2025-10-28T19:53:20.413982] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-10-28T19:53:20.426090] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-09. [2025-10-28T19:53:20.447436] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-10-28T19:53:20.455498] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-04. [2025-10-28T19:53:21.151848] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-10-28T19:53:21.157210] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-08. [2025-10-28T19:53:21.426838] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-10-28T19:53:21.434337] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-05. [2025-10-28T19:53:21.824334] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-10-28T19:53:21.829088] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-09. [2025-10-28T19:53:21.921504] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-10-28T19:53:21.932089] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-10. [2025-10-28T19:53:22.342425] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-10-28T19:53:22.365333] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-06. [2025-10-28T19:53:22.367918] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-06 (7.40 seconds). [2025-10-28T19:53:22.378502] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-07. [2025-10-28T19:53:23.327997] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-10-28T19:53:23.334763] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-07. [2025-10-28T19:53:23.406392] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-10 (1.47 seconds). [2025-10-28T19:53:23.416865] [INFO ] [REMOTE ] MDU: Full fetch complete (70733 records). [2025-10-28T19:53:23.417021] [DEBUG] [VALIDATOR ] MDU: Validating primary data. [2025-10-28T19:53:23.807446] [DEBUG] [VALIDATOR ] MDU: All expected trading days are present. [2025-10-28T19:53:23.807550] [DEBUG] [VALIDATOR ] MDU: Primary data validation passed. [2025-10-28T19:53:23.808639] [INFO ] [MAIN ] MDU: Fetched primary data is valid. [2025-10-28T19:53:23.808923] [DEBUG] [LOCAL ] MDU: Saving primary data. [2025-10-28T19:53:23.810345] [DEBUG] [LOCAL ] MDU: Trimmed 70733 records to 47933 (keeping 200 days of data) [2025-10-28T19:53:23.972269] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-10-28T19:53:24.075630] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-08. [2025-10-28T19:53:24.163880] [DEBUG] [LOCAL ] MDU: Primary data saved (47933 records). [2025-10-28T19:53:24.164016] [INFO ] [MAIN ] MDU: Full history saved. [2025-10-28T19:53:24.164098] [INFO ] [MAIN ] Update Progress: 1323/2366 symbols completed. MDU took 19.4s. Estimated remaining: 2h 16m 40s. Rate: 7.6 symbols/min [2025-10-28T19:53:24.335203] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-10-28T19:53:24.366435] [INFO ] [MAIN ] MEGI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:53:24.369482] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-08. [2025-10-28T19:53:24.369996] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-09 (2.54 seconds). [2025-10-28T19:53:24.376622] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-10. [2025-10-28T19:53:24.395085] [DEBUG] [LOCAL ] MEGI: Loaded 19596 existing records from primary storage. [2025-10-28T19:53:24.395321] [INFO ] [MAIN ] MEGI: Loaded 19596 existing records. [2025-10-28T19:53:24.574918] [WARN ] [MAIN ] MEGI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:53:24.575155] [INFO ] [MAIN ] MEGI: Wiping existing primary data before full refresh. [2025-10-28T19:53:24.575204] [INFO ] [LOCAL ] MEGI: Starting deletion of primary data. [2025-10-28T19:53:24.575372] [DEBUG] [LOCAL ] MEGI: Deleted primary data file. [2025-10-28T19:53:24.575409] [INFO ] [MAIN ] MEGI: Starting full primary refresh. [2025-10-28T19:53:24.918581] [INFO ] [REMOTE ] MEGI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:53:24.919047] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-01. [2025-10-28T19:53:25.245458] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-10-28T19:53:25.519731] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-10-28T19:53:25.580244] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-09. [2025-10-28T19:53:25.634165] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-10-28T19:53:26.358897] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-28T19:53:26.363012] [INFO ] [REMOTE ] MED: Full fetch complete (31712 records). [2025-10-28T19:53:26.363094] [DEBUG] [VALIDATOR ] MED: Validating primary data. [2025-10-28T19:53:26.385384] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-02. [2025-10-28T19:53:26.754040] [DEBUG] [VALIDATOR ] MED: All expected trading days are present. [2025-10-28T19:53:26.754163] [DEBUG] [VALIDATOR ] MED: Primary data validation passed. [2025-10-28T19:53:26.754938] [INFO ] [MAIN ] MED: Fetched primary data is valid. [2025-10-28T19:53:26.755016] [DEBUG] [LOCAL ] MED: Saving primary data. [2025-10-28T19:53:26.786800] [DEBUG] [LOCAL ] MED: Trimmed 31712 records to 20631 (keeping 200 days of data) [2025-10-28T19:53:26.789610] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-10-28T19:53:26.936391] [DEBUG] [LOCAL ] MED: Primary data saved (20631 records). [2025-10-28T19:53:26.936524] [INFO ] [MAIN ] MED: Full history saved. [2025-10-28T19:53:26.936603] [INFO ] [MAIN ] Update Progress: 1324/2366 symbols completed. MED took 12.2s. Estimated remaining: 2h 16m 28s. Rate: 7.6 symbols/min [2025-10-28T19:53:27.105760] [INFO ] [MAIN ] MEI: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:53:27.136913] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-10-28T19:53:27.153581] [DEBUG] [LOCAL ] MEI: Loaded 31111 existing records from primary storage. [2025-10-28T19:53:27.153911] [INFO ] [MAIN ] MEI: Loaded 31111 existing records. [2025-10-28T19:53:27.185460] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-09. [2025-10-28T19:53:27.329959] [WARN ] [MAIN ] MEI: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:53:27.330167] [INFO ] [MAIN ] MEI: Wiping existing primary data before full refresh. [2025-10-28T19:53:27.330216] [INFO ] [LOCAL ] MEI: Starting deletion of primary data. [2025-10-28T19:53:27.330412] [DEBUG] [LOCAL ] MEI: Deleted primary data file. [2025-10-28T19:53:27.330480] [INFO ] [MAIN ] MEI: Starting full primary refresh. [2025-10-28T19:53:27.689759] [INFO ] [REMOTE ] MEI: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:53:27.980314] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-10. [2025-10-28T19:53:28.780295] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-03. [2025-10-28T19:53:29.043778] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-10 (1.06 seconds). [2025-10-28T19:53:29.051027] [INFO ] [REMOTE ] MEG: Full fetch complete (47089 records). [2025-10-28T19:53:29.051172] [DEBUG] [VALIDATOR ] MEG: Validating primary data. [2025-10-28T19:53:29.425874] [DEBUG] [VALIDATOR ] MEG: All expected trading days are present. [2025-10-28T19:53:29.426133] [DEBUG] [VALIDATOR ] MEG: Primary data validation passed. [2025-10-28T19:53:29.427041] [INFO ] [MAIN ] MEG: Fetched primary data is valid. [2025-10-28T19:53:29.427119] [DEBUG] [LOCAL ] MEG: Saving primary data. [2025-10-28T19:53:29.428774] [DEBUG] [LOCAL ] MEG: Trimmed 47089 records to 31110 (keeping 200 days of data) [2025-10-28T19:53:29.592364] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-01. [2025-10-28T19:53:29.628480] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-10-28T19:53:29.631457] [DEBUG] [LOCAL ] MEG: Primary data saved (31110 records). [2025-10-28T19:53:29.636461] [INFO ] [MAIN ] MEG: Full history saved. [2025-10-28T19:53:29.637175] [INFO ] [MAIN ] Update Progress: 1325/2366 symbols completed. MEG took 12.8s. Estimated remaining: 2h 16m 16s. Rate: 7.6 symbols/min [2025-10-28T19:53:29.818040] [INFO ] [MAIN ] MET: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:53:29.867750] [DEBUG] [LOCAL ] MET: Loaded 53279 existing records from primary storage. [2025-10-28T19:53:29.868119] [INFO ] [MAIN ] MET: Loaded 53279 existing records. [2025-10-28T19:53:30.060411] [WARN ] [MAIN ] MET: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:53:30.060700] [INFO ] [MAIN ] MET: Wiping existing primary data before full refresh. [2025-10-28T19:53:30.060761] [INFO ] [LOCAL ] MET: Starting deletion of primary data. [2025-10-28T19:53:30.061044] [DEBUG] [LOCAL ] MET: Deleted primary data file. [2025-10-28T19:53:30.061102] [INFO ] [MAIN ] MET: Starting full primary refresh. [2025-10-28T19:53:30.391252] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-04. [2025-10-28T19:53:30.422867] [INFO ] [REMOTE ] MET: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:53:30.596619] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-10-28T19:53:31.102392] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-10-28T19:53:31.180240] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-05. [2025-10-28T19:53:31.797423] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-10-28T19:53:31.980313] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-02. [2025-10-28T19:53:32.778878] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-10-28T19:53:32.783988] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-01. [2025-10-28T19:53:32.869289] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-09 (5.68 seconds). [2025-10-28T19:53:33.580274] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-03. [2025-10-28T19:53:34.080400] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-10-28T19:53:34.380321] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-02. [2025-10-28T19:53:34.531245] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-10-28T19:53:35.180332] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-10. [2025-10-28T19:53:35.646712] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-10-28T19:53:35.980322] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-03. [2025-10-28T19:53:36.780377] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-04. [2025-10-28T19:53:37.501511] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-10-28T19:53:37.580232] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-04. [2025-10-28T19:53:37.810572] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-10-28T19:53:38.380226] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-05. [2025-10-28T19:53:39.180360] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-06. [2025-10-28T19:53:39.238144] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-10-28T19:53:39.688580] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-10 (4.51 seconds). [2025-10-28T19:53:39.700370] [INFO ] [REMOTE ] MDT: Full fetch complete (77857 records). [2025-10-28T19:53:39.700516] [DEBUG] [VALIDATOR ] MDT: Validating primary data. [2025-10-28T19:53:39.883501] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-10-28T19:53:39.987048] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-07. [2025-10-28T19:53:40.139152] [DEBUG] [VALIDATOR ] MDT: All expected trading days are present. [2025-10-28T19:53:40.139239] [DEBUG] [VALIDATOR ] MDT: Primary data validation passed. [2025-10-28T19:53:40.140546] [INFO ] [MAIN ] MDT: Fetched primary data is valid. [2025-10-28T19:53:40.140613] [DEBUG] [LOCAL ] MDT: Saving primary data. [2025-10-28T19:53:40.142212] [DEBUG] [LOCAL ] MDT: Trimmed 77857 records to 53678 (keeping 200 days of data) [2025-10-28T19:53:40.497253] [DEBUG] [LOCAL ] MDT: Primary data saved (53678 records). [2025-10-28T19:53:40.497439] [INFO ] [MAIN ] MDT: Full history saved. [2025-10-28T19:53:40.497542] [INFO ] [MAIN ] Update Progress: 1326/2366 symbols completed. MDT took 35.7s. Estimated remaining: 2h 16m 11s. Rate: 7.6 symbols/min [2025-10-28T19:53:40.674244] [INFO ] [MAIN ] MFA: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:53:40.713816] [DEBUG] [LOCAL ] MFA: Loaded 45266 existing records from primary storage. [2025-10-28T19:53:40.714364] [INFO ] [MAIN ] MFA: Loaded 45266 existing records. [2025-10-28T19:53:40.789613] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-06. [2025-10-28T19:53:40.914036] [WARN ] [MAIN ] MFA: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:53:40.931855] [INFO ] [MAIN ] MFA: Wiping existing primary data before full refresh. [2025-10-28T19:53:40.931965] [INFO ] [LOCAL ] MFA: Starting deletion of primary data. [2025-10-28T19:53:40.932448] [DEBUG] [LOCAL ] MFA: Deleted primary data file. [2025-10-28T19:53:40.932538] [INFO ] [MAIN ] MFA: Starting full primary refresh. [2025-10-28T19:53:40.969051] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-10-28T19:53:41.311173] [INFO ] [REMOTE ] MFA: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:53:41.580235] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-08. [2025-10-28T19:53:41.628404] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-10-28T19:53:42.319718] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-10-28T19:53:42.380249] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-09. [2025-10-28T19:53:43.069108] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-10-28T19:53:43.180250] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-07. [2025-10-28T19:53:43.606079] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-04 (6.03 seconds). [2025-10-28T19:53:43.980484] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-05. [2025-10-28T19:53:44.211896] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-10-28T19:53:44.780301] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-01. [2025-10-28T19:53:45.370305] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-10-28T19:53:45.580365] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-10. [2025-10-28T19:53:45.696950] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-10-28T19:53:46.380279] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-08. [2025-10-28T19:53:47.180267] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-06. [2025-10-28T19:53:47.254541] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-10-28T19:53:47.416297] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-10 (1.84 seconds). [2025-10-28T19:53:47.420838] [INFO ] [REMOTE ] MEGI: Full fetch complete (28906 records). [2025-10-28T19:53:47.421068] [DEBUG] [VALIDATOR ] MEGI: Validating primary data. [2025-10-28T19:53:47.806805] [DEBUG] [VALIDATOR ] MEGI: All expected trading days are present. [2025-10-28T19:53:47.806883] [DEBUG] [VALIDATOR ] MEGI: Primary data validation passed. [2025-10-28T19:53:47.807502] [INFO ] [MAIN ] MEGI: Fetched primary data is valid. [2025-10-28T19:53:47.807546] [DEBUG] [LOCAL ] MEGI: Saving primary data. [2025-10-28T19:53:47.808277] [DEBUG] [LOCAL ] MEGI: Trimmed 28906 records to 19566 (keeping 200 days of data) [2025-10-28T19:53:47.927079] [DEBUG] [LOCAL ] MEGI: Primary data saved (19566 records). [2025-10-28T19:53:47.927217] [INFO ] [MAIN ] MEGI: Full history saved. [2025-10-28T19:53:47.927294] [INFO ] [MAIN ] Update Progress: 1327/2366 symbols completed. MEGI took 23.8s. Estimated remaining: 2h 16m 2s. Rate: 7.6 symbols/min [2025-10-28T19:53:47.990777] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-02. [2025-10-28T19:53:48.099742] [INFO ] [MAIN ] MFAN: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:53:48.106929] [DEBUG] [LOCAL ] MFAN: Loaded 4192 existing records from primary storage. [2025-10-28T19:53:48.107138] [INFO ] [MAIN ] MFAN: Loaded 4192 existing records. [2025-10-28T19:53:48.286076] [WARN ] [MAIN ] MFAN: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:53:48.286367] [INFO ] [MAIN ] MFAN: Wiping existing primary data before full refresh. [2025-10-28T19:53:48.286531] [INFO ] [LOCAL ] MFAN: Starting deletion of primary data. [2025-10-28T19:53:48.286718] [DEBUG] [LOCAL ] MFAN: Deleted primary data file. [2025-10-28T19:53:48.286774] [INFO ] [MAIN ] MFAN: Starting full primary refresh. [2025-10-28T19:53:48.646504] [INFO ] [REMOTE ] MFAN: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:53:48.677920] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-10-28T19:53:48.780246] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-07. [2025-10-28T19:53:49.082171] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-10-28T19:53:49.580287] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-03. [2025-10-28T19:53:50.250089] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-10-28T19:53:50.380239] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-08. [2025-10-28T19:53:50.699207] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-10-28T19:53:51.180254] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-01. [2025-10-28T19:53:51.830027] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-10-28T19:53:51.980257] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-09. [2025-10-28T19:53:52.072789] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-10-28T19:53:52.780260] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-04. [2025-10-28T19:53:53.292058] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-28T19:53:53.580260] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-02. [2025-10-28T19:53:53.873457] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-02 (0.29 seconds). [2025-10-28T19:53:54.061104] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-10-28T19:53:54.380277] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-03. [2025-10-28T19:53:54.721040] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-10-28T19:53:55.180288] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-04. [2025-10-28T19:53:55.549452] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-10-28T19:53:55.980296] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-05. [2025-10-28T19:53:56.780350] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-05. [2025-10-28T19:53:57.153590] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-10-28T19:53:57.158196] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-10-28T19:53:57.580262] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-06. [2025-10-28T19:53:58.380369] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-06. [2025-10-28T19:53:58.729288] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-10-28T19:53:58.755760] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-10-28T19:53:59.180282] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-07. [2025-10-28T19:53:59.980329] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-09. [2025-10-28T19:54:00.428878] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-10-28T19:54:00.780234] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-07. [2025-10-28T19:54:01.027505] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-10-28T19:54:01.150436] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-10-28T19:54:01.580294] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-08. [2025-10-28T19:54:01.999856] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-10-28T19:54:02.380299] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-09. [2025-10-28T19:54:02.915259] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-10-28T19:54:03.180255] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-08. [2025-10-28T19:54:03.980236] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-10. [2025-10-28T19:54:04.780223] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-10. [2025-10-28T19:54:04.953220] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-10 (0.97 seconds). [2025-10-28T19:54:04.959363] [INFO ] [REMOTE ] MEI: Full fetch complete (45303 records). [2025-10-28T19:54:04.959452] [DEBUG] [VALIDATOR ] MEI: Validating primary data. [2025-10-28T19:54:05.357854] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-10 (0.58 seconds). [2025-10-28T19:54:05.371017] [INFO ] [REMOTE ] MFAN: Full fetch complete (5924 records). [2025-10-28T19:54:05.370940] [DEBUG] [VALIDATOR ] MEI: All expected trading days are present. [2025-10-28T19:54:05.371130] [DEBUG] [VALIDATOR ] MFAN: Validating primary data. [2025-10-28T19:54:05.371195] [DEBUG] [VALIDATOR ] MEI: Primary data validation passed. [2025-10-28T19:54:05.387461] [INFO ] [MAIN ] MEI: Fetched primary data is valid. [2025-10-28T19:54:05.404183] [DEBUG] [LOCAL ] MEI: Saving primary data. [2025-10-28T19:54:05.478094] [DEBUG] [LOCAL ] MEI: Trimmed 45303 records to 30990 (keeping 200 days of data) [2025-10-28T19:54:05.581532] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-10. [2025-10-28T19:54:05.861422] [DEBUG] [VALIDATOR ] MFAN: All expected trading days are present. [2025-10-28T19:54:05.861508] [DEBUG] [VALIDATOR ] MFAN: Primary data validation passed. [2025-10-28T19:54:05.861726] [INFO ] [MAIN ] MFAN: Fetched primary data is valid. [2025-10-28T19:54:05.861787] [DEBUG] [LOCAL ] MFAN: Saving primary data. [2025-10-28T19:54:05.862374] [DEBUG] [LOCAL ] MFAN: Trimmed 5924 records to 4177 (keeping 200 days of data) [2025-10-28T19:54:05.942754] [DEBUG] [LOCAL ] MEI: Primary data saved (30990 records). [2025-10-28T19:54:05.943804] [INFO ] [MAIN ] MEI: Full history saved. [2025-10-28T19:54:05.944145] [INFO ] [MAIN ] Update Progress: 1328/2366 symbols completed. MEI took 39.0s. Estimated remaining: 2h 16m 2s. Rate: 7.6 symbols/min [2025-10-28T19:54:06.027685] [DEBUG] [LOCAL ] MFAN: Primary data saved (4177 records). [2025-10-28T19:54:06.046458] [INFO ] [MAIN ] MFAN: Full history saved. [2025-10-28T19:54:06.046591] [INFO ] [MAIN ] Update Progress: 1329/2366 symbols completed. MFAN took 18.1s. Estimated remaining: 2h 15m 49s. Rate: 7.6 symbols/min [2025-10-28T19:54:06.223607] [INFO ] [MAIN ] MFAO: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:54:06.298751] [DEBUG] [LOCAL ] MFAO: Loaded 3768 existing records from primary storage. [2025-10-28T19:54:06.300342] [INFO ] [MAIN ] MFC: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:54:06.300699] [INFO ] [MAIN ] MFAO: Loaded 3768 existing records. [2025-10-28T19:54:06.544627] [WARN ] [MAIN ] MFAO: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:54:06.545152] [INFO ] [MAIN ] MFAO: Wiping existing primary data before full refresh. [2025-10-28T19:54:06.545243] [INFO ] [LOCAL ] MFAO: Starting deletion of primary data. [2025-10-28T19:54:06.545392] [DEBUG] [LOCAL ] MFAO: Deleted primary data file. [2025-10-28T19:54:06.545451] [INFO ] [MAIN ] MFAO: Starting full primary refresh. [2025-10-28T19:54:06.717495] [DEBUG] [LOCAL ] MFC: Loaded 50900 existing records from primary storage. [2025-10-28T19:54:06.733714] [INFO ] [MAIN ] MFC: Loaded 50900 existing records. [2025-10-28T19:54:07.141319] [WARN ] [MAIN ] MFC: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:54:07.165872] [INFO ] [REMOTE ] MFAO: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:54:07.166545] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-01. [2025-10-28T19:54:07.166678] [INFO ] [MAIN ] MFC: Wiping existing primary data before full refresh. [2025-10-28T19:54:07.166761] [INFO ] [LOCAL ] MFC: Starting deletion of primary data. [2025-10-28T19:54:07.168248] [DEBUG] [LOCAL ] MFC: Deleted primary data file. [2025-10-28T19:54:07.168319] [INFO ] [MAIN ] MFC: Starting full primary refresh. [2025-10-28T19:54:07.556607] [INFO ] [REMOTE ] MFC: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:54:07.563421] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-10-28T19:54:07.563247] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-01. [2025-10-28T19:54:07.562981] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-10 (1.98 seconds). [2025-10-28T19:54:07.577366] [INFO ] [REMOTE ] MET: Full fetch complete (77353 records). [2025-10-28T19:54:07.577474] [DEBUG] [VALIDATOR ] MET: Validating primary data. [2025-10-28T19:54:07.962708] [DEBUG] [VALIDATOR ] MET: All expected trading days are present. [2025-10-28T19:54:07.962791] [DEBUG] [VALIDATOR ] MET: Primary data validation passed. [2025-10-28T19:54:07.963882] [INFO ] [MAIN ] MET: Fetched primary data is valid. [2025-10-28T19:54:07.963943] [DEBUG] [LOCAL ] MET: Saving primary data. [2025-10-28T19:54:07.965317] [DEBUG] [LOCAL ] MET: Trimmed 77353 records to 53277 (keeping 200 days of data) [2025-10-28T19:54:08.018627] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-02. [2025-10-28T19:54:08.287569] [DEBUG] [LOCAL ] MET: Primary data saved (53277 records). [2025-10-28T19:54:08.287746] [INFO ] [MAIN ] MET: Full history saved. [2025-10-28T19:54:08.288199] [INFO ] [MAIN ] Update Progress: 1330/2366 symbols completed. MET took 38.7s. Estimated remaining: 2h 15m 36s. Rate: 7.6 symbols/min [2025-10-28T19:54:08.424491] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-08 (5.24 seconds). [2025-10-28T19:54:08.447101] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-10-28T19:54:08.508852] [INFO ] [MAIN ] MFG: Starting incremental primary update from 2025-10-20 to 2025-10-28. [2025-10-28T19:54:08.551757] [DEBUG] [LOCAL ] MFG: Loaded 49410 existing records from primary storage. [2025-10-28T19:54:08.552052] [INFO ] [MAIN ] MFG: Loaded 49410 existing records. [2025-10-28T19:54:08.738405] [WARN ] [MAIN ] MFG: Insufficient historical data. Have data from 2025-04-10, but need from 2025-01-13 for 200 day retention. Performing full refresh. [2025-10-28T19:54:08.738739] [INFO ] [MAIN ] MFG: Wiping existing primary data before full refresh. [2025-10-28T19:54:08.738819] [INFO ] [LOCAL ] MFG: Starting deletion of primary data. [2025-10-28T19:54:08.739632] [DEBUG] [LOCAL ] MFG: Deleted primary data file. [2025-10-28T19:54:08.739729] [INFO ] [MAIN ] MFG: Starting full primary refresh. [2025-10-28T19:54:08.783256] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-03. [2025-10-28T19:54:09.059983] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-10-28T19:54:09.178576] [INFO ] [REMOTE ] MFG: Fetching primary data covering 200 trading days from 2025-01-13 to 2025-10-28 (requires 10 months of data pull). [2025-10-28T19:54:09.183829] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-10-28T19:54:09.580326] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-02. [2025-10-28T19:54:10.380303] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-09. [2025-10-28T19:54:10.742474] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-10-28T19:54:11.180284] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-03. [2025-10-28T19:54:11.689941] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-10-28T19:54:11.980322] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-01. [2025-10-28T19:54:12.600931] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-10-28T19:54:12.780358] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-04. [2025-10-28T19:54:13.199194] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-10-28T19:54:13.350953] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-10-28T19:54:13.580306] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-05. [2025-10-28T19:54:14.008721] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-10-28T19:54:14.380323] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-04. [2025-10-28T19:54:15.180271] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-06. [2025-10-28T19:54:15.497010] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-10-28T19:54:15.562205] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-10-28T19:54:15.980342] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-07. [2025-10-28T19:54:16.325857] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-10-28T19:54:16.780291] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-08. [2025-10-28T19:54:17.120418] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-10-28T19:54:17.580362] [INFO ] [REMOTE ] MFC: Fetching primary